APPLICATION OF CHATGPT IN THE TEACHING OF PHYSICS TO BACHELOR’S STUDENTS AT A TECHNICAL UNIVERSITY

Authors

DOI:

https://doi.org/10.33407/itlt.v97i5.5374

Keywords:

ChatGPT, physics education, aspects of assistance to teachers and students

Abstract

Chat GPT, which was created on the basis of artificial intelligence (AI), posed a number of questions to education, ranging from the most appropriate ways to use it to ways to combat its threats. Answering these questions requires determining the current level of "learning " possessed by ChatGPT in specific knowledge domains, particularly physics studied by students in a bachelor's program at a technical university, and establishing the capabilities of ChatGPT to assist teachers and students in their educational work. The AI, using ChatGPT, considers itself able to assist educators in explaining concepts, answering questions, creating educational content, and supporting research. As for students, the AI believes that ChatGPT is also ready to explain concepts, solve problems, provide additional study materials and advise on exam preparation. For each aspect of assistance to teachers and students (except research support) we posed questions to ChatGPT and analyzed its responses. As it turned out, despite the vast amount of information available to artificial intelligence, in the answers to our queries ChatGPT quit often proposed inaccurate, and sometimes fundamentally incorrect statements, which may indicate the still insufficient level of its knowledge in physics regarding even fairly simple issues. The article presents the most striking examples of such responses. All of this suggests that ChatGPT currently lacks the necessary breadth of knowledge to effectively assist physics teachers and engineering students who study physics at a technical university. Additionally, the study assumes that the accuracy of ChatGPT's answers is determined not only by the content of the question but also by the language in which it is formulated. Based on the analysis of responses, it was concluded that currently it is most appropriate to use GPT for the development of students' critical thinking. The greatest threat posed by ChatGPT to the study of physics can be considered its inadequate level of training, rather than the concerns expressed in the litera`ture that ChatGPT may facilitate students’ cheating.

Downloads

Download data is not yet available.

Author Biographies

Serhii O. Podlasov, National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”

senior lecturer at the Department of the General Physics and Modeling of Physical Processes

Oleksii V. Matviichuk, National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute”

PhD of Pedagogical Sciences, Associate Professor, Associate Professor at the Department of the General Physics and Modeling of Physical Processes

References

M. Halaweh, "ChatGPT in education: Strategies for responsible implementation", Contemporary Educational Technology, vol. 15, no. 2, 2023, ep421. doi: https://doi.org/10.30935/cedtech/13036. Accessed on: Jun. 12, 2023.

C. K. Lo, “What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature”, Educ. Sci., vol.13, no.410, 2023. doi: https://doi.org/10.3390/educsci13040410.

J. Rudolph, S. Tan, Sh. Tan, “ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?” Journal of Applied Learning & Teaching, vol. 6 no. 1, pp.1 – 22, 2023. doi: https://doi.org/10.37074/jalt.2023.6.1.9.

M. Sullivan, A. Kelly, P. McLaughlan, “ChatGPT in higher education: Considerations for academic integrity and student learning”, Journal of Applied Learning & Teaching, vol.6 no.1, pp.31-40, 2023. doi: https://doi.org/10.37074/jalt.2023.6.1.17.

A. Tlili1 et al., “What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education”, Smart Learning Environments, vol.10, no.15, 2023. doi: https://doi.org/10.1186/s40561-023-00237-x.

M. Farrokhnia, S. K. Banihashem, O. Noroozi & A. Wals, “A SWOT analysis of ChatGPT: Implications for educational practice and research”, Innovations in Education and Teaching International, doi: https://doi.org/10.1080/14703297.2023.2195846.

D. R. E. Cotton, P. A. Cotton & J. R. Shipway, “Chatting and cheating: Ensuring academic integrity in the era of ChatGPT”, Innovations in Education and Teaching International, 2023. doi: https://doi.org/10.1080/14703297.2023.2190148.

Y. K. Dwivedi et al. “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, vol.71, 102642, pp.1-63, 2023. doi: https://doi.org/10.1016/j.ijinfomgt.2023.102642.

E. A. M. van Dis, J. Bollen, W. Zuidema, R. van Rooij, C. L. Bockting, “ChatGPT: five priorities for research|”, Nature, vol.3, 614 (7947), pp. 224-226, 2023. doi: http://10.1038/d41586-023-00288-7, [Електронний ресурс]. Доступно: https://www.nature.com/articles/d41586-023-00288-7

W. Yeadon, O.-O. Inyang, A. Mizouri, A. Peach & C. P. Testrow, “The death of the short-form physics essay in the coming AI revolution”, Physics Education, vol.58 (3), art № 035027, 2023. doi: 10.1088/1361-6552/acc5cf

S. Küchemann et al., “Physics task development of prospective physics teachers using ChatGPT”, arXiv:2304.10014v1 [physics.ed-ph]. doi: https://doi.org/10.48550/arXiv.2304.10014.

C. G. West, “Advances in apparent conceptual physics reasoning in GPT-4”, arXiv:2303.17012v3 [physics.ed-ph], doi: https://doi.org/10.48550/arXiv.2303.17012.

Ph. M. Newton, “ChatGPT performance on MCQ-based exams”, (February 21, 2023). Preprint. doi: https://doi.org/10.35542/osf.io/sytu3.

S. Fergus, M. Botha, M. Ostovar, “Evaluating Academic Answers Generated Using ChatGPT”, Journal of Chemical Education, vol.100, no.4, pp.1672-1675, 2023. doi: 10.1021/acs.jchemed.3c00087.

T. Susnjak, “ChatGPT: The End of Online Exam Integrity?”, arXiv:2212.09292v1 [cs.AI]. doi: https://doi.org/10.48550/arXiv.2212.09292.

M. Yang, “New York City schools ban AI chatbot that writes essays and answers prompts”, The Guardian, Fri 6 Jan 2023. New York City schools ban AI chatbot ChatGPT. [Електронний ресурс]. Доступно: https://www.theguardian.com/us-news/2023/jan/06/new-york-city-schools-ban-ai-chatbot-chatgpt. Accessed on Jun 17, 2023.

B. A. Anders, “Is using ChatGPT cheating, plagiarism, both, neither, or forward thinking?”, (2023) Patterns, vol.4, issue.3, 100694, 14 April 2023. doi: https://doi.org/10.1016/j.patter.2023.100694.

K. Toyama, Geek heresy: Rescuing social change from the cult of technology. PublicAffairs, 2015. [Електронний ресурс]. Доступно: https://www.amazon.com/Geek-Heresy-Rescuing-Social-Technology/dp/161039528X. Accessed on Jul 06, 2023.

J. Qadir “Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education”. TechRxiv. Preprint. posted on 2022-12-30. [Online]. Available: https://doi.org/10.36227/techrxiv.21789434.v1. Accessed on Jun 12, 2023.J. Willems, “ChatGPT at Universities – The Least of Our Concerns”, [Електронний ресурс]. Доступно: https://ssrn.com/abstract=4334162 or doi: http://dx.doi.org/10.2139/ssrn.4334162.

D. MacIsaac. “Chatbots Attempt Physics Homework – ChatGPT: Chat Generative Pre-Trained Transformer” The Physics Teacher, vol. 61, no.4, p.318, 2023. doi: https://doi.org/10.1119/10.0017700. Accessed on May 28, 2023.

J. Wang “ChatGPT: A test drive”. American Journal of Physics, vol.91, pp.255–256, 2023. doi: https://doi.org/10.1119/5.0145897. Accessed on Jun 04, 2023.

С. О. Подласов і О. В. Матвійчук, “Підготовка та проведення екзамену з фізики в режимі онлайн”, ITLT, вип. 92, вип. 6, с. 124–139, Груд 2022. [Електронний ресурс]. Доступно: https://journal.iitta.gov.ua/index.php/itlt/article/view/5068. doi: https://doi.org/10.33407/itlt.v92i6.5068. Дата звернення: Лип. 07, 2023.

S. Küchemann, et. al. “Physics task development of prospective physics teachers using ChatGPT”. arXiv:2304.10014 [physics.ed-ph]. doi: https://doi.org/10.48550/arXiv.2304.10014. Accessed on Jul 01, 2023.

І. П. Гаркуша, І. Т. Горбачук, В. П. Курінний, М. Ш. Певзнер, Загальний курс фізики: Збірник задач. Київ, Україна: Техніка, 2003.

“What is weight?” [Електронний ресурс]. Доступно: https://www.khanacademy.org/science/physics/forces-newtons-laws/normal-contact-force/a/what-is-weight. Accessed on Jul 01, 2023.

J. Walker, D. Halliday, R. Resnick. Fundamentals of physics. 10th edition. USA: John Wiley & Sons, Inc, 2014. [Електронний ресурс]. Доступно: https://www.academia.edu/36062426/fundamentals_of_physics_textbook_pdf. Accessed on Jul 06, 2023.

S. P. Thomas. “Grappling with the Implications of ChatGPT for Researchers, Clinicians, and Educators”, Issues in Mental Health Nursing, 2023, 44:3, p.141-142. doi: 10.1080/01612840.2023.2180982. [Електронний ресурс]. Доступно: https://www.tandfonline.com/doi/full/10.1080/01612840.2023.2180982. Accessed on Jun 10, 2023.


REFERENCES (TRANSLATED AND TRANSLITERATED)

M. Halaweh, "ChatGPT in education: Strategies for responsible implementation", Contemporary Educational Technology, vol. 15, no. 2, 2023, ep421. doi: https://doi.org/10.30935/cedtech/13036. Accessed on: Jun. 12, 2023. (in English)

C. K. Lo, “What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature”, Educ. Sci., vol.13, no.410, 2023. doi: https://doi.org/10.3390/educsci13040410. (in English)

J. Rudolph, S. Tan, Sh. Tan, “ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?” Journal of Applied Learning & Teaching, vol. 6 no. 1, pp.1 – 22, 2023. doi: https://doi.org/10.37074/jalt.2023.6.1.9. (in English)

M. Sullivan, A. Kelly, P. McLaughlan, “ChatGPT in higher education: Considerations for academic integrity and student learning”, Journal of Applied Learning & Teaching, vol.6 no.1, pp.31-40, 2023. doi: https://doi.org/10.37074/jalt.2023.6.1.17. (in English)

A. Tlili1 et al., “What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education”, Smart Learning Environments, vol.10, no.15, 2023. doi: https://doi.org/10.1186/s40561-023-00237-x (in English)

M. Farrokhnia, S. K. Banihashem, O. Noroozi & A. Wals, “A SWOT analysis of ChatGPT: Implications for educational practice and research”, Innovations in Education and Teaching International, doi: https://doi.org/10.1080/14703297.2023.2195846. (in English)

D. R. E. Cotton, P. A. Cotton & J. R. Shipway, “Chatting and cheating: Ensuring academic integrity in the era of ChatGPT”, Innovations in Education and Teaching International, 2023. doi: https://doi.org/10.1080/14703297.2023.2190148. (in English)

Y. K. Dwivedi et al. “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, vol.71, 102642, pp.1-63, 2023. doi: https://doi.org/10.1016/j.ijinfomgt.2023.102642 (in English)

E. A. M. van Dis, J. Bollen, W. Zuidema, R. van Rooij, C. L. Bockting, “ChatGPT: five priorities for research|”, Nature, vol.3, 614 (7947), pp. 224-226, 2023. doi: http://10.1038/d41586-023-00288-7, [Online]. Available: https://www.nature.com/articles/d41586-023-00288-7 (in English)

W. Yeadon, O.-O. Inyang, A. Mizouri, A. Peach & C. P. Testrow, “The death of the short-form physics essay in the coming AI revolution”, Physics Education, vol.58 (3), art № 035027, 2023. doi:10.1088/1361-6552/acc5cf (in English)

S. Küchemann et al., “Physics task development of prospective physics teachers using ChatGPT”, arXiv:2304.10014v1 [physics.ed-ph]. doi: https://doi.org/10.48550/arXiv.2304.10014 (in English)

C. G. West, “Advances in apparent conceptual physics reasoning in GPT-4”, arXiv:2303.17012v3 [physics.ed-ph], doi: https://doi.org/10.48550/arXiv.2303.17012 (in English)

Ph. M. Newton, “ChatGPT performance on MCQ-based exams”, (February 21, 2023). Preprint. doi: https://doi.org/10.35542/osf.io/sytu3. (in English)

S. Fergus, M. Botha, M. Ostovar, “Evaluating Academic Answers Generated Using ChatGPT”, Journal of Chemical Education, vol.100, no.4, pp.1672-1675, 2023. DOI: 10.1021/acs.jchemed.3c00087. (in English)

T. Susnjak, “ChatGPT: The End of Online Exam Integrity?”, arXiv:2212.09292v1 [cs.AI]. doi: https://doi.org/10.48550/arXiv.2212.09292. (in English)

M. Yang, “New York City schools ban AI chatbot that writes essays and answers prompts”, The Guardian, Fri 6 Jan 2023. New York City schools ban AI chatbot ChatGPT. [Online]. Available: https://www.theguardian.com/us-news/2023/jan/06/new-york-city-schools-ban-ai-chatbot-chatgpt. Accessed on Jun 17, 2023. (in English)

B. A. Anders, “Is using ChatGPT cheating, plagiarism, both, neither, or forward thinking?”, (2023) Patterns, vol.4, issue.3, 100694, 14 April 2023. doi: https://doi.org/10.1016/j.patter.2023.100694. (in English)

K. Toyama, Geek heresy: Rescuing social change from the cult of technology. PublicAffairs, 2015. [Online]. Available: https://www.amazon.com/Geek-Heresy-Rescuing-Social-Technology/dp/161039528X. Accessed on Jul 06, 2023. (in English)

J. Qadir “Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education”. TechRxiv. Preprint. posted on 2022-12-30. doi: https://doi.org/10.36227/techrxiv.21789434.v1. Accessed on Jun 12, 2023.J. Willems, “ChatGPT at Universities – The Least of Our Concerns”, [Online]. Available: https://ssrn.com/abstract=4334162 or http://dx.doi.org/10.2139/ssrn.4334162. (in English)

D. MacIsaac. “Chatbots Attempt Physics Homework – ChatGPT: Chat Generative Pre-Trained Transformer” The Physics Teacher, vol. 61, no.4, p.318, 2023. doi: https://doi.org/10.1119/10.0017700. Accessed on May 28, 2023. (in English)

J. Wang “ChatGPT: A test drive”. American Journal of Physics, vol.91, pp.255–256, 2023. doi: https://doi.org/10.1119/5.0145897. Accessed on Jun 04, 2023.

S. О. Podlasov and О. V. Matviichuk, “Preparation and conducting of the online physics exam”, ITLT, vol. 92, no. 6, pp. 124–139, Dec. 2022. [Online]. Available: https://journal.iitta.gov.ua/index.php/itlt/article/view/5068. doi: https://doi.org/10.33407/itlt.v92i6.5068. Дата звернення: Лип. 07, 2023. (In Ukranian).

S. Küchemann, et. al. “Physics task development of prospective physics teachers using ChatGPT”. arXiv:2304.10014 [physics.ed-ph]. doi: https://doi.org/10.48550/arXiv.2304.10014. Accessed on Jul 01, 2023. (in English)

I. P. Harkusha, I. T. Horbachuk, V. P. Kurinnyi, M. Sh. Pevzner, General physics course: Collection of problems. Kyiv, Ukraine: Київ, Україна: Tekhnika, 2003. (In Ukranian).

“What is weight?” [Online]. Available: https://www.khanacademy.org/science/physics/forces-newtons-laws/normal-contact-force/a/what-is-weight. Accessed on Jul 01, 2023. (in English)

J. Walker, D. Halliday, R. Resnick. Fundamentals of physics. 10th edition. USA: John Wiley & Sons, Inc, 2014. [Online]. Available: https://www.academia.edu/36062426/fundamentals_of_physics_textbook_pdf. Accessed on Jul 06, 2023. (in English)

S. P. Thomas. “Grappling with the Implications of ChatGPT for Researchers, Clinicians, and Educators”, Issues in Mental Health Nursing, 2023, 44:3, p.141-142. doi:10.1080/01612840.2023.2180982. [Online]. Available: https://www.tandfonline.com/doi/full/10.1080/01612840.2023.2180982. Accessed on Jun 10, 2023. (in English)

Downloads

Published

2023-10-30

How to Cite

[1]
Podlasov С. О. and Matviichuk О. В., “APPLICATION OF CHATGPT IN THE TEACHING OF PHYSICS TO BACHELOR’S STUDENTS AT A TECHNICAL UNIVERSITY”, ITLT, vol. 97, no. 5, pp. 149–166, Oct. 2023.

Issue

Vol. 97 No. 5 (2023)

Section

Artificial Intelligence in Education and Scientific Research

License

Copyright (c) 2023 Сергій Олександрович Подласов, Олексій Васильович Матвійчук

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Authors who publish in this journal agree to the following terms:

  1. Authors hold copyright immediately after publication of their works and retain publishing rights without any restrictions.
  2. The copyright commencement date complies the publication date of the issue, where the article is included in.

Content Licensing

  1. Authors grant the journal a right of the first publication of the work under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC BY-NC-SA 4.0) that allows others freely to read, download, copy and print submissions, search content and link to published articles, disseminate their full text and use them for any legitimate non-commercial purposes (i.e. educational or scientific) with the mandatory reference to the article’s authors and initial publication in this journal.
  2. Original published articles cannot be used by users (exept authors) for commercial purposes or distributed by third-party intermediary organizations for a fee.

Deposit Policy

  1. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) during the editorial process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (see this journal’s registered deposit policy at Sherpa/Romeo directory).
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  3. Post-print (post-refereeing manuscript version) and publisher's PDF-version self-archiving is allowed.
  4. Archiving the pre-print (pre-refereeing manuscript version) not allowed.