Keywords
physics education
aspects of assistance to teachers and students
How to Cite
Abstract
Chat GPT, which was created on the basis of artificial intelligence (AI), posed a number of questions to education, ranging from the most appropriate ways to use it to ways to combat its threats. Answering these questions requires determining the current level of "learning " possessed by ChatGPT in specific knowledge domains, particularly physics studied by students in a bachelor's program at a technical university, and establishing the capabilities of ChatGPT to assist teachers and students in their educational work. The AI, using ChatGPT, considers itself able to assist educators in explaining concepts, answering questions, creating educational content, and supporting research. As for students, the AI believes that ChatGPT is also ready to explain concepts, solve problems, provide additional study materials and advise on exam preparation. For each aspect of assistance to teachers and students (except research support) we posed questions to ChatGPT and analyzed its responses. As it turned out, despite the vast amount of information available to artificial intelligence, in the answers to our queries ChatGPT quit often proposed inaccurate, and sometimes fundamentally incorrect statements, which may indicate the still insufficient level of its knowledge in physics regarding even fairly simple issues. The article presents the most striking examples of such responses. All of this suggests that ChatGPT currently lacks the necessary breadth of knowledge to effectively assist physics teachers and engineering students who study physics at a technical university. Additionally, the study assumes that the accuracy of ChatGPT's answers is determined not only by the content of the question but also by the language in which it is formulated. Based on the analysis of responses, it was concluded that currently it is most appropriate to use GPT for the development of students' critical thinking. The greatest threat posed by ChatGPT to the study of physics can be considered its inadequate level of training, rather than the concerns expressed in the litera`ture that ChatGPT may facilitate students’ cheating.
References
M. Halaweh, "ChatGPT in education: Strategies for responsible implementation", Contemporary Educational Technology, vol. 15, no. 2, 2023, ep421. doi: https://doi.org/10.30935/cedtech/13036. Accessed on: Jun. 12, 2023.
C. K. Lo, “What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature”, Educ. Sci., vol.13, no.410, 2023. doi: https://doi.org/10.3390/educsci13040410.
J. Rudolph, S. Tan, Sh. Tan, “ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?” Journal of Applied Learning & Teaching, vol. 6 no. 1, pp.1 – 22, 2023. doi: https://doi.org/10.37074/jalt.2023.6.1.9.
M. Sullivan, A. Kelly, P. McLaughlan, “ChatGPT in higher education: Considerations for academic integrity and student learning”, Journal of Applied Learning & Teaching, vol.6 no.1, pp.31-40, 2023. doi: https://doi.org/10.37074/jalt.2023.6.1.17.
A. Tlili1 et al., “What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education”, Smart Learning Environments, vol.10, no.15, 2023. doi: https://doi.org/10.1186/s40561-023-00237-x.
M. Farrokhnia, S. K. Banihashem, O. Noroozi & A. Wals, “A SWOT analysis of ChatGPT: Implications for educational practice and research”, Innovations in Education and Teaching International, doi: https://doi.org/10.1080/14703297.2023.2195846.
D. R. E. Cotton, P. A. Cotton & J. R. Shipway, “Chatting and cheating: Ensuring academic integrity in the era of ChatGPT”, Innovations in Education and Teaching International, 2023. doi: https://doi.org/10.1080/14703297.2023.2190148.
Y. K. Dwivedi et al. “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, vol.71, 102642, pp.1-63, 2023. doi: https://doi.org/10.1016/j.ijinfomgt.2023.102642.
E. A. M. van Dis, J. Bollen, W. Zuidema, R. van Rooij, C. L. Bockting, “ChatGPT: five priorities for research|”, Nature, vol.3, 614 (7947), pp. 224-226, 2023. doi: http://10.1038/d41586-023-00288-7, [Електронний ресурс]. Доступно: https://www.nature.com/articles/d41586-023-00288-7
W. Yeadon, O.-O. Inyang, A. Mizouri, A. Peach & C. P. Testrow, “The death of the short-form physics essay in the coming AI revolution”, Physics Education, vol.58 (3), art № 035027, 2023. doi: 10.1088/1361-6552/acc5cf
S. Küchemann et al., “Physics task development of prospective physics teachers using ChatGPT”, arXiv:2304.10014v1 [physics.ed-ph]. doi: https://doi.org/10.48550/arXiv.2304.10014.
C. G. West, “Advances in apparent conceptual physics reasoning in GPT-4”, arXiv:2303.17012v3 [physics.ed-ph], doi: https://doi.org/10.48550/arXiv.2303.17012.
Ph. M. Newton, “ChatGPT performance on MCQ-based exams”, (February 21, 2023). Preprint. doi: https://doi.org/10.35542/osf.io/sytu3.
S. Fergus, M. Botha, M. Ostovar, “Evaluating Academic Answers Generated Using ChatGPT”, Journal of Chemical Education, vol.100, no.4, pp.1672-1675, 2023. doi: 10.1021/acs.jchemed.3c00087.
T. Susnjak, “ChatGPT: The End of Online Exam Integrity?”, arXiv:2212.09292v1 [cs.AI]. doi: https://doi.org/10.48550/arXiv.2212.09292.
M. Yang, “New York City schools ban AI chatbot that writes essays and answers prompts”, The Guardian, Fri 6 Jan 2023. New York City schools ban AI chatbot ChatGPT. [Електронний ресурс]. Доступно: https://www.theguardian.com/us-news/2023/jan/06/new-york-city-schools-ban-ai-chatbot-chatgpt. Accessed on Jun 17, 2023.
B. A. Anders, “Is using ChatGPT cheating, plagiarism, both, neither, or forward thinking?”, (2023) Patterns, vol.4, issue.3, 100694, 14 April 2023. doi: https://doi.org/10.1016/j.patter.2023.100694.
K. Toyama, Geek heresy: Rescuing social change from the cult of technology. PublicAffairs, 2015. [Електронний ресурс]. Доступно: https://www.amazon.com/Geek-Heresy-Rescuing-Social-Technology/dp/161039528X. Accessed on Jul 06, 2023.
J. Qadir “Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education”. TechRxiv. Preprint. posted on 2022-12-30. [Online]. Available: https://doi.org/10.36227/techrxiv.21789434.v1. Accessed on Jun 12, 2023.J. Willems, “ChatGPT at Universities – The Least of Our Concerns”, [Електронний ресурс]. Доступно: https://ssrn.com/abstract=4334162 or doi: http://dx.doi.org/10.2139/ssrn.4334162.
D. MacIsaac. “Chatbots Attempt Physics Homework – ChatGPT: Chat Generative Pre-Trained Transformer” The Physics Teacher, vol. 61, no.4, p.318, 2023. doi: https://doi.org/10.1119/10.0017700. Accessed on May 28, 2023.
J. Wang “ChatGPT: A test drive”. American Journal of Physics, vol.91, pp.255–256, 2023. doi: https://doi.org/10.1119/5.0145897. Accessed on Jun 04, 2023.
С. О. Подласов і О. В. Матвійчук, “Підготовка та проведення екзамену з фізики в режимі онлайн”, ITLT, вип. 92, вип. 6, с. 124–139, Груд 2022. [Електронний ресурс]. Доступно: https://journal.iitta.gov.ua/index.php/itlt/article/view/5068. doi: https://doi.org/10.33407/itlt.v92i6.5068. Дата звернення: Лип. 07, 2023.
S. Küchemann, et. al. “Physics task development of prospective physics teachers using ChatGPT”. arXiv:2304.10014 [physics.ed-ph]. doi: https://doi.org/10.48550/arXiv.2304.10014. Accessed on Jul 01, 2023.
І. П. Гаркуша, І. Т. Горбачук, В. П. Курінний, М. Ш. Певзнер, Загальний курс фізики: Збірник задач. Київ, Україна: Техніка, 2003.
“What is weight?” [Електронний ресурс]. Доступно: https://www.khanacademy.org/science/physics/forces-newtons-laws/normal-contact-force/a/what-is-weight. Accessed on Jul 01, 2023.
J. Walker, D. Halliday, R. Resnick. Fundamentals of physics. 10th edition. USA: John Wiley & Sons, Inc, 2014. [Електронний ресурс]. Доступно: https://www.academia.edu/36062426/fundamentals_of_physics_textbook_pdf. Accessed on Jul 06, 2023.
S. P. Thomas. “Grappling with the Implications of ChatGPT for Researchers, Clinicians, and Educators”, Issues in Mental Health Nursing, 2023, 44:3, p.141-142. doi: 10.1080/01612840.2023.2180982. [Електронний ресурс]. Доступно: https://www.tandfonline.com/doi/full/10.1080/01612840.2023.2180982. Accessed on Jun 10, 2023.
REFERENCES (TRANSLATED AND TRANSLITERATED)
M. Halaweh, "ChatGPT in education: Strategies for responsible implementation", Contemporary Educational Technology, vol. 15, no. 2, 2023, ep421. doi: https://doi.org/10.30935/cedtech/13036. Accessed on: Jun. 12, 2023. (in English)
C. K. Lo, “What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature”, Educ. Sci., vol.13, no.410, 2023. doi: https://doi.org/10.3390/educsci13040410. (in English)
J. Rudolph, S. Tan, Sh. Tan, “ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?” Journal of Applied Learning & Teaching, vol. 6 no. 1, pp.1 – 22, 2023. doi: https://doi.org/10.37074/jalt.2023.6.1.9. (in English)
M. Sullivan, A. Kelly, P. McLaughlan, “ChatGPT in higher education: Considerations for academic integrity and student learning”, Journal of Applied Learning & Teaching, vol.6 no.1, pp.31-40, 2023. doi: https://doi.org/10.37074/jalt.2023.6.1.17. (in English)
A. Tlili1 et al., “What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education”, Smart Learning Environments, vol.10, no.15, 2023. doi: https://doi.org/10.1186/s40561-023-00237-x (in English)
M. Farrokhnia, S. K. Banihashem, O. Noroozi & A. Wals, “A SWOT analysis of ChatGPT: Implications for educational practice and research”, Innovations in Education and Teaching International, doi: https://doi.org/10.1080/14703297.2023.2195846. (in English)
D. R. E. Cotton, P. A. Cotton & J. R. Shipway, “Chatting and cheating: Ensuring academic integrity in the era of ChatGPT”, Innovations in Education and Teaching International, 2023. doi: https://doi.org/10.1080/14703297.2023.2190148. (in English)
Y. K. Dwivedi et al. “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, vol.71, 102642, pp.1-63, 2023. doi: https://doi.org/10.1016/j.ijinfomgt.2023.102642 (in English)
E. A. M. van Dis, J. Bollen, W. Zuidema, R. van Rooij, C. L. Bockting, “ChatGPT: five priorities for research|”, Nature, vol.3, 614 (7947), pp. 224-226, 2023. doi: http://10.1038/d41586-023-00288-7, [Online]. Available: https://www.nature.com/articles/d41586-023-00288-7 (in English)
W. Yeadon, O.-O. Inyang, A. Mizouri, A. Peach & C. P. Testrow, “The death of the short-form physics essay in the coming AI revolution”, Physics Education, vol.58 (3), art № 035027, 2023. doi:10.1088/1361-6552/acc5cf (in English)
S. Küchemann et al., “Physics task development of prospective physics teachers using ChatGPT”, arXiv:2304.10014v1 [physics.ed-ph]. doi: https://doi.org/10.48550/arXiv.2304.10014 (in English)
C. G. West, “Advances in apparent conceptual physics reasoning in GPT-4”, arXiv:2303.17012v3 [physics.ed-ph], doi: https://doi.org/10.48550/arXiv.2303.17012 (in English)
Ph. M. Newton, “ChatGPT performance on MCQ-based exams”, (February 21, 2023). Preprint. doi: https://doi.org/10.35542/osf.io/sytu3. (in English)
S. Fergus, M. Botha, M. Ostovar, “Evaluating Academic Answers Generated Using ChatGPT”, Journal of Chemical Education, vol.100, no.4, pp.1672-1675, 2023. DOI: 10.1021/acs.jchemed.3c00087. (in English)
T. Susnjak, “ChatGPT: The End of Online Exam Integrity?”, arXiv:2212.09292v1 [cs.AI]. doi: https://doi.org/10.48550/arXiv.2212.09292. (in English)
M. Yang, “New York City schools ban AI chatbot that writes essays and answers prompts”, The Guardian, Fri 6 Jan 2023. New York City schools ban AI chatbot ChatGPT. [Online]. Available: https://www.theguardian.com/us-news/2023/jan/06/new-york-city-schools-ban-ai-chatbot-chatgpt. Accessed on Jun 17, 2023. (in English)
B. A. Anders, “Is using ChatGPT cheating, plagiarism, both, neither, or forward thinking?”, (2023) Patterns, vol.4, issue.3, 100694, 14 April 2023. doi: https://doi.org/10.1016/j.patter.2023.100694. (in English)
K. Toyama, Geek heresy: Rescuing social change from the cult of technology. PublicAffairs, 2015. [Online]. Available: https://www.amazon.com/Geek-Heresy-Rescuing-Social-Technology/dp/161039528X. Accessed on Jul 06, 2023. (in English)
J. Qadir “Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education”. TechRxiv. Preprint. posted on 2022-12-30. doi: https://doi.org/10.36227/techrxiv.21789434.v1. Accessed on Jun 12, 2023.J. Willems, “ChatGPT at Universities – The Least of Our Concerns”, [Online]. Available: https://ssrn.com/abstract=4334162 or http://dx.doi.org/10.2139/ssrn.4334162. (in English)
D. MacIsaac. “Chatbots Attempt Physics Homework – ChatGPT: Chat Generative Pre-Trained Transformer” The Physics Teacher, vol. 61, no.4, p.318, 2023. doi: https://doi.org/10.1119/10.0017700. Accessed on May 28, 2023. (in English)
J. Wang “ChatGPT: A test drive”. American Journal of Physics, vol.91, pp.255–256, 2023. doi: https://doi.org/10.1119/5.0145897. Accessed on Jun 04, 2023.
S. О. Podlasov and О. V. Matviichuk, “Preparation and conducting of the online physics exam”, ITLT, vol. 92, no. 6, pp. 124–139, Dec. 2022. [Online]. Available: https://journal.iitta.gov.ua/index.php/itlt/article/view/5068. doi: https://doi.org/10.33407/itlt.v92i6.5068. Дата звернення: Лип. 07, 2023. (In Ukranian).
S. Küchemann, et. al. “Physics task development of prospective physics teachers using ChatGPT”. arXiv:2304.10014 [physics.ed-ph]. doi: https://doi.org/10.48550/arXiv.2304.10014. Accessed on Jul 01, 2023. (in English)
I. P. Harkusha, I. T. Horbachuk, V. P. Kurinnyi, M. Sh. Pevzner, General physics course: Collection of problems. Kyiv, Ukraine: Київ, Україна: Tekhnika, 2003. (In Ukranian).
“What is weight?” [Online]. Available: https://www.khanacademy.org/science/physics/forces-newtons-laws/normal-contact-force/a/what-is-weight. Accessed on Jul 01, 2023. (in English)
J. Walker, D. Halliday, R. Resnick. Fundamentals of physics. 10th edition. USA: John Wiley & Sons, Inc, 2014. [Online]. Available: https://www.academia.edu/36062426/fundamentals_of_physics_textbook_pdf. Accessed on Jul 06, 2023. (in English)
S. P. Thomas. “Grappling with the Implications of ChatGPT for Researchers, Clinicians, and Educators”, Issues in Mental Health Nursing, 2023, 44:3, p.141-142. doi:10.1080/01612840.2023.2180982. [Online]. Available: https://www.tandfonline.com/doi/full/10.1080/01612840.2023.2180982. Accessed on Jun 10, 2023. (in English)
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright (c) 2023 Сергій Олександрович Подласов, Олексій Васильович Матвійчук