Pre-Service Teachers' Approaches in Solving Mathematics Tasks with ChatGPT

Saved in:
Bibliographic Details
Title: Pre-Service Teachers' Approaches in Solving Mathematics Tasks with ChatGPT
Language: English
Authors: Norbert Noster (ORCID 0000-0003-2404-6102), Sebastian Gerber (ORCID 0000-0002-0614-2777), Hans-Stefan Siller (ORCID 0000-0003-1597-7108)
Source: Digital Experiences in Mathematics Education. 2024 10(3):543-567.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 25
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Preservice Teachers, Mathematics Skills, Problem Solving, Technology Uses in Education, Artificial Intelligence, Pedagogical Content Knowledge, Technological Literacy, Error Patterns, Accuracy, Natural Language Processing, Prompting
DOI: 10.1007/s40751-024-00155-8
ISSN: 2199-3246
2199-3254
Abstract: The use of large language models like ChatGPT is widely discussed for educational purposes. Using this technology requires teachers to have appropriate competences that incorporate knowledge of how to make use of this technology. In this study, we investigate pre-service teachers' knowledge through the lens of the KTMT model ("Knowledge for Teaching Mathematics with Technology" model), a domain-specific variant of the TPACK-model. One component is represented in mathematical fidelity as knowledge of the mathematical accuracy of the technology, which in case of large language models is of special interest, as it may produce erroneous but plausible-sounding information. Furthermore, prompting techniques are of interest as technological knowledge, which influence mathematical fidelity. For this study, eleven pre-service teachers were asked to solve four different mathematical tasks with the help of ChatGPT. The chatlogs and information provided in an interview after working on the tasks are analyzed using qualitative content analysis. Results show that both correct and incorrect answers were produced for all tasks. The rate of pre-service teachers providing an incorrect answer is high when having been presented with an incorrect answer generated by the large language model. Despite having access to ChatGPT as a tool, many of the participants were not able to provide correct answers to all tasks. Furthermore, the mathematical fidelity was often over- and, in some cases, underrated. The mathematical knowledge seems to have changed while working with ChatGPT. Based on the applied prompting techniques, the pre-service teachers showed a deficiency in technological knowledge.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1446056
Database: ERIC
Description
Abstract:The use of large language models like ChatGPT is widely discussed for educational purposes. Using this technology requires teachers to have appropriate competences that incorporate knowledge of how to make use of this technology. In this study, we investigate pre-service teachers' knowledge through the lens of the KTMT model ("Knowledge for Teaching Mathematics with Technology" model), a domain-specific variant of the TPACK-model. One component is represented in mathematical fidelity as knowledge of the mathematical accuracy of the technology, which in case of large language models is of special interest, as it may produce erroneous but plausible-sounding information. Furthermore, prompting techniques are of interest as technological knowledge, which influence mathematical fidelity. For this study, eleven pre-service teachers were asked to solve four different mathematical tasks with the help of ChatGPT. The chatlogs and information provided in an interview after working on the tasks are analyzed using qualitative content analysis. Results show that both correct and incorrect answers were produced for all tasks. The rate of pre-service teachers providing an incorrect answer is high when having been presented with an incorrect answer generated by the large language model. Despite having access to ChatGPT as a tool, many of the participants were not able to provide correct answers to all tasks. Furthermore, the mathematical fidelity was often over- and, in some cases, underrated. The mathematical knowledge seems to have changed while working with ChatGPT. Based on the applied prompting techniques, the pre-service teachers showed a deficiency in technological knowledge.
ISSN:2199-3246
2199-3254
DOI:10.1007/s40751-024-00155-8