View in EDS

Pre-Service Teachers' Approaches in Solving Mathematics Tasks with ChatGPT

Saved in:
Bibliographic Details
Title: Pre-Service Teachers' Approaches in Solving Mathematics Tasks with ChatGPT
Language: English
Authors: Norbert Noster (ORCID 0000-0003-2404-6102), Sebastian Gerber (ORCID 0000-0002-0614-2777), Hans-Stefan Siller (ORCID 0000-0003-1597-7108)
Source: Digital Experiences in Mathematics Education. 2024 10(3):543-567.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 25
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Preservice Teachers, Mathematics Skills, Problem Solving, Technology Uses in Education, Artificial Intelligence, Pedagogical Content Knowledge, Technological Literacy, Error Patterns, Accuracy, Natural Language Processing, Prompting
DOI: 10.1007/s40751-024-00155-8
ISSN: 2199-3246
2199-3254
Abstract: The use of large language models like ChatGPT is widely discussed for educational purposes. Using this technology requires teachers to have appropriate competences that incorporate knowledge of how to make use of this technology. In this study, we investigate pre-service teachers' knowledge through the lens of the KTMT model ("Knowledge for Teaching Mathematics with Technology" model), a domain-specific variant of the TPACK-model. One component is represented in mathematical fidelity as knowledge of the mathematical accuracy of the technology, which in case of large language models is of special interest, as it may produce erroneous but plausible-sounding information. Furthermore, prompting techniques are of interest as technological knowledge, which influence mathematical fidelity. For this study, eleven pre-service teachers were asked to solve four different mathematical tasks with the help of ChatGPT. The chatlogs and information provided in an interview after working on the tasks are analyzed using qualitative content analysis. Results show that both correct and incorrect answers were produced for all tasks. The rate of pre-service teachers providing an incorrect answer is high when having been presented with an incorrect answer generated by the large language model. Despite having access to ChatGPT as a tool, many of the participants were not able to provide correct answers to all tasks. Furthermore, the mathematical fidelity was often over- and, in some cases, underrated. The mathematical knowledge seems to have changed while working with ChatGPT. Based on the applied prompting techniques, the pre-service teachers showed a deficiency in technological knowledge.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1446056
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1446056
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Pre-Service Teachers' Approaches in Solving Mathematics Tasks with ChatGPT
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Norbert+Noster%22">Norbert Noster</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0003-2404-6102">0000-0003-2404-6102</externalLink>)<br /><searchLink fieldCode="AR" term="%22Sebastian+Gerber%22">Sebastian Gerber</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-0614-2777">0000-0002-0614-2777</externalLink>)<br /><searchLink fieldCode="AR" term="%22Hans-Stefan+Siller%22">Hans-Stefan Siller</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0003-1597-7108">0000-0003-1597-7108</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Digital+Experiences+in+Mathematics+Education%22"><i>Digital Experiences in Mathematics Education</i></searchLink>. 2024 10(3):543-567.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 25
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Preservice+Teachers%22">Preservice Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Skills%22">Mathematics Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Problem+Solving%22">Problem Solving</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Pedagogical+Content+Knowledge%22">Pedagogical Content Knowledge</searchLink><br /><searchLink fieldCode="DE" term="%22Technological+Literacy%22">Technological Literacy</searchLink><br /><searchLink fieldCode="DE" term="%22Error+Patterns%22">Error Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Accuracy%22">Accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22Natural+Language+Processing%22">Natural Language Processing</searchLink><br /><searchLink fieldCode="DE" term="%22Prompting%22">Prompting</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s40751-024-00155-8
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2199-3246<br />2199-3254
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The use of large language models like ChatGPT is widely discussed for educational purposes. Using this technology requires teachers to have appropriate competences that incorporate knowledge of how to make use of this technology. In this study, we investigate pre-service teachers' knowledge through the lens of the KTMT model ("Knowledge for Teaching Mathematics with Technology" model), a domain-specific variant of the TPACK-model. One component is represented in mathematical fidelity as knowledge of the mathematical accuracy of the technology, which in case of large language models is of special interest, as it may produce erroneous but plausible-sounding information. Furthermore, prompting techniques are of interest as technological knowledge, which influence mathematical fidelity. For this study, eleven pre-service teachers were asked to solve four different mathematical tasks with the help of ChatGPT. The chatlogs and information provided in an interview after working on the tasks are analyzed using qualitative content analysis. Results show that both correct and incorrect answers were produced for all tasks. The rate of pre-service teachers providing an incorrect answer is high when having been presented with an incorrect answer generated by the large language model. Despite having access to ChatGPT as a tool, many of the participants were not able to provide correct answers to all tasks. Furthermore, the mathematical fidelity was often over- and, in some cases, underrated. The mathematical knowledge seems to have changed while working with ChatGPT. Based on the applied prompting techniques, the pre-service teachers showed a deficiency in technological knowledge.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1446056
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1446056
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s40751-024-00155-8
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 25
        StartPage: 543
    Subjects:
      – SubjectFull: Preservice Teachers
        Type: general
      – SubjectFull: Mathematics Skills
        Type: general
      – SubjectFull: Problem Solving
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Pedagogical Content Knowledge
        Type: general
      – SubjectFull: Technological Literacy
        Type: general
      – SubjectFull: Error Patterns
        Type: general
      – SubjectFull: Accuracy
        Type: general
      – SubjectFull: Natural Language Processing
        Type: general
      – SubjectFull: Prompting
        Type: general
    Titles:
      – TitleFull: Pre-Service Teachers' Approaches in Solving Mathematics Tasks with ChatGPT
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Norbert Noster
      – PersonEntity:
          Name:
            NameFull: Sebastian Gerber
      – PersonEntity:
          Name:
            NameFull: Hans-Stefan Siller
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 2199-3246
            – Type: issn-electronic
              Value: 2199-3254
          Numbering:
            – Type: volume
              Value: 10
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Digital Experiences in Mathematics Education
              Type: main
ResultId 1