View in EDS

Success through Error: Using Error Analysis of ChatGPT Output in English as a Foreign Language Learner Writing Instruction

Saved in:
Bibliographic Details
Title: Success through Error: Using Error Analysis of ChatGPT Output in English as a Foreign Language Learner Writing Instruction
Language: English
Authors: Arifi Wak (ORCID 0000-0003-1222-0978), Muhammad W. Ashraf (ORCID 0000-0002-7087-9714), Hanadi AbdelSalam (ORCID 0000-0003-2591-4661), Khadija El Alaoui (ORCID 0000-0002-6852-8800), Maura Pilotti (ORCID 0000-0001-7955-680X)
Source: International Society for Technology, Education, and Science. 2024.
Availability: International Society for Technology, Education, and Science. 944 Maysey Drive, San Antonio, TX 78227. Tel: 515-294-1075; Fax: 515-294-1003; email: istesoffice@gmail.com; Web site: http://www.istes.org
Peer Reviewed: Y
Page Count: 13
Publication Date: 2024
Document Type: Reports - Research
Speeches/Meeting Papers
Education Level: Higher Education
Postsecondary Education
Descriptors: Artificial Intelligence, Computer Software, Second Language Learning, Second Language Instruction, English (Second Language), Word Frequency, Technology Integration, Writing Instruction, Error Patterns, Computational Linguistics, Arabic, Native Language, Standards, Language Tests, Language Proficiency, Writing Evaluation, Educational Benefits, Error Analysis (Language), Contrastive Linguistics, College Freshmen, Foreign Countries, English for Academic Purposes
Geographic Terms: Saudi Arabia
Assessment and Survey Identifiers: International English Language Testing System
Abstract: Questions exist as to whether AI tools, such as ChatGPT, can aid learning. This study examined whether in-class exercises involving error detection in text generated by ChatGPT can aid students' foreign language writing. Participants were Arabic-English speakers who were classified as ranging from modest to competent English users according to IELTS standards. There were two conditions, each involving four sections of an English communication course, distributed across consecutive semesters and taught by the same instructor. In the treatment condition (n = 101), students performed error detection exercises using text generated by ChatGPT. In the control condition (n = 112), students performed the same exercises without ChatGPT. Then, they wrote a descriptive essay. It was hypothesized that if ChatGPT exercises enhanced students' confidence as writers, they would write longer essays. If ChatGPT exercises enhanced attention to detail, the exercises would increase writing quality (e.g., greater use of low-frequency and abstract words, and greater reliance on complex syntactic structures). In this study, students exposed to ChatGPT exercises used more low-frequency words and wrote more sentences but of shorter length than control condition students. The number of words did not differ, suggesting that ChatGPT exercises enhanced writers' attention to the shorter sentence length of the English language and its vast vocabulary. The results of this study suggest that ChatGPT exercises yield minor benefits for improving the writing of second-language speakers. Yet, extensive and broader exercises may yield more substantial benefits. [For the complete proceedings, see ED672804.]
Abstractor: As Provided
Entry Date: 2025
Accession Number: ED673080
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED673080
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED673080
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Success through Error: Using Error Analysis of ChatGPT Output in English as a Foreign Language Learner Writing Instruction
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Arifi+Wak%22">Arifi Wak</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-1222-0978">0000-0003-1222-0978</externalLink>)<br /><searchLink fieldCode="AR" term="%22Muhammad+W%2E+Ashraf%22">Muhammad W. Ashraf</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-7087-9714">0000-0002-7087-9714</externalLink>)<br /><searchLink fieldCode="AR" term="%22Hanadi+AbdelSalam%22">Hanadi AbdelSalam</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2591-4661">0000-0003-2591-4661</externalLink>)<br /><searchLink fieldCode="AR" term="%22Khadija+El+Alaoui%22">Khadija El Alaoui</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-6852-8800">0000-0002-6852-8800</externalLink>)<br /><searchLink fieldCode="AR" term="%22Maura+Pilotti%22">Maura Pilotti</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7955-680X">0000-0001-7955-680X</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Society+for+Technology%2C+Education%2C+and+Science%22"><i>International Society for Technology, Education, and Science</i></searchLink>. 2024.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Society for Technology, Education, and Science. 944 Maysey Drive, San Antonio, TX 78227. Tel: 515-294-1075; Fax: 515-294-1003; email: istesoffice@gmail.com; Web site: http://www.istes.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 13
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research<br />Speeches/Meeting Papers
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Software%22">Computer Software</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Instruction%22">Second Language Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22English+%28Second+Language%29%22">English (Second Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Word+Frequency%22">Word Frequency</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Integration%22">Technology Integration</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+Instruction%22">Writing Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Error+Patterns%22">Error Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Computational+Linguistics%22">Computational Linguistics</searchLink><br /><searchLink fieldCode="DE" term="%22Arabic%22">Arabic</searchLink><br /><searchLink fieldCode="DE" term="%22Native+Language%22">Native Language</searchLink><br /><searchLink fieldCode="DE" term="%22Standards%22">Standards</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Tests%22">Language Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Proficiency%22">Language Proficiency</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+Evaluation%22">Writing Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Benefits%22">Educational Benefits</searchLink><br /><searchLink fieldCode="DE" term="%22Error+Analysis+%28Language%29%22">Error Analysis (Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Contrastive+Linguistics%22">Contrastive Linguistics</searchLink><br /><searchLink fieldCode="DE" term="%22College+Freshmen%22">College Freshmen</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22English+for+Academic+Purposes%22">English for Academic Purposes</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Saudi+Arabia%22">Saudi Arabia</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22International+English+Language+Testing+System%22">International English Language Testing System</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Questions exist as to whether AI tools, such as ChatGPT, can aid learning. This study examined whether in-class exercises involving error detection in text generated by ChatGPT can aid students' foreign language writing. Participants were Arabic-English speakers who were classified as ranging from modest to competent English users according to IELTS standards. There were two conditions, each involving four sections of an English communication course, distributed across consecutive semesters and taught by the same instructor. In the treatment condition (n = 101), students performed error detection exercises using text generated by ChatGPT. In the control condition (n = 112), students performed the same exercises without ChatGPT. Then, they wrote a descriptive essay. It was hypothesized that if ChatGPT exercises enhanced students' confidence as writers, they would write longer essays. If ChatGPT exercises enhanced attention to detail, the exercises would increase writing quality (e.g., greater use of low-frequency and abstract words, and greater reliance on complex syntactic structures). In this study, students exposed to ChatGPT exercises used more low-frequency words and wrote more sentences but of shorter length than control condition students. The number of words did not differ, suggesting that ChatGPT exercises enhanced writers' attention to the shorter sentence length of the English language and its vast vocabulary. The results of this study suggest that ChatGPT exercises yield minor benefits for improving the writing of second-language speakers. Yet, extensive and broader exercises may yield more substantial benefits. [For the complete proceedings, see ED672804.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED673080
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED673080
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 13
    Subjects:
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Computer Software
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Second Language Instruction
        Type: general
      – SubjectFull: English (Second Language)
        Type: general
      – SubjectFull: Word Frequency
        Type: general
      – SubjectFull: Technology Integration
        Type: general
      – SubjectFull: Writing Instruction
        Type: general
      – SubjectFull: Error Patterns
        Type: general
      – SubjectFull: Computational Linguistics
        Type: general
      – SubjectFull: Arabic
        Type: general
      – SubjectFull: Native Language
        Type: general
      – SubjectFull: Standards
        Type: general
      – SubjectFull: Language Tests
        Type: general
      – SubjectFull: Language Proficiency
        Type: general
      – SubjectFull: Writing Evaluation
        Type: general
      – SubjectFull: Educational Benefits
        Type: general
      – SubjectFull: Error Analysis (Language)
        Type: general
      – SubjectFull: Contrastive Linguistics
        Type: general
      – SubjectFull: College Freshmen
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: English for Academic Purposes
        Type: general
      – SubjectFull: Saudi Arabia
        Type: general
      – SubjectFull: International English Language Testing System
        Type: general
    Titles:
      – TitleFull: Success through Error: Using Error Analysis of ChatGPT Output in English as a Foreign Language Learner Writing Instruction
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Arifi Wak
      – PersonEntity:
          Name:
            NameFull: Muhammad W. Ashraf
      – PersonEntity:
          Name:
            NameFull: Hanadi AbdelSalam
      – PersonEntity:
          Name:
            NameFull: Khadija El Alaoui
      – PersonEntity:
          Name:
            NameFull: Maura Pilotti
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Titles:
            – TitleFull: International Society for Technology, Education, and Science
              Type: main
ResultId 1