Native, Nonnative, or Bilingual? A Concise Assessment of ChatGPT's Suitability for Second-Language Instruction as a Native or Nonnative Pedagogue

Saved in:
Bibliographic Details
Title: Native, Nonnative, or Bilingual? A Concise Assessment of ChatGPT's Suitability for Second-Language Instruction as a Native or Nonnative Pedagogue
Language: English
Authors: Noboru Sakai
Source: Journal of Educators Online. 2025 22(1).
Availability: Journal of Educators Online. Grand Canyon University, 23300 West Camelback Road, Phoenix, AZ 85017. e-mail: CIRT@gcu.edu. Web site: https://www.thejeo.com
Peer Reviewed: Y
Page Count: 16
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Descriptors: Foreign Countries, Artificial Intelligence, Native Speakers, English (Second Language), Language Tests, Second Language Learning, Linguistic Competence, Communicative Competence (Languages), Language Skills, Grammar, Language Patterns, Difficulty Level, Language Proficiency
Geographic Terms: Japan
Assessment and Survey Identifiers: Test of English for International Communication
ISSN: 1547-500X
Abstract: This study aims to investigate ChatGPT's ability to comprehend input from nonnative speakers, specifically those learning English as a second language, with Japanese speakers serving as the model population. The experiment examines how ChatGPT evaluates the difficulty levels of the Test of English for International Communication (TOEIC), which is widely taken by nonnative English speakers of varying proficiency levels. This study also measures ChatGPT's response to discourses produced by nonnative speakers--one containing grammatical errors and the other incorporating sociolinguistic or strategic competence expressions. The findings indicate that ChatGPT demonstrates proficiency in lexical and grammatical features and can comprehend nonperfect grammatical discourses produced by nonnative speakers. However, ChatGPT does not accurately perceive the varying degrees of difficulty experienced by nonnative speakers. Moreover, while ChatGPT can comprehend sociolinguistic expressions when the context is clear, its understanding of other communication strategies employed by nonnative speakers is relatively limited.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1462337
Database: ERIC
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwGtNtTMp6rsx2Ikj7wmNCMaAAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDHMkvmneUPDf6MW3dgIBEICBm90PqC1Bc0VlJlujasIU1X8gc7j_l6Cvlj3RJj5mJqetD3WciYowDvdcD8QO2k8SmMP0dqNmCmosegj85TKom851BKRqGOYV3uywLnbEVbQLbdEN2JbjIgXax2WZAOzAG2xTFdbxTavHacCBozceKeCGNb3yV872vFHzcvTIVxEa7T7Sw66Hog4I99J_CU7dKJmm2aoRbP9-Z4hM
Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1462337
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1462337
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Native, Nonnative, or Bilingual? A Concise Assessment of ChatGPT's Suitability for Second-Language Instruction as a Native or Nonnative Pedagogue
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Noboru+Sakai%22">Noboru Sakai</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Educators+Online%22"><i>Journal of Educators Online</i></searchLink>. 2025 22(1).
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Journal of Educators Online. Grand Canyon University, 23300 West Camelback Road, Phoenix, AZ 85017. e-mail: CIRT@gcu.edu. Web site: https://www.thejeo.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 16
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Native+Speakers%22">Native Speakers</searchLink><br /><searchLink fieldCode="DE" term="%22English+%28Second+Language%29%22">English (Second Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Tests%22">Language Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Linguistic+Competence%22">Linguistic Competence</searchLink><br /><searchLink fieldCode="DE" term="%22Communicative+Competence+%28Languages%29%22">Communicative Competence (Languages)</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Skills%22">Language Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Grammar%22">Grammar</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Patterns%22">Language Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Difficulty+Level%22">Difficulty Level</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Proficiency%22">Language Proficiency</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Japan%22">Japan</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22Test+of+English+for+International+Communication%22">Test of English for International Communication</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1547-500X
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study aims to investigate ChatGPT's ability to comprehend input from nonnative speakers, specifically those learning English as a second language, with Japanese speakers serving as the model population. The experiment examines how ChatGPT evaluates the difficulty levels of the Test of English for International Communication (TOEIC), which is widely taken by nonnative English speakers of varying proficiency levels. This study also measures ChatGPT's response to discourses produced by nonnative speakers--one containing grammatical errors and the other incorporating sociolinguistic or strategic competence expressions. The findings indicate that ChatGPT demonstrates proficiency in lexical and grammatical features and can comprehend nonperfect grammatical discourses produced by nonnative speakers. However, ChatGPT does not accurately perceive the varying degrees of difficulty experienced by nonnative speakers. Moreover, while ChatGPT can comprehend sociolinguistic expressions when the context is clear, its understanding of other communication strategies employed by nonnative speakers is relatively limited.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1462337
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1462337
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 16
    Subjects:
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Native Speakers
        Type: general
      – SubjectFull: English (Second Language)
        Type: general
      – SubjectFull: Language Tests
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Linguistic Competence
        Type: general
      – SubjectFull: Communicative Competence (Languages)
        Type: general
      – SubjectFull: Language Skills
        Type: general
      – SubjectFull: Grammar
        Type: general
      – SubjectFull: Language Patterns
        Type: general
      – SubjectFull: Difficulty Level
        Type: general
      – SubjectFull: Language Proficiency
        Type: general
      – SubjectFull: Japan
        Type: general
      – SubjectFull: Test of English for International Communication
        Type: general
    Titles:
      – TitleFull: Native, Nonnative, or Bilingual? A Concise Assessment of ChatGPT's Suitability for Second-Language Instruction as a Native or Nonnative Pedagogue
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Noboru Sakai
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 1547-500X
          Numbering:
            – Type: volume
              Value: 22
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Journal of Educators Online
              Type: main
ResultId 1