Evaluating AI-Generated Language as Models for Strategic Competence in English Language Teaching

Saved in:
Bibliographic Details
Title: Evaluating AI-Generated Language as Models for Strategic Competence in English Language Teaching
Language: English
Authors: Phuong-Anh Nguyen
Source: IAFOR Journal of Education. 2024 12(3):325-349.
Availability: International Academic Forum. Sakae 1-16-26 - 201 Naka Ward, Nagoya Aichi, Japan 460-0008. Tel: +81-50-5806-3184; Web site: http://iafor.org
Peer Reviewed: Y
Page Count: 25
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Descriptors: Artificial Intelligence, Computer Software, Metacognition, Technology Uses in Education, Teaching Methods, Communication Strategies, Transcripts (Written Records), Taxonomy, Cues, Interaction, Instructional Materials, Computational Linguistics, English (Second Language), Dialogs (Language), Task Analysis
ISSN: 2187-0594
Abstract: Strategic competence, the ability to use communication strategies (CS) to overcome challenges and enhance communication effectiveness, is crucial in language learning. However, the coverage of these strategies as well as target models to teach them remain scarce in current instructional materials. This paper represents the first attempt to examine the application of ChatGPT in providing target models of CSs and facilitate L2 learners' strategic competence. ChatGPT-4 was used to generate transcripts of monologues and dialogues around a description task following two types of prompts: with and without a taxonomy of communication strategies (structured and unstructured prompts). Preliminary findings suggest Chat-GPT's considerable potential in modeling communication strategies. Across the two prompting conditions, the chatbot was able to present a wide range of CSs, including achievement, self-monitoring, timegaining, and interactive strategies. The highest CS content was found in the structured-prompt dialogue which utilized 9 out of 10 CS sub-types, a more diverse range than typically covered in textbooks, with approximation, circumlocution, and time gaining being most frequently used. In terms of linguistic presentation, the AI-generated transcripts demonstrated appropriate use of CSs, though their linguistic realizations were limited in range. The article concludes with implications for leveraging Chat-GPT to contextualize communication strategies, considerations for prompt engineering, strategy training to proficiency levels, and AI-teacher collaboration.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1453502
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1453502
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1453502
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Evaluating AI-Generated Language as Models for Strategic Competence in English Language Teaching
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Phuong-Anh+Nguyen%22">Phuong-Anh Nguyen</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22IAFOR+Journal+of+Education%22"><i>IAFOR Journal of Education</i></searchLink>. 2024 12(3):325-349.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Academic Forum. Sakae 1-16-26 - 201 Naka Ward, Nagoya Aichi, Japan 460-0008. Tel: +81-50-5806-3184; Web site: http://iafor.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 25
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Software%22">Computer Software</searchLink><br /><searchLink fieldCode="DE" term="%22Metacognition%22">Metacognition</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Communication+Strategies%22">Communication Strategies</searchLink><br /><searchLink fieldCode="DE" term="%22Transcripts+%28Written+Records%29%22">Transcripts (Written Records)</searchLink><br /><searchLink fieldCode="DE" term="%22Taxonomy%22">Taxonomy</searchLink><br /><searchLink fieldCode="DE" term="%22Cues%22">Cues</searchLink><br /><searchLink fieldCode="DE" term="%22Interaction%22">Interaction</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Materials%22">Instructional Materials</searchLink><br /><searchLink fieldCode="DE" term="%22Computational+Linguistics%22">Computational Linguistics</searchLink><br /><searchLink fieldCode="DE" term="%22English+%28Second+Language%29%22">English (Second Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Dialogs+%28Language%29%22">Dialogs (Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Task+Analysis%22">Task Analysis</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2187-0594
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Strategic competence, the ability to use communication strategies (CS) to overcome challenges and enhance communication effectiveness, is crucial in language learning. However, the coverage of these strategies as well as target models to teach them remain scarce in current instructional materials. This paper represents the first attempt to examine the application of ChatGPT in providing target models of CSs and facilitate L2 learners' strategic competence. ChatGPT-4 was used to generate transcripts of monologues and dialogues around a description task following two types of prompts: with and without a taxonomy of communication strategies (structured and unstructured prompts). Preliminary findings suggest Chat-GPT's considerable potential in modeling communication strategies. Across the two prompting conditions, the chatbot was able to present a wide range of CSs, including achievement, self-monitoring, timegaining, and interactive strategies. The highest CS content was found in the structured-prompt dialogue which utilized 9 out of 10 CS sub-types, a more diverse range than typically covered in textbooks, with approximation, circumlocution, and time gaining being most frequently used. In terms of linguistic presentation, the AI-generated transcripts demonstrated appropriate use of CSs, though their linguistic realizations were limited in range. The article concludes with implications for leveraging Chat-GPT to contextualize communication strategies, considerations for prompt engineering, strategy training to proficiency levels, and AI-teacher collaboration.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1453502
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1453502
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 25
        StartPage: 325
    Subjects:
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Computer Software
        Type: general
      – SubjectFull: Metacognition
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
      – SubjectFull: Communication Strategies
        Type: general
      – SubjectFull: Transcripts (Written Records)
        Type: general
      – SubjectFull: Taxonomy
        Type: general
      – SubjectFull: Cues
        Type: general
      – SubjectFull: Interaction
        Type: general
      – SubjectFull: Instructional Materials
        Type: general
      – SubjectFull: Computational Linguistics
        Type: general
      – SubjectFull: English (Second Language)
        Type: general
      – SubjectFull: Dialogs (Language)
        Type: general
      – SubjectFull: Task Analysis
        Type: general
    Titles:
      – TitleFull: Evaluating AI-Generated Language as Models for Strategic Competence in English Language Teaching
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Phuong-Anh Nguyen
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-electronic
              Value: 2187-0594
          Numbering:
            – Type: volume
              Value: 12
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: IAFOR Journal of Education
              Type: main
ResultId 1