Exploring and Comparing Scaffolding Strategies of ChatGPT-3.5 and a Customized GPT for Reading Comprehension

Saved in:
Bibliographic Details
Title: Exploring and Comparing Scaffolding Strategies of ChatGPT-3.5 and a Customized GPT for Reading Comprehension
Language: English
Authors: Udomsak Sirita, Richard Watson Todd
Source: rEFLections. 2025 32(3):1793-1819.
Availability: King Mongkut's University of Technology Thonburi School of Liberal Arts. 126 Pracha Uthit Road, Bang Mod, Thung Khru, Bangkok, Thailand 10140. Tel: +66-2470-8756; Fax: +66-2428-3375; Web site: https://so05.tci-thaijo.org/index.php/reflections/index
Peer Reviewed: Y
Page Count: 27
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Artificial Intelligence, Technology Uses in Education, Reading Comprehension, Foreign Countries, Undergraduate Students, Reading Tests, Multiple Choice Tests, Computer Assisted Testing, Scaffolding (Teaching Technique), Reading Instruction, Error Correction, Misconceptions, Critical Thinking, Instructional Effectiveness, Instructional Design
Geographic Terms: Thailand
ISSN: 1513-5934
2651-1479
Abstract: This study compares scaffolding strategies generated by ChatGPT-3.5 and a customized GPT in reading comprehension exercises to assist Thai university students in achieving a minimum CEFR B2 level as a requirement for Thai bachelor's degree programs. A prompt for ChatGPT-3.5 was designed to generate four reading passages, each with five multiple-choice questions. A similar approach was used to configure a customized GPT, also with a prepared file containing four reading passages and five multiple-choice questions. Data were collected based on the responses from both versions when two incorrect and one correct answer were selected respectively for each question. The results revealed that the customized GPT generated more meaningful and diverse scaffolding strategies, whereas ChatGPT-3.5 produced consistent but limited responses focused on specific reading strategies. Furthermore, the study found that some valuable strategies, such as misconception correction and the promotion of critical thinking, were absent in ChatGPT-3.5. While both versions offer educational value, they differ in the depth and range of scaffolds provided. Educators and researchers should carefully consider these differences when integrating generative AI into instructional design. In particular, this study highlights the importance of grounding AI-assisted learning in established pedagogical theories, such as scaffolding, to support core language skills like reading comprehension. As generative AI becomes more common in classrooms, thoughtful implementation and training for both instructors and students will be key to maximizing its potential within the Thai educational context.
Abstractor: As Provided
Entry Date: 2026
Accession Number: EJ1498344
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1498344
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1498344
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Exploring and Comparing Scaffolding Strategies of ChatGPT-3.5 and a Customized GPT for Reading Comprehension
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Udomsak+Sirita%22">Udomsak Sirita</searchLink><br /><searchLink fieldCode="AR" term="%22Richard+Watson+Todd%22">Richard Watson Todd</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22rEFLections%22"><i>rEFLections</i></searchLink>. 2025 32(3):1793-1819.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: King Mongkut's University of Technology Thonburi School of Liberal Arts. 126 Pracha Uthit Road, Bang Mod, Thung Khru, Bangkok, Thailand 10140. Tel: +66-2470-8756; Fax: +66-2428-3375; Web site: https://so05.tci-thaijo.org/index.php/reflections/index
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 27
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Comprehension%22">Reading Comprehension</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Tests%22">Reading Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Multiple+Choice+Tests%22">Multiple Choice Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Scaffolding+%28Teaching+Technique%29%22">Scaffolding (Teaching Technique)</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Instruction%22">Reading Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Error+Correction%22">Error Correction</searchLink><br /><searchLink fieldCode="DE" term="%22Misconceptions%22">Misconceptions</searchLink><br /><searchLink fieldCode="DE" term="%22Critical+Thinking%22">Critical Thinking</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Effectiveness%22">Instructional Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Design%22">Instructional Design</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Thailand%22">Thailand</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1513-5934<br />2651-1479
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study compares scaffolding strategies generated by ChatGPT-3.5 and a customized GPT in reading comprehension exercises to assist Thai university students in achieving a minimum CEFR B2 level as a requirement for Thai bachelor's degree programs. A prompt for ChatGPT-3.5 was designed to generate four reading passages, each with five multiple-choice questions. A similar approach was used to configure a customized GPT, also with a prepared file containing four reading passages and five multiple-choice questions. Data were collected based on the responses from both versions when two incorrect and one correct answer were selected respectively for each question. The results revealed that the customized GPT generated more meaningful and diverse scaffolding strategies, whereas ChatGPT-3.5 produced consistent but limited responses focused on specific reading strategies. Furthermore, the study found that some valuable strategies, such as misconception correction and the promotion of critical thinking, were absent in ChatGPT-3.5. While both versions offer educational value, they differ in the depth and range of scaffolds provided. Educators and researchers should carefully consider these differences when integrating generative AI into instructional design. In particular, this study highlights the importance of grounding AI-assisted learning in established pedagogical theories, such as scaffolding, to support core language skills like reading comprehension. As generative AI becomes more common in classrooms, thoughtful implementation and training for both instructors and students will be key to maximizing its potential within the Thai educational context.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1498344
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1498344
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 27
        StartPage: 1793
    Subjects:
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
      – SubjectFull: Reading Comprehension
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Undergraduate Students
        Type: general
      – SubjectFull: Reading Tests
        Type: general
      – SubjectFull: Multiple Choice Tests
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Scaffolding (Teaching Technique)
        Type: general
      – SubjectFull: Reading Instruction
        Type: general
      – SubjectFull: Error Correction
        Type: general
      – SubjectFull: Misconceptions
        Type: general
      – SubjectFull: Critical Thinking
        Type: general
      – SubjectFull: Instructional Effectiveness
        Type: general
      – SubjectFull: Instructional Design
        Type: general
      – SubjectFull: Thailand
        Type: general
    Titles:
      – TitleFull: Exploring and Comparing Scaffolding Strategies of ChatGPT-3.5 and a Customized GPT for Reading Comprehension
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Udomsak Sirita
      – PersonEntity:
          Name:
            NameFull: Richard Watson Todd
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 1513-5934
            – Type: issn-electronic
              Value: 2651-1479
          Numbering:
            – Type: volume
              Value: 32
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: rEFLections
              Type: main
ResultId 1