Exploring and Comparing Scaffolding Strategies of ChatGPT-3.5 and a Customized GPT for Reading Comprehension
Saved in:
| Title: | Exploring and Comparing Scaffolding Strategies of ChatGPT-3.5 and a Customized GPT for Reading Comprehension |
|---|---|
| Language: | English |
| Authors: | Udomsak Sirita, Richard Watson Todd |
| Source: | rEFLections. 2025 32(3):1793-1819. |
| Availability: | King Mongkut's University of Technology Thonburi School of Liberal Arts. 126 Pracha Uthit Road, Bang Mod, Thung Khru, Bangkok, Thailand 10140. Tel: +66-2470-8756; Fax: +66-2428-3375; Web site: https://so05.tci-thaijo.org/index.php/reflections/index |
| Peer Reviewed: | Y |
| Page Count: | 27 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Artificial Intelligence, Technology Uses in Education, Reading Comprehension, Foreign Countries, Undergraduate Students, Reading Tests, Multiple Choice Tests, Computer Assisted Testing, Scaffolding (Teaching Technique), Reading Instruction, Error Correction, Misconceptions, Critical Thinking, Instructional Effectiveness, Instructional Design |
| Geographic Terms: | Thailand |
| ISSN: | 1513-5934 2651-1479 |
| Abstract: | This study compares scaffolding strategies generated by ChatGPT-3.5 and a customized GPT in reading comprehension exercises to assist Thai university students in achieving a minimum CEFR B2 level as a requirement for Thai bachelor's degree programs. A prompt for ChatGPT-3.5 was designed to generate four reading passages, each with five multiple-choice questions. A similar approach was used to configure a customized GPT, also with a prepared file containing four reading passages and five multiple-choice questions. Data were collected based on the responses from both versions when two incorrect and one correct answer were selected respectively for each question. The results revealed that the customized GPT generated more meaningful and diverse scaffolding strategies, whereas ChatGPT-3.5 produced consistent but limited responses focused on specific reading strategies. Furthermore, the study found that some valuable strategies, such as misconception correction and the promotion of critical thinking, were absent in ChatGPT-3.5. While both versions offer educational value, they differ in the depth and range of scaffolds provided. Educators and researchers should carefully consider these differences when integrating generative AI into instructional design. In particular, this study highlights the importance of grounding AI-assisted learning in established pedagogical theories, such as scaffolding, to support core language skills like reading comprehension. As generative AI becomes more common in classrooms, thoughtful implementation and training for both instructors and students will be key to maximizing its potential within the Thai educational context. |
| Abstractor: | As Provided |
| Entry Date: | 2026 |
| Accession Number: | EJ1498344 |
| Database: | ERIC |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1498344 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1498344 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Exploring and Comparing Scaffolding Strategies of ChatGPT-3.5 and a Customized GPT for Reading Comprehension – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Udomsak+Sirita%22">Udomsak Sirita</searchLink><br /><searchLink fieldCode="AR" term="%22Richard+Watson+Todd%22">Richard Watson Todd</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22rEFLections%22"><i>rEFLections</i></searchLink>. 2025 32(3):1793-1819. – Name: Avail Label: Availability Group: Avail Data: King Mongkut's University of Technology Thonburi School of Liberal Arts. 126 Pracha Uthit Road, Bang Mod, Thung Khru, Bangkok, Thailand 10140. Tel: +66-2470-8756; Fax: +66-2428-3375; Web site: https://so05.tci-thaijo.org/index.php/reflections/index – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 27 – Name: DatePubCY Label: Publication Date Group: Date Data: 2025 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Comprehension%22">Reading Comprehension</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Tests%22">Reading Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Multiple+Choice+Tests%22">Multiple Choice Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Scaffolding+%28Teaching+Technique%29%22">Scaffolding (Teaching Technique)</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Instruction%22">Reading Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Error+Correction%22">Error Correction</searchLink><br /><searchLink fieldCode="DE" term="%22Misconceptions%22">Misconceptions</searchLink><br /><searchLink fieldCode="DE" term="%22Critical+Thinking%22">Critical Thinking</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Effectiveness%22">Instructional Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Design%22">Instructional Design</searchLink> – Name: Subject Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Thailand%22">Thailand</searchLink> – Name: ISSN Label: ISSN Group: ISSN Data: 1513-5934<br />2651-1479 – Name: Abstract Label: Abstract Group: Ab Data: This study compares scaffolding strategies generated by ChatGPT-3.5 and a customized GPT in reading comprehension exercises to assist Thai university students in achieving a minimum CEFR B2 level as a requirement for Thai bachelor's degree programs. A prompt for ChatGPT-3.5 was designed to generate four reading passages, each with five multiple-choice questions. A similar approach was used to configure a customized GPT, also with a prepared file containing four reading passages and five multiple-choice questions. Data were collected based on the responses from both versions when two incorrect and one correct answer were selected respectively for each question. The results revealed that the customized GPT generated more meaningful and diverse scaffolding strategies, whereas ChatGPT-3.5 produced consistent but limited responses focused on specific reading strategies. Furthermore, the study found that some valuable strategies, such as misconception correction and the promotion of critical thinking, were absent in ChatGPT-3.5. While both versions offer educational value, they differ in the depth and range of scaffolds provided. Educators and researchers should carefully consider these differences when integrating generative AI into instructional design. In particular, this study highlights the importance of grounding AI-assisted learning in established pedagogical theories, such as scaffolding, to support core language skills like reading comprehension. As generative AI becomes more common in classrooms, thoughtful implementation and training for both instructors and students will be key to maximizing its potential within the Thai educational context. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2026 – Name: AN Label: Accession Number Group: ID Data: EJ1498344 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1498344 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 27 StartPage: 1793 Subjects: – SubjectFull: Artificial Intelligence Type: general – SubjectFull: Technology Uses in Education Type: general – SubjectFull: Reading Comprehension Type: general – SubjectFull: Foreign Countries Type: general – SubjectFull: Undergraduate Students Type: general – SubjectFull: Reading Tests Type: general – SubjectFull: Multiple Choice Tests Type: general – SubjectFull: Computer Assisted Testing Type: general – SubjectFull: Scaffolding (Teaching Technique) Type: general – SubjectFull: Reading Instruction Type: general – SubjectFull: Error Correction Type: general – SubjectFull: Misconceptions Type: general – SubjectFull: Critical Thinking Type: general – SubjectFull: Instructional Effectiveness Type: general – SubjectFull: Instructional Design Type: general – SubjectFull: Thailand Type: general Titles: – TitleFull: Exploring and Comparing Scaffolding Strategies of ChatGPT-3.5 and a Customized GPT for Reading Comprehension Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Udomsak Sirita – PersonEntity: Name: NameFull: Richard Watson Todd IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 1513-5934 – Type: issn-electronic Value: 2651-1479 Numbering: – Type: volume Value: 32 – Type: issue Value: 3 Titles: – TitleFull: rEFLections Type: main |
| ResultId | 1 |