Generative AI as a Reflective Scaffold in a UAV-Based STEM Project: A Mixed-Methods Study on Students' Higher-Order Thinking and Cognitive Transformation

Saved in:
Bibliographic Details
Title: Generative AI as a Reflective Scaffold in a UAV-Based STEM Project: A Mixed-Methods Study on Students' Higher-Order Thinking and Cognitive Transformation
Language: English
Authors: Shih-Yeh Chen, Wei-Cheng Chen, Chin-Feng Lai (ORCID 0000-0001-7138-0272)
Source: Education and Information Technologies. 2025 30(17):24787-24814.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 28
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Scaffolding (Teaching Technique), Reflection, Artificial Intelligence, STEM Education, Thinking Skills, Cognitive Processes, Engineering Education, College Students, Aviation Technology, Technology Uses in Education
DOI: 10.1007/s10639-025-13758-4
ISSN: 1360-2357
1573-7608
Abstract: In today's knowledge society, where artificial intelligence (AI) technologies are increasingly integrated into educational contexts, designing intelligent learning systems with cognitive scaffolding functions has become a critical issue in learning technology research. Unmanned Aerial Vehicle (UAV) courses, which involve mechanical assembly, sensor integration, data processing, and flight control, present a highly integrated STEM learning task and an ideal context for examining the effectiveness of generative AI-assisted learning. This study employed a quasi-experimental design involving 64 first-year engineering students, who were randomly assigned to either an experimental group or a control group to participate in a six-week UAV-based project-oriented STEM course. The experimental group interacted with a GPT-based system featuring semantic prompts and dynamic feedback to support reflective questioning and strategic adjustment, while the control group engaged in paper-based reflection activities. Independent sample t-tests revealed that students in the experimental group significantly outperformed their counterparts in STEM literacy, levels of reflection, and higher-order thinking indicators. Furthermore, thematic analysis of students' reflection records and AI dialogues demonstrated that the GPT system effectively facilitated verbalized reflection and multi-level cognitive regulation. Students' engagement gradually shifted from operational procedures to conceptually driven strategic understanding. This study confirms the feasibility of AI-supported reflection and provides concrete theoretical and practical implications for the design and evaluation of future intelligent learning systems.
Abstractor: As Provided
Entry Date: 2026
Accession Number: EJ1501366
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1501366
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Generative AI as a Reflective Scaffold in a UAV-Based STEM Project: A Mixed-Methods Study on Students' Higher-Order Thinking and Cognitive Transformation
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Shih-Yeh+Chen%22">Shih-Yeh Chen</searchLink><br /><searchLink fieldCode="AR" term="%22Wei-Cheng+Chen%22">Wei-Cheng Chen</searchLink><br /><searchLink fieldCode="AR" term="%22Chin-Feng+Lai%22">Chin-Feng Lai</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0001-7138-0272">0000-0001-7138-0272</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Education+and+Information+Technologies%22"><i>Education and Information Technologies</i></searchLink>. 2025 30(17):24787-24814.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 28
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Scaffolding+%28Teaching+Technique%29%22">Scaffolding (Teaching Technique)</searchLink><br /><searchLink fieldCode="DE" term="%22Reflection%22">Reflection</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22STEM+Education%22">STEM Education</searchLink><br /><searchLink fieldCode="DE" term="%22Thinking+Skills%22">Thinking Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Processes%22">Cognitive Processes</searchLink><br /><searchLink fieldCode="DE" term="%22Engineering+Education%22">Engineering Education</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Aviation+Technology%22">Aviation Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s10639-025-13758-4
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1360-2357<br />1573-7608
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In today's knowledge society, where artificial intelligence (AI) technologies are increasingly integrated into educational contexts, designing intelligent learning systems with cognitive scaffolding functions has become a critical issue in learning technology research. Unmanned Aerial Vehicle (UAV) courses, which involve mechanical assembly, sensor integration, data processing, and flight control, present a highly integrated STEM learning task and an ideal context for examining the effectiveness of generative AI-assisted learning. This study employed a quasi-experimental design involving 64 first-year engineering students, who were randomly assigned to either an experimental group or a control group to participate in a six-week UAV-based project-oriented STEM course. The experimental group interacted with a GPT-based system featuring semantic prompts and dynamic feedback to support reflective questioning and strategic adjustment, while the control group engaged in paper-based reflection activities. Independent sample t-tests revealed that students in the experimental group significantly outperformed their counterparts in STEM literacy, levels of reflection, and higher-order thinking indicators. Furthermore, thematic analysis of students' reflection records and AI dialogues demonstrated that the GPT system effectively facilitated verbalized reflection and multi-level cognitive regulation. Students' engagement gradually shifted from operational procedures to conceptually driven strategic understanding. This study confirms the feasibility of AI-supported reflection and provides concrete theoretical and practical implications for the design and evaluation of future intelligent learning systems.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1501366
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1501366
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s10639-025-13758-4
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 28
        StartPage: 24787
    Subjects:
      – SubjectFull: Scaffolding (Teaching Technique)
        Type: general
      – SubjectFull: Reflection
        Type: general
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: STEM Education
        Type: general
      – SubjectFull: Thinking Skills
        Type: general
      – SubjectFull: Cognitive Processes
        Type: general
      – SubjectFull: Engineering Education
        Type: general
      – SubjectFull: College Students
        Type: general
      – SubjectFull: Aviation Technology
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
    Titles:
      – TitleFull: Generative AI as a Reflective Scaffold in a UAV-Based STEM Project: A Mixed-Methods Study on Students' Higher-Order Thinking and Cognitive Transformation
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Shih-Yeh Chen
      – PersonEntity:
          Name:
            NameFull: Wei-Cheng Chen
      – PersonEntity:
          Name:
            NameFull: Chin-Feng Lai
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 1360-2357
            – Type: issn-electronic
              Value: 1573-7608
          Numbering:
            – Type: volume
              Value: 30
            – Type: issue
              Value: 17
          Titles:
            – TitleFull: Education and Information Technologies
              Type: main
ResultId 1