Tracking Students' Progression in Developing Understanding of Energy Using AI Technologies

Saved in:
Bibliographic Details
Title: Tracking Students' Progression in Developing Understanding of Energy Using AI Technologies
Language: English
Authors: Tobias Wyrwich, Marcus Kubsch (ORCID 0000-0001-5497-8336), Hendrik Drachsler, Knut Neumann (ORCID 0000-0002-4391-7308)
Source: Physical Review Physics Education Research. 2025 21(1).
Availability: American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: https://journals.aps.org/prper/
Peer Reviewed: Y
Page Count: 17
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: High Schools
Secondary Education
Descriptors: Learning Processes, Physics, Energy, Science Instruction, Artificial Intelligence, Technology Integration, Longitudinal Studies, Natural Language Processing, Learning Trajectories, Climate, Computer Software, Feedback (Response), Scores, Units of Study, High School Students, Foreign Countries
Geographic Terms: Germany
DOI: 10.1103/PhysRevPhysEducRes.21.010152
ISSN: 2469-9896
Abstract: Students struggle to acquire the needed energy understanding to meaningfully participate in the energy discourse about socially relevant topics, such as energy transformation or climate change. Identifying students on differing learning trajectories, as well as differences in knowledge used, is essential to help students achieve the needed energy understanding. Collecting and analyzing the longitudinal and fine-grained data necessary for this represents a substantial challenge. However, the use of a digital workbook, which captures all interaction data, has enabled us to collect such data from N=548 students (data from 172 students were analyzed after applying exclusion criteria). Using machine learning and natural language processing, we analyzed the data to identify productive and unproductive learning trajectories and their underlying reasons. The learning trajectories were classified according to the post-test score. To analyze the tasks from the digital workbook, machine learning methods, specifically random forest, and natural language processing, were employed to identify how students on different learning trajectories progress through the unit. The random forest analysis was accurate in distinguishing between productive and unproductive learning trajectories. Furthermore, natural language processing was employed to analyze open-ended responses, which revealed disparities in the knowledge elements that students on productive and unproductive trajectories utilized. The findings of this study indicate that machine learning techniques have the potential to provide valuable insights into student learning trajectories, which can inform the design of instructional units and the feedback provided to teachers and students. [This paper is part of the Focused Collection in Artificial Intelligence Tools in Physics Teaching and Physics Education Research.]
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1478004
Database: ERIC
Description
Abstract:Students struggle to acquire the needed energy understanding to meaningfully participate in the energy discourse about socially relevant topics, such as energy transformation or climate change. Identifying students on differing learning trajectories, as well as differences in knowledge used, is essential to help students achieve the needed energy understanding. Collecting and analyzing the longitudinal and fine-grained data necessary for this represents a substantial challenge. However, the use of a digital workbook, which captures all interaction data, has enabled us to collect such data from N=548 students (data from 172 students were analyzed after applying exclusion criteria). Using machine learning and natural language processing, we analyzed the data to identify productive and unproductive learning trajectories and their underlying reasons. The learning trajectories were classified according to the post-test score. To analyze the tasks from the digital workbook, machine learning methods, specifically random forest, and natural language processing, were employed to identify how students on different learning trajectories progress through the unit. The random forest analysis was accurate in distinguishing between productive and unproductive learning trajectories. Furthermore, natural language processing was employed to analyze open-ended responses, which revealed disparities in the knowledge elements that students on productive and unproductive trajectories utilized. The findings of this study indicate that machine learning techniques have the potential to provide valuable insights into student learning trajectories, which can inform the design of instructional units and the feedback provided to teachers and students. [This paper is part of the Focused Collection in Artificial Intelligence Tools in Physics Teaching and Physics Education Research.]
ISSN:2469-9896
DOI:10.1103/PhysRevPhysEducRes.21.010152