Leveraging Performance and Feedback-Seeking Indicators from a Digital Learning Platform for Early Prediction of Students' Learning Outcomes

Saved in:
Bibliographic Details
Title: Leveraging Performance and Feedback-Seeking Indicators from a Digital Learning Platform for Early Prediction of Students' Learning Outcomes
Language: English
Authors: Teresa M. Ober (ORCID 0000-0001-9698-9543), Ying Cheng, Matthew F. Carter, Cheng Liu
Source: Journal of Computer Assisted Learning. 2024 40(1):219-240.
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 22
Publication Date: 2024
Sponsoring Agency: Institute of Education Sciences (ED)
National Science Foundation (NSF), Division of Research on Learning in Formal and Informal Settings (DRL)
Contract Number: R305A180269
1350787
Document Type: Journal Articles
Reports - Research
Education Level: High Schools
Secondary Education
Descriptors: Academic Achievement, Feedback (Response), Student Behavior, At Risk Students, Identification, Outcomes of Education, Student Educational Objectives, Electronic Learning, Advanced Placement Programs, Statistics Education, High School Students
DOI: 10.1111/jcal.12870
ISSN: 0266-4909
1365-2729
Abstract: Background: Students' tendencies to seek feedback are associated with improved learning. Yet, how soon this association becomes robust enough to make predictions about learning is not fully understood. Such knowledge has strong implications for early identification of students at-risk for underachievement via digital learning platforms. Objectives: We sought to understand how early in the academic year students' end-of-year learning outcomes could be predicted by their performance and feedback-seeking behaviours within a digital learning platform. We analysed data collected at different time points in the academic year and across different cohorts of students within the context of high school advanced placement (AP) Statistics courses. Methods: High school students enrolled in AP Statistics spanning three academic years between 2017 and 2020 (N = 726; M[subscript age] = 16.72 years) completed 3 or 4 homework assignments, each 2 and 3 months apart. Results and conclusions: Across the three cohorts, and even as early as the first assignment, a model consisting of demographic variables (gender, race/ethnicity, parental education), assignment performance, and interaction with the digital score report explained significant variation in students' final course grades (R[superscript 2] = 0.314-0.412) and AP exam scores (? = 0.583-0.689). Students' assignment performance was positively associated with end-of-year learning outcomes. Students who more frequently checked their digital score reports tended to receive better learning outcomes, though not consistently across cohorts. Implications: These findings further an understanding of how students' early performance and feedback-seeking behaviours within a digital learning platform predict end-of-year learning outcomes.
Abstractor: As Provided
Notes: https://osf.io/dnu32
IES Funded: Yes
Entry Date: 2024
Accession Number: EJ1407115
Database: ERIC
Description
Abstract:Background: Students' tendencies to seek feedback are associated with improved learning. Yet, how soon this association becomes robust enough to make predictions about learning is not fully understood. Such knowledge has strong implications for early identification of students at-risk for underachievement via digital learning platforms. Objectives: We sought to understand how early in the academic year students' end-of-year learning outcomes could be predicted by their performance and feedback-seeking behaviours within a digital learning platform. We analysed data collected at different time points in the academic year and across different cohorts of students within the context of high school advanced placement (AP) Statistics courses. Methods: High school students enrolled in AP Statistics spanning three academic years between 2017 and 2020 (N = 726; M[subscript age] = 16.72 years) completed 3 or 4 homework assignments, each 2 and 3 months apart. Results and conclusions: Across the three cohorts, and even as early as the first assignment, a model consisting of demographic variables (gender, race/ethnicity, parental education), assignment performance, and interaction with the digital score report explained significant variation in students' final course grades (R[superscript 2] = 0.314-0.412) and AP exam scores (? = 0.583-0.689). Students' assignment performance was positively associated with end-of-year learning outcomes. Students who more frequently checked their digital score reports tended to receive better learning outcomes, though not consistently across cohorts. Implications: These findings further an understanding of how students' early performance and feedback-seeking behaviours within a digital learning platform predict end-of-year learning outcomes.
ISSN:0266-4909
1365-2729
DOI:10.1111/jcal.12870