Preserving the Integrity of Study Behaviour in Online Retrieval Practice Using Quantified Learner Dynamics

Saved in:
Bibliographic Details
Title: Preserving the Integrity of Study Behaviour in Online Retrieval Practice Using Quantified Learner Dynamics
Language: English
Authors: Maarten van der Velde, Malte Krambeer, Hedderik van Rijn
Source: International Educational Data Mining Society. 2025.
Availability: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Peer Reviewed: Y
Page Count: 8
Publication Date: 2025
Document Type: Speeches/Meeting Papers
Reports - Research
Education Level: Secondary Education
Descriptors: Artificial Intelligence, Technology Uses in Education, Student Behavior, Information Retrieval, Integrity, Keyboarding (Data Entry), Secondary School Students, Foreign Countries, Cheating, Prevention, Deception
Geographic Terms: Netherlands
Abstract: Ensuring the integrity of results in online learning and assessment tools is a challenge, due to the lack of direct supervision increasing the risk of fraud. We propose and evaluate a machine learning-based method for detecting anomalous behaviour in an online retrieval practice task, using an XGBoost classifier trained on keystroke dynamics and task performance features to distinguish between genuine and fraudulent responses. The classifier requires only a modest amount of training data--approximately 100 short-answer responses, typically collected within 10 minutes of practice-- and maintains good performance when not all feature types are available. This method enhances the reliability of online learning and assessment by identifying anomalous response behaviour in a way that preserves learners' privacy. [For the complete proceedings, see ED675583.]
Abstractor: As Provided
Entry Date: 2025
Accession Number: ED675635
Database: ERIC
Description
Abstract:Ensuring the integrity of results in online learning and assessment tools is a challenge, due to the lack of direct supervision increasing the risk of fraud. We propose and evaluate a machine learning-based method for detecting anomalous behaviour in an online retrieval practice task, using an XGBoost classifier trained on keystroke dynamics and task performance features to distinguish between genuine and fraudulent responses. The classifier requires only a modest amount of training data--approximately 100 short-answer responses, typically collected within 10 minutes of practice-- and maintains good performance when not all feature types are available. This method enhances the reliability of online learning and assessment by identifying anomalous response behaviour in a way that preserves learners' privacy. [For the complete proceedings, see ED675583.]