Principled Transformers for Predictive Performance in Knowledge Tracing
Saved in:
| Title: | Principled Transformers for Predictive Performance in Knowledge Tracing |
|---|---|
| Language: | English |
| Authors: | Kai Neubauer, Yannick Rudolph, Ulf Brefeld |
| Source: | Journal of Educational Data Mining. 2026 18(1):89-112. |
| Availability: | International Educational Data Mining. e-mail: jedm.editor@gmail.com; Web site: https://jedm.educationaldatamining.org/index.php/JEDM |
| Peer Reviewed: | Y |
| Page Count: | 24 |
| Publication Date: | 2026 |
| Document Type: | Journal Articles Reports - Descriptive |
| Descriptors: | Intelligent Tutoring Systems, Knowledge Level, Models, Prediction, Learning Processes, Best Practices, Benchmarking |
| ISSN: | 2157-2100 |
| Abstract: | Knowledge tracing aims to model students' knowledge and abilities over time, which is crucial for intelligent tutoring systems. In this paper, we propose a straightforward model class, knowledge tracing set transformers" (KTSTs), specifically addressing predictive performance in "knowledge tracing tasks. KTSTs closely follow prominent transformer architectures and use an intuitive set-based representation for student interactions. We introduce "learnable ALiBi", which simplifies and improves upon a prevalent attention mechanism in knowledge tracing, and "MHSA aggregation", which readily allows incorporating an arbitrary number of additional, potentially more complex features per student interaction. We highlight and discuss flaws present in related approaches, which are overly complex and, in part, based on suboptimal design choices. We validate our design choices for KTSTs in experiments with real-world data and simulated learning sequences. Overall, we address "lessons learned" and propose a straightforward model that relies on best practices and establishes a new state-of-the-art on standardized benchmark datasets. Ultimately, KTSTs may serve as a simple but effective base model class for future research in knowledge tracing and intelligent tutoring systems. |
| Abstractor: | As Provided |
| Entry Date: | 2026 |
| Accession Number: | EJ1506613 |
| Database: | ERIC |
| Abstract: | Knowledge tracing aims to model students' knowledge and abilities over time, which is crucial for intelligent tutoring systems. In this paper, we propose a straightforward model class, knowledge tracing set transformers" (KTSTs), specifically addressing predictive performance in "knowledge tracing tasks. KTSTs closely follow prominent transformer architectures and use an intuitive set-based representation for student interactions. We introduce "learnable ALiBi", which simplifies and improves upon a prevalent attention mechanism in knowledge tracing, and "MHSA aggregation", which readily allows incorporating an arbitrary number of additional, potentially more complex features per student interaction. We highlight and discuss flaws present in related approaches, which are overly complex and, in part, based on suboptimal design choices. We validate our design choices for KTSTs in experiments with real-world data and simulated learning sequences. Overall, we address "lessons learned" and propose a straightforward model that relies on best practices and establishes a new state-of-the-art on standardized benchmark datasets. Ultimately, KTSTs may serve as a simple but effective base model class for future research in knowledge tracing and intelligent tutoring systems. |
|---|---|
| ISSN: | 2157-2100 |
