Variation Theory Meets Diagnostic Classification Models: The Case of Assessment in a Learning Study on Subtraction with Negative Numbers

Saved in:
Bibliographic Details
Title: Variation Theory Meets Diagnostic Classification Models: The Case of Assessment in a Learning Study on Subtraction with Negative Numbers
Language: English
Authors: Ahoo Sh Fard (ORCID 0000-0002-8860-8904), Frank Dige Bach (ORCID 0000-0001-5614-9064), Åke Ingerman (ORCID 0000-0002-0198-7631), Ulf Ryberg (ORCID 0009-0008-1277-7067)
Source: International Journal for Lesson and Learning Studies. 2026 15(5):17-32.
Availability: Emerald Publishing Limited. Howard House, Wagon Lane, Bingley, West Yorkshire, BD16 1WA, UK. Tel: +44-1274-777700; Fax: +44-1274-785201; e-mail: emerald@emeraldinsight.com; Web site: http://www.emerald.com/insight
Peer Reviewed: Y
Page Count: 16
Publication Date: 2026
Document Type: Journal Articles
Reports - Research
Education Level: Elementary Education
Grade 6
Intermediate Grades
Middle Schools
Descriptors: Subtraction, Numbers, Teacher Improvement, Teacher Collaboration, Grade 6, Foreign Countries, Statistical Analysis, Test Items, Models, Classification, Mathematics Tests, Learning Theories, Learning Objectives
Geographic Terms: Sweden
DOI: 10.1108/IJLLS-12-2024-0301
ISSN: 2046-8253
Abstract: Purpose: The study reports a learning study on subtraction with negative numbers based on Variation Theory (VT), with special focus on exploring the conditions for using diagnostic classification models (DCMs) for assessment. DCMs offer a multidimensional statistical modeling approach where the dimensions may mimic CAs (CAs) in VT. The study aims to within a learning study develop a knowledge test that meets DCM standards and to assess its usefulness in that context. Design/methodology/approach: Data comes from a learning study based on VT, in grade 6 in three Swedish schools. The developed teaching relied on four identified CAs that were also used to develop a knowledge test meeting the standards for DCM. The methodology involved iterative cycles of test development and statistical model evaluation, alongside qualitative methods such as think-aloud interviews. Findings: The developed test meets statistical standards implied by DCMs. Challenges in operationalizing CAs in test items are identified. Detailed information about how test-takers discerned CAs becomes available, which also may be used for the development of teaching and the articulation of CAs. In particular, the DCM analysis provided individual profiles regarding CAs, supporting a nuanced understanding of learning outcomes at the group level. Originality/value: The bridging VT and DCMs offer a comprehensive assessment of learning outcomes, emphasizing the importance of aligning tests with the object of learning. The findings suggest that DCMs can complement qualitative methods, providing a systematic and detailed analysis of students' knowledge.
Abstractor: As Provided
Entry Date: 20260101
Accession Number: EJ1503031
Database: ERIC
Description
Abstract:Purpose: The study reports a learning study on subtraction with negative numbers based on Variation Theory (VT), with special focus on exploring the conditions for using diagnostic classification models (DCMs) for assessment. DCMs offer a multidimensional statistical modeling approach where the dimensions may mimic CAs (CAs) in VT. The study aims to within a learning study develop a knowledge test that meets DCM standards and to assess its usefulness in that context. Design/methodology/approach: Data comes from a learning study based on VT, in grade 6 in three Swedish schools. The developed teaching relied on four identified CAs that were also used to develop a knowledge test meeting the standards for DCM. The methodology involved iterative cycles of test development and statistical model evaluation, alongside qualitative methods such as think-aloud interviews. Findings: The developed test meets statistical standards implied by DCMs. Challenges in operationalizing CAs in test items are identified. Detailed information about how test-takers discerned CAs becomes available, which also may be used for the development of teaching and the articulation of CAs. In particular, the DCM analysis provided individual profiles regarding CAs, supporting a nuanced understanding of learning outcomes at the group level. Originality/value: The bridging VT and DCMs offer a comprehensive assessment of learning outcomes, emphasizing the importance of aligning tests with the object of learning. The findings suggest that DCMs can complement qualitative methods, providing a systematic and detailed analysis of students' knowledge.
ISSN:2046-8253
DOI:10.1108/IJLLS-12-2024-0301