View in EDS

Comparing two psychometric approaches: The case of item analysis for a classroom test in mathematics.

Saved in:
Bibliographic Details
Title: Comparing two psychometric approaches: The case of item analysis for a classroom test in mathematics.
Authors: Garcia, Mark Lester B.1 mark.garcia@student.ateneo.edu, Santos, Kevin Carl P.1 cvistro-yu@ateneo.edu, Vistro-Yu, Catherine P.2 kpsantos1@up.edu.ph
Source: International Journal of Education & Practice (2311-6897). 2025, Vol. 13 Issue 1, p327-344. 18p.
Subject Terms: *Item response theory, *Summative tests, *Classical test theory, *Standardized tests, Parameter estimation, Psychometrics
Abstract: Multiple-choice and constructed-response item formats are widely used in Philippine classrooms where tests are primarily summative. Conducting item analysis provides teachers the professional possibility to independently improve their test items while also allowing them to make informed decisions about test improvement and ensure that their assessments provide meaningful scores. Comparisons of item analysis approaches have been extensively used in standardized tests but not so much in smallscale testing such as classroom assessments. Hence, this research reports an empirical study where a summative test for classroom use is analyzed using psychometric techniques from the Classical Test Theory (CTT) and the Item Response Theory (IRT). This study employs an action research design where the primary author being a teaching practitioner-researcher, reports how an item analysis of his teacher-made summative test was conducted to improve the test items. Results from this study show that interpretations of the item parameter estimates from both psychometric approaches, CTT and IRT agree on most of the recommendations for the items. The items where the two approaches provide contrasting recommendations call for a further qualitative evaluation of the flagged items putting the teacher in a judicious position to discern which recommendations to follow regarding the concerned items. In the context of this study, an example of a guiding insight in deciding would be reflecting on the learning objectives measured by the test and the context in which the test was created. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Education & Practice (2311-6897) is the property of Conscientia Beam and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Description
Abstract:Multiple-choice and constructed-response item formats are widely used in Philippine classrooms where tests are primarily summative. Conducting item analysis provides teachers the professional possibility to independently improve their test items while also allowing them to make informed decisions about test improvement and ensure that their assessments provide meaningful scores. Comparisons of item analysis approaches have been extensively used in standardized tests but not so much in smallscale testing such as classroom assessments. Hence, this research reports an empirical study where a summative test for classroom use is analyzed using psychometric techniques from the Classical Test Theory (CTT) and the Item Response Theory (IRT). This study employs an action research design where the primary author being a teaching practitioner-researcher, reports how an item analysis of his teacher-made summative test was conducted to improve the test items. Results from this study show that interpretations of the item parameter estimates from both psychometric approaches, CTT and IRT agree on most of the recommendations for the items. The items where the two approaches provide contrasting recommendations call for a further qualitative evaluation of the flagged items putting the teacher in a judicious position to discern which recommendations to follow regarding the concerned items. In the context of this study, an example of a guiding insight in deciding would be reflecting on the learning objectives measured by the test and the context in which the test was created. [ABSTRACT FROM AUTHOR]
ISSN:23116897
DOI:10.18488/61.v13i1.4060