View in EDS

Determining Item Screening Criteria Using Cost-Benefit Analysis

Saved in:
Bibliographic Details
Title: Determining Item Screening Criteria Using Cost-Benefit Analysis
Language: English
Authors: Bashkov, Bozhidar M., Clauser, Jerome C.
Source: Practical Assessment, Research & Evaluation. Apr 2019 24(2).
Availability: Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare
Peer Reviewed: Y
Page Count: 9
Publication Date: 2019
Document Type: Journal Articles
Reports - Research
Descriptors: Test Items, Test Reliability, Evaluation Criteria, Accuracy, High Stakes Tests, Item Response Theory, Item Sampling, Classification, Pass Fail Grading, Certification, Medical Education, Statistical Analysis
ISSN: 1531-7714
Abstract: Successful testing programs rely on high-quality test items to produce reliable scores and defensible exams. However, determining what statistical screening criteria are most appropriate to support these goals can be daunting. This study describes and demonstrates cost-benefit analysis as an empirical approach to determining appropriate screening criteria for a given testing program and purpose. Using a certification exam's item pool and simulation we illustrate how to examine a wide range of screening criteria and reach an acceptable balance between the number of items screened out (cost) and pass/fail classification accuracy (benefit).
Abstractor: As Provided
Entry Date: 2019
Accession Number: EJ1214891
Database: ERIC
Description
Abstract:Successful testing programs rely on high-quality test items to produce reliable scores and defensible exams. However, determining what statistical screening criteria are most appropriate to support these goals can be daunting. This study describes and demonstrates cost-benefit analysis as an empirical approach to determining appropriate screening criteria for a given testing program and purpose. Using a certification exam's item pool and simulation we illustrate how to examine a wide range of screening criteria and reach an acceptable balance between the number of items screened out (cost) and pass/fail classification accuracy (benefit).
ISSN:1531-7714