Using Full-Information Item Analysis to Improve Item Quality
Saved in:
| Title: | Using Full-Information Item Analysis to Improve Item Quality |
|---|---|
| Language: | English |
| Authors: | Haladyna, Thomas M., Rodriguez, Michael C. |
| Source: | Educational Assessment. 2021 26(3):198-211. |
| Availability: | Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals |
| Peer Reviewed: | Y |
| Page Count: | 14 |
| Publication Date: | 2021 |
| Document Type: | Journal Articles Reports - Descriptive |
| Education Level: | Elementary Education Grade 6 Intermediate Grades Middle Schools |
| Descriptors: | Test Items, Item Analysis, Reading Tests, Mathematics Tests, Grade 6, Difficulty Level |
| DOI: | 10.1080/10627197.2021.1946390 |
| ISSN: | 1062-7197 |
| Abstract: | Full-information item analysis provides item developers and reviewers comprehensive empirical evidence of item quality, including option response frequency, point-biserial index (PBI) for distractors, mean-scores of respondents selecting each option, and option trace lines. The multi-serial index (MSI) is introduced as a more informative item-total correlation, accounting for variable distractor performance. The overall item PBI is empirically compared to the MSI. For items from an operational mathematics and reading test, poorly performing distractors are systematically removed to recompute the MSI, indicating improvements in item quality. Case studies for specific items with different characteristics are described to illustrate a variety of outcomes, focused on improving item discrimination. Full-information item analyses are presented for each case study item, providing clear examples of interpretation and use of item analyses. A summary of recommendations for item analysts is provided. |
| Abstractor: | As Provided |
| Entry Date: | 2021 |
| Accession Number: | EJ1309544 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Full-information item analysis provides item developers and reviewers comprehensive empirical evidence of item quality, including option response frequency, point-biserial index (PBI) for distractors, mean-scores of respondents selecting each option, and option trace lines. The multi-serial index (MSI) is introduced as a more informative item-total correlation, accounting for variable distractor performance. The overall item PBI is empirically compared to the MSI. For items from an operational mathematics and reading test, poorly performing distractors are systematically removed to recompute the MSI, indicating improvements in item quality. Case studies for specific items with different characteristics are described to illustrate a variety of outcomes, focused on improving item discrimination. Full-information item analyses are presented for each case study item, providing clear examples of interpretation and use of item analyses. A summary of recommendations for item analysts is provided. |
|---|---|
| ISSN: | 1062-7197 |
| DOI: | 10.1080/10627197.2021.1946390 |
