Position of Correct Option and Distractors Impacts Responses to Multiple-Choice Items: Evidence from a National Test
Saved in:
| Title: | Position of Correct Option and Distractors Impacts Responses to Multiple-Choice Items: Evidence from a National Test |
|---|---|
| Language: | English |
| Authors: | Lions, Séverin (ORCID |
| Source: | Educational and Psychological Measurement. Oct 2023 83(5):861-884. |
| Availability: | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com |
| Peer Reviewed: | Y |
| Page Count: | 24 |
| Publication Date: | 2023 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education Secondary Education |
| Descriptors: | Multiple Choice Tests, Test Items, Item Analysis, Responses, Error of Measurement, High Stakes Tests, Standardized Tests, Language Processing, Interference (Learning), Academic Achievement, Foreign Countries, College Entrance Examinations, Accuracy, Difficulty Level, Comparative Analysis, Reading Processes, Secondary School Students |
| Geographic Terms: | Chile |
| DOI: | 10.1177/00131644221132335 |
| ISSN: | 0013-1644 1552-3888 |
| Abstract: | Even though the impact of the position of response options on answers to multiple-choice items has been investigated for decades, it remains debated. Research on this topic is inconclusive, perhaps because too few studies have obtained experimental data from large-sized samples in a real-world context and have manipulated the position of both correct response and distractors. Since multiple-choice tests' outcomes can be strikingly consequential and option position effects constitute a potential source of measurement error, these effects should be clarified. In this study, two experiments in which the position of correct response and distractors was carefully manipulated were performed within a Chilean national high-stakes standardized test, responded by 195,715 examinees. Results show small but clear and systematic effects of options position on examinees' responses in both experiments. They consistently indicate that a five-option item is slightly easier when the correct response is in A rather than E and when the most attractive distractor is after and far away from the correct response. They clarify and extend previous findings, showing that the appeal of all options is influenced by position. The existence and nature of a potential interference phenomenon between the options' processing are discussed, and implications for test development are considered. |
| Abstractor: | As Provided |
| Entry Date: | 2023 |
| Accession Number: | EJ1390939 |
| Database: | ERIC |
| Abstract: | Even though the impact of the position of response options on answers to multiple-choice items has been investigated for decades, it remains debated. Research on this topic is inconclusive, perhaps because too few studies have obtained experimental data from large-sized samples in a real-world context and have manipulated the position of both correct response and distractors. Since multiple-choice tests' outcomes can be strikingly consequential and option position effects constitute a potential source of measurement error, these effects should be clarified. In this study, two experiments in which the position of correct response and distractors was carefully manipulated were performed within a Chilean national high-stakes standardized test, responded by 195,715 examinees. Results show small but clear and systematic effects of options position on examinees' responses in both experiments. They consistently indicate that a five-option item is slightly easier when the correct response is in A rather than E and when the most attractive distractor is after and far away from the correct response. They clarify and extend previous findings, showing that the appeal of all options is influenced by position. The existence and nature of a potential interference phenomenon between the options' processing are discussed, and implications for test development are considered. |
|---|---|
| ISSN: | 0013-1644 1552-3888 |
| DOI: | 10.1177/00131644221132335 |
