An Experimental Validation of Sequential Multiple-Choice Tests.
Saved in:
| Title: | An Experimental Validation of Sequential Multiple-Choice Tests. |
|---|---|
| Authors: | Papenberg, Martin (AUTHOR), Diedenhofen, Birk (AUTHOR), Musch, Jochen (AUTHOR) |
| Source: | Journal of Experimental Education. 2021, Vol. 89 Issue 2, p402-421. 20p. 1 Chart, 1 Graph. |
| Subjects: | Psychometrics, Test scoring, Prior learning, Test validity, Examinations |
| Abstract: | Testwiseness may introduce construct-irrelevant variance to multiple-choice test scores. Presenting response options sequentially has been proposed as a potential solution to this problem. In an experimental validation, we determined the psychometric properties of a test based on the sequential presentation of response options. We created a strong validity criterion by providing participants with different levels of information on a domain about which they had no prior knowledge. Test takers' capability of guessing the correct answer was strongly reduced by the sequential test format, whereas sequential test scores were as valid and reliable as multiple-choice test scores. We concluded that the sequential presentation of response options should be investigated more closely as a viable alternative to the traditional multiple-choice test format. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Experimental Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Testwiseness may introduce construct-irrelevant variance to multiple-choice test scores. Presenting response options sequentially has been proposed as a potential solution to this problem. In an experimental validation, we determined the psychometric properties of a test based on the sequential presentation of response options. We created a strong validity criterion by providing participants with different levels of information on a domain about which they had no prior knowledge. Test takers' capability of guessing the correct answer was strongly reduced by the sequential test format, whereas sequential test scores were as valid and reliable as multiple-choice test scores. We concluded that the sequential presentation of response options should be investigated more closely as a viable alternative to the traditional multiple-choice test format. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 00220973 |
| DOI: | 10.1080/00220973.2019.1671299 |
