View in EDS HTML Full Text PDF Full Text

An Experimental Validation of Sequential Multiple-Choice Tests.

Saved in:
Bibliographic Details
Title: An Experimental Validation of Sequential Multiple-Choice Tests.
Authors: Papenberg, Martin (AUTHOR), Diedenhofen, Birk (AUTHOR), Musch, Jochen (AUTHOR)
Source: Journal of Experimental Education. 2021, Vol. 89 Issue 2, p402-421. 20p. 1 Chart, 1 Graph.
Subjects: Psychometrics, Test scoring, Prior learning, Test validity, Examinations
Abstract: Testwiseness may introduce construct-irrelevant variance to multiple-choice test scores. Presenting response options sequentially has been proposed as a potential solution to this problem. In an experimental validation, we determined the psychometric properties of a test based on the sequential presentation of response options. We created a strong validity criterion by providing participants with different levels of information on a domain about which they had no prior knowledge. Test takers' capability of guessing the correct answer was strongly reduced by the sequential test format, whereas sequential test scores were as valid and reliable as multiple-choice test scores. We concluded that the sequential presentation of response options should be investigated more closely as a viable alternative to the traditional multiple-choice test format. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Experimental Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 148447505
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: An Experimental Validation of Sequential Multiple-Choice Tests.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Papenberg%2C+Martin%22">Papenberg, Martin</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Diedenhofen%2C+Birk%22">Diedenhofen, Birk</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Musch%2C+Jochen%22">Musch, Jochen</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Experimental+Education%22">Journal of Experimental Education</searchLink>. 2021, Vol. 89 Issue 2, p402-421. 20p. 1 Chart, 1 Graph.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Test+scoring%22">Test scoring</searchLink><br /><searchLink fieldCode="DE" term="%22Prior+learning%22">Prior learning</searchLink><br /><searchLink fieldCode="DE" term="%22Test+validity%22">Test validity</searchLink><br /><searchLink fieldCode="DE" term="%22Examinations%22">Examinations</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Testwiseness may introduce construct-irrelevant variance to multiple-choice test scores. Presenting response options sequentially has been proposed as a potential solution to this problem. In an experimental validation, we determined the psychometric properties of a test based on the sequential presentation of response options. We created a strong validity criterion by providing participants with different levels of information on a domain about which they had no prior knowledge. Test takers' capability of guessing the correct answer was strongly reduced by the sequential test format, whereas sequential test scores were as valid and reliable as multiple-choice test scores. We concluded that the sequential presentation of response options should be investigated more closely as a viable alternative to the traditional multiple-choice test format. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Experimental Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=148447505
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/00220973.2019.1671299
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 20
        StartPage: 402
    Subjects:
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Test scoring
        Type: general
      – SubjectFull: Prior learning
        Type: general
      – SubjectFull: Test validity
        Type: general
      – SubjectFull: Examinations
        Type: general
    Titles:
      – TitleFull: An Experimental Validation of Sequential Multiple-Choice Tests.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Papenberg, Martin
      – PersonEntity:
          Name:
            NameFull: Diedenhofen, Birk
      – PersonEntity:
          Name:
            NameFull: Musch, Jochen
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Text: 2021
              Type: published
              Y: 2021
          Identifiers:
            – Type: issn-print
              Value: 00220973
          Numbering:
            – Type: volume
              Value: 89
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Journal of Experimental Education
              Type: main
ResultId 1