View in EDS HTML Full Text PDF Full Text

Toward Evidence-Based Guidelines on Answer Keys' Placement in Multiple-Choice Tests: A Simulation Study.

Saved in:
Bibliographic Details
Title: Toward Evidence-Based Guidelines on Answer Keys' Placement in Multiple-Choice Tests: A Simulation Study.
Authors: Ortega, Gabriel (AUTHOR), Lions, Séverin (AUTHOR), Dartnell, Pablo (AUTHOR)
Source: Applied Measurement in Education. Jul-Dec2025, Vol. 38 Issue 3/4, p284-303. 20p.
Subjects: Test design, Simulation methods & models, Test methods, Test-taking skills, Test validity, Educational evaluation, Multiple choice examinations
Abstract: Multiple-choice is the most common test format in educational assessment. It offers many advantages but has one shortcoming: examinees might earn extra points through strategic guessing. Item-writing guidelines on response option placement have been formulated to prevent examinees from strategically using the answer keys' distribution as clues. However, several guidelines co-exist in literature, untested by mathematical methods. In this study, the answer keys' distributions that may emerge when implementing the most common guidelines on answer keys' placement (balancing and randomization) were modeled, and the effectiveness of using well-known option-position-based response strategies ("when in doubt, choose C"; balanced guessing) was analyzed through a simulation study. Gains obtained in the different scenarios were compared for tests with different lengths and examinees with different achievement levels. Results show that randomization is the only guideline not associated with potential test results validity or equity issues. A set of recommendations for test developers is provided. [ABSTRACT FROM AUTHOR]
Copyright of Applied Measurement in Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 192312337
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Toward Evidence-Based Guidelines on Answer Keys' Placement in Multiple-Choice Tests: A Simulation Study.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Ortega%2C+Gabriel%22">Ortega, Gabriel</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Lions%2C+Séverin%22">Lions, Séverin</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Dartnell%2C+Pablo%22">Dartnell, Pablo</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Applied+Measurement+in+Education%22">Applied Measurement in Education</searchLink>. Jul-Dec2025, Vol. 38 Issue 3/4, p284-303. 20p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Test+design%22">Test design</searchLink><br /><searchLink fieldCode="DE" term="%22Simulation+methods+%26+models%22">Simulation methods & models</searchLink><br /><searchLink fieldCode="DE" term="%22Test+methods%22">Test methods</searchLink><br /><searchLink fieldCode="DE" term="%22Test-taking+skills%22">Test-taking skills</searchLink><br /><searchLink fieldCode="DE" term="%22Test+validity%22">Test validity</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+evaluation%22">Educational evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Multiple+choice+examinations%22">Multiple choice examinations</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Multiple-choice is the most common test format in educational assessment. It offers many advantages but has one shortcoming: examinees might earn extra points through strategic guessing. Item-writing guidelines on response option placement have been formulated to prevent examinees from strategically using the answer keys' distribution as clues. However, several guidelines co-exist in literature, untested by mathematical methods. In this study, the answer keys' distributions that may emerge when implementing the most common guidelines on answer keys' placement (balancing and randomization) were modeled, and the effectiveness of using well-known option-position-based response strategies ("when in doubt, choose C"; balanced guessing) was analyzed through a simulation study. Gains obtained in the different scenarios were compared for tests with different lengths and examinees with different achievement levels. Results show that randomization is the only guideline not associated with potential test results validity or equity issues. A set of recommendations for test developers is provided. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Applied Measurement in Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=192312337
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/08957347.2025.2608017
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 20
        StartPage: 284
    Subjects:
      – SubjectFull: Test design
        Type: general
      – SubjectFull: Simulation methods & models
        Type: general
      – SubjectFull: Test methods
        Type: general
      – SubjectFull: Test-taking skills
        Type: general
      – SubjectFull: Test validity
        Type: general
      – SubjectFull: Educational evaluation
        Type: general
      – SubjectFull: Multiple choice examinations
        Type: general
    Titles:
      – TitleFull: Toward Evidence-Based Guidelines on Answer Keys' Placement in Multiple-Choice Tests: A Simulation Study.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Ortega, Gabriel
      – PersonEntity:
          Name:
            NameFull: Lions, Séverin
      – PersonEntity:
          Name:
            NameFull: Dartnell, Pablo
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Text: Jul-Dec2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 08957347
          Numbering:
            – Type: volume
              Value: 38
            – Type: issue
              Value: 3/4
          Titles:
            – TitleFull: Applied Measurement in Education
              Type: main
ResultId 1