View in EDS

Randomize It: Fair Procedures When Constructing Multiple-Choice Test-Keys

Saved in:
Bibliographic Details
Title: Randomize It: Fair Procedures When Constructing Multiple-Choice Test-Keys
Language: English
Authors: Joseph, Dane Christian
Source: Journal of Effective Teaching in Higher Education. Spr 2019 2(1):80-92.
Availability: Journal of Effective Teaching in Higher Education. Centers for Teaching Excellence and Faculty Leadership, University of North Carolina Wilmington, 601 South College Road, Wilmington, NC 28403. e-mail: jethe@uncw.edu; Web site: https://jethe.org/index.php/jethe
Peer Reviewed: Y
Page Count: 13
Publication Date: 2019
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Test Construction, Multiple Choice Tests, Guessing (Tests), Test Wiseness, Answer Keys, Test Interpretation, Guidelines, Science Tests, Biology, Test Format, Undergraduate Students
ISSN: 2578-7608
Abstract: Multiple-choice testing is a staple within the U.S. higher education system. From classroom assessments to standardized entrance exams such as the GRE, GMAT, or LSAT, test developers utilize a variety of validated and heuristic driven item-writing guidelines. One such guideline that has been given recent attention is to randomize the position of the correct answer throughout the entire answer key. Doing this theoretically limits the number of correct guesses that test takers can make and thus reduces the amount of construct-irrelevant variance in test score interpretations. This study empirically tested the strategy to randomize the answer-key. Specifically, a factorial ANOVA was conducted to examine differences in General Biology classroom multiple-choice test scores by the interaction of method for varying the correct answer's position and student ability. Although no statistically significant differences were found, the paper argues that the guideline is nevertheless ethically substantiated.
Abstractor: As Provided
Entry Date: 2019
Accession Number: EJ1214927
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1214927
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1214927
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Randomize It: Fair Procedures When Constructing Multiple-Choice Test-Keys
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Joseph%2C+Dane+Christian%22">Joseph, Dane Christian</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Effective+Teaching+in+Higher+Education%22"><i>Journal of Effective Teaching in Higher Education</i></searchLink>. Spr 2019 2(1):80-92.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Journal of Effective Teaching in Higher Education. Centers for Teaching Excellence and Faculty Leadership, University of North Carolina Wilmington, 601 South College Road, Wilmington, NC 28403. e-mail: jethe@uncw.edu; Web site: https://jethe.org/index.php/jethe
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 13
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2019
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Multiple+Choice+Tests%22">Multiple Choice Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Guessing+%28Tests%29%22">Guessing (Tests)</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Wiseness%22">Test Wiseness</searchLink><br /><searchLink fieldCode="DE" term="%22Answer+Keys%22">Answer Keys</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Interpretation%22">Test Interpretation</searchLink><br /><searchLink fieldCode="DE" term="%22Guidelines%22">Guidelines</searchLink><br /><searchLink fieldCode="DE" term="%22Science+Tests%22">Science Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Biology%22">Biology</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Format%22">Test Format</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2578-7608
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Multiple-choice testing is a staple within the U.S. higher education system. From classroom assessments to standardized entrance exams such as the GRE, GMAT, or LSAT, test developers utilize a variety of validated and heuristic driven item-writing guidelines. One such guideline that has been given recent attention is to randomize the position of the correct answer throughout the entire answer key. Doing this theoretically limits the number of correct guesses that test takers can make and thus reduces the amount of construct-irrelevant variance in test score interpretations. This study empirically tested the strategy to randomize the answer-key. Specifically, a factorial ANOVA was conducted to examine differences in General Biology classroom multiple-choice test scores by the interaction of method for varying the correct answer's position and student ability. Although no statistically significant differences were found, the paper argues that the guideline is nevertheless ethically substantiated.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2019
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1214927
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1214927
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 13
        StartPage: 80
    Subjects:
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Multiple Choice Tests
        Type: general
      – SubjectFull: Guessing (Tests)
        Type: general
      – SubjectFull: Test Wiseness
        Type: general
      – SubjectFull: Answer Keys
        Type: general
      – SubjectFull: Test Interpretation
        Type: general
      – SubjectFull: Guidelines
        Type: general
      – SubjectFull: Science Tests
        Type: general
      – SubjectFull: Biology
        Type: general
      – SubjectFull: Test Format
        Type: general
      – SubjectFull: Undergraduate Students
        Type: general
    Titles:
      – TitleFull: Randomize It: Fair Procedures When Constructing Multiple-Choice Test-Keys
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Joseph, Dane Christian
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2019
          Identifiers:
            – Type: issn-electronic
              Value: 2578-7608
          Numbering:
            – Type: volume
              Value: 2
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Journal of Effective Teaching in Higher Education
              Type: main
ResultId 1