View in EDS

On Examinee Choice in Educational Testing. GRE Board Professional Report No. 91-17P.

Saved in:
Bibliographic Details
Title: On Examinee Choice in Educational Testing. GRE Board Professional Report No. 91-17P.
Language: English
Authors: Wainer, Howard, Thissen, David, Educational Testing Service, Princeton, NJ. Graduate Record Examination Board Program.
Peer Reviewed: N
Page Count: 42
Publication Date: 1994
Document Type: Information Analyses
Reports - Evaluative
Descriptors: Constructed Response, Difficulty Level, Educational Testing, Equated Scores, Individual Testing, Item Banks, Literature Reviews, Test Bias, Test Construction, Test Format, Test Items, Test Length
Abstract: When an examination consists in whole or part of constructed response test items, it is common practice to allow the examinee to choose a subset of the constructed response questions from a larger pool. It is sometimes argued that, if choice were not allowed, the limitations on domain coverage forced by the small number of items might unfairly affect some examinees. Alternatives, such as increasing test length or confining questions to a core curriculum, might discourage teachers because of practical considerations. In this consideration of whether allowing examinee choice is a sensible strategy, some of the pitfalls of allowing choice are described. Some experimental steps that can tell whether choice can be implemented fairly are discussed. A bleak picture of the use of examinee choice emerges. To make tests with choice fair requires equating the test forms generated by the tests for their differential difficulty. Accomplishing this requires some special data gathering effort or trust in assumptions about unobserved responses that, if true, obviate the need for choice. If test items can be equated successfully, the value of choice is removed for any but the most superficial sense. Eight tables and seven figures illustrate the discussion. (Contains 40 references.) (SLD)
Entry Date: 1995
Accession Number: ED381555
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED381555
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED381555
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: On Examinee Choice in Educational Testing. GRE Board Professional Report No. 91-17P.
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Wainer%2C+Howard%22">Wainer, Howard</searchLink><br /><searchLink fieldCode="AR" term="%22Thissen%2C+David%22">Thissen, David</searchLink><br /><searchLink fieldCode="AR" term="%22Educational+Testing+Service%2C+Princeton%2C+NJ%2E+Graduate+Record+Examination+Board+Program%2E%22">Educational Testing Service, Princeton, NJ. Graduate Record Examination Board Program.</searchLink>
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 42
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 1994
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Information Analyses<br />Reports - Evaluative
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Constructed+Response%22">Constructed Response</searchLink><br /><searchLink fieldCode="DE" term="%22Difficulty+Level%22">Difficulty Level</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Testing%22">Educational Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Equated+Scores%22">Equated Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Individual+Testing%22">Individual Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Banks%22">Item Banks</searchLink><br /><searchLink fieldCode="DE" term="%22Literature+Reviews%22">Literature Reviews</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Bias%22">Test Bias</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Format%22">Test Format</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Length%22">Test Length</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: When an examination consists in whole or part of constructed response test items, it is common practice to allow the examinee to choose a subset of the constructed response questions from a larger pool. It is sometimes argued that, if choice were not allowed, the limitations on domain coverage forced by the small number of items might unfairly affect some examinees. Alternatives, such as increasing test length or confining questions to a core curriculum, might discourage teachers because of practical considerations. In this consideration of whether allowing examinee choice is a sensible strategy, some of the pitfalls of allowing choice are described. Some experimental steps that can tell whether choice can be implemented fairly are discussed. A bleak picture of the use of examinee choice emerges. To make tests with choice fair requires equating the test forms generated by the tests for their differential difficulty. Accomplishing this requires some special data gathering effort or trust in assumptions about unobserved responses that, if true, obviate the need for choice. If test items can be equated successfully, the value of choice is removed for any but the most superficial sense. Eight tables and seven figures illustrate the discussion. (Contains 40 references.) (SLD)
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 1995
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED381555
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED381555
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 42
    Subjects:
      – SubjectFull: Constructed Response
        Type: general
      – SubjectFull: Difficulty Level
        Type: general
      – SubjectFull: Educational Testing
        Type: general
      – SubjectFull: Equated Scores
        Type: general
      – SubjectFull: Individual Testing
        Type: general
      – SubjectFull: Item Banks
        Type: general
      – SubjectFull: Literature Reviews
        Type: general
      – SubjectFull: Test Bias
        Type: general
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Test Format
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Test Length
        Type: general
    Titles:
      – TitleFull: On Examinee Choice in Educational Testing. GRE Board Professional Report No. 91-17P.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Educational Testing Service, Princeton, NJ. Graduate Record Examination Board Program.
      – PersonEntity:
          Name:
            NameFull: Wainer, Howard
      – PersonEntity:
          Name:
            NameFull: Thissen, David
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Type: published
              Y: 1994
ResultId 1