View in EDS

Determining Item Screening Criteria Using Cost-Benefit Analysis

Saved in:
Bibliographic Details
Title: Determining Item Screening Criteria Using Cost-Benefit Analysis
Language: English
Authors: Bashkov, Bozhidar M., Clauser, Jerome C.
Source: Practical Assessment, Research & Evaluation. Apr 2019 24(2).
Availability: Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare
Peer Reviewed: Y
Page Count: 9
Publication Date: 2019
Document Type: Journal Articles
Reports - Research
Descriptors: Test Items, Test Reliability, Evaluation Criteria, Accuracy, High Stakes Tests, Item Response Theory, Item Sampling, Classification, Pass Fail Grading, Certification, Medical Education, Statistical Analysis
ISSN: 1531-7714
Abstract: Successful testing programs rely on high-quality test items to produce reliable scores and defensible exams. However, determining what statistical screening criteria are most appropriate to support these goals can be daunting. This study describes and demonstrates cost-benefit analysis as an empirical approach to determining appropriate screening criteria for a given testing program and purpose. Using a certification exam's item pool and simulation we illustrate how to examine a wide range of screening criteria and reach an acceptable balance between the number of items screened out (cost) and pass/fail classification accuracy (benefit).
Abstractor: As Provided
Entry Date: 2019
Accession Number: EJ1214891
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1214891
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1214891
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Determining Item Screening Criteria Using Cost-Benefit Analysis
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Bashkov%2C+Bozhidar+M%2E%22">Bashkov, Bozhidar M.</searchLink><br /><searchLink fieldCode="AR" term="%22Clauser%2C+Jerome+C%2E%22">Clauser, Jerome C.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Practical+Assessment%2C+Research+%26+Evaluation%22"><i>Practical Assessment, Research & Evaluation</i></searchLink>. Apr 2019 24(2).
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 9
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2019
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Criteria%22">Evaluation Criteria</searchLink><br /><searchLink fieldCode="DE" term="%22Accuracy%22">Accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22High+Stakes+Tests%22">High Stakes Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Sampling%22">Item Sampling</searchLink><br /><searchLink fieldCode="DE" term="%22Classification%22">Classification</searchLink><br /><searchLink fieldCode="DE" term="%22Pass+Fail+Grading%22">Pass Fail Grading</searchLink><br /><searchLink fieldCode="DE" term="%22Certification%22">Certification</searchLink><br /><searchLink fieldCode="DE" term="%22Medical+Education%22">Medical Education</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Analysis%22">Statistical Analysis</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1531-7714
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Successful testing programs rely on high-quality test items to produce reliable scores and defensible exams. However, determining what statistical screening criteria are most appropriate to support these goals can be daunting. This study describes and demonstrates cost-benefit analysis as an empirical approach to determining appropriate screening criteria for a given testing program and purpose. Using a certification exam's item pool and simulation we illustrate how to examine a wide range of screening criteria and reach an acceptable balance between the number of items screened out (cost) and pass/fail classification accuracy (benefit).
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2019
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1214891
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1214891
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 9
    Subjects:
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Test Reliability
        Type: general
      – SubjectFull: Evaluation Criteria
        Type: general
      – SubjectFull: Accuracy
        Type: general
      – SubjectFull: High Stakes Tests
        Type: general
      – SubjectFull: Item Response Theory
        Type: general
      – SubjectFull: Item Sampling
        Type: general
      – SubjectFull: Classification
        Type: general
      – SubjectFull: Pass Fail Grading
        Type: general
      – SubjectFull: Certification
        Type: general
      – SubjectFull: Medical Education
        Type: general
      – SubjectFull: Statistical Analysis
        Type: general
    Titles:
      – TitleFull: Determining Item Screening Criteria Using Cost-Benefit Analysis
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Bashkov, Bozhidar M.
      – PersonEntity:
          Name:
            NameFull: Clauser, Jerome C.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Type: published
              Y: 2019
          Identifiers:
            – Type: issn-electronic
              Value: 1531-7714
          Numbering:
            – Type: volume
              Value: 24
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Practical Assessment, Research & Evaluation
              Type: main
ResultId 1