Does Preequating Work? An Investigation into a Preequated Testlet-Based College Placement Exam Using Postadministration Data. Research Report. ETS RR-12-12

Saved in:
Bibliographic Details
Title: Does Preequating Work? An Investigation into a Preequated Testlet-Based College Placement Exam Using Postadministration Data. Research Report. ETS RR-12-12
Language: English
Authors: Gao, Rui, He, Wei, Ruan, Chunyi
Source: ETS Research Report Series. Jul 2012.
Availability: Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Peer Reviewed: Y
Page Count: 22
Publication Date: 2012
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: College Entrance Examinations, Student Placement, Item Response Theory, True Scores, Equated Scores, Intellectual Disciplines, Literature Appreciation, United States Government (Course), College Mathematics, Algebra, Differences, Evaluation Criteria, Classification, Raw Scores, Scaling, Graduate Study
Assessment and Survey Identifiers: ACT Assessment, College Level Examination Program, Graduate Record Examinations, SAT (College Admission Test)
ISSN: 2330-8516
Abstract: In this study, we investigated whether preequating results agree with equating results that are based on observed operational data (postequating) for a college placement program. Specifically, we examined the degree to which item response theory (IRT) true score preequating results agreed with those from IRT true score postequating and from observed score equating. Three academic subjects were examined in this study: analyzing and interpreting literature, American government, and college algebra. The findings suggested that differences between equating results from IRT true score preequating and postequating varied from subject to subject. In general, IRT true score postequating agreed with IRT true score preequating for most of the forms for a test subject. Any difference among the equating results can be attributed to the way through which items were pretested, contextual/order effects, or the violation of IRT assumptions.
Abstractor: As Provided
Number of References: 16
Entry Date: 2016
Accession Number: EJ1109847
Database: ERIC
Description
Abstract:In this study, we investigated whether preequating results agree with equating results that are based on observed operational data (postequating) for a college placement program. Specifically, we examined the degree to which item response theory (IRT) true score preequating results agreed with those from IRT true score postequating and from observed score equating. Three academic subjects were examined in this study: analyzing and interpreting literature, American government, and college algebra. The findings suggested that differences between equating results from IRT true score preequating and postequating varied from subject to subject. In general, IRT true score postequating agreed with IRT true score preequating for most of the forms for a test subject. Any difference among the equating results can be attributed to the way through which items were pretested, contextual/order effects, or the violation of IRT assumptions.
ISSN:2330-8516