Common Persons Design in Score Equating: A Monte Carlo Investigation
Saved in:
| Title: | Common Persons Design in Score Equating: A Monte Carlo Investigation |
|---|---|
| Language: | English |
| Authors: | Jiayi Liu, Zhehan Jiang, Tianpeng Zheng, Yuting Han (ORCID |
| Source: | Educational and Psychological Measurement. 2026 86(2):320-344. |
| Availability: | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com |
| Peer Reviewed: | Y |
| Page Count: | 25 |
| Publication Date: | 2026 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Equated Scores, Accuracy, Test Length, Difficulty Level, Correlation, Test Items, Item Response Theory, Ability, Statistical Analysis, Statistical Bias |
| DOI: | 10.1177/00131644251380585 |
| ISSN: | 0013-1644 1552-3888 |
| Abstract: | The Common Persons (CP) equating design offers critical advantages for high-security testing contexts--eliminating anchor item exposure risks while accommodating non-equivalent groups--yet few studies have systematically examined how CP characteristics influence equating accuracy, and the field still lacks clear implementation guidelines. Addressing this gap, this comprehensive Monte Carlo simulation (N = 5,000 examinees per form; 500 replications) evaluates CP equating by manipulating 8 factors: test length, difficulty shift, ability dispersion, correlation between test forms and CP characteristics. Four equating methods (identity, IRT true-score, linear, equipercentile) were compared using normalized RMSE and %Bias. Key findings reveal: (a) when the CP sample size reaches at least 30, CP sample properties exert negligible influence on accuracy, challenging assumptions about distributional representativeness; (b) Test factors dominate outcomes--difficulty shifts (ΔδXY= 1) degrade IRT precision severely (|%Bias| >22% vs. linear/equipercentile's |%Bias| <1.5%), while longer tests reduce NRMSE and wider ability dispersion (σθ= 1) enhances precision through improved person-item targeting; (c) Equipercentile and linear methods demonstrate superior robustness under form differences. We establish minimum operational thresholds: ≥30 CPs covering the score range suffice for precise equating. These results provide an evidence-based framework for CP implementation by systematically examining multiple manipulated factors, resolving security-vs-accuracy tradeoffs in high-stakes equating (e.g., credentialing exams) and enabling novel solutions like synthetic respondents. |
| Abstractor: | As Provided |
| Entry Date: | 20260101 |
| Accession Number: | EJ1517664 |
| Database: | ERIC |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1517664 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Common Persons Design in Score Equating: A Monte Carlo Investigation – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Jiayi+Liu%22">Jiayi Liu</searchLink><br /><searchLink fieldCode="AR" term="%22Zhehan+Jiang%22">Zhehan Jiang</searchLink><br /><searchLink fieldCode="AR" term="%22Tianpeng+Zheng%22">Tianpeng Zheng</searchLink><br /><searchLink fieldCode="AR" term="%22Yuting+Han%22">Yuting Han</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7604-9802">0000-0001-7604-9802</externalLink>)<br /><searchLink fieldCode="AR" term="%22Shicong+Feng%22">Shicong Feng</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Educational+and+Psychological+Measurement%22"><i>Educational and Psychological Measurement</i></searchLink>. 2026 86(2):320-344. – Name: Avail Label: Availability Group: Avail Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 25 – Name: DatePubCY Label: Publication Date Group: Date Data: 2026 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Equated+Scores%22">Equated Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Accuracy%22">Accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Length%22">Test Length</searchLink><br /><searchLink fieldCode="DE" term="%22Difficulty+Level%22">Difficulty Level</searchLink><br /><searchLink fieldCode="DE" term="%22Correlation%22">Correlation</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Ability%22">Ability</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Analysis%22">Statistical Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Bias%22">Statistical Bias</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1177/00131644251380585 – Name: ISSN Label: ISSN Group: ISSN Data: 0013-1644<br />1552-3888 – Name: Abstract Label: Abstract Group: Ab Data: The Common Persons (CP) equating design offers critical advantages for high-security testing contexts--eliminating anchor item exposure risks while accommodating non-equivalent groups--yet few studies have systematically examined how CP characteristics influence equating accuracy, and the field still lacks clear implementation guidelines. Addressing this gap, this comprehensive Monte Carlo simulation (N = 5,000 examinees per form; 500 replications) evaluates CP equating by manipulating 8 factors: test length, difficulty shift, ability dispersion, correlation between test forms and CP characteristics. Four equating methods (identity, IRT true-score, linear, equipercentile) were compared using normalized RMSE and %Bias. Key findings reveal: (a) when the CP sample size reaches at least 30, CP sample properties exert negligible influence on accuracy, challenging assumptions about distributional representativeness; (b) Test factors dominate outcomes--difficulty shifts (ΔδXY= 1) degrade IRT precision severely (|%Bias| >22% vs. linear/equipercentile's |%Bias| <1.5%), while longer tests reduce NRMSE and wider ability dispersion (σθ= 1) enhances precision through improved person-item targeting; (c) Equipercentile and linear methods demonstrate superior robustness under form differences. We establish minimum operational thresholds: ≥30 CPs covering the score range suffice for precise equating. These results provide an evidence-based framework for CP implementation by systematically examining multiple manipulated factors, resolving security-vs-accuracy tradeoffs in high-stakes equating (e.g., credentialing exams) and enabling novel solutions like synthetic respondents. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 20260101 – Name: AN Label: Accession Number Group: ID Data: EJ1517664 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1517664 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1177/00131644251380585 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 25 StartPage: 320 Subjects: – SubjectFull: Equated Scores Type: general – SubjectFull: Accuracy Type: general – SubjectFull: Test Length Type: general – SubjectFull: Difficulty Level Type: general – SubjectFull: Correlation Type: general – SubjectFull: Test Items Type: general – SubjectFull: Item Response Theory Type: general – SubjectFull: Ability Type: general – SubjectFull: Statistical Analysis Type: general – SubjectFull: Statistical Bias Type: general Titles: – TitleFull: Common Persons Design in Score Equating: A Monte Carlo Investigation Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Jiayi Liu – PersonEntity: Name: NameFull: Zhehan Jiang – PersonEntity: Name: NameFull: Tianpeng Zheng – PersonEntity: Name: NameFull: Yuting Han – PersonEntity: Name: NameFull: Shicong Feng IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 04 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 0013-1644 – Type: issn-electronic Value: 1552-3888 Numbering: – Type: volume Value: 86 – Type: issue Value: 2 Titles: – TitleFull: Educational and Psychological Measurement Type: main |
| ResultId | 1 |