Computation and Accuracy Evaluation of Comparable Scores on Culturally Responsive Assessments.
Saved in:
| Title: | Computation and Accuracy Evaluation of Comparable Scores on Culturally Responsive Assessments. |
|---|---|
| Authors: | Sinharay, Sandip1 (AUTHOR) ssinharay@ets.org, Johnson, Matthew S.1 (AUTHOR) |
| Source: | Journal of Educational Measurement. Mar2024, Vol. 61 Issue 1, p5-46. 42p. |
| Subject Terms: | *Computer adaptive testing, Rasch models, Multidimensional databases, Data modeling, Fairness |
| Abstract: | Culturally responsive assessments have been proposed as potential tools to ensure equity and fairness for examinees from all backgrounds including those from traditionally underserved or minoritized groups. However, these assessments are relatively new and, with few exceptions, are yet to be implemented in large scale. Consequently, there is a lack of guidance on how one can compute comparable scores on various versions of these assessments. In this paper, the multigroup multidimensional Rasch model is repurposed for modeling data originating from various versions of a culturally responsive assessment and for analyzing such data to compute comparable scores. Two simulation studies are performed to evaluate the performance of the model for data simulated from hypothetical culturally responsive assessments and to find the conditions under which the computed scores are accurate. Recommendations are made for measurement practitioners interested in culturally responsive assessments. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Educational Measurement is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 175800281 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Computation and Accuracy Evaluation of Comparable Scores on Culturally Responsive Assessments. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Sinharay%2C+Sandip%22">Sinharay, Sandip</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> ssinharay@ets.org</i><br /><searchLink fieldCode="AR" term="%22Johnson%2C+Matthew+S%2E%22">Johnson, Matthew S.</searchLink><relatesTo>1</relatesTo> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Educational+Measurement%22">Journal of Educational Measurement</searchLink>. Mar2024, Vol. 61 Issue 1, p5-46. 42p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Computer+adaptive+testing%22">Computer adaptive testing</searchLink><br /><searchLink fieldCode="DE" term="%22Rasch+models%22">Rasch models</searchLink><br /><searchLink fieldCode="DE" term="%22Multidimensional+databases%22">Multidimensional databases</searchLink><br /><searchLink fieldCode="DE" term="%22Data+modeling%22">Data modeling</searchLink><br /><searchLink fieldCode="DE" term="%22Fairness%22">Fairness</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Culturally responsive assessments have been proposed as potential tools to ensure equity and fairness for examinees from all backgrounds including those from traditionally underserved or minoritized groups. However, these assessments are relatively new and, with few exceptions, are yet to be implemented in large scale. Consequently, there is a lack of guidance on how one can compute comparable scores on various versions of these assessments. In this paper, the multigroup multidimensional Rasch model is repurposed for modeling data originating from various versions of a culturally responsive assessment and for analyzing such data to compute comparable scores. Two simulation studies are performed to evaluate the performance of the model for data simulated from hypothetical culturally responsive assessments and to find the conditions under which the computed scores are accurate. Recommendations are made for measurement practitioners interested in culturally responsive assessments. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Educational Measurement is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=175800281 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1111/jedm.12381 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 42 StartPage: 5 Subjects: – SubjectFull: Computer adaptive testing Type: general – SubjectFull: Rasch models Type: general – SubjectFull: Multidimensional databases Type: general – SubjectFull: Data modeling Type: general – SubjectFull: Fairness Type: general Titles: – TitleFull: Computation and Accuracy Evaluation of Comparable Scores on Culturally Responsive Assessments. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Sinharay, Sandip – PersonEntity: Name: NameFull: Johnson, Matthew S. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 03 Text: Mar2024 Type: published Y: 2024 Identifiers: – Type: issn-print Value: 00220655 Numbering: – Type: volume Value: 61 – Type: issue Value: 1 Titles: – TitleFull: Journal of Educational Measurement Type: main |
| ResultId | 1 |