Rethinking 'Standardization' for NAEP to Increase Equity and Access. Technical Report #2510
Saved in:
| Title: | Rethinking 'Standardization' for NAEP to Increase Equity and Access. Technical Report #2510 |
|---|---|
| Language: | English |
| Authors: | Gerald Tindal, University of Oregon, Behavioral Research and Teaching (BRT) |
| Source: | Behavioral Research and Teaching. 2025. |
| Availability: | Behavioral Research and Teaching. 175 Lokey Education 5262 University of Oregon, Eugene, OR 97403. Tel: 541-346-3535; Fax: 541-346-5689; Web site: http://www.brtprojects.org |
| Peer Reviewed: | N |
| Page Count: | 65 |
| Publication Date: | 2025 |
| Document Type: | Reports - Research |
| Descriptors: | National Competency Tests, Academic Standards, Equal Education, Access to Education, Educational Testing, Psychological Testing, Testing Accommodations, Students with Disabilities, English Learners, Adaptive Testing, Data Collection, Test Format |
| Assessment and Survey Identifiers: | National Assessment of Educational Progress |
| Abstract: | The National Assessment of Educational Progress (NAEP) is the largest nationally representative and continuing assessment of what students in the United States know and can do in various subjects. NAEP first encountered tensions between standardization and inclusion in the mid-1990s after the passage of the Education for All Handicapped Children Act (Public Law 94-142) in 1975 and the Individuals with Disabilities Education Act (IDEA) in 1990. A second challenge related to standardization arose in the early 2000s as NAEP began new testing methods and question types that reflected the growing use of technology in education. NAEP is currently facing a third challenge related to standardization as it considers adaptations to administration. The focus of this paper is to discuss research and possible adaptations for NAEP in the setting, administration, and scoring by extending Sireci's (2020) perspective on standardization: "In educational testing, 'students' are the most important part of the measurement process, not the measure itself, or the measurement scale" (p. 100). With this orientation, the primary goal is to better understand testing conditions and how they interact with student characteristics, which may require flexibility. In Sireci's examples, culturally responsive assessments allow students to rely on their funds of knowledge through translanguaging (e.g., bilingual test delivery systems). Other illustrations address flexibility in the testing environment that allow students to take the test using their own equipment (e.g., computers, devices, and software), selecting their own passages or writing prompts, and adapting the language for taking tests. In this paper, test adaptations are examined that might allow more flexibility in NAEP test administration, citing relevant research and current practices to test adaptations. This paper has seven major sections: (1) Defining test adaptations, both within the Standards for Educational and Psychological Testing; hereafter "Standards" (American Educational Research Association [AERA], American Psychological Association, & National Council on Measurement in Education, 2014) and as practiced within the NAEP program: accommodations, designated supports, and universal designs; (2) Summaries of the research previously conducted on a particular type of test adaptation, covering the extensive research on accommodations, both specific to NAEP and in general, as relevant to large-scale testing programs to establish a more expansive view of accommodations as measured by the significance of difference and consistency of outcomes within and across performance levels; (3) Focus to an even broader and more practical view of test adaptations by referencing state policies and practices as well as the consistency of adaptations across testing platforms; (4) Understand test adaptations for students beyond labels and categorical characteristics to understand their impact. This issue is critical, given the common lament by researchers that student samples often are only vaguely described; and (5) Speculations beyond research and practice, considering both function and format of the process, with two specific explications. An example in writing focuses on constructs and applies this logic to the content and constructs of reading. Three specific questions are posed for defining test adaptations, emphasizing universality for improving equity and access to a more diverse population of students. Within each section, recommendations are offered that NAEP may consider that provide greater flexibility in administration and measurement in the service of increasing equity and access; these recommendations are preceded by the abbreviation 'Rx.' Finally, a summary of these recommendations is presented, along with suggestions for future research. |
| Abstractor: | ERIC |
| Entry Date: | 2026 |
| Accession Number: | ED679444 |
| Database: | ERIC |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED679444 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: ED679444 AccessLevel: 3 PubType: Report PubTypeId: report PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Rethinking 'Standardization' for NAEP to Increase Equity and Access. Technical Report #2510 – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Gerald+Tindal%22">Gerald Tindal</searchLink><br /><searchLink fieldCode="AR" term="%22University+of+Oregon%2C+Behavioral+Research+and+Teaching+%28BRT%29%22">University of Oregon, Behavioral Research and Teaching (BRT)</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Behavioral+Research+and+Teaching%22"><i>Behavioral Research and Teaching</i></searchLink>. 2025. – Name: Avail Label: Availability Group: Avail Data: Behavioral Research and Teaching. 175 Lokey Education 5262 University of Oregon, Eugene, OR 97403. Tel: 541-346-3535; Fax: 541-346-5689; Web site: http://www.brtprojects.org – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: N – Name: Pages Label: Page Count Group: Src Data: 65 – Name: DatePubCY Label: Publication Date Group: Date Data: 2025 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Reports - Research – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22National+Competency+Tests%22">National Competency Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Academic+Standards%22">Academic Standards</searchLink><br /><searchLink fieldCode="DE" term="%22Equal+Education%22">Equal Education</searchLink><br /><searchLink fieldCode="DE" term="%22Access+to+Education%22">Access to Education</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Testing%22">Educational Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Psychological+Testing%22">Psychological Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Testing+Accommodations%22">Testing Accommodations</searchLink><br /><searchLink fieldCode="DE" term="%22Students+with+Disabilities%22">Students with Disabilities</searchLink><br /><searchLink fieldCode="DE" term="%22English+Learners%22">English Learners</searchLink><br /><searchLink fieldCode="DE" term="%22Adaptive+Testing%22">Adaptive Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Collection%22">Data Collection</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Format%22">Test Format</searchLink> – Name: SubjectThesaurus Label: Assessment and Survey Identifiers Group: Su Data: <searchLink fieldCode="SU" term="%22National+Assessment+of+Educational+Progress%22">National Assessment of Educational Progress</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: The National Assessment of Educational Progress (NAEP) is the largest nationally representative and continuing assessment of what students in the United States know and can do in various subjects. NAEP first encountered tensions between standardization and inclusion in the mid-1990s after the passage of the Education for All Handicapped Children Act (Public Law 94-142) in 1975 and the Individuals with Disabilities Education Act (IDEA) in 1990. A second challenge related to standardization arose in the early 2000s as NAEP began new testing methods and question types that reflected the growing use of technology in education. NAEP is currently facing a third challenge related to standardization as it considers adaptations to administration. The focus of this paper is to discuss research and possible adaptations for NAEP in the setting, administration, and scoring by extending Sireci's (2020) perspective on standardization: "In educational testing, 'students' are the most important part of the measurement process, not the measure itself, or the measurement scale" (p. 100). With this orientation, the primary goal is to better understand testing conditions and how they interact with student characteristics, which may require flexibility. In Sireci's examples, culturally responsive assessments allow students to rely on their funds of knowledge through translanguaging (e.g., bilingual test delivery systems). Other illustrations address flexibility in the testing environment that allow students to take the test using their own equipment (e.g., computers, devices, and software), selecting their own passages or writing prompts, and adapting the language for taking tests. In this paper, test adaptations are examined that might allow more flexibility in NAEP test administration, citing relevant research and current practices to test adaptations. This paper has seven major sections: (1) Defining test adaptations, both within the Standards for Educational and Psychological Testing; hereafter "Standards" (American Educational Research Association [AERA], American Psychological Association, & National Council on Measurement in Education, 2014) and as practiced within the NAEP program: accommodations, designated supports, and universal designs; (2) Summaries of the research previously conducted on a particular type of test adaptation, covering the extensive research on accommodations, both specific to NAEP and in general, as relevant to large-scale testing programs to establish a more expansive view of accommodations as measured by the significance of difference and consistency of outcomes within and across performance levels; (3) Focus to an even broader and more practical view of test adaptations by referencing state policies and practices as well as the consistency of adaptations across testing platforms; (4) Understand test adaptations for students beyond labels and categorical characteristics to understand their impact. This issue is critical, given the common lament by researchers that student samples often are only vaguely described; and (5) Speculations beyond research and practice, considering both function and format of the process, with two specific explications. An example in writing focuses on constructs and applies this logic to the content and constructs of reading. Three specific questions are posed for defining test adaptations, emphasizing universality for improving equity and access to a more diverse population of students. Within each section, recommendations are offered that NAEP may consider that provide greater flexibility in administration and measurement in the service of increasing equity and access; these recommendations are preceded by the abbreviation 'Rx.' Finally, a summary of these recommendations is presented, along with suggestions for future research. – Name: AbstractInfo Label: Abstractor Group: Ab Data: ERIC – Name: DateEntry Label: Entry Date Group: Date Data: 2026 – Name: AN Label: Accession Number Group: ID Data: ED679444 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED679444 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 65 Subjects: – SubjectFull: National Competency Tests Type: general – SubjectFull: Academic Standards Type: general – SubjectFull: Equal Education Type: general – SubjectFull: Access to Education Type: general – SubjectFull: Educational Testing Type: general – SubjectFull: Psychological Testing Type: general – SubjectFull: Testing Accommodations Type: general – SubjectFull: Students with Disabilities Type: general – SubjectFull: English Learners Type: general – SubjectFull: Adaptive Testing Type: general – SubjectFull: Data Collection Type: general – SubjectFull: Test Format Type: general – SubjectFull: National Assessment of Educational Progress Type: general Titles: – TitleFull: Rethinking 'Standardization' for NAEP to Increase Equity and Access. Technical Report #2510 Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: University of Oregon, Behavioral Research and Teaching (BRT) – PersonEntity: Name: NameFull: Gerald Tindal IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2025 Titles: – TitleFull: Behavioral Research and Teaching Type: main |
| ResultId | 1 |
