Does Test Item Performance Increase with Test-to-Standards Alignment?

Saved in:
Bibliographic Details
Title: Does Test Item Performance Increase with Test-to-Standards Alignment?
Authors: Traynor, Anne (AUTHOR)
Source: Educational Assessment. Jul-Sep2017, Vol. 22 Issue 3, p171-188. 18p.
Subjects: Scale items, Performance evaluation, Educational standards, Mathematical ability testing, Academic achievement
Abstract: Variation in test performance among examinees from different regions or national jurisdictions is often partially attributed to differences in the degree of content correspondence between local school or training program curricula, and the test of interest. This posited relationship between test-curriculum correspondence, or “alignment,” and test performance is usually inferred from highly distal evidence, rather than directly examined. Utilizing mathematics standards content analysis data and achievement test item data from ten U.S. states, we examine the relationship between topic-specific alignment and test item performance. When a particular item’s content type is emphasized by the standards, we find evidence of a positive relationship between the alignment measure and proportion-correct test item difficulty, although this effect is not consistent across samples. Implications of the results for curricular achievement test development and score interpretation are discussed. [ABSTRACT FROM PUBLISHER]
Copyright of Educational Assessment is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 124435027
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Does Test Item Performance Increase with Test-to-Standards Alignment?
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Traynor%2C+Anne%22">Traynor, Anne</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Educational+Assessment%22">Educational Assessment</searchLink>. Jul-Sep2017, Vol. 22 Issue 3, p171-188. 18p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Scale+items%22">Scale items</searchLink><br /><searchLink fieldCode="DE" term="%22Performance+evaluation%22">Performance evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+standards%22">Educational standards</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+ability+testing%22">Mathematical ability testing</searchLink><br /><searchLink fieldCode="DE" term="%22Academic+achievement%22">Academic achievement</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Variation in test performance among examinees from different regions or national jurisdictions is often partially attributed to differences in the degree of content correspondence between local school or training program curricula, and the test of interest. This posited relationship between test-curriculum correspondence, or “alignment,” and test performance is usually inferred from highly distal evidence, rather than directly examined. Utilizing mathematics standards content analysis data and achievement test item data from ten U.S. states, we examine the relationship between topic-specific alignment and test item performance. When a particular item’s content type is emphasized by the standards, we find evidence of a positive relationship between the alignment measure and proportion-correct test item difficulty, although this effect is not consistent across samples. Implications of the results for curricular achievement test development and score interpretation are discussed. [ABSTRACT FROM PUBLISHER]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Educational Assessment is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=124435027
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/10627197.2017.1344092
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 171
    Subjects:
      – SubjectFull: Scale items
        Type: general
      – SubjectFull: Performance evaluation
        Type: general
      – SubjectFull: Educational standards
        Type: general
      – SubjectFull: Mathematical ability testing
        Type: general
      – SubjectFull: Academic achievement
        Type: general
    Titles:
      – TitleFull: Does Test Item Performance Increase with Test-to-Standards Alignment?
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Traynor, Anne
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Text: Jul-Sep2017
              Type: published
              Y: 2017
          Identifiers:
            – Type: issn-print
              Value: 10627197
          Numbering:
            – Type: volume
              Value: 22
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Educational Assessment
              Type: main
ResultId 1