Evaluating Statistical Targets for Assembling Parallel Mixed-Format Test Forms.

Saved in:
Bibliographic Details
Title: Evaluating Statistical Targets for Assembling Parallel Mixed-Format Test Forms.
Authors: Debeer, Dries1 dries.debeer@uzh.ch, Ali, Usama S.2 uali@ets.org, Rijn, Peter W.3 pvanrijn@etsglobal.org
Source: Journal of Educational Measurement. Summer2017, Vol. 54 Issue 2, p218-242. 25p.
Subject Terms: *Educational testing services, *Educational programs, *Item response theory, Parameters (Statistics), Logistic model (Demography)
Abstract: Test assembly is the process of selecting items from an item pool to form one or more new test forms. Often new test forms are constructed to be parallel with an existing (or an ideal) test. Within the context of item response theory, the test information function (TIF) or the test characteristic curve (TCC) are commonly used as statistical targets to obtain this parallelism. In a recent study, Ali and van Rijn proposed combining the TIF and TCC as statistical targets, rather than using only a single statistical target. In this article, we propose two new methods using this combined approach, and compare these methods with single statistical targets for the assembly of mixed-format tests. In addition, we introduce new criteria to evaluate the parallelism of multiple forms. The results show that single statistical targets can be problematic, while the combined targets perform better, especially in situations with increasing numbers of polytomous items. Implications of using the combined target are discussed. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Educational Measurement is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: ehh
DbLabel: Education Research Complete
An: 123349882
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Evaluating Statistical Targets for Assembling Parallel Mixed-Format Test Forms.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Debeer%2C+Dries%22">Debeer, Dries</searchLink><relatesTo>1</relatesTo><i> dries.debeer@uzh.ch</i><br /><searchLink fieldCode="AR" term="%22Ali%2C+Usama+S%2E%22">Ali, Usama S.</searchLink><relatesTo>2</relatesTo><i> uali@ets.org</i><br /><searchLink fieldCode="AR" term="%22Rijn%2C+Peter+W%2E%22">Rijn, Peter W.</searchLink><relatesTo>3</relatesTo><i> pvanrijn@etsglobal.org</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Educational+Measurement%22">Journal of Educational Measurement</searchLink>. Summer2017, Vol. 54 Issue 2, p218-242. 25p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Educational+testing+services%22">Educational testing services</searchLink><br />*<searchLink fieldCode="DE" term="%22Educational+programs%22">Educational programs</searchLink><br />*<searchLink fieldCode="DE" term="%22Item+response+theory%22">Item response theory</searchLink><br /><searchLink fieldCode="DE" term="%22Parameters+%28Statistics%29%22">Parameters (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22Logistic+model+%28Demography%29%22">Logistic model (Demography)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Test assembly is the process of selecting items from an item pool to form one or more new test forms. Often new test forms are constructed to be parallel with an existing (or an ideal) test. Within the context of item response theory, the test information function (TIF) or the test characteristic curve (TCC) are commonly used as statistical targets to obtain this parallelism. In a recent study, Ali and van Rijn proposed combining the TIF and TCC as statistical targets, rather than using only a single statistical target. In this article, we propose two new methods using this combined approach, and compare these methods with single statistical targets for the assembly of mixed-format tests. In addition, we introduce new criteria to evaluate the parallelism of multiple forms. The results show that single statistical targets can be problematic, while the combined targets perform better, especially in situations with increasing numbers of polytomous items. Implications of using the combined target are discussed. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Educational Measurement is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=123349882
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/jedm.12142
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 25
        StartPage: 218
    Subjects:
      – SubjectFull: Educational testing services
        Type: general
      – SubjectFull: Educational programs
        Type: general
      – SubjectFull: Item response theory
        Type: general
      – SubjectFull: Parameters (Statistics)
        Type: general
      – SubjectFull: Logistic model (Demography)
        Type: general
    Titles:
      – TitleFull: Evaluating Statistical Targets for Assembling Parallel Mixed-Format Test Forms.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Debeer, Dries
      – PersonEntity:
          Name:
            NameFull: Ali, Usama S.
      – PersonEntity:
          Name:
            NameFull: Rijn, Peter W.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Text: Summer2017
              Type: published
              Y: 2017
          Identifiers:
            – Type: issn-print
              Value: 00220655
          Numbering:
            – Type: volume
              Value: 54
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Journal of Educational Measurement
              Type: main
ResultId 1