View in EDS HTML Full Text PDF Full Text

An Evaluation of Automatic Item Generation: A Case Study of Weak Theory Approach.

Saved in:
Bibliographic Details
Title: An Evaluation of Automatic Item Generation: A Case Study of Weak Theory Approach.
Authors: Fu, Yanyan1 (AUTHOR), Choe, Edison M.1 (AUTHOR), Lim, Hwanggyu1 (AUTHOR), Choi, Jaehwa2 (AUTHOR)
Source: Educational Measurement: Issues & Practice. Dec2022, Vol. 41 Issue 4, p10-22. 13p. 3 Color Photographs, 4 Charts, 4 Graphs.
Subject Terms: *Authors, Psychometrics, Statistics
Abstract: This case study applied the weak theory of Automatic Item Generation (AIG) to generate isomorphic item instances (i.e., unique but psychometrically equivalent items) for a large‐scale assessment. Three representative instances were selected from each item template (i.e., model) and pilot‐tested. In addition, a new analytical framework, differential child item functioning (DCIF) analysis, based on the existing differential item functioning statistics, was applied to evaluate the psychometric equivalency of item instances within each template. The results showed that, out of 23 templates, nine successfully generated isomorphic instances, five required minor revisions to make them isomorphic, and the remaining templates required major modifications. The results and insights obtained from the AIG template development procedure may help item writers and psychometricians effectively develop and manage the templates that generate isomorphic instances. [ABSTRACT FROM AUTHOR]
Copyright of Educational Measurement: Issues & Practice is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: ehh
DbLabel: Education Research Complete
An: 160590404
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: An Evaluation of Automatic Item Generation: A Case Study of Weak Theory Approach.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Fu%2C+Yanyan%22">Fu, Yanyan</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Choe%2C+Edison+M%2E%22">Choe, Edison M.</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Lim%2C+Hwanggyu%22">Lim, Hwanggyu</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Choi%2C+Jaehwa%22">Choi, Jaehwa</searchLink><relatesTo>2</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Educational+Measurement%3A+Issues+%26+Practice%22">Educational Measurement: Issues & Practice</searchLink>. Dec2022, Vol. 41 Issue 4, p10-22. 13p. 3 Color Photographs, 4 Charts, 4 Graphs.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Authors%22">Authors</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Statistics%22">Statistics</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This case study applied the weak theory of Automatic Item Generation (AIG) to generate isomorphic item instances (i.e., unique but psychometrically equivalent items) for a large‐scale assessment. Three representative instances were selected from each item template (i.e., model) and pilot‐tested. In addition, a new analytical framework, differential child item functioning (DCIF) analysis, based on the existing differential item functioning statistics, was applied to evaluate the psychometric equivalency of item instances within each template. The results showed that, out of 23 templates, nine successfully generated isomorphic instances, five required minor revisions to make them isomorphic, and the remaining templates required major modifications. The results and insights obtained from the AIG template development procedure may help item writers and psychometricians effectively develop and manage the templates that generate isomorphic instances. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Educational Measurement: Issues & Practice is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=160590404
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/emip.12529
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 13
        StartPage: 10
    Subjects:
      – SubjectFull: Authors
        Type: general
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Statistics
        Type: general
    Titles:
      – TitleFull: An Evaluation of Automatic Item Generation: A Case Study of Weak Theory Approach.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Fu, Yanyan
      – PersonEntity:
          Name:
            NameFull: Choe, Edison M.
      – PersonEntity:
          Name:
            NameFull: Lim, Hwanggyu
      – PersonEntity:
          Name:
            NameFull: Choi, Jaehwa
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Text: Dec2022
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 07311745
          Numbering:
            – Type: volume
              Value: 41
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Educational Measurement: Issues & Practice
              Type: main
ResultId 1