Maintaining Item Banks with the Rasch Model: An Example from Wave Optics

Saved in:
Bibliographic Details
Title: Maintaining Item Banks with the Rasch Model: An Example from Wave Optics
Language: English
Authors: Glamocic, Džana Salibašic (ORCID 0000-0001-7648-8207), Mešic, Vanes (ORCID 0000-0003-3337-3471), Neumann, Knut, Sušac, Ana (ORCID 0000-0002-0554-4088), Boone, William J. (ORCID 0000-0002-3555-7082), Aviani, Ivica, Hasovic, Elvedin, Erceg, Nataša (ORCID 0000-0003-3308-1372), Repnik, Robert (ORCID 0000-0003-4039-7236), Grubelnik, Vladimir (ORCID 0000-0002-4182-8520)
Source: Physical Review Physics Education Research. Jan-Jun 2021 17(1).
Availability: American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: http://prst-per.aps.org
Peer Reviewed: Y
Page Count: 18
Publication Date: 2021
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Item Banks, Test Items, Item Response Theory, Item Sampling, Optics, Physics, College Students, Foreign Countries, Test Reliability
Geographic Terms: Slovenia, Croatia, Bosnia and Herzegovina
DOI: 10.1103/PhysRevPhysEducRes.17.010105
ISSN: 2469-9896
Abstract: Item banks are generally considered the basis of a new generation of educational measurement. In combination with specialized software, they can facilitate the computerized assembling of multiple pre-equated test forms. However, for advantages of item banks to become fully realized it is important that the item banks store a relatively large number of valid test items. In this paper, we demonstrate how the Rasch model is used for integrating new items into an existing wave optics item bank. First, we identified and applied a set of criteria for selecting 18 linking items from our initial item bank. In order to integrate 12 newly developed items, we combined the 18 linking items with the 12 newly developed ones into one test and administered this test to 106 postinstruction physics students from 4 universities in Slovenia, Croatia, and Bosnia and Herzegovina. It was determined that the 12 new items measure the same construct as items from the initial item bank. In addition, all items exhibited good item fit, item reliability was excellent and person reliability was fair. The ratio of standard deviations of linking item difficulties for the new test and existing item bank amounted to 0.89 and correlation of these difficulties amounted to 0.93 which indicated good linking precision. We could conclude that good linking precision can be obtained if linking items are chosen based on the following set of criteria: number of items, item fit, range and spacing of item difficulties, content representativeness, position in test form and interuniversity DIF contrasts.
Abstractor: As Provided
Entry Date: 2021
Accession Number: EJ1286907
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1286907
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Maintaining Item Banks with the Rasch Model: An Example from Wave Optics
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Glamocic%2C+Džana+Salibašic%22">Glamocic, Džana Salibašic</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7648-8207">0000-0001-7648-8207</externalLink>)<br /><searchLink fieldCode="AR" term="%22Mešic%2C+Vanes%22">Mešic, Vanes</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-3337-3471">0000-0003-3337-3471</externalLink>)<br /><searchLink fieldCode="AR" term="%22Neumann%2C+Knut%22">Neumann, Knut</searchLink><br /><searchLink fieldCode="AR" term="%22Sušac%2C+Ana%22">Sušac, Ana</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-0554-4088">0000-0002-0554-4088</externalLink>)<br /><searchLink fieldCode="AR" term="%22Boone%2C+William+J%2E%22">Boone, William J.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-3555-7082">0000-0002-3555-7082</externalLink>)<br /><searchLink fieldCode="AR" term="%22Aviani%2C+Ivica%22">Aviani, Ivica</searchLink><br /><searchLink fieldCode="AR" term="%22Hasovic%2C+Elvedin%22">Hasovic, Elvedin</searchLink><br /><searchLink fieldCode="AR" term="%22Erceg%2C+Nataša%22">Erceg, Nataša</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-3308-1372">0000-0003-3308-1372</externalLink>)<br /><searchLink fieldCode="AR" term="%22Repnik%2C+Robert%22">Repnik, Robert</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-4039-7236">0000-0003-4039-7236</externalLink>)<br /><searchLink fieldCode="AR" term="%22Grubelnik%2C+Vladimir%22">Grubelnik, Vladimir</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-4182-8520">0000-0002-4182-8520</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Physical+Review+Physics+Education+Research%22"><i>Physical Review Physics Education Research</i></searchLink>. Jan-Jun 2021 17(1).
– Name: Avail
  Label: Availability
  Group: Avail
  Data: American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: http://prst-per.aps.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 18
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2021
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Item+Banks%22">Item Banks</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Sampling%22">Item Sampling</searchLink><br /><searchLink fieldCode="DE" term="%22Optics%22">Optics</searchLink><br /><searchLink fieldCode="DE" term="%22Physics%22">Physics</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Slovenia%22">Slovenia</searchLink><br /><searchLink fieldCode="DE" term="%22Croatia%22">Croatia</searchLink><br /><searchLink fieldCode="DE" term="%22Bosnia+and+Herzegovina%22">Bosnia and Herzegovina</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1103/PhysRevPhysEducRes.17.010105
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2469-9896
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Item banks are generally considered the basis of a new generation of educational measurement. In combination with specialized software, they can facilitate the computerized assembling of multiple pre-equated test forms. However, for advantages of item banks to become fully realized it is important that the item banks store a relatively large number of valid test items. In this paper, we demonstrate how the Rasch model is used for integrating new items into an existing wave optics item bank. First, we identified and applied a set of criteria for selecting 18 linking items from our initial item bank. In order to integrate 12 newly developed items, we combined the 18 linking items with the 12 newly developed ones into one test and administered this test to 106 postinstruction physics students from 4 universities in Slovenia, Croatia, and Bosnia and Herzegovina. It was determined that the 12 new items measure the same construct as items from the initial item bank. In addition, all items exhibited good item fit, item reliability was excellent and person reliability was fair. The ratio of standard deviations of linking item difficulties for the new test and existing item bank amounted to 0.89 and correlation of these difficulties amounted to 0.93 which indicated good linking precision. We could conclude that good linking precision can be obtained if linking items are chosen based on the following set of criteria: number of items, item fit, range and spacing of item difficulties, content representativeness, position in test form and interuniversity DIF contrasts.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2021
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1286907
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1286907
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1103/PhysRevPhysEducRes.17.010105
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
    Subjects:
      – SubjectFull: Item Banks
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Item Response Theory
        Type: general
      – SubjectFull: Item Sampling
        Type: general
      – SubjectFull: Optics
        Type: general
      – SubjectFull: Physics
        Type: general
      – SubjectFull: College Students
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Test Reliability
        Type: general
      – SubjectFull: Slovenia
        Type: general
      – SubjectFull: Croatia
        Type: general
      – SubjectFull: Bosnia and Herzegovina
        Type: general
    Titles:
      – TitleFull: Maintaining Item Banks with the Rasch Model: An Example from Wave Optics
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Glamocic, Džana Salibašic
      – PersonEntity:
          Name:
            NameFull: Mešic, Vanes
      – PersonEntity:
          Name:
            NameFull: Neumann, Knut
      – PersonEntity:
          Name:
            NameFull: Sušac, Ana
      – PersonEntity:
          Name:
            NameFull: Boone, William J.
      – PersonEntity:
          Name:
            NameFull: Aviani, Ivica
      – PersonEntity:
          Name:
            NameFull: Hasovic, Elvedin
      – PersonEntity:
          Name:
            NameFull: Erceg, Nataša
      – PersonEntity:
          Name:
            NameFull: Repnik, Robert
      – PersonEntity:
          Name:
            NameFull: Grubelnik, Vladimir
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2021
          Identifiers:
            – Type: issn-electronic
              Value: 2469-9896
          Numbering:
            – Type: volume
              Value: 17
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Physical Review Physics Education Research
              Type: main
ResultId 1