View in EDS HTML Full Text PDF Full Text

Marginalized Learners in International and Regional Test Data: The Extent of Floor Effects.

Saved in:
Bibliographic Details
Title: Marginalized Learners in International and Regional Test Data: The Extent of Floor Effects.
Authors: Gustafsson, Martin, Barakat, Bilal Fouad
Source: Comparative Education Review. Aug2023, Vol. 67 Issue 3, p509-533. 25p. 3 Charts, 10 Graphs.
Subject Terms: *Education policy, *Learning, *Multiple choice examinations, Entertainers, Developing countries
Abstract: International assessments inform education policy debates, yet little is known about their floor effects: To what extent do they fail to differentiate between the lowest performers, and what are the implications of this? TIMSS, SACMEQ, and LLECE data are analyzed to answer this question. In TIMSS, floor effects have been reduced through the introduction of a greater number of easy items. SACMEQ and LLECE, despite being specifically designed for developing countries, display substantial floor effects, a problem obscured by their strong reliance on multiple-choice questions. Consequently, some learners are officially classified as proficient who effectively score zero points beyond random guessing. Though floor effects do not substantially alter country rankings, they are large enough to distort trends over time. Designers of assessment programs need to limit floor effects through a greater number of easier multiple-choice items and more constructed-response items. The former solution is easiest to implement. [ABSTRACT FROM AUTHOR]
Copyright of Comparative Education Review is the property of University of Chicago Press and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: ehh
DbLabel: Education Research Complete
An: 169876563
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Marginalized Learners in International and Regional Test Data: The Extent of Floor Effects.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Gustafsson%2C+Martin%22">Gustafsson, Martin</searchLink><br /><searchLink fieldCode="AR" term="%22Barakat%2C+Bilal+Fouad%22">Barakat, Bilal Fouad</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Comparative+Education+Review%22">Comparative Education Review</searchLink>. Aug2023, Vol. 67 Issue 3, p509-533. 25p. 3 Charts, 10 Graphs.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Education+policy%22">Education policy</searchLink><br />*<searchLink fieldCode="DE" term="%22Learning%22">Learning</searchLink><br />*<searchLink fieldCode="DE" term="%22Multiple+choice+examinations%22">Multiple choice examinations</searchLink><br /><searchLink fieldCode="DE" term="%22Entertainers%22">Entertainers</searchLink><br /><searchLink fieldCode="DE" term="%22Developing+countries%22">Developing countries</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: International assessments inform education policy debates, yet little is known about their floor effects: To what extent do they fail to differentiate between the lowest performers, and what are the implications of this? TIMSS, SACMEQ, and LLECE data are analyzed to answer this question. In TIMSS, floor effects have been reduced through the introduction of a greater number of easy items. SACMEQ and LLECE, despite being specifically designed for developing countries, display substantial floor effects, a problem obscured by their strong reliance on multiple-choice questions. Consequently, some learners are officially classified as proficient who effectively score zero points beyond random guessing. Though floor effects do not substantially alter country rankings, they are large enough to distort trends over time. Designers of assessment programs need to limit floor effects through a greater number of easier multiple-choice items and more constructed-response items. The former solution is easiest to implement. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Comparative Education Review is the property of University of Chicago Press and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=169876563
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1086/725442
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 25
        StartPage: 509
    Subjects:
      – SubjectFull: Education policy
        Type: general
      – SubjectFull: Learning
        Type: general
      – SubjectFull: Multiple choice examinations
        Type: general
      – SubjectFull: Entertainers
        Type: general
      – SubjectFull: Developing countries
        Type: general
    Titles:
      – TitleFull: Marginalized Learners in International and Regional Test Data: The Extent of Floor Effects.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Gustafsson, Martin
      – PersonEntity:
          Name:
            NameFull: Barakat, Bilal Fouad
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Text: Aug2023
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-print
              Value: 00104086
          Numbering:
            – Type: volume
              Value: 67
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Comparative Education Review
              Type: main
ResultId 1