View in EDS

Investigating Authentic Nature of PISA Mathematics Items

Saved in:
Bibliographic Details
Title: Investigating Authentic Nature of PISA Mathematics Items
Language: English
Authors: Semahat Incikabi (ORCID 0000-0002-7686-1996)
Source: School Science and Mathematics. 2026 126(3):274-288.
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 15
Publication Date: 2026
Document Type: Journal Articles
Reports - Research
Education Level: Secondary Education
Descriptors: International Assessment, Achievement Tests, Secondary School Students, Foreign Countries, Authentic Learning, Performance Based Assessment, Test Items, Mathematics Tests, Item Analysis
Assessment and Survey Identifiers: Program for International Student Assessment
DOI: 10.1111/ssm.18402
ISSN: 0036-6803
1949-8594
Abstract: The objective of this study is to evaluate PISA mathematics literacy items in terms of their alignment with authentic contexts. A qualitative research design was adopted, employing document analysis to address the research aim. A total of 133 released items from 67 PISA contexts were analyzed. The findings indicate that the majority of the items exhibited a poor level of authenticity, while only a small proportion demonstrated a high degree of alignment with authentic contexts. Further analysis revealed that 88 items, which initially showed potential for being classified as good-fit or stereotypical based on their overall authenticity scores, were ultimately rated as poor-fit due to insufficient representation across certain authenticity aspects. The findings also suggest that three aspects (affective purpose, specificity of information, and question) play a pivotal role in the classification of items as poor-fit. Notably, nearly half of the items categorized as poor-fit remained at that level due to the absence of a single critical component. These results suggest that relatively minor, targeted revisions could substantially improve the authenticity of assessment tasks. The findings provide actionable insights for assessment developers, curriculum designers, and educators, offering clear priorities for enhancing the design of large-scale assessment items and informing policies that promote more meaningful and contextually relevant mathematics learning experiences.
Abstractor: As Provided
Entry Date: 2026
Accession Number: EJ1507572
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1507572
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Investigating Authentic Nature of PISA Mathematics Items
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Semahat+Incikabi%22">Semahat Incikabi</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-7686-1996">0000-0002-7686-1996</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22School+Science+and+Mathematics%22"><i>School Science and Mathematics</i></searchLink>. 2026 126(3):274-288.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 15
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2026
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22International+Assessment%22">International Assessment</searchLink><br /><searchLink fieldCode="DE" term="%22Achievement+Tests%22">Achievement Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Secondary+School+Students%22">Secondary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Authentic+Learning%22">Authentic Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Performance+Based+Assessment%22">Performance Based Assessment</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Tests%22">Mathematics Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Analysis%22">Item Analysis</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22Program+for+International+Student+Assessment%22">Program for International Student Assessment</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1111/ssm.18402
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0036-6803<br />1949-8594
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The objective of this study is to evaluate PISA mathematics literacy items in terms of their alignment with authentic contexts. A qualitative research design was adopted, employing document analysis to address the research aim. A total of 133 released items from 67 PISA contexts were analyzed. The findings indicate that the majority of the items exhibited a poor level of authenticity, while only a small proportion demonstrated a high degree of alignment with authentic contexts. Further analysis revealed that 88 items, which initially showed potential for being classified as good-fit or stereotypical based on their overall authenticity scores, were ultimately rated as poor-fit due to insufficient representation across certain authenticity aspects. The findings also suggest that three aspects (affective purpose, specificity of information, and question) play a pivotal role in the classification of items as poor-fit. Notably, nearly half of the items categorized as poor-fit remained at that level due to the absence of a single critical component. These results suggest that relatively minor, targeted revisions could substantially improve the authenticity of assessment tasks. The findings provide actionable insights for assessment developers, curriculum designers, and educators, offering clear priorities for enhancing the design of large-scale assessment items and informing policies that promote more meaningful and contextually relevant mathematics learning experiences.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1507572
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1507572
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/ssm.18402
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 15
        StartPage: 274
    Subjects:
      – SubjectFull: International Assessment
        Type: general
      – SubjectFull: Achievement Tests
        Type: general
      – SubjectFull: Secondary School Students
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Authentic Learning
        Type: general
      – SubjectFull: Performance Based Assessment
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Mathematics Tests
        Type: general
      – SubjectFull: Item Analysis
        Type: general
      – SubjectFull: Program for International Student Assessment
        Type: general
    Titles:
      – TitleFull: Investigating Authentic Nature of PISA Mathematics Items
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Semahat Incikabi
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 0036-6803
            – Type: issn-electronic
              Value: 1949-8594
          Numbering:
            – Type: volume
              Value: 126
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: School Science and Mathematics
              Type: main
ResultId 1