Investigating Authentic Nature of PISA Mathematics Items
Saved in:
| Title: | Investigating Authentic Nature of PISA Mathematics Items |
|---|---|
| Language: | English |
| Authors: | Semahat Incikabi (ORCID |
| Source: | School Science and Mathematics. 2026 126(3):274-288. |
| Availability: | Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us |
| Peer Reviewed: | Y |
| Page Count: | 15 |
| Publication Date: | 2026 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Secondary Education |
| Descriptors: | International Assessment, Achievement Tests, Secondary School Students, Foreign Countries, Authentic Learning, Performance Based Assessment, Test Items, Mathematics Tests, Item Analysis |
| Assessment and Survey Identifiers: | Program for International Student Assessment |
| DOI: | 10.1111/ssm.18402 |
| ISSN: | 0036-6803 1949-8594 |
| Abstract: | The objective of this study is to evaluate PISA mathematics literacy items in terms of their alignment with authentic contexts. A qualitative research design was adopted, employing document analysis to address the research aim. A total of 133 released items from 67 PISA contexts were analyzed. The findings indicate that the majority of the items exhibited a poor level of authenticity, while only a small proportion demonstrated a high degree of alignment with authentic contexts. Further analysis revealed that 88 items, which initially showed potential for being classified as good-fit or stereotypical based on their overall authenticity scores, were ultimately rated as poor-fit due to insufficient representation across certain authenticity aspects. The findings also suggest that three aspects (affective purpose, specificity of information, and question) play a pivotal role in the classification of items as poor-fit. Notably, nearly half of the items categorized as poor-fit remained at that level due to the absence of a single critical component. These results suggest that relatively minor, targeted revisions could substantially improve the authenticity of assessment tasks. The findings provide actionable insights for assessment developers, curriculum designers, and educators, offering clear priorities for enhancing the design of large-scale assessment items and informing policies that promote more meaningful and contextually relevant mathematics learning experiences. |
| Abstractor: | As Provided |
| Entry Date: | 2026 |
| Accession Number: | EJ1507572 |
| Database: | ERIC |
| Abstract: | The objective of this study is to evaluate PISA mathematics literacy items in terms of their alignment with authentic contexts. A qualitative research design was adopted, employing document analysis to address the research aim. A total of 133 released items from 67 PISA contexts were analyzed. The findings indicate that the majority of the items exhibited a poor level of authenticity, while only a small proportion demonstrated a high degree of alignment with authentic contexts. Further analysis revealed that 88 items, which initially showed potential for being classified as good-fit or stereotypical based on their overall authenticity scores, were ultimately rated as poor-fit due to insufficient representation across certain authenticity aspects. The findings also suggest that three aspects (affective purpose, specificity of information, and question) play a pivotal role in the classification of items as poor-fit. Notably, nearly half of the items categorized as poor-fit remained at that level due to the absence of a single critical component. These results suggest that relatively minor, targeted revisions could substantially improve the authenticity of assessment tasks. The findings provide actionable insights for assessment developers, curriculum designers, and educators, offering clear priorities for enhancing the design of large-scale assessment items and informing policies that promote more meaningful and contextually relevant mathematics learning experiences. |
|---|---|
| ISSN: | 0036-6803 1949-8594 |
| DOI: | 10.1111/ssm.18402 |
