The PISA 2022 Creative Thinking Assessment: A Welcome Opportunity to Explore the Mechanics of Flexibility Scoring

Saved in:
Bibliographic Details
Title: The PISA 2022 Creative Thinking Assessment: A Welcome Opportunity to Explore the Mechanics of Flexibility Scoring
Language: English
Authors: Boris Forthmann (ORCID 0000-0001-9755-7304)
Source: Journal of Creative Behavior. 2026 60(1).
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 7
Publication Date: 2026
Document Type: Journal Articles
Reports - Research
Education Level: Secondary Education
Descriptors: Achievement Tests, Foreign Countries, International Assessment, Secondary School Students, Creative Thinking, Creativity Tests, Creativity, Scoring, Scores
Assessment and Survey Identifiers: Program for International Student Assessment
DOI: 10.1002/jocb.70103
ISSN: 0022-0175
2162-6057
Abstract: The PISA 2022 Creative Thinking Assessment measures the ability to generate diverse ideas, that is, flexibility. However, since test-takers only provide up to three responses, scoring flexibility is challenging. Employed scoring systems rely on dimensions such as linguistic diversity or category systems to quantify how dissimilar a test-taker's responses are. In this work, I will revisit the flexibility scoring in the PISA 2022 Creative Thinking Assessment from the perspective of general diversity measure frameworks, which distinguish variety, balance, and disparity, in the hope of identifying ways to gain more information on test-takers' performances. An empirical illustration demonstrates the potential of diversity scores to better differentiate between different response patterns.
Abstractor: As Provided
Notes: https://osf.io/gb3h5
Entry Date: 2026
Accession Number: EJ1500598
Database: ERIC
Description
Abstract:The PISA 2022 Creative Thinking Assessment measures the ability to generate diverse ideas, that is, flexibility. However, since test-takers only provide up to three responses, scoring flexibility is challenging. Employed scoring systems rely on dimensions such as linguistic diversity or category systems to quantify how dissimilar a test-taker's responses are. In this work, I will revisit the flexibility scoring in the PISA 2022 Creative Thinking Assessment from the perspective of general diversity measure frameworks, which distinguish variety, balance, and disparity, in the hope of identifying ways to gain more information on test-takers' performances. An empirical illustration demonstrates the potential of diversity scores to better differentiate between different response patterns.
ISSN:0022-0175
2162-6057
DOI:10.1002/jocb.70103