Exploring Career-Readiness Features in High School Test Items through Cognitive Laboratory Interviews. CRESST Report 857

Saved in:
Bibliographic Details
Title: Exploring Career-Readiness Features in High School Test Items through Cognitive Laboratory Interviews. CRESST Report 857
Language: English
Authors: Madni, Ayesha, Kao, Jenny C., Rivera, Nichole M., Baker, Eva L., Cai, Li, National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
Source: National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 2018.
Availability: National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 300 Charles E Young Drive N, GSE&IS Building 3rd Floor, Mailbox 951522, Los Angeles, CA 90095-1522. Tel: 310-206-1532; Fax: 310-825-3883; Web site: http://www.cresst.org
Peer Reviewed: N
Page Count: 68
Publication Date: 2018
Sponsoring Agency: Department of Education (ED)
Contract Number: S368A150011
Document Type: Reports - Research
Tests/Questionnaires
Education Level: High Schools
Secondary Education
Descriptors: Career Readiness, High School Students, Test Items, Student Evaluation, Mathematics, Language Arts, Problem Solving, Response Style (Tests), Critical Thinking, Reading Comprehension, Writing Skills, Mathematics Skills
Geographic Terms: California
Abstract: This report is the first in a series of five reports considering career-readiness features within high school assessments. Utilizing feature analysis and cognitive lab interviews, the primary objective of this study was to verify and validate the existence of specific career-readiness features in select math and English language arts (ELA) test items. Feature analysis is a method to characterize items and tasks by components, so that item design, revision, and instruction may benefit. Seventeen students representing three high schools in Southern California participated. Results from the preliminary feature analysis on four math and two ELA items indicated that each test item contained between eight and 13 career-readiness features. Results from the cognitive labs supported the presence of these features. That is, these features were either part of the problem-solving process, and/or were necessary to solve the problem correctly.
Abstractor: As Provided
Entry Date: 2019
Accession Number: ED594595
Database: ERIC
Description
Abstract:This report is the first in a series of five reports considering career-readiness features within high school assessments. Utilizing feature analysis and cognitive lab interviews, the primary objective of this study was to verify and validate the existence of specific career-readiness features in select math and English language arts (ELA) test items. Feature analysis is a method to characterize items and tasks by components, so that item design, revision, and instruction may benefit. Seventeen students representing three high schools in Southern California participated. Results from the preliminary feature analysis on four math and two ELA items indicated that each test item contained between eight and 13 career-readiness features. Results from the cognitive labs supported the presence of these features. That is, these features were either part of the problem-solving process, and/or were necessary to solve the problem correctly.