View in EDS

Exploring Career-Readiness Features in High School Test Items through Cognitive Laboratory Interviews. CRESST Report 857

Saved in:
Bibliographic Details
Title: Exploring Career-Readiness Features in High School Test Items through Cognitive Laboratory Interviews. CRESST Report 857
Language: English
Authors: Madni, Ayesha, Kao, Jenny C., Rivera, Nichole M., Baker, Eva L., Cai, Li, National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
Source: National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 2018.
Availability: National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 300 Charles E Young Drive N, GSE&IS Building 3rd Floor, Mailbox 951522, Los Angeles, CA 90095-1522. Tel: 310-206-1532; Fax: 310-825-3883; Web site: http://www.cresst.org
Peer Reviewed: N
Page Count: 68
Publication Date: 2018
Sponsoring Agency: Department of Education (ED)
Contract Number: S368A150011
Document Type: Reports - Research
Tests/Questionnaires
Education Level: High Schools
Secondary Education
Descriptors: Career Readiness, High School Students, Test Items, Student Evaluation, Mathematics, Language Arts, Problem Solving, Response Style (Tests), Critical Thinking, Reading Comprehension, Writing Skills, Mathematics Skills
Geographic Terms: California
Abstract: This report is the first in a series of five reports considering career-readiness features within high school assessments. Utilizing feature analysis and cognitive lab interviews, the primary objective of this study was to verify and validate the existence of specific career-readiness features in select math and English language arts (ELA) test items. Feature analysis is a method to characterize items and tasks by components, so that item design, revision, and instruction may benefit. Seventeen students representing three high schools in Southern California participated. Results from the preliminary feature analysis on four math and two ELA items indicated that each test item contained between eight and 13 career-readiness features. Results from the cognitive labs supported the presence of these features. That is, these features were either part of the problem-solving process, and/or were necessary to solve the problem correctly.
Abstractor: As Provided
Entry Date: 2019
Accession Number: ED594595
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED594595
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED594595
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Exploring Career-Readiness Features in High School Test Items through Cognitive Laboratory Interviews. CRESST Report 857
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Madni%2C+Ayesha%22">Madni, Ayesha</searchLink><br /><searchLink fieldCode="AR" term="%22Kao%2C+Jenny+C%2E%22">Kao, Jenny C.</searchLink><br /><searchLink fieldCode="AR" term="%22Rivera%2C+Nichole+M%2E%22">Rivera, Nichole M.</searchLink><br /><searchLink fieldCode="AR" term="%22Baker%2C+Eva+L%2E%22">Baker, Eva L.</searchLink><br /><searchLink fieldCode="AR" term="%22Cai%2C+Li%22">Cai, Li</searchLink><br /><searchLink fieldCode="AR" term="%22National+Center+for+Research+on+Evaluation%2C+Standards%2C+and+Student+Testing+%28CRESST%29%22">National Center for Research on Evaluation, Standards, and Student Testing (CRESST)</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22National+Center+for+Research+on+Evaluation%2C+Standards%2C+and+Student+Testing+%28CRESST%29%22"><i>National Center for Research on Evaluation, Standards, and Student Testing (CRESST)</i></searchLink>. 2018.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: National Center for Research on Evaluation, Standards, and Student Testing (CRESST). 300 Charles E Young Drive N, GSE&IS Building 3rd Floor, Mailbox 951522, Los Angeles, CA 90095-1522. Tel: 310-206-1532; Fax: 310-825-3883; Web site: http://www.cresst.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 68
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2018
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Department of Education (ED)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: S368A150011
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research<br />Tests/Questionnaires
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22High+Schools%22">High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Career+Readiness%22">Career Readiness</searchLink><br /><searchLink fieldCode="DE" term="%22High+School+Students%22">High School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Evaluation%22">Student Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics%22">Mathematics</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Arts%22">Language Arts</searchLink><br /><searchLink fieldCode="DE" term="%22Problem+Solving%22">Problem Solving</searchLink><br /><searchLink fieldCode="DE" term="%22Response+Style+%28Tests%29%22">Response Style (Tests)</searchLink><br /><searchLink fieldCode="DE" term="%22Critical+Thinking%22">Critical Thinking</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Comprehension%22">Reading Comprehension</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+Skills%22">Writing Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Skills%22">Mathematics Skills</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22California%22">California</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This report is the first in a series of five reports considering career-readiness features within high school assessments. Utilizing feature analysis and cognitive lab interviews, the primary objective of this study was to verify and validate the existence of specific career-readiness features in select math and English language arts (ELA) test items. Feature analysis is a method to characterize items and tasks by components, so that item design, revision, and instruction may benefit. Seventeen students representing three high schools in Southern California participated. Results from the preliminary feature analysis on four math and two ELA items indicated that each test item contained between eight and 13 career-readiness features. Results from the cognitive labs supported the presence of these features. That is, these features were either part of the problem-solving process, and/or were necessary to solve the problem correctly.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2019
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED594595
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED594595
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 68
    Subjects:
      – SubjectFull: Career Readiness
        Type: general
      – SubjectFull: High School Students
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Student Evaluation
        Type: general
      – SubjectFull: Mathematics
        Type: general
      – SubjectFull: Language Arts
        Type: general
      – SubjectFull: Problem Solving
        Type: general
      – SubjectFull: Response Style (Tests)
        Type: general
      – SubjectFull: Critical Thinking
        Type: general
      – SubjectFull: Reading Comprehension
        Type: general
      – SubjectFull: Writing Skills
        Type: general
      – SubjectFull: Mathematics Skills
        Type: general
      – SubjectFull: California
        Type: general
    Titles:
      – TitleFull: Exploring Career-Readiness Features in High School Test Items through Cognitive Laboratory Interviews. CRESST Report 857
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
      – PersonEntity:
          Name:
            NameFull: Madni, Ayesha
      – PersonEntity:
          Name:
            NameFull: Kao, Jenny C.
      – PersonEntity:
          Name:
            NameFull: Rivera, Nichole M.
      – PersonEntity:
          Name:
            NameFull: Baker, Eva L.
      – PersonEntity:
          Name:
            NameFull: Cai, Li
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2018
          Titles:
            – TitleFull: National Center for Research on Evaluation, Standards, and Student Testing (CRESST)
              Type: main
ResultId 1