View in EDS HTML Full Text PDF Full Text

Testing Expert-Based and Student-Based Cognitive Models: An Application of the Attribute Hierarchy Method and Hierarchy Consistency Index.

Saved in:
Bibliographic Details
Title: Testing Expert-Based and Student-Based Cognitive Models: An Application of the Attribute Hierarchy Method and Hierarchy Consistency Index.
Authors: Leighton, JacquelineP. (AUTHOR), Cui, Ying (AUTHOR), Cor, M. Ken (AUTHOR)
Source: Applied Measurement in Education. 2009, Vol. 22 Issue 3, p229-254. 26p. 3 Diagrams, 4 Charts.
Subjects: Cognition, Mathematical models, Mathematical analysis, Slosson Intelligence Test, Students, Methodology, Judgment (Psychology), Reasoning
Abstract: The objective of the present investigation was to compare the adequacy of two cognitive models for predicting examinee performance on a sample of algebra I and II items from the March 2005 administration of the SAT™. The two models included one generated from verbal reports provided by 21 examinees as they solved the SAT™ items, and the other generated from the judgment of a content expert. Using the attribute hierarchy method (Leighton, Gierl, & Hunka, 2004) and the hierarchy consistency index (Cui, Leighton, Gierl, & Hunka, 2006), the predictive adequacy of the two cognitive models was tested with three samples of varying size. Results indicated that the student-based model predicted the test performance of examinees of moderately high ability with excellent accuracy but not the test performance of examinees of moderate (or average) ability. In contrast, the expert-based model was more consistent, predicting the test performance of both moderately high ability examinees and moderate ability examinees with reasonable accuracy. Expert-based models may be more predictive of the general response processes used by diverse groups of examinees, whereas student-based models may be preferred when making inferences about examinees at specific ability levels. [ABSTRACT FROM AUTHOR]
Copyright of Applied Measurement in Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 42746599
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Testing Expert-Based and Student-Based Cognitive Models: An Application of the Attribute Hierarchy Method and Hierarchy Consistency Index.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Leighton%2C+JacquelineP%2E%22">Leighton, JacquelineP.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Cui%2C+Ying%22">Cui, Ying</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Cor%2C+M%2E+Ken%22">Cor, M. Ken</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Applied+Measurement+in+Education%22">Applied Measurement in Education</searchLink>. 2009, Vol. 22 Issue 3, p229-254. 26p. 3 Diagrams, 4 Charts.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Cognition%22">Cognition</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+models%22">Mathematical models</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+analysis%22">Mathematical analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Slosson+Intelligence+Test%22">Slosson Intelligence Test</searchLink><br /><searchLink fieldCode="DE" term="%22Students%22">Students</searchLink><br /><searchLink fieldCode="DE" term="%22Methodology%22">Methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Judgment+%28Psychology%29%22">Judgment (Psychology)</searchLink><br /><searchLink fieldCode="DE" term="%22Reasoning%22">Reasoning</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The objective of the present investigation was to compare the adequacy of two cognitive models for predicting examinee performance on a sample of algebra I and II items from the March 2005 administration of the SAT™. The two models included one generated from verbal reports provided by 21 examinees as they solved the SAT™ items, and the other generated from the judgment of a content expert. Using the attribute hierarchy method (Leighton, Gierl, & Hunka, 2004) and the hierarchy consistency index (Cui, Leighton, Gierl, & Hunka, 2006), the predictive adequacy of the two cognitive models was tested with three samples of varying size. Results indicated that the student-based model predicted the test performance of examinees of moderately high ability with excellent accuracy but not the test performance of examinees of moderate (or average) ability. In contrast, the expert-based model was more consistent, predicting the test performance of both moderately high ability examinees and moderate ability examinees with reasonable accuracy. Expert-based models may be more predictive of the general response processes used by diverse groups of examinees, whereas student-based models may be preferred when making inferences about examinees at specific ability levels. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Applied Measurement in Education is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=42746599
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/08957340902984018
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 26
        StartPage: 229
    Subjects:
      – SubjectFull: Cognition
        Type: general
      – SubjectFull: Mathematical models
        Type: general
      – SubjectFull: Mathematical analysis
        Type: general
      – SubjectFull: Slosson Intelligence Test
        Type: general
      – SubjectFull: Students
        Type: general
      – SubjectFull: Methodology
        Type: general
      – SubjectFull: Judgment (Psychology)
        Type: general
      – SubjectFull: Reasoning
        Type: general
    Titles:
      – TitleFull: Testing Expert-Based and Student-Based Cognitive Models: An Application of the Attribute Hierarchy Method and Hierarchy Consistency Index.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Leighton, JacquelineP.
      – PersonEntity:
          Name:
            NameFull: Cui, Ying
      – PersonEntity:
          Name:
            NameFull: Cor, M. Ken
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Text: 2009
              Type: published
              Y: 2009
          Identifiers:
            – Type: issn-print
              Value: 08957347
          Numbering:
            – Type: volume
              Value: 22
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Applied Measurement in Education
              Type: main
ResultId 1