View in EDS

The Relationship of Constrained Free-Response to Multiple-Choice and Open-Ended Items.

Saved in:
Bibliographic Details
Title: The Relationship of Constrained Free-Response to Multiple-Choice and Open-Ended Items.
Language: English
Authors: Bennett, Randy Elliot, Educational Testing Service, Princeton, NJ.
Peer Reviewed: N
Page Count: 43
Publication Date: 1989
Document Type: Reports - Research
Descriptors: College Students, Computer Science, Computer Software, Debugging (Computers), Factor Structure, Goodness of Fit, Higher Education, Multiple Choice Tests, Scoring, Test Construction, Test Items
Assessment and Survey Identifiers: Advanced Placement Examinations (CEEB)
Abstract: This study examined the relationship of a machine-scorable, constrained free-response computer science item that required the student to debug a faulty program to two other types of items: multiple-choice and free-response requiring production of a computer program. The free-response items were from the College Board's Advanced Placement Computer Science Examination. Data were from 614 college students for whom records were complete. Confirmatory factor analysis was used to test the fit of a three-factor model to these data and to compare the fit of this model to three alternatives. These models were fit using two random-half samples, one given a faulty program containing one bug and the other a program with three bugs. A single-factor model best fit the data for the sample taking the one-bug constrained free-response, and a two-factor model fit the data for the second sample. In addition, the factor intercorrelations showed this item type to be significantly related to both the free-response items and the multiple-choice measures. An appendix gives samples of the item types. (Contains 7 tables and 21 references.) (Author/SLD)
EIS Cited: ED545896
Entry Date: 1996
Accession Number: ED395026
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED395026
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED395026
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Relationship of Constrained Free-Response to Multiple-Choice and Open-Ended Items.
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Bennett%2C+Randy+Elliot%22">Bennett, Randy Elliot</searchLink><br /><searchLink fieldCode="AR" term="%22Educational+Testing+Service%2C+Princeton%2C+NJ%2E%22">Educational Testing Service, Princeton, NJ.</searchLink>
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 43
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 1989
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Science%22">Computer Science</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Software%22">Computer Software</searchLink><br /><searchLink fieldCode="DE" term="%22Debugging+%28Computers%29%22">Debugging (Computers)</searchLink><br /><searchLink fieldCode="DE" term="%22Factor+Structure%22">Factor Structure</searchLink><br /><searchLink fieldCode="DE" term="%22Goodness+of+Fit%22">Goodness of Fit</searchLink><br /><searchLink fieldCode="DE" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="DE" term="%22Multiple+Choice+Tests%22">Multiple Choice Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring%22">Scoring</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22Advanced+Placement+Examinations+%28CEEB%29%22">Advanced Placement Examinations (CEEB)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study examined the relationship of a machine-scorable, constrained free-response computer science item that required the student to debug a faulty program to two other types of items: multiple-choice and free-response requiring production of a computer program. The free-response items were from the College Board's Advanced Placement Computer Science Examination. Data were from 614 college students for whom records were complete. Confirmatory factor analysis was used to test the fit of a three-factor model to these data and to compare the fit of this model to three alternatives. These models were fit using two random-half samples, one given a faulty program containing one bug and the other a program with three bugs. A single-factor model best fit the data for the sample taking the one-bug constrained free-response, and a two-factor model fit the data for the second sample. In addition, the factor intercorrelations showed this item type to be significantly related to both the free-response items and the multiple-choice measures. An appendix gives samples of the item types. (Contains 7 tables and 21 references.) (Author/SLD)
– Name: CodeSource
  Label: EIS Cited
  Group: SrcInfo
  Data: ED545896
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 1996
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED395026
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED395026
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 43
    Subjects:
      – SubjectFull: College Students
        Type: general
      – SubjectFull: Computer Science
        Type: general
      – SubjectFull: Computer Software
        Type: general
      – SubjectFull: Debugging (Computers)
        Type: general
      – SubjectFull: Factor Structure
        Type: general
      – SubjectFull: Goodness of Fit
        Type: general
      – SubjectFull: Higher Education
        Type: general
      – SubjectFull: Multiple Choice Tests
        Type: general
      – SubjectFull: Scoring
        Type: general
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Advanced Placement Examinations (CEEB)
        Type: general
    Titles:
      – TitleFull: The Relationship of Constrained Free-Response to Multiple-Choice and Open-Ended Items.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Educational Testing Service, Princeton, NJ.
      – PersonEntity:
          Name:
            NameFull: Bennett, Randy Elliot
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Type: published
              Y: 1989
ResultId 1