View in EDS

The Art of Test Construction: Can You Make a Good Physics Exam by Selecting Questions from a Bank?

Saved in:
Bibliographic Details
Title: The Art of Test Construction: Can You Make a Good Physics Exam by Selecting Questions from a Bank?
Language: English
Authors: Tom Bramley, Victoria Crisp, Stuart Shaw
Source: Research Matters. 2019 (27):2-8.
Availability: Cambridge University Press & Assessment. Shaftesbury Road Cambridge CB2 8EA. Tel: 44-1223-553311; e-mail: directcs@cambridge.org; Web site: https://www.cambridgeassessment.org.uk/our-research/all-published-resources/research-matters/
Peer Reviewed: N
Page Count: 7
Publication Date: 2019
Document Type: Journal Articles
Reports - Research
Education Level: Secondary Education
Descriptors: Physics, Science Tests, Science Instruction, Test Construction, Secondary School Students, Specialists, Test Items, Item Analysis, Foreign Countries
Geographic Terms: United Kingdom
ISSN: 1755-6031
Abstract: In the traditional approach to constructing a GCSE or A Level examination paper, a single person writes the whole paper. In some other contexts, tests are constructed by selecting questions from a bank of questions. In this research, we asked experts to evaluate the quality of Physics exam papers constructed in the traditional way, constructed by expert selection of items from a bank, and constructed by computer selection of items from a bank. Anecdotal evidence suggested a "compilation" process would be detrimental to the quality of this kind of exam. We wanted to test whether in fact assessment experts could distinguish between tests that had been created in the traditional way, and those that had been compiled by selection from a bank, when they were unaware of the method of construction.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1418711
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1418711
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1418711
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Art of Test Construction: Can You Make a Good Physics Exam by Selecting Questions from a Bank?
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Tom+Bramley%22">Tom Bramley</searchLink><br /><searchLink fieldCode="AR" term="%22Victoria+Crisp%22">Victoria Crisp</searchLink><br /><searchLink fieldCode="AR" term="%22Stuart+Shaw%22">Stuart Shaw</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Research+Matters%22"><i>Research Matters</i></searchLink>. 2019 (27):2-8.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Cambridge University Press & Assessment. Shaftesbury Road Cambridge CB2 8EA. Tel: 44-1223-553311; e-mail: directcs@cambridge.org; Web site: https://www.cambridgeassessment.org.uk/our-research/all-published-resources/research-matters/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 7
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2019
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Physics%22">Physics</searchLink><br /><searchLink fieldCode="DE" term="%22Science+Tests%22">Science Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Science+Instruction%22">Science Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Secondary+School+Students%22">Secondary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Specialists%22">Specialists</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Analysis%22">Item Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22United+Kingdom%22">United Kingdom</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1755-6031
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In the traditional approach to constructing a GCSE or A Level examination paper, a single person writes the whole paper. In some other contexts, tests are constructed by selecting questions from a bank of questions. In this research, we asked experts to evaluate the quality of Physics exam papers constructed in the traditional way, constructed by expert selection of items from a bank, and constructed by computer selection of items from a bank. Anecdotal evidence suggested a "compilation" process would be detrimental to the quality of this kind of exam. We wanted to test whether in fact assessment experts could distinguish between tests that had been created in the traditional way, and those that had been compiled by selection from a bank, when they were unaware of the method of construction.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1418711
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1418711
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 7
        StartPage: 2
    Subjects:
      – SubjectFull: Physics
        Type: general
      – SubjectFull: Science Tests
        Type: general
      – SubjectFull: Science Instruction
        Type: general
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Secondary School Students
        Type: general
      – SubjectFull: Specialists
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Item Analysis
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: United Kingdom
        Type: general
    Titles:
      – TitleFull: The Art of Test Construction: Can You Make a Good Physics Exam by Selecting Questions from a Bank?
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Tom Bramley
      – PersonEntity:
          Name:
            NameFull: Victoria Crisp
      – PersonEntity:
          Name:
            NameFull: Stuart Shaw
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2019
          Identifiers:
            – Type: issn-print
              Value: 1755-6031
          Numbering:
            – Type: issue
              Value: 27
          Titles:
            – TitleFull: Research Matters
              Type: main
ResultId 1