View in EDS PDF Full Text

Computer-aided assessment in mechanics: question design and test evaluation.

Saved in:
Bibliographic Details
Title: Computer-aided assessment in mechanics: question design and test evaluation.
Authors: M. Gill, M. Greenhow
Source: Teaching Mathematics & its Applications. Sep2007, Vol. 26 Issue 3, p124-124. 1p.
Subject Terms: *Objective tests, Mechanics (Physics), MathML (Document markup language), SVG (Document markup language)
Abstract: This article describes pedagogic issues in setting objective tests in mechanics using Question Mark Perception, coupled with MathML mathematics mark-up and the Scalable Vector Graphics (SVG) syntax for producing diagrams. The content of the questions (for a range of question types such as multi-choice, numerical input and variants such as confidence-based questions) is scripted with random parameters, thereby producing many millions of realizations of the underlying ‘question style’. This means that the question setter must completely specify the algebraic and pedagogic structure of the question. For some question types, we need to understand and encode the ways in which students make mistakes, offering them as distracters or recognizing their use in numerical inputs (we call this responsive numerical input). We have examined several years’ worth of exam scripts to discover what ‘mal-rules’ are used for each question and attempted to characterize them with metadata that makes students’ responses recorded in the answer files easier to understand. Results from evaluation experiments are presented; in particular, we are interested in whether the feedback ‘feeds forward’ to affect students’ approaches to doing problems in a repeat test or exam, delayed by a variable time period (almost immediately, after 1 week, 1 month or more). To quantify this when examining end of semester exam scripts, we looked at four indicators: using units, identifying vectors, using diagrams and emulating the good layout of the feedback screens in their own written solutions. [ABSTRACT FROM AUTHOR]
Copyright of Teaching Mathematics & its Applications is the property of Oxford University Press / USA and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: ehh
DbLabel: Education Research Complete
An: 26589209
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Computer-aided assessment in mechanics: question design and test evaluation.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22M%2E+Gill%22">M. Gill</searchLink><br /><searchLink fieldCode="AR" term="%22M%2E+Greenhow%22">M. Greenhow</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Teaching+Mathematics+%26+its+Applications%22">Teaching Mathematics & its Applications</searchLink>. Sep2007, Vol. 26 Issue 3, p124-124. 1p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Objective+tests%22">Objective tests</searchLink><br /><searchLink fieldCode="DE" term="%22Mechanics+%28Physics%29%22">Mechanics (Physics)</searchLink><br /><searchLink fieldCode="DE" term="%22MathML+%28Document+markup+language%29%22">MathML (Document markup language)</searchLink><br /><searchLink fieldCode="DE" term="%22SVG+%28Document+markup+language%29%22">SVG (Document markup language)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This article describes pedagogic issues in setting objective tests in mechanics using Question Mark Perception, coupled with MathML mathematics mark-up and the Scalable Vector Graphics (SVG) syntax for producing diagrams. The content of the questions (for a range of question types such as multi-choice, numerical input and variants such as confidence-based questions) is scripted with random parameters, thereby producing many millions of realizations of the underlying ‘question style’. This means that the question setter must completely specify the algebraic and pedagogic structure of the question. For some question types, we need to understand and encode the ways in which students make mistakes, offering them as distracters or recognizing their use in numerical inputs (we call this responsive numerical input). We have examined several years’ worth of exam scripts to discover what ‘mal-rules’ are used for each question and attempted to characterize them with metadata that makes students’ responses recorded in the answer files easier to understand. Results from evaluation experiments are presented; in particular, we are interested in whether the feedback ‘feeds forward’ to affect students’ approaches to doing problems in a repeat test or exam, delayed by a variable time period (almost immediately, after 1 week, 1 month or more). To quantify this when examining end of semester exam scripts, we looked at four indicators: using units, identifying vectors, using diagrams and emulating the good layout of the feedback screens in their own written solutions. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Teaching Mathematics & its Applications is the property of Oxford University Press / USA and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=26589209
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1093/teamat/hrm006
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 1
        StartPage: 124
    Subjects:
      – SubjectFull: Objective tests
        Type: general
      – SubjectFull: Mechanics (Physics)
        Type: general
      – SubjectFull: MathML (Document markup language)
        Type: general
      – SubjectFull: SVG (Document markup language)
        Type: general
    Titles:
      – TitleFull: Computer-aided assessment in mechanics: question design and test evaluation.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: M. Gill
      – PersonEntity:
          Name:
            NameFull: M. Greenhow
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 12
              M: 09
              Text: Sep2007
              Type: published
              Y: 2007
          Identifiers:
            – Type: issn-print
              Value: 02683679
          Numbering:
            – Type: volume
              Value: 26
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Teaching Mathematics & its Applications
              Type: main
ResultId 1