View in EDS

Assessor Decision Making While Marking a Note-Taking Listening Test: The Case of the OET

Saved in:
Bibliographic Details
Title: Assessor Decision Making While Marking a Note-Taking Listening Test: The Case of the OET
Language: English
Authors: Harding, Luke, Pill, John, Ryan, Kerry
Source: Language Assessment Quarterly. 2011 8(2):108-126.
Availability: Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Peer Reviewed: Y
Physical Description: PDF
Page Count: 19
Publication Date: 2011
Document Type: Journal Articles
Reports - Research
Descriptors: Notetaking, Task Analysis, English (Second Language), Second Language Learning, Listening Comprehension Tests, Tests, Decision Making, Content Analysis, Literacy, Language Tests, Recall (Psychology), Classification, Evaluators, Grading
DOI: 10.1080/15434303.2011.556770
ISSN: 1543-4303
Abstract: This article investigates assessor decision making when using and applying a marking guide for a note-taking task in a specific purpose English language listening test. In contexts where note-taking items are used, a marking guide is intended to stipulate what kind of response should be accepted as evidence of the ability under test. However, there remains some scope for assessors to apply their own interpretations of the construct in judging responses that fall outside the information provided in a marking guide. From a content analysis of data collected in a stimulated recall group discussion, a taxonomy of the types of decisions made by assessors is derived and the bases on which assessors make such decisions are discussed. The present study is therefore a departure point for further investigations into how assessor decision-making processes while marking open-ended items might be improved. (Contains 2 tables and 2 figures.)
Abstractor: As Provided
Number of References: 33
Entry Date: 2011
Accession Number: EJ926434
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ926434
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Assessor Decision Making While Marking a Note-Taking Listening Test: The Case of the OET
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Harding%2C+Luke%22">Harding, Luke</searchLink><br /><searchLink fieldCode="AR" term="%22Pill%2C+John%22">Pill, John</searchLink><br /><searchLink fieldCode="AR" term="%22Ryan%2C+Kerry%22">Ryan, Kerry</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Language+Assessment+Quarterly%22"><i>Language Assessment Quarterly</i></searchLink>. 2011 8(2):108-126.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: PhysDesc
  Label: Physical Description
  Group: PhysDesc
  Data: PDF
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 19
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2011
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Notetaking%22">Notetaking</searchLink><br /><searchLink fieldCode="DE" term="%22Task+Analysis%22">Task Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22English+%28Second+Language%29%22">English (Second Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Listening+Comprehension+Tests%22">Listening Comprehension Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Tests%22">Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Decision+Making%22">Decision Making</searchLink><br /><searchLink fieldCode="DE" term="%22Content+Analysis%22">Content Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Literacy%22">Literacy</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Tests%22">Language Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Recall+%28Psychology%29%22">Recall (Psychology)</searchLink><br /><searchLink fieldCode="DE" term="%22Classification%22">Classification</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluators%22">Evaluators</searchLink><br /><searchLink fieldCode="DE" term="%22Grading%22">Grading</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1080/15434303.2011.556770
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1543-4303
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This article investigates assessor decision making when using and applying a marking guide for a note-taking task in a specific purpose English language listening test. In contexts where note-taking items are used, a marking guide is intended to stipulate what kind of response should be accepted as evidence of the ability under test. However, there remains some scope for assessors to apply their own interpretations of the construct in judging responses that fall outside the information provided in a marking guide. From a content analysis of data collected in a stimulated recall group discussion, a taxonomy of the types of decisions made by assessors is derived and the bases on which assessors make such decisions are discussed. The present study is therefore a departure point for further investigations into how assessor decision-making processes while marking open-ended items might be improved. (Contains 2 tables and 2 figures.)
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: Ref
  Label: Number of References
  Group: RefInfo
  Data: 33
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2011
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ926434
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ926434
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/15434303.2011.556770
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 19
        StartPage: 108
    Subjects:
      – SubjectFull: Notetaking
        Type: general
      – SubjectFull: Task Analysis
        Type: general
      – SubjectFull: English (Second Language)
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Listening Comprehension Tests
        Type: general
      – SubjectFull: Tests
        Type: general
      – SubjectFull: Decision Making
        Type: general
      – SubjectFull: Content Analysis
        Type: general
      – SubjectFull: Literacy
        Type: general
      – SubjectFull: Language Tests
        Type: general
      – SubjectFull: Recall (Psychology)
        Type: general
      – SubjectFull: Classification
        Type: general
      – SubjectFull: Evaluators
        Type: general
      – SubjectFull: Grading
        Type: general
    Titles:
      – TitleFull: Assessor Decision Making While Marking a Note-Taking Listening Test: The Case of the OET
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Harding, Luke
      – PersonEntity:
          Name:
            NameFull: Pill, John
      – PersonEntity:
          Name:
            NameFull: Ryan, Kerry
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2011
          Identifiers:
            – Type: issn-print
              Value: 1543-4303
          Numbering:
            – Type: volume
              Value: 8
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Language Assessment Quarterly
              Type: main
ResultId 1