Assessor Decision Making While Marking a Note-Taking Listening Test: The Case of the OET

Saved in:
Bibliographic Details
Title: Assessor Decision Making While Marking a Note-Taking Listening Test: The Case of the OET
Language: English
Authors: Harding, Luke, Pill, John, Ryan, Kerry
Source: Language Assessment Quarterly. 2011 8(2):108-126.
Availability: Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Peer Reviewed: Y
Physical Description: PDF
Page Count: 19
Publication Date: 2011
Document Type: Journal Articles
Reports - Research
Descriptors: Notetaking, Task Analysis, English (Second Language), Second Language Learning, Listening Comprehension Tests, Tests, Decision Making, Content Analysis, Literacy, Language Tests, Recall (Psychology), Classification, Evaluators, Grading
DOI: 10.1080/15434303.2011.556770
ISSN: 1543-4303
Abstract: This article investigates assessor decision making when using and applying a marking guide for a note-taking task in a specific purpose English language listening test. In contexts where note-taking items are used, a marking guide is intended to stipulate what kind of response should be accepted as evidence of the ability under test. However, there remains some scope for assessors to apply their own interpretations of the construct in judging responses that fall outside the information provided in a marking guide. From a content analysis of data collected in a stimulated recall group discussion, a taxonomy of the types of decisions made by assessors is derived and the bases on which assessors make such decisions are discussed. The present study is therefore a departure point for further investigations into how assessor decision-making processes while marking open-ended items might be improved. (Contains 2 tables and 2 figures.)
Abstractor: As Provided
Number of References: 33
Entry Date: 2011
Accession Number: EJ926434
Database: ERIC
Description
Abstract:This article investigates assessor decision making when using and applying a marking guide for a note-taking task in a specific purpose English language listening test. In contexts where note-taking items are used, a marking guide is intended to stipulate what kind of response should be accepted as evidence of the ability under test. However, there remains some scope for assessors to apply their own interpretations of the construct in judging responses that fall outside the information provided in a marking guide. From a content analysis of data collected in a stimulated recall group discussion, a taxonomy of the types of decisions made by assessors is derived and the bases on which assessors make such decisions are discussed. The present study is therefore a departure point for further investigations into how assessor decision-making processes while marking open-ended items might be improved. (Contains 2 tables and 2 figures.)
ISSN:1543-4303
DOI:10.1080/15434303.2011.556770