The Effects of Visual Input on Scoring a Speaking Achievement Test

Saved in:
Bibliographic Details
Title: The Effects of Visual Input on Scoring a Speaking Achievement Test
Language: English
Authors: Beltrán, Jorge
Source: Working Papers in TESOL & Applied Linguistics. 2016 16(2):1-24.
Availability: Teachers College, Columbia University. 525 West 120th Street, New York, NY 10027. e-mail: tcwebjournal@tc.columbia.edu; Web site: https://tesolal.columbia.edu/
Peer Reviewed: Y
Page Count: 24
Publication Date: 2016
Document Type: Journal Articles
Reports - Research
Tests/Questionnaires
Education Level: Adult Education
Descriptors: Achievement Tests, Speech Skills, Speech Tests, Second Language Learning, Visual Stimuli, Listening Comprehension Tests, Scoring Formulas, Audiovisual Aids, Intermode Differences, Interrater Reliability, Preferences, Quasiexperimental Design, College Second Language Programs, Task Analysis, Scoring Rubrics, Questionnaires, Test Reliability, Comparative Analysis, Mixed Methods Research, Adult Learning
Geographic Terms: New York (New York)
ISSN: 1936-7384
Abstract: In the assessment of aural skills of second language learners, the study of the inclusion of visual stimuli has almost exclusively been conducted in the context of listening assessment. While the inclusion of contextual information in test input has been advocated for by numerous researchers (Ockey, 2010), little has been said regarding the "scoring" of speaking tests, which also involves raters' listening comprehension. This study is designed to identify the possible variation in the scoring of speaking test performance when the speech samples to be scored are presented in either audio-only or audio-visual format. A group of raters were first asked to score a set of audio-only speech samples from an achievement speaking test consisting of one monologic task through an online platform. Weeks later, they scored the same samples presented in audio-visual format. Scores from both scoring sessions were compared. Findings suggest that the inclusion of visual stimuli may not result in significant effects on assigned scores or internal consistency. Yet, given the raters' reported preference of using the audio-visual format, the study results call for further exploration of the positive effects of delivery methods on rater effect.
Abstractor: As Provided
Number of References: 26
Entry Date: 2018
Accession Number: EJ1176860
Database: ERIC
Be the first to leave a comment!
You must be logged in first