View in EDS

The Effects of Visual Input on Scoring a Speaking Achievement Test

Saved in:
Bibliographic Details
Title: The Effects of Visual Input on Scoring a Speaking Achievement Test
Language: English
Authors: Beltrán, Jorge
Source: Working Papers in TESOL & Applied Linguistics. 2016 16(2):1-24.
Availability: Teachers College, Columbia University. 525 West 120th Street, New York, NY 10027. e-mail: tcwebjournal@tc.columbia.edu; Web site: https://tesolal.columbia.edu/
Peer Reviewed: Y
Page Count: 24
Publication Date: 2016
Document Type: Journal Articles
Reports - Research
Tests/Questionnaires
Education Level: Adult Education
Descriptors: Achievement Tests, Speech Skills, Speech Tests, Second Language Learning, Visual Stimuli, Listening Comprehension Tests, Scoring Formulas, Audiovisual Aids, Intermode Differences, Interrater Reliability, Preferences, Quasiexperimental Design, College Second Language Programs, Task Analysis, Scoring Rubrics, Questionnaires, Test Reliability, Comparative Analysis, Mixed Methods Research, Adult Learning
Geographic Terms: New York (New York)
ISSN: 1936-7384
Abstract: In the assessment of aural skills of second language learners, the study of the inclusion of visual stimuli has almost exclusively been conducted in the context of listening assessment. While the inclusion of contextual information in test input has been advocated for by numerous researchers (Ockey, 2010), little has been said regarding the "scoring" of speaking tests, which also involves raters' listening comprehension. This study is designed to identify the possible variation in the scoring of speaking test performance when the speech samples to be scored are presented in either audio-only or audio-visual format. A group of raters were first asked to score a set of audio-only speech samples from an achievement speaking test consisting of one monologic task through an online platform. Weeks later, they scored the same samples presented in audio-visual format. Scores from both scoring sessions were compared. Findings suggest that the inclusion of visual stimuli may not result in significant effects on assigned scores or internal consistency. Yet, given the raters' reported preference of using the audio-visual format, the study results call for further exploration of the positive effects of delivery methods on rater effect.
Abstractor: As Provided
Number of References: 26
Entry Date: 2018
Accession Number: EJ1176860
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1176860
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1176860
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Effects of Visual Input on Scoring a Speaking Achievement Test
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Beltrán%2C+Jorge%22">Beltrán, Jorge</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Working+Papers+in+TESOL+%26+Applied+Linguistics%22"><i>Working Papers in TESOL & Applied Linguistics</i></searchLink>. 2016 16(2):1-24.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Teachers College, Columbia University. 525 West 120th Street, New York, NY 10027. e-mail: tcwebjournal@tc.columbia.edu; Web site: https://tesolal.columbia.edu/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 24
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2016
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research<br />Tests/Questionnaires
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Adult+Education%22">Adult Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Achievement+Tests%22">Achievement Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Speech+Skills%22">Speech Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Speech+Tests%22">Speech Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Visual+Stimuli%22">Visual Stimuli</searchLink><br /><searchLink fieldCode="DE" term="%22Listening+Comprehension+Tests%22">Listening Comprehension Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring+Formulas%22">Scoring Formulas</searchLink><br /><searchLink fieldCode="DE" term="%22Audiovisual+Aids%22">Audiovisual Aids</searchLink><br /><searchLink fieldCode="DE" term="%22Intermode+Differences%22">Intermode Differences</searchLink><br /><searchLink fieldCode="DE" term="%22Interrater+Reliability%22">Interrater Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Preferences%22">Preferences</searchLink><br /><searchLink fieldCode="DE" term="%22Quasiexperimental+Design%22">Quasiexperimental Design</searchLink><br /><searchLink fieldCode="DE" term="%22College+Second+Language+Programs%22">College Second Language Programs</searchLink><br /><searchLink fieldCode="DE" term="%22Task+Analysis%22">Task Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring+Rubrics%22">Scoring Rubrics</searchLink><br /><searchLink fieldCode="DE" term="%22Questionnaires%22">Questionnaires</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Mixed+Methods+Research%22">Mixed Methods Research</searchLink><br /><searchLink fieldCode="DE" term="%22Adult+Learning%22">Adult Learning</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22New+York+%28New+York%29%22">New York (New York)</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1936-7384
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In the assessment of aural skills of second language learners, the study of the inclusion of visual stimuli has almost exclusively been conducted in the context of listening assessment. While the inclusion of contextual information in test input has been advocated for by numerous researchers (Ockey, 2010), little has been said regarding the "scoring" of speaking tests, which also involves raters' listening comprehension. This study is designed to identify the possible variation in the scoring of speaking test performance when the speech samples to be scored are presented in either audio-only or audio-visual format. A group of raters were first asked to score a set of audio-only speech samples from an achievement speaking test consisting of one monologic task through an online platform. Weeks later, they scored the same samples presented in audio-visual format. Scores from both scoring sessions were compared. Findings suggest that the inclusion of visual stimuli may not result in significant effects on assigned scores or internal consistency. Yet, given the raters' reported preference of using the audio-visual format, the study results call for further exploration of the positive effects of delivery methods on rater effect.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: Ref
  Label: Number of References
  Group: RefInfo
  Data: 26
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2018
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1176860
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1176860
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 24
        StartPage: 1
    Subjects:
      – SubjectFull: Achievement Tests
        Type: general
      – SubjectFull: Speech Skills
        Type: general
      – SubjectFull: Speech Tests
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Visual Stimuli
        Type: general
      – SubjectFull: Listening Comprehension Tests
        Type: general
      – SubjectFull: Scoring Formulas
        Type: general
      – SubjectFull: Audiovisual Aids
        Type: general
      – SubjectFull: Intermode Differences
        Type: general
      – SubjectFull: Interrater Reliability
        Type: general
      – SubjectFull: Preferences
        Type: general
      – SubjectFull: Quasiexperimental Design
        Type: general
      – SubjectFull: College Second Language Programs
        Type: general
      – SubjectFull: Task Analysis
        Type: general
      – SubjectFull: Scoring Rubrics
        Type: general
      – SubjectFull: Questionnaires
        Type: general
      – SubjectFull: Test Reliability
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Mixed Methods Research
        Type: general
      – SubjectFull: Adult Learning
        Type: general
      – SubjectFull: New York (New York)
        Type: general
    Titles:
      – TitleFull: The Effects of Visual Input on Scoring a Speaking Achievement Test
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Beltrán, Jorge
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2016
          Identifiers:
            – Type: issn-electronic
              Value: 1936-7384
          Numbering:
            – Type: volume
              Value: 16
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Working Papers in TESOL & Applied Linguistics
              Type: main
ResultId 1