View in EDS

Automated Scoring of Nonnative Speech Using the 'SpeechRater'? v. 5.0 Engine. Research Report. ETS RR-18-10

Saved in:
Bibliographic Details
Title: Automated Scoring of Nonnative Speech Using the 'SpeechRater'? v. 5.0 Engine. Research Report. ETS RR-18-10
Language: English
Authors: Chen, Lei, Zechner, Klaus, Yoon, Su-Youn, Evanini, Keelan, Wang, Xinhao, Loukina, Anatassia, Tap, Jidong, Davis, Lawrence, Lee, Chong Min, Ma, Min, Mundowsky, Robert, Lu, Chi, Leong, Chee Wee, Gyawali, Binod
Source: ETS Research Report Series. Dec 2018.
Availability: Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Peer Reviewed: Y
Page Count: 33
Publication Date: 2018
Document Type: Journal Articles
Reports - Research
Descriptors: Computer Assisted Testing, Scoring, Test Scoring Machines, Speech Tests, Automation, Pronunciation, Suprasegmentals, Vocabulary, Grammar, Natural Language Processing, Communicative Competence (Languages), Oral Language, Non English Speaking
ISSN: 2330-8516
Abstract: This research report provides an overview of the R&D efforts at Educational Testing Service related to its capability for automated scoring of nonnative spontaneous speech with the "SpeechRater"? automated scoring service since its initial version was deployed in 2006. While most aspects of this R&D work have been published in various venues in recent years, no comprehensive account of the current state of SpeechRater has been provided since the initial publications following its first operational use in 2006. After a brief review of recent related work by other institutions, we summarize the main features and feature classes that have been developed and introduced into SpeechRater in the past 10 years, including features measuring aspects of pronunciation, prosody, vocabulary, grammar, content, and discourse. Furthermore, new types of filtering models for flagging nonscorable spoken responses are described, as is our new hybrid way of building linear regression scoring models with improved feature selection. Finally, empirical results for SpeechRater 5.0 (operationally deployed in 2016) are provided.
Abstractor: As Provided
Number of References: 114
Entry Date: 2019
Accession Number: EJ1202795
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1202795
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1202795
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Automated Scoring of Nonnative Speech Using the 'SpeechRater'? v. 5.0 Engine. Research Report. ETS RR-18-10
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Chen%2C+Lei%22">Chen, Lei</searchLink><br /><searchLink fieldCode="AR" term="%22Zechner%2C+Klaus%22">Zechner, Klaus</searchLink><br /><searchLink fieldCode="AR" term="%22Yoon%2C+Su-Youn%22">Yoon, Su-Youn</searchLink><br /><searchLink fieldCode="AR" term="%22Evanini%2C+Keelan%22">Evanini, Keelan</searchLink><br /><searchLink fieldCode="AR" term="%22Wang%2C+Xinhao%22">Wang, Xinhao</searchLink><br /><searchLink fieldCode="AR" term="%22Loukina%2C+Anatassia%22">Loukina, Anatassia</searchLink><br /><searchLink fieldCode="AR" term="%22Tap%2C+Jidong%22">Tap, Jidong</searchLink><br /><searchLink fieldCode="AR" term="%22Davis%2C+Lawrence%22">Davis, Lawrence</searchLink><br /><searchLink fieldCode="AR" term="%22Lee%2C+Chong+Min%22">Lee, Chong Min</searchLink><br /><searchLink fieldCode="AR" term="%22Ma%2C+Min%22">Ma, Min</searchLink><br /><searchLink fieldCode="AR" term="%22Mundowsky%2C+Robert%22">Mundowsky, Robert</searchLink><br /><searchLink fieldCode="AR" term="%22Lu%2C+Chi%22">Lu, Chi</searchLink><br /><searchLink fieldCode="AR" term="%22Leong%2C+Chee+Wee%22">Leong, Chee Wee</searchLink><br /><searchLink fieldCode="AR" term="%22Gyawali%2C+Binod%22">Gyawali, Binod</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22ETS+Research+Report+Series%22"><i>ETS Research Report Series</i></searchLink>. Dec 2018.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 33
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2018
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring%22">Scoring</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Scoring+Machines%22">Test Scoring Machines</searchLink><br /><searchLink fieldCode="DE" term="%22Speech+Tests%22">Speech Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Automation%22">Automation</searchLink><br /><searchLink fieldCode="DE" term="%22Pronunciation%22">Pronunciation</searchLink><br /><searchLink fieldCode="DE" term="%22Suprasegmentals%22">Suprasegmentals</searchLink><br /><searchLink fieldCode="DE" term="%22Vocabulary%22">Vocabulary</searchLink><br /><searchLink fieldCode="DE" term="%22Grammar%22">Grammar</searchLink><br /><searchLink fieldCode="DE" term="%22Natural+Language+Processing%22">Natural Language Processing</searchLink><br /><searchLink fieldCode="DE" term="%22Communicative+Competence+%28Languages%29%22">Communicative Competence (Languages)</searchLink><br /><searchLink fieldCode="DE" term="%22Oral+Language%22">Oral Language</searchLink><br /><searchLink fieldCode="DE" term="%22Non+English+Speaking%22">Non English Speaking</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2330-8516
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This research report provides an overview of the R&D efforts at Educational Testing Service related to its capability for automated scoring of nonnative spontaneous speech with the "SpeechRater"? automated scoring service since its initial version was deployed in 2006. While most aspects of this R&D work have been published in various venues in recent years, no comprehensive account of the current state of SpeechRater has been provided since the initial publications following its first operational use in 2006. After a brief review of recent related work by other institutions, we summarize the main features and feature classes that have been developed and introduced into SpeechRater in the past 10 years, including features measuring aspects of pronunciation, prosody, vocabulary, grammar, content, and discourse. Furthermore, new types of filtering models for flagging nonscorable spoken responses are described, as is our new hybrid way of building linear regression scoring models with improved feature selection. Finally, empirical results for SpeechRater 5.0 (operationally deployed in 2016) are provided.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: Ref
  Label: Number of References
  Group: RefInfo
  Data: 114
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2019
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1202795
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1202795
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 33
    Subjects:
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Scoring
        Type: general
      – SubjectFull: Test Scoring Machines
        Type: general
      – SubjectFull: Speech Tests
        Type: general
      – SubjectFull: Automation
        Type: general
      – SubjectFull: Pronunciation
        Type: general
      – SubjectFull: Suprasegmentals
        Type: general
      – SubjectFull: Vocabulary
        Type: general
      – SubjectFull: Grammar
        Type: general
      – SubjectFull: Natural Language Processing
        Type: general
      – SubjectFull: Communicative Competence (Languages)
        Type: general
      – SubjectFull: Oral Language
        Type: general
      – SubjectFull: Non English Speaking
        Type: general
    Titles:
      – TitleFull: Automated Scoring of Nonnative Speech Using the 'SpeechRater'? v. 5.0 Engine. Research Report. ETS RR-18-10
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Chen, Lei
      – PersonEntity:
          Name:
            NameFull: Zechner, Klaus
      – PersonEntity:
          Name:
            NameFull: Yoon, Su-Youn
      – PersonEntity:
          Name:
            NameFull: Evanini, Keelan
      – PersonEntity:
          Name:
            NameFull: Wang, Xinhao
      – PersonEntity:
          Name:
            NameFull: Loukina, Anatassia
      – PersonEntity:
          Name:
            NameFull: Tap, Jidong
      – PersonEntity:
          Name:
            NameFull: Davis, Lawrence
      – PersonEntity:
          Name:
            NameFull: Lee, Chong Min
      – PersonEntity:
          Name:
            NameFull: Ma, Min
      – PersonEntity:
          Name:
            NameFull: Mundowsky, Robert
      – PersonEntity:
          Name:
            NameFull: Lu, Chi
      – PersonEntity:
          Name:
            NameFull: Leong, Chee Wee
      – PersonEntity:
          Name:
            NameFull: Gyawali, Binod
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2018
          Identifiers:
            – Type: issn-electronic
              Value: 2330-8516
          Titles:
            – TitleFull: ETS Research Report Series
              Type: main
ResultId 1