Automated Scoring of Nonnative Speech Using the 'SpeechRater'? v. 5.0 Engine. Research Report. ETS RR-18-10
Saved in:
| Title: | Automated Scoring of Nonnative Speech Using the 'SpeechRater'? v. 5.0 Engine. Research Report. ETS RR-18-10 |
|---|---|
| Language: | English |
| Authors: | Chen, Lei, Zechner, Klaus, Yoon, Su-Youn, Evanini, Keelan, Wang, Xinhao, Loukina, Anatassia, Tap, Jidong, Davis, Lawrence, Lee, Chong Min, Ma, Min, Mundowsky, Robert, Lu, Chi, Leong, Chee Wee, Gyawali, Binod |
| Source: | ETS Research Report Series. Dec 2018. |
| Availability: | Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets |
| Peer Reviewed: | Y |
| Page Count: | 33 |
| Publication Date: | 2018 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Computer Assisted Testing, Scoring, Test Scoring Machines, Speech Tests, Automation, Pronunciation, Suprasegmentals, Vocabulary, Grammar, Natural Language Processing, Communicative Competence (Languages), Oral Language, Non English Speaking |
| ISSN: | 2330-8516 |
| Abstract: | This research report provides an overview of the R&D efforts at Educational Testing Service related to its capability for automated scoring of nonnative spontaneous speech with the "SpeechRater"? automated scoring service since its initial version was deployed in 2006. While most aspects of this R&D work have been published in various venues in recent years, no comprehensive account of the current state of SpeechRater has been provided since the initial publications following its first operational use in 2006. After a brief review of recent related work by other institutions, we summarize the main features and feature classes that have been developed and introduced into SpeechRater in the past 10 years, including features measuring aspects of pronunciation, prosody, vocabulary, grammar, content, and discourse. Furthermore, new types of filtering models for flagging nonscorable spoken responses are described, as is our new hybrid way of building linear regression scoring models with improved feature selection. Finally, empirical results for SpeechRater 5.0 (operationally deployed in 2016) are provided. |
| Abstractor: | As Provided |
| Number of References: | 114 |
| Entry Date: | 2019 |
| Accession Number: | EJ1202795 |
| Database: | ERIC |
| Abstract: | This research report provides an overview of the R&D efforts at Educational Testing Service related to its capability for automated scoring of nonnative spontaneous speech with the "SpeechRater"? automated scoring service since its initial version was deployed in 2006. While most aspects of this R&D work have been published in various venues in recent years, no comprehensive account of the current state of SpeechRater has been provided since the initial publications following its first operational use in 2006. After a brief review of recent related work by other institutions, we summarize the main features and feature classes that have been developed and introduced into SpeechRater in the past 10 years, including features measuring aspects of pronunciation, prosody, vocabulary, grammar, content, and discourse. Furthermore, new types of filtering models for flagging nonscorable spoken responses are described, as is our new hybrid way of building linear regression scoring models with improved feature selection. Finally, empirical results for SpeechRater 5.0 (operationally deployed in 2016) are provided. |
|---|---|
| ISSN: | 2330-8516 |
