Comparing L2 Intelligibility for Learners of French: Automatic Speech Recognition versus Human Listeners

Saved in:
Bibliographic Details
Title: Comparing L2 Intelligibility for Learners of French: Automatic Speech Recognition versus Human Listeners
Language: English
Authors: Elena Shimanskaya (ORCID 0000-0002-4534-6772)
Source: Foreign Language Annals. 2025 58(2):438-457.
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 20
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Descriptors: Comparative Analysis, French, Second Language Learning, Second Language Instruction, Accuracy, Intelligibility, Correlation, Technology Integration, Native Language, Audio Equipment, Speech Communication, Transcripts (Written Records), Evaluators, Oral Reading, Language Teachers
DOI: 10.1111/flan.12807
ISSN: 0015-718X
1944-9720
Abstract: In this study, I compare the accuracy of automatic speech recognition (ASR) transcription against two measures of intelligibility provided by human listeners. The data came from readings of five texts recorded by 15 language learners of French. Human understanding was gauged by (i) asking a group of 36 naïve first language (L1) speakers of French recruited from the general population to provide word-for-word transcriptions of the recordings, and (ii) asking two experienced French teachers (L1 speakers of French) to rate the recordings for intelligibility. The results reveal that ASR transcription accuracy was lower than that of human transcribers. However, all three measures, namely ASR transcription accuracy, human transcription accuracy, and human ratings of intelligibility, were correlated. Implications of these results for using the technology in foreign language teaching and learning are considered in the discussion.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1477307
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:In this study, I compare the accuracy of automatic speech recognition (ASR) transcription against two measures of intelligibility provided by human listeners. The data came from readings of five texts recorded by 15 language learners of French. Human understanding was gauged by (i) asking a group of 36 naïve first language (L1) speakers of French recruited from the general population to provide word-for-word transcriptions of the recordings, and (ii) asking two experienced French teachers (L1 speakers of French) to rate the recordings for intelligibility. The results reveal that ASR transcription accuracy was lower than that of human transcribers. However, all three measures, namely ASR transcription accuracy, human transcription accuracy, and human ratings of intelligibility, were correlated. Implications of these results for using the technology in foreign language teaching and learning are considered in the discussion.
ISSN:0015-718X
1944-9720
DOI:10.1111/flan.12807