The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech
Saved in:
| Title: | The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech |
|---|---|
| Language: | English |
| Authors: | Crandell, Hannah A., Silcox, Jack W., Ferguson, Sarah H., Lohani, Monika, Payne, Brennan R. (ORCID |
| Source: | Journal of Speech, Language, and Hearing Research. Jun 2022 65(6):2364-2390. |
| Availability: | American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org |
| Peer Reviewed: | Y |
| Page Count: | 27 |
| Publication Date: | 2022 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Visual Aids, Video Technology, Layout (Publications), Error Patterns, Hearing Impairments, Deafness, Assistive Technology, Speech Communication, Older Adults, Listening, Recall (Psychology), Acoustics, Young Adults |
| DOI: | 10.1044/2022_JSLHR-21-00416 |
| ISSN: | 1092-4388 1558-9102 |
| Abstract: | Purpose: Previous studies have suggested that the negative effects of acoustic challenge on speech memory can be attenuated with assistive text captions, particularly among older adults with hearing impairment. However, no studies have systematically examined the effects of text-captioning errors, which are common in automated speech recognition (ASR) systems. Method: In two experiments, we examined memory for text-captioned speech (with and without background noise) when captions had no errors (control) or had one of three common ASR errors: substitution, deletion, or insertion errors. Results: In both Experiment 1 (young adults with normal hearing) and Experiment 2 (older adults with varying hearing acuity), we observed similar additive effects of caption errors and background noise, such that increased background noise and the presence of captioning errors negatively impacted memory outcomes. Notably, the negative effects of captioning errors were largest among older adults with increased hearing thresholds, suggesting that older adults with hearing loss may show an increased reliance on text captions compared to adults with normal hearing. Conclusion: Our findings show that even a single-word error can be deleterious to memory for text-captioned speech, especially in older adults with hearing loss. Therefore, to produce the greatest benefit to memory, it is crucial that text captions are accurate. |
| Abstractor: | As Provided |
| Entry Date: | 2022 |
| Accession Number: | EJ1348275 |
| Database: | ERIC |
| Abstract: | Purpose: Previous studies have suggested that the negative effects of acoustic challenge on speech memory can be attenuated with assistive text captions, particularly among older adults with hearing impairment. However, no studies have systematically examined the effects of text-captioning errors, which are common in automated speech recognition (ASR) systems. Method: In two experiments, we examined memory for text-captioned speech (with and without background noise) when captions had no errors (control) or had one of three common ASR errors: substitution, deletion, or insertion errors. Results: In both Experiment 1 (young adults with normal hearing) and Experiment 2 (older adults with varying hearing acuity), we observed similar additive effects of caption errors and background noise, such that increased background noise and the presence of captioning errors negatively impacted memory outcomes. Notably, the negative effects of captioning errors were largest among older adults with increased hearing thresholds, suggesting that older adults with hearing loss may show an increased reliance on text captions compared to adults with normal hearing. Conclusion: Our findings show that even a single-word error can be deleterious to memory for text-captioned speech, especially in older adults with hearing loss. Therefore, to produce the greatest benefit to memory, it is crucial that text captions are accurate. |
|---|---|
| ISSN: | 1092-4388 1558-9102 |
| DOI: | 10.1044/2022_JSLHR-21-00416 |
