The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech.
Saved in:
| Title: | The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech. |
|---|---|
| Authors: | Crandell, Hannah A.1, Silcox, Jack W.1, Ferguson, Sarah H.2, Lohani, Monika3, Payne, Brennan R.1,2 Brennan.payne@utah.edu |
| Source: | Journal of Speech, Language & Hearing Research. Jun2022, Vol. 65 Issue 6, p2364-2390. 27p. 3 Charts, 3 Graphs. |
| Subject Terms: | *Memory, *Audiometry, Closed captioning, Speech errors, Noise, Hearing disorder diagnosis, Automatic speech recognition, Deafness prevention |
| Abstract: | Purpose: Previous studies have suggested that the negative effects of acoustic challenge on speech memory can be attenuated with assistive text captions, particularly among older adults with hearing impairment. However, no studies have systematically examined the effects of text-captioning errors, which are common in automated speech recognition (ASR) systems. Method: In two experiments, we examined memory for text-captioned speech (with and without background noise) when captions had no errors (control) or had one of three common ASR errors: substitution, deletion, or insertion errors. Results: In both Experiment 1 (young adults with normal hearing) and Experiment 2 (older adults with varying hearing acuity), we observed similar additive effects of caption errors and background noise, such that increased background noise and the presence of captioning errors negatively impacted memory outcomes. Notably, the negative effects of captioning errors were largest among older adults with increased hearing thresholds, suggesting that older adults with hearing loss may show an increased reliance on text captions compared to adults with normal hearing. Conclusion: Our findings show that even a single-word error can be deleterious to memory for text-captioned speech, especially in older adults with hearing loss. Therefore, to produce the greatest benefit to memory, it is crucial that text captions are accurate. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Speech, Language & Hearing Research is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 157403226 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Crandell%2C+Hannah+A%2E%22">Crandell, Hannah A.</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Silcox%2C+Jack+W%2E%22">Silcox, Jack W.</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Ferguson%2C+Sarah+H%2E%22">Ferguson, Sarah H.</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Lohani%2C+Monika%22">Lohani, Monika</searchLink><relatesTo>3</relatesTo><br /><searchLink fieldCode="AR" term="%22Payne%2C+Brennan+R%2E%22">Payne, Brennan R.</searchLink><relatesTo>1,2</relatesTo><i> Brennan.payne@utah.edu</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Speech%2C+Language+%26+Hearing+Research%22">Journal of Speech, Language & Hearing Research</searchLink>. Jun2022, Vol. 65 Issue 6, p2364-2390. 27p. 3 Charts, 3 Graphs. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Memory%22">Memory</searchLink><br />*<searchLink fieldCode="DE" term="%22Audiometry%22">Audiometry</searchLink><br /><searchLink fieldCode="DE" term="%22Closed+captioning%22">Closed captioning</searchLink><br /><searchLink fieldCode="DE" term="%22Speech+errors%22">Speech errors</searchLink><br /><searchLink fieldCode="DE" term="%22Noise%22">Noise</searchLink><br /><searchLink fieldCode="DE" term="%22Hearing+disorder+diagnosis%22">Hearing disorder diagnosis</searchLink><br /><searchLink fieldCode="DE" term="%22Automatic+speech+recognition%22">Automatic speech recognition</searchLink><br /><searchLink fieldCode="DE" term="%22Deafness+prevention%22">Deafness prevention</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Purpose: Previous studies have suggested that the negative effects of acoustic challenge on speech memory can be attenuated with assistive text captions, particularly among older adults with hearing impairment. However, no studies have systematically examined the effects of text-captioning errors, which are common in automated speech recognition (ASR) systems. Method: In two experiments, we examined memory for text-captioned speech (with and without background noise) when captions had no errors (control) or had one of three common ASR errors: substitution, deletion, or insertion errors. Results: In both Experiment 1 (young adults with normal hearing) and Experiment 2 (older adults with varying hearing acuity), we observed similar additive effects of caption errors and background noise, such that increased background noise and the presence of captioning errors negatively impacted memory outcomes. Notably, the negative effects of captioning errors were largest among older adults with increased hearing thresholds, suggesting that older adults with hearing loss may show an increased reliance on text captions compared to adults with normal hearing. Conclusion: Our findings show that even a single-word error can be deleterious to memory for text-captioned speech, especially in older adults with hearing loss. Therefore, to produce the greatest benefit to memory, it is crucial that text captions are accurate. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Speech, Language & Hearing Research is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=157403226 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1044/2022_JSLHR-21-00416 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 27 StartPage: 2364 Subjects: – SubjectFull: Memory Type: general – SubjectFull: Audiometry Type: general – SubjectFull: Closed captioning Type: general – SubjectFull: Speech errors Type: general – SubjectFull: Noise Type: general – SubjectFull: Hearing disorder diagnosis Type: general – SubjectFull: Automatic speech recognition Type: general – SubjectFull: Deafness prevention Type: general Titles: – TitleFull: The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Crandell, Hannah A. – PersonEntity: Name: NameFull: Silcox, Jack W. – PersonEntity: Name: NameFull: Ferguson, Sarah H. – PersonEntity: Name: NameFull: Lohani, Monika – PersonEntity: Name: NameFull: Payne, Brennan R. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Text: Jun2022 Type: published Y: 2022 Identifiers: – Type: issn-print Value: 10924388 Numbering: – Type: volume Value: 65 – Type: issue Value: 6 Titles: – TitleFull: Journal of Speech, Language & Hearing Research Type: main |
| ResultId | 1 |
