View in EDS PDF Full Text

The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech

Saved in:
Bibliographic Details
Title: The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech
Language: English
Authors: Crandell, Hannah A., Silcox, Jack W., Ferguson, Sarah H., Lohani, Monika, Payne, Brennan R. (ORCID 0000-0001-6732-6599)
Source: Journal of Speech, Language, and Hearing Research. Jun 2022 65(6):2364-2390.
Availability: American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Peer Reviewed: Y
Page Count: 27
Publication Date: 2022
Document Type: Journal Articles
Reports - Research
Descriptors: Visual Aids, Video Technology, Layout (Publications), Error Patterns, Hearing Impairments, Deafness, Assistive Technology, Speech Communication, Older Adults, Listening, Recall (Psychology), Acoustics, Young Adults
DOI: 10.1044/2022_JSLHR-21-00416
ISSN: 1092-4388
1558-9102
Abstract: Purpose: Previous studies have suggested that the negative effects of acoustic challenge on speech memory can be attenuated with assistive text captions, particularly among older adults with hearing impairment. However, no studies have systematically examined the effects of text-captioning errors, which are common in automated speech recognition (ASR) systems. Method: In two experiments, we examined memory for text-captioned speech (with and without background noise) when captions had no errors (control) or had one of three common ASR errors: substitution, deletion, or insertion errors. Results: In both Experiment 1 (young adults with normal hearing) and Experiment 2 (older adults with varying hearing acuity), we observed similar additive effects of caption errors and background noise, such that increased background noise and the presence of captioning errors negatively impacted memory outcomes. Notably, the negative effects of captioning errors were largest among older adults with increased hearing thresholds, suggesting that older adults with hearing loss may show an increased reliance on text captions compared to adults with normal hearing. Conclusion: Our findings show that even a single-word error can be deleterious to memory for text-captioned speech, especially in older adults with hearing loss. Therefore, to produce the greatest benefit to memory, it is crucial that text captions are accurate.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1348275
Database: ERIC
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwF6UFpapy2m5cWQQWY4DtzSAAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDJYzNGgANT_rZ2-BKwIBEICBm_xVy_d5IubwI2fNEwN96UhFCodC_6566kyADY4_KBhNKzMb-rgKFNG7TFGqe9YWI-VthjeVl5xK8RKWeih4Seme5HYRT_g1EE0X5wglf1LynuxNyRKqeY0WOYvhWQvUQV20GVHpskAIWdU2pzpOC6MfE7ov5PhhxO6XVLqLyG4kkDJDxP9npiO8dLrLOpnJ1FeDwIBTrQGa6PV_
Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1348275
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Crandell%2C+Hannah+A%2E%22">Crandell, Hannah A.</searchLink><br /><searchLink fieldCode="AR" term="%22Silcox%2C+Jack+W%2E%22">Silcox, Jack W.</searchLink><br /><searchLink fieldCode="AR" term="%22Ferguson%2C+Sarah+H%2E%22">Ferguson, Sarah H.</searchLink><br /><searchLink fieldCode="AR" term="%22Lohani%2C+Monika%22">Lohani, Monika</searchLink><br /><searchLink fieldCode="AR" term="%22Payne%2C+Brennan+R%2E%22">Payne, Brennan R.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-6732-6599">0000-0001-6732-6599</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Speech%2C+Language%2C+and+Hearing+Research%22"><i>Journal of Speech, Language, and Hearing Research</i></searchLink>. Jun 2022 65(6):2364-2390.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 27
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Visual+Aids%22">Visual Aids</searchLink><br /><searchLink fieldCode="DE" term="%22Video+Technology%22">Video Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Layout+%28Publications%29%22">Layout (Publications)</searchLink><br /><searchLink fieldCode="DE" term="%22Error+Patterns%22">Error Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Hearing+Impairments%22">Hearing Impairments</searchLink><br /><searchLink fieldCode="DE" term="%22Deafness%22">Deafness</searchLink><br /><searchLink fieldCode="DE" term="%22Assistive+Technology%22">Assistive Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Speech+Communication%22">Speech Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Older+Adults%22">Older Adults</searchLink><br /><searchLink fieldCode="DE" term="%22Listening%22">Listening</searchLink><br /><searchLink fieldCode="DE" term="%22Recall+%28Psychology%29%22">Recall (Psychology)</searchLink><br /><searchLink fieldCode="DE" term="%22Acoustics%22">Acoustics</searchLink><br /><searchLink fieldCode="DE" term="%22Young+Adults%22">Young Adults</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1044/2022_JSLHR-21-00416
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1092-4388<br />1558-9102
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: Previous studies have suggested that the negative effects of acoustic challenge on speech memory can be attenuated with assistive text captions, particularly among older adults with hearing impairment. However, no studies have systematically examined the effects of text-captioning errors, which are common in automated speech recognition (ASR) systems. Method: In two experiments, we examined memory for text-captioned speech (with and without background noise) when captions had no errors (control) or had one of three common ASR errors: substitution, deletion, or insertion errors. Results: In both Experiment 1 (young adults with normal hearing) and Experiment 2 (older adults with varying hearing acuity), we observed similar additive effects of caption errors and background noise, such that increased background noise and the presence of captioning errors negatively impacted memory outcomes. Notably, the negative effects of captioning errors were largest among older adults with increased hearing thresholds, suggesting that older adults with hearing loss may show an increased reliance on text captions compared to adults with normal hearing. Conclusion: Our findings show that even a single-word error can be deleterious to memory for text-captioned speech, especially in older adults with hearing loss. Therefore, to produce the greatest benefit to memory, it is crucial that text captions are accurate.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1348275
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1348275
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1044/2022_JSLHR-21-00416
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 27
        StartPage: 2364
    Subjects:
      – SubjectFull: Visual Aids
        Type: general
      – SubjectFull: Video Technology
        Type: general
      – SubjectFull: Layout (Publications)
        Type: general
      – SubjectFull: Error Patterns
        Type: general
      – SubjectFull: Hearing Impairments
        Type: general
      – SubjectFull: Deafness
        Type: general
      – SubjectFull: Assistive Technology
        Type: general
      – SubjectFull: Speech Communication
        Type: general
      – SubjectFull: Older Adults
        Type: general
      – SubjectFull: Listening
        Type: general
      – SubjectFull: Recall (Psychology)
        Type: general
      – SubjectFull: Acoustics
        Type: general
      – SubjectFull: Young Adults
        Type: general
    Titles:
      – TitleFull: The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Crandell, Hannah A.
      – PersonEntity:
          Name:
            NameFull: Silcox, Jack W.
      – PersonEntity:
          Name:
            NameFull: Ferguson, Sarah H.
      – PersonEntity:
          Name:
            NameFull: Lohani, Monika
      – PersonEntity:
          Name:
            NameFull: Payne, Brennan R.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 1092-4388
            – Type: issn-electronic
              Value: 1558-9102
          Numbering:
            – Type: volume
              Value: 65
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: Journal of Speech, Language, and Hearing Research
              Type: main
ResultId 1