View in EDS PDF Full Text

Effects of Visual Speech Envelope on Audiovisual Speech Perception in Multitalker Listening Environments

Saved in:
Bibliographic Details
Title: Effects of Visual Speech Envelope on Audiovisual Speech Perception in Multitalker Listening Environments
Language: English
Authors: Yuan, Yi, Meyers, Kelli, Borges, Kayla, Lleo, Yasneli, Fiorentino, Katarina A., Oh, Yonghee (ORCID 0000-0002-1083-7774)
Source: Journal of Speech, Language, and Hearing Research. Jul 2021 64(7):2845-2853.
Availability: American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Peer Reviewed: Y
Page Count: 9
Publication Date: 2021
Document Type: Journal Articles
Reports - Research
Descriptors: Speech, Auditory Perception, Visual Perception, Acoustics, Recognition (Psychology), Intelligibility, Accuracy, Context Effect, Young Adults
DOI: 10.1044/2021_JSLHR-20-00688
ISSN: 1092-4388
Abstract: Purpose: This study investigated the effects of visually presented speech envelope information with various modulation rates and depths on audiovisual speech perception in noise. Method: Forty adults (21.25 ± 1.45 years) participated in audiovisual sentence recognition measurements in noise. Target speech sentences were auditorily presented in multitalker babble noises at a -3 dB SNR. Acoustic amplitude envelopes of target signals were extracted through low-pass filters with different cutoff frequencies (4, 10, and 30 Hz) and a fixed modulation depth at 100% (Experiment 1) or extracted with various modulation depths (0%, 25%, 50%, 75%, and 100%) and a fixed 10-Hz modulation rate (Experiment 2). The extracted target envelopes were synchronized with the amplitude of a spherical-shaped ball and presented as visual stimuli. Subjects were instructed to attend to both auditory and visual stimuli of the target sentences and type down their answers. The sentence recognition accuracy was compared between audio-only and audiovisual conditions. Results: In Experiment 1, a significant improvement in speech intelligibility was observed when the visual analog (a sphere) synced with the acoustic amplitude envelope modulated at a 10-Hz modulation rate compared to the audio-only condition. In Experiment 2, the visual analog with 75% modulation depth resulted in better audiovisual speech perception in noise compared to the other modulation depth conditions. Conclusion: An abstract visual analog of acoustic amplitude envelopes can be efficiently delivered by the visual system and integrated online with auditory signals to enhance speech perception in noise, independent of particular articulation movements.
Abstractor: As Provided
Entry Date: 2021
Accession Number: EJ1307246
Database: ERIC
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwF8YGYHexV7PjCGcko5EwagAAAA4jCB3wYJKoZIhvcNAQcGoIHRMIHOAgEAMIHIBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDH0j9QkPzhcYeQu87AIBEICBmvyiOdNYsgH5nGjdy3w1QUJOhk_8GW12er4_mO7EFQVDhefnFdyNAgdFzRgtnicN18jtQaFE3SExRG5pQOZLg2quTVFKtzogmKOTEHMaM_PvKyNRoUHQ7KO3-2jzl4ApGGHUbBgBmB4Jg2fDF8hLjhp8dA3AKz1asvKPrOd5uaQ1yYaCOY6fC-MYH-azQJPXKrPIn4uPWznL3YA=
Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1307246
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Effects of Visual Speech Envelope on Audiovisual Speech Perception in Multitalker Listening Environments
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Yuan%2C+Yi%22">Yuan, Yi</searchLink><br /><searchLink fieldCode="AR" term="%22Meyers%2C+Kelli%22">Meyers, Kelli</searchLink><br /><searchLink fieldCode="AR" term="%22Borges%2C+Kayla%22">Borges, Kayla</searchLink><br /><searchLink fieldCode="AR" term="%22Lleo%2C+Yasneli%22">Lleo, Yasneli</searchLink><br /><searchLink fieldCode="AR" term="%22Fiorentino%2C+Katarina+A%2E%22">Fiorentino, Katarina A.</searchLink><br /><searchLink fieldCode="AR" term="%22Oh%2C+Yonghee%22">Oh, Yonghee</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-1083-7774">0000-0002-1083-7774</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Speech%2C+Language%2C+and+Hearing+Research%22"><i>Journal of Speech, Language, and Hearing Research</i></searchLink>. Jul 2021 64(7):2845-2853.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 9
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2021
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Speech%22">Speech</searchLink><br /><searchLink fieldCode="DE" term="%22Auditory+Perception%22">Auditory Perception</searchLink><br /><searchLink fieldCode="DE" term="%22Visual+Perception%22">Visual Perception</searchLink><br /><searchLink fieldCode="DE" term="%22Acoustics%22">Acoustics</searchLink><br /><searchLink fieldCode="DE" term="%22Recognition+%28Psychology%29%22">Recognition (Psychology)</searchLink><br /><searchLink fieldCode="DE" term="%22Intelligibility%22">Intelligibility</searchLink><br /><searchLink fieldCode="DE" term="%22Accuracy%22">Accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22Context+Effect%22">Context Effect</searchLink><br /><searchLink fieldCode="DE" term="%22Young+Adults%22">Young Adults</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1044/2021_JSLHR-20-00688
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1092-4388
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: This study investigated the effects of visually presented speech envelope information with various modulation rates and depths on audiovisual speech perception in noise. Method: Forty adults (21.25 ± 1.45 years) participated in audiovisual sentence recognition measurements in noise. Target speech sentences were auditorily presented in multitalker babble noises at a -3 dB SNR. Acoustic amplitude envelopes of target signals were extracted through low-pass filters with different cutoff frequencies (4, 10, and 30 Hz) and a fixed modulation depth at 100% (Experiment 1) or extracted with various modulation depths (0%, 25%, 50%, 75%, and 100%) and a fixed 10-Hz modulation rate (Experiment 2). The extracted target envelopes were synchronized with the amplitude of a spherical-shaped ball and presented as visual stimuli. Subjects were instructed to attend to both auditory and visual stimuli of the target sentences and type down their answers. The sentence recognition accuracy was compared between audio-only and audiovisual conditions. Results: In Experiment 1, a significant improvement in speech intelligibility was observed when the visual analog (a sphere) synced with the acoustic amplitude envelope modulated at a 10-Hz modulation rate compared to the audio-only condition. In Experiment 2, the visual analog with 75% modulation depth resulted in better audiovisual speech perception in noise compared to the other modulation depth conditions. Conclusion: An abstract visual analog of acoustic amplitude envelopes can be efficiently delivered by the visual system and integrated online with auditory signals to enhance speech perception in noise, independent of particular articulation movements.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2021
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1307246
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1307246
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1044/2021_JSLHR-20-00688
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 9
        StartPage: 2845
    Subjects:
      – SubjectFull: Speech
        Type: general
      – SubjectFull: Auditory Perception
        Type: general
      – SubjectFull: Visual Perception
        Type: general
      – SubjectFull: Acoustics
        Type: general
      – SubjectFull: Recognition (Psychology)
        Type: general
      – SubjectFull: Intelligibility
        Type: general
      – SubjectFull: Accuracy
        Type: general
      – SubjectFull: Context Effect
        Type: general
      – SubjectFull: Young Adults
        Type: general
    Titles:
      – TitleFull: Effects of Visual Speech Envelope on Audiovisual Speech Perception in Multitalker Listening Environments
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Yuan, Yi
      – PersonEntity:
          Name:
            NameFull: Meyers, Kelli
      – PersonEntity:
          Name:
            NameFull: Borges, Kayla
      – PersonEntity:
          Name:
            NameFull: Lleo, Yasneli
      – PersonEntity:
          Name:
            NameFull: Fiorentino, Katarina A.
      – PersonEntity:
          Name:
            NameFull: Oh, Yonghee
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Type: published
              Y: 2021
          Identifiers:
            – Type: issn-print
              Value: 1092-4388
          Numbering:
            – Type: volume
              Value: 64
            – Type: issue
              Value: 7
          Titles:
            – TitleFull: Journal of Speech, Language, and Hearing Research
              Type: main
ResultId 1