Cross-Modal Facilitation in Speech Prosody
Saved in:
| Title: | Cross-Modal Facilitation in Speech Prosody |
|---|---|
| Language: | English |
| Authors: | Foxton, Jessica M., Riviere, Louis-David, Barone, Pascal |
| Source: | Cognition. Apr 2010 115(1):71-78. |
| Availability: | Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com |
| Peer Reviewed: | Y |
| Physical Description: | |
| Page Count: | 8 |
| Publication Date: | 2010 |
| Document Type: | Journal Articles Reports - Evaluative |
| Descriptors: | Visual Stimuli, Speech Communication, Suprasegmentals, Human Body, Motion, Speech, Auditory Perception, Video Technology, Evaluation Methods, Language Processing |
| DOI: | 10.1016/j.cognition.2009.11.009 |
| ISSN: | 0010-0277 |
| Abstract: | Speech prosody has traditionally been considered solely in terms of its auditory features, yet correlated visual features exist, such as head and eyebrow movements. This study investigated the extent to which visual prosodic features are able to affect the perception of the auditory features. Participants were presented with videos of a speaker pronouncing two words, with visual features of emphasis on one of these words. For each trial, participants saw one video where the two words were identical in both pitch and amplitude, and another video where there was a difference in either pitch or amplitude that was congruent or incongruent with the visual changes. Participants were asked to decide which video contained the sound difference. Thresholds were obtained for the congruent and incongruent videos, and for an auditory-alone condition. It was found that the congruent thresholds were better than the incongruent thresholds for both pitch and amplitude changes. Interestingly, the congruent thresholds for amplitude were better than for the auditory-alone condition, which implies that the visual features improve sensitivity to loudness changes. These results demonstrate that visual stimuli can affect auditory thresholds for changes in pitch and amplitude, and furthermore support the view that visual prosodic features enhance speech processing. (Contains 1 table and 3 figures.) |
| Abstractor: | As Provided |
| Entry Date: | 2010 |
| Accession Number: | EJ874815 |
| Database: | ERIC |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ874815 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Cross-Modal Facilitation in Speech Prosody – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Foxton%2C+Jessica+M%2E%22">Foxton, Jessica M.</searchLink><br /><searchLink fieldCode="AR" term="%22Riviere%2C+Louis-David%22">Riviere, Louis-David</searchLink><br /><searchLink fieldCode="AR" term="%22Barone%2C+Pascal%22">Barone, Pascal</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Cognition%22"><i>Cognition</i></searchLink>. Apr 2010 115(1):71-78. – Name: Avail Label: Availability Group: Avail Data: Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: PhysDesc Label: Physical Description Group: PhysDesc Data: PDF – Name: Pages Label: Page Count Group: Src Data: 8 – Name: DatePubCY Label: Publication Date Group: Date Data: 2010 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Evaluative – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Visual+Stimuli%22">Visual Stimuli</searchLink><br /><searchLink fieldCode="DE" term="%22Speech+Communication%22">Speech Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Suprasegmentals%22">Suprasegmentals</searchLink><br /><searchLink fieldCode="DE" term="%22Human+Body%22">Human Body</searchLink><br /><searchLink fieldCode="DE" term="%22Motion%22">Motion</searchLink><br /><searchLink fieldCode="DE" term="%22Speech%22">Speech</searchLink><br /><searchLink fieldCode="DE" term="%22Auditory+Perception%22">Auditory Perception</searchLink><br /><searchLink fieldCode="DE" term="%22Video+Technology%22">Video Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Processing%22">Language Processing</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1016/j.cognition.2009.11.009 – Name: ISSN Label: ISSN Group: ISSN Data: 0010-0277 – Name: Abstract Label: Abstract Group: Ab Data: Speech prosody has traditionally been considered solely in terms of its auditory features, yet correlated visual features exist, such as head and eyebrow movements. This study investigated the extent to which visual prosodic features are able to affect the perception of the auditory features. Participants were presented with videos of a speaker pronouncing two words, with visual features of emphasis on one of these words. For each trial, participants saw one video where the two words were identical in both pitch and amplitude, and another video where there was a difference in either pitch or amplitude that was congruent or incongruent with the visual changes. Participants were asked to decide which video contained the sound difference. Thresholds were obtained for the congruent and incongruent videos, and for an auditory-alone condition. It was found that the congruent thresholds were better than the incongruent thresholds for both pitch and amplitude changes. Interestingly, the congruent thresholds for amplitude were better than for the auditory-alone condition, which implies that the visual features improve sensitivity to loudness changes. These results demonstrate that visual stimuli can affect auditory thresholds for changes in pitch and amplitude, and furthermore support the view that visual prosodic features enhance speech processing. (Contains 1 table and 3 figures.) – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2010 – Name: AN Label: Accession Number Group: ID Data: EJ874815 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ874815 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1016/j.cognition.2009.11.009 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 8 StartPage: 71 Subjects: – SubjectFull: Visual Stimuli Type: general – SubjectFull: Speech Communication Type: general – SubjectFull: Suprasegmentals Type: general – SubjectFull: Human Body Type: general – SubjectFull: Motion Type: general – SubjectFull: Speech Type: general – SubjectFull: Auditory Perception Type: general – SubjectFull: Video Technology Type: general – SubjectFull: Evaluation Methods Type: general – SubjectFull: Language Processing Type: general Titles: – TitleFull: Cross-Modal Facilitation in Speech Prosody Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Foxton, Jessica M. – PersonEntity: Name: NameFull: Riviere, Louis-David – PersonEntity: Name: NameFull: Barone, Pascal IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 04 Type: published Y: 2010 Identifiers: – Type: issn-print Value: 0010-0277 Numbering: – Type: volume Value: 115 – Type: issue Value: 1 Titles: – TitleFull: Cognition Type: main |
| ResultId | 1 |
