Visual Anticipatory Information Modulates Multisensory Interactions of Artificial Audiovisual Stimuli.
Saved in:
| Title: | Visual Anticipatory Information Modulates Multisensory Interactions of Artificial Audiovisual Stimuli. |
|---|---|
| Authors: | Vroomen, Jean1, Stekelenburg, Jeroen J.1 |
| Source: | Journal of Cognitive Neuroscience. Jul2010, Vol. 22 Issue 7, p1583-1596. 14p. 2 Diagrams, 3 Graphs. |
| Subjects: | Cognitive processing of language, Visual perception testing, Perceptual motor learning, Physiological aspects of speech, Biological neural networks, Auditory perception testing |
| Abstract: | The neural activity of speech sound processing (the N1 component of the auditory ERP) can be suppressed if a speech sound is accompanied by concordant lip movements. Here we demonstrate that this audiovisual interaction is neither speech specific nor linked to humanlike actions but can be observed with artificial stimuli if their timing is made predictable. In Experiment 1, a pure tone synchronized with a deformation of a rectangle induced a smaller auditory N1 than auditory-only presentations if the temporal occurrence of this audiovisual event was made predictable by two moving disks that touched the rectangle. Local autoregressive average source estimation indicated that this audiovisual interaction may be related to integrative processing in auditory areas. When the moving disks did not precede the audiovisual stimulus-making the onset unpredictable-there was no N1 reduction. In Experiment 2, the predictability of the leading visual signal was manipulated by introducing a temporal asynchrony between the audiovisual event and the collision of moving disks. Audiovisual events occurred either at the moment, before (too "early"), or after (too "late") the disks collided on the rectangle. When asynchronies varied from trial to trial-rendering the moving disks unreliable temporal predictors of the audiovisual event-the N1 reduction was abolished. These results demonstrate that the N1 suppression is induced by visual information that both precedes and reliably predicts audiovisual onset, without a necessary link to human action-related neural mechanisms. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Cognitive Neuroscience is the property of MIT Press and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 49039382 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Visual Anticipatory Information Modulates Multisensory Interactions of Artificial Audiovisual Stimuli. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Vroomen%2C+Jean%22">Vroomen, Jean</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Stekelenburg%2C+Jeroen+J%2E%22">Stekelenburg, Jeroen J.</searchLink><relatesTo>1</relatesTo> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Cognitive+Neuroscience%22">Journal of Cognitive Neuroscience</searchLink>. Jul2010, Vol. 22 Issue 7, p1583-1596. 14p. 2 Diagrams, 3 Graphs. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Cognitive+processing+of+language%22">Cognitive processing of language</searchLink><br /><searchLink fieldCode="DE" term="%22Visual+perception+testing%22">Visual perception testing</searchLink><br /><searchLink fieldCode="DE" term="%22Perceptual+motor+learning%22">Perceptual motor learning</searchLink><br /><searchLink fieldCode="DE" term="%22Physiological+aspects+of+speech%22">Physiological aspects of speech</searchLink><br /><searchLink fieldCode="DE" term="%22Biological+neural+networks%22">Biological neural networks</searchLink><br /><searchLink fieldCode="DE" term="%22Auditory+perception+testing%22">Auditory perception testing</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: The neural activity of speech sound processing (the N1 component of the auditory ERP) can be suppressed if a speech sound is accompanied by concordant lip movements. Here we demonstrate that this audiovisual interaction is neither speech specific nor linked to humanlike actions but can be observed with artificial stimuli if their timing is made predictable. In Experiment 1, a pure tone synchronized with a deformation of a rectangle induced a smaller auditory N1 than auditory-only presentations if the temporal occurrence of this audiovisual event was made predictable by two moving disks that touched the rectangle. Local autoregressive average source estimation indicated that this audiovisual interaction may be related to integrative processing in auditory areas. When the moving disks did not precede the audiovisual stimulus-making the onset unpredictable-there was no N1 reduction. In Experiment 2, the predictability of the leading visual signal was manipulated by introducing a temporal asynchrony between the audiovisual event and the collision of moving disks. Audiovisual events occurred either at the moment, before (too "early"), or after (too "late") the disks collided on the rectangle. When asynchronies varied from trial to trial-rendering the moving disks unreliable temporal predictors of the audiovisual event-the N1 reduction was abolished. These results demonstrate that the N1 suppression is induced by visual information that both precedes and reliably predicts audiovisual onset, without a necessary link to human action-related neural mechanisms. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Cognitive Neuroscience is the property of MIT Press and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=49039382 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1162/jocn.2009.21308 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 14 StartPage: 1583 Subjects: – SubjectFull: Cognitive processing of language Type: general – SubjectFull: Visual perception testing Type: general – SubjectFull: Perceptual motor learning Type: general – SubjectFull: Physiological aspects of speech Type: general – SubjectFull: Biological neural networks Type: general – SubjectFull: Auditory perception testing Type: general Titles: – TitleFull: Visual Anticipatory Information Modulates Multisensory Interactions of Artificial Audiovisual Stimuli. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Vroomen, Jean – PersonEntity: Name: NameFull: Stekelenburg, Jeroen J. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 07 Text: Jul2010 Type: published Y: 2010 Identifiers: – Type: issn-print Value: 0898929X Numbering: – Type: volume Value: 22 – Type: issue Value: 7 Titles: – TitleFull: Journal of Cognitive Neuroscience Type: main |
| ResultId | 1 |
