Visual Speech Primes Open-Set Recognition of Spoken Words

Saved in:
Bibliographic Details
Title: Visual Speech Primes Open-Set Recognition of Spoken Words
Language: English
Authors: Buchwald, Adam B., Winters, Stephen J., Pisoni, David B.
Source: Language and Cognitive Processes. 2009 24(4):580-610.
Availability: Psychology Press. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Peer Reviewed: Y
Page Count: 31
Publication Date: 2009
Document Type: Journal Articles
Reports - Research
Descriptors: Auditory Perception, Word Recognition, Cognitive Processes, Cues, Visual Perception, Task Analysis, Phonetics, Speech, Acoustics, Responses, Decision Making, Undergraduate Students, Statistical Analysis
Geographic Terms: Indiana
DOI: 10.1080/01690960802536357
ISSN: 0169-0965
Abstract: Visual speech perception has become a topic of considerable interest to speech researchers. Previous research has demonstrated that perceivers neurally encode and use speech information from the visual modality, and this information has been found to facilitate spoken word recognition in tasks such as lexical decision (Kim, Davis, & Krins, 2004). In this paper, we used a cross-modality repetition priming paradigm with visual speech lexical primes and auditory lexical targets to explore the nature of this priming effect. First, we report that participants identified spoken words mixed with noise more accurately when the words were preceded by a visual speech prime of the same word compared with a control condition. Second, analyses of the responses indicated that both correct and incorrect responses were constrained by the visual speech information in the prime. These complementary results suggest that the visual speech primes have an effect on lexical access by increasing the likelihood that words with certain phonetic properties are selected. Third, we found that the cross-modality repetition priming effect was maintained even when visual and auditory signals came from different speakers, and thus different instances of the same lexical item. We discuss implications of these results for current theories of speech perception. (Contains 1 figure, 4 tables, and 4 footnotes.)
Abstractor: As Provided
Number of References: 82
Entry Date: 2009
Accession Number: EJ858964
Database: ERIC
Description
Abstract:Visual speech perception has become a topic of considerable interest to speech researchers. Previous research has demonstrated that perceivers neurally encode and use speech information from the visual modality, and this information has been found to facilitate spoken word recognition in tasks such as lexical decision (Kim, Davis, & Krins, 2004). In this paper, we used a cross-modality repetition priming paradigm with visual speech lexical primes and auditory lexical targets to explore the nature of this priming effect. First, we report that participants identified spoken words mixed with noise more accurately when the words were preceded by a visual speech prime of the same word compared with a control condition. Second, analyses of the responses indicated that both correct and incorrect responses were constrained by the visual speech information in the prime. These complementary results suggest that the visual speech primes have an effect on lexical access by increasing the likelihood that words with certain phonetic properties are selected. Third, we found that the cross-modality repetition priming effect was maintained even when visual and auditory signals came from different speakers, and thus different instances of the same lexical item. We discuss implications of these results for current theories of speech perception. (Contains 1 figure, 4 tables, and 4 footnotes.)
ISSN:0169-0965
DOI:10.1080/01690960802536357