| 1 |
Visual information constrains early and late stages of spoken-word recognition in sentence context
|
|
|
|
In: ISSN: 0167-8760 ; International Journal of Psychophysiology ; https://hal.univ-lille.fr/hal-01911769 ; International Journal of Psychophysiology, Elsevier, 2013, 89 (1), pp.136--147. ⟨10.1016/j.ijpsycho.2013.06.016⟩ (2013)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
Cross-modal predictive mechanisms during speech perception
|
|
|
|
In: TDX (Tesis Doctorals en Xarxa) (2013)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Cross-modal prediction in speech depends on prior linguistic experience
|
|
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Cross-modal prediction in speech perception
|
|
|
|
Abstract:
Speech perception often benefits from vision of the speaker's lip movements when they are available. One potential mechanism underlying this reported gain in perception arising from audio-visual integration is on-line prediction. In this study we address whether the preceding speech context in a single modality can improve audiovisual processing and whether this improvement is based on on-line information-transfer across sensory modalities. In the experiments presented here, during each trial, a speech fragment (context) presented in a single sensory modality (voice or lips) was immediately continued by an audiovisual target fragment. Participants made speeded judgments about whether voice and lips were in agreement in the target fragment. The leading single sensory context and the subsequent audiovisual target fragment could be continuous in either one modality only, both (context in one modality continues into both modalities in the target fragment) or neither modalities (i.e., discontinuous). The results showed quicker audiovisual matching responses when context was continuous with the target within either the visual or auditory channel (Experiment 1). Critically, prior visual context also provided an advantage when it was cross-modally continuous (with the auditory channel in the target), but auditory to visual cross-modal continuity resulted in no advantage (Experiment 2). This suggests that visual speech information can provide an on-line benefit for processing the upcoming auditory input through the use of predictive mechanisms. We hypothesize that this benefit is expressed at an early level of speech analysis. ; This research was supported by the Spanish Ministry of Science and Innovation (PSI2010-15426 and Consolider INGENIO CSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (SRG2009-092 and PIV2009-00122), and the European Research Council (StG-2010 263145).
|
|
URL: http://hdl.handle.net/10230/23674
https://doi.org/10.1371/journal.pone.0025198
|
|
BASE
|
|
Hide details
|
|
|
| 6 |
Visual information constrains early and late stages of spoken-word recognition in sentence context
|
|
|
|
BASE
|
|
Show details
|
|
|
|
|
