The role of visual spatial attention in audiovisual speech perception

T.S. Andersen (Corresponding Author), K. Tiippana, Jari Laarni, I. Kojo, M. Sams

    Research output: Contribution to journalArticleScientificpeer-review

    28 Citations (Scopus)

    Abstract

    Auditory and visual information is integrated when perceiving speech, as evidenced by the McGurk effect in which viewing an incongruent talking face categorically alters auditory speech perception. Audiovisual integration in speech perception has long been considered automatic and pre-attentive but recent reports have challenged this view. Here we study the effect of visual spatial attention on the McGurk effect. By presenting a movie of two faces symmetrically displaced to each side of a central fixation point and dubbed with a single auditory speech track, we were able to discern the influences from each of the faces and from the voice on the auditory speech percept. We found that directing visual spatial attention towards a face increased the influence of that face on auditory perception. However, the influence of the voice on auditory perception did not change suggesting that audiovisual integration did not change. Visual spatial attention was also able to select between the faces when lip reading. This suggests that visual spatial attention acts at the level of visual speech perception prior to audiovisual integration and that the effect propagates through audiovisual integration to influence auditory perception.
    Original languageEnglish
    Pages (from-to)184-193
    Number of pages10
    JournalSpeech Communication
    Volume51
    Issue number2
    DOIs
    Publication statusPublished - 2009
    MoE publication typeA1 Journal article-refereed

      Fingerprint

    Cite this