Reduced audiovisual integration in synesthesia - Evidence from bimodal speech perception

Christopher Sinke, Janina Neufeld, Markus Zedler, Hinderk M. Emrich, Stefan Bleich, Thomas F. Münte, Gregor R. Szycik*

*Corresponding author for this work
6 Citations (Scopus)

Abstract

Recent research suggests synesthesia as a result of a hypersensitive multimodal binding mechanism. To address the question whether multimodal integration is altered in synesthetes in general, grapheme-colour and auditory-visual synesthetes were investigated using speech-related stimulation in two behavioural experiments. First, we used the McGurk illusion to test the strength and number of illusory perceptions in synesthesia. In a second step, we analysed the gain in speech perception coming from seen articulatory movements under acoustically noisy conditions. We used disyllabic nouns as stimulation and varied signal-to-noise ratio of the auditory stream presented concurrently to a matching video of the speaker. We hypothesized that if synesthesia is due to a general hyperbinding mechanism this group of subjects should be more susceptible to McGurk illusions and profit more from the visual information during audiovisual speech perception. The results indicate that there are differences between synesthetes and controls concerning multisensory integration - but in the opposite direction as hypothesized. Synesthetes showed a reduced number of illusions and had a reduced gain in comprehension by viewing matching articulatory movements in comparison to control subjects. Our results indicate that rather than having a hypersensitive binding mechanism, synesthetes show weaker integration of vision and audition.

Original languageEnglish
JournalJournal of Neuropsychology
Volume8
Issue number1
Pages (from-to)94-106
Number of pages13
ISSN1748-6645
DOIs
Publication statusPublished - 01.03.2014

Fingerprint

Dive into the research topics of 'Reduced audiovisual integration in synesthesia - Evidence from bimodal speech perception'. Together they form a unique fingerprint.

Cite this