TY - JOUR
T1 - Visual scenes trigger immediate syntactic reanalysis: Evidence from ERPs during situated spoken comprehension
AU - Knoeferle, Pia
AU - Habets, Boukje
AU - Crocker, Matthew W.
AU - Münte, Thomas F.
N1 - Funding Information:
German research foundation Deutsche Forschungsgemein-schaft (PhD scholarship GRK-715 to PK, postdoctoral fellowship to PK, SFB-378-‘‘ALPHA’’ to MWC, and MU1311/13-1 to TFM).
Copyright:
Copyright 2008 Elsevier B.V., All rights reserved.
PY - 2008/4
Y1 - 2008/4
N2 - A central topic in sentence comprehension research is the kinds of information and mechanisms involved in resolving temporary ambiguity regarding the syntactic structure of a sentence. Gaze patterns in scenes during spoken sentence comprehension have provided strong evidence that visual scenes trigger rapid syntactic reanalysis. However, they have also been interpreted as reflecting nonlinguistic, visual processes. Furthermore, little is known as to whether similar processes of syntactic revision are triggered by linguistic versus scene cues. To better understand how scenes influence comprehension and its time course, we recorded event-related potentials (ERPs) during the comprehension of spoken sentences that relate to depicted events. Prior electrophysiological research has observed a P600 when structural disambiguation toward a noncanonical structure occurred during reading and in the absence of scenes. We observed an ERP component with a similar latency, polarity, and distribution when depicted events disambiguated toward a noncanonical structure. The distributional similarities further suggest that scenes are on a par with linguistic contexts in triggering syntactic revision. Our findings confirm the interpretation of previous eye movement studies and highlight the benefits of combining ERP and eye-tracking measures to ascertain the neuronal processes enabled by, and the locus of attention in, visual contexts.
AB - A central topic in sentence comprehension research is the kinds of information and mechanisms involved in resolving temporary ambiguity regarding the syntactic structure of a sentence. Gaze patterns in scenes during spoken sentence comprehension have provided strong evidence that visual scenes trigger rapid syntactic reanalysis. However, they have also been interpreted as reflecting nonlinguistic, visual processes. Furthermore, little is known as to whether similar processes of syntactic revision are triggered by linguistic versus scene cues. To better understand how scenes influence comprehension and its time course, we recorded event-related potentials (ERPs) during the comprehension of spoken sentences that relate to depicted events. Prior electrophysiological research has observed a P600 when structural disambiguation toward a noncanonical structure occurred during reading and in the absence of scenes. We observed an ERP component with a similar latency, polarity, and distribution when depicted events disambiguated toward a noncanonical structure. The distributional similarities further suggest that scenes are on a par with linguistic contexts in triggering syntactic revision. Our findings confirm the interpretation of previous eye movement studies and highlight the benefits of combining ERP and eye-tracking measures to ascertain the neuronal processes enabled by, and the locus of attention in, visual contexts.
UR - http://www.scopus.com/inward/record.url?scp=40849147080&partnerID=8YFLogxK
U2 - 10.1093/cercor/bhm121
DO - 10.1093/cercor/bhm121
M3 - Journal articles
C2 - 17644830
AN - SCOPUS:40849147080
SN - 1047-3211
VL - 18
SP - 789
EP - 795
JO - Cerebral Cortex
JF - Cerebral Cortex
IS - 4
ER -