Verb Comprehension Deficits in Probable Alzheimer's Disease

Studies of lexical comprehension in probable Alzheimer's disease (pAD) have focused almost exclusively on nouns. In the following preliminary study, we examined whether lexical comprehension for verbs is also impaired in 25 pAD patients. The semantic meaning of motion verbs, cognition verbs, and perception verbs was assessed with a triadic comparison task. Structural meaning associated with these verbs was evaluated by asking the patients to judge the coherence of sentence frames that accept these verbs naturally or awkwardly. We found that pAD patients are significantly impaired at identifying semantic relations among verbs. pAD patients also encountered significantly more difficulty judging the coherence of sentences than control subjects. Correlation and regression analyses demonstrated that semantic characteristics of verbs are projected from the verbs' sentence frames in control subjects, but there was minimal evidence for such a structural–semantic relationship in pAD. We consider several possible explanations for our preliminary observations of an impairment that has consequences for processing both semantic and structural aspects of verb meaning.     

Verbs in space: Axis and direction of motion norms for 299 English verbs

A strong body of work has explored the interaction between visual perception and language comprehension; for example, recent studies exploring predictions from embodied cognition have focused particularly on the common representation of sensory—motor and semantic information. Motivated by this background, we provide a set of norms for the axis and direction of motion implied in 299 English verbs, collected from approximately 100 native speakers of British English. Until now, there have been no freely available norms of this kind for a large set of verbs that can be used in any area of language research investigating the semantic representation of motion. We have used these norms to investigate the interaction between language comprehension and low-level visual processes involved in motion perception, validating the norming procedure’s ability to capture the motion content of individual verbs. Supplemental materials for this study may be downloaded from brm.psychonomic-journals.org/content/supplemental.     

BOLD response to motion verbs in left posterior middle temporal gyrus during story comprehension

A primary focus within neuroimaging research on language comprehension is on the distribution of semantic knowledge in the brain. Studies have shown that the left posterior middle temporal gyrus (LPMT), a region just anterior to area MT/V5, is important for the processing of complex action knowledge. It has also been found that motion verbs cause activation in LPMT. In this experiment we investigated whether this effect could be replicated in a setting resembling real life language comprehension, i.e. without any overt behavioral task during passive listening to a story. During fMRI participants listened to a recording of the story “The Ugly Duckling”. We incorporated a nuisance elimination regression approach for factoring out known nuisance variables both in terms of physiological noise, sound intensity, linguistic variables and emotional content. Compared to the remaining text, clauses containing motion verbs were accompanied by a robust activation of LPMT with no other significant effects, consistent with the hypothesis that this brain region is important for processing motion knowledge, even during naturalistic language comprehension conditions.     

Verb processing during sentence comprehension in aphasia

This study examines verb processing during on-line sentence comprehension in aphasia. We describe two experiments that explore whether a group of Broca's aphasics, who were agrammatic in comprehension as well as speech, a group of fluent aphasics, and a group of normal controls are sensitive to the argument structure arrangements of verbs. Subjects had to perform a complex secondary task both in the immediate vicinity of the verb and also at a point well past the verb while listening to sentences for meaning. Reaction times to this secondary task show that both normal controls and agrammatic Broca's aphasic subjects activate multiple argument structure possibilities for a verb in the vicinity of the verb, yet at a point downstream from the verb such effects disappear. These data suggest that the problems agrammatic subjects show with verbs in sentence comprehension, and the general lexical access deficit also recently claimed to be part of the agrammatics' problem, may not extend to the real-time processing of verbs and their arguments. Fluent aphasic subjects, on the other hand, do not show sensitivity to the argument structure properties of verbs, suggesting that these patients may have a semantic-like sentence processing deficit.     

Perception of auditory motion affects language processing

Previous reports have demonstrated that the comprehension of sentences describing motion in a particular direction (toward, away, up, or down) is affected by concurrently viewing a stimulus that depicts motion in the same or opposite direction. We report 3 experiments that extend our understanding of the relation between perception and language processing in 2 ways. First, whereas most previous studies of the relation between perception and language processing have focused on visual perception, our data show that sentence processing can be affected by the concurrent processing of auditory stimuli. Second, it is shown that the relation between the processing of auditory stimuli and the processing of sentences depends on whether the sentences are presented in the auditory or visual modality.     

Spatial and linguistic aspects of visual imagery in sentence comprehension

There is mounting evidence that language comprehension involves the activation of mental imagery of the content of utterances ( Barsalou, 1999 ; Bergen, Chang, & Narayan, 2004 ; Bergen, Narayan, & Feldman, 2003 ; Narayan, Bergen, & Weinberg, 2004 ; Richardson, Spivey, McRae, & Barsalou, 2003 ; Stanfield & Zwaan, 2001 ; Zwaan, Stanfield, & Yaxley, 2002 ). This imagery can have motor or perceptual content. Three main questions about the process remain under‐explored, however. First, are lexical associations with perception or motion sufficient to yield mental simulation, or is the integration of lexical semantics into larger structures, like sentences, necessary? Second, what linguistic elements (e.g., verbs, nouns, etc.) trigger mental simulations? Third, how detailed are the visual simulations that are performed? A series of behavioral experiments address these questions, using a visual object categorization task to investigate whether up‐ or down‐related language selectively interferes with visual processing in the same part of the visual field (following Richardson et al., 2003 ). The results demonstrate that either subject nouns or main verbs can trigger visual imagery, but only when used in literal sentences about real space—metaphorical language does not yield significant effects—which implies that it is the comprehension of the sentence as a whole and not simply lexical associations that yields imagery effects. These studies also show that the evoked imagery contains detail as to the part of the visual field where the described scene would take place.     

Perception of motion affects language processing

Recently developed accounts of language comprehension propose that sentences are understood by constructing a perceptual simulation of the events being described. These simulations involve the re-activation of patterns of brain activation that were formed during the comprehender's interaction with the world. In two experiments we explored the specificity of the processing mechanisms required to construct simulations during language comprehension. Participants listened to (and made judgments on) sentences that described motion in a particular direction (e.g. "The car approached you"). They simultaneously viewed dynamic black-and-white stimuli that produced the perception of movement in the same direction as the action specified in the sentence (i.e. towards you) or in the opposite direction as the action specified in the sentence (i.e. away from you). Responses were faster to sentences presented concurrently with a visual stimulus depicting motion in the opposite direction as the action described in the sentence. This suggests that the processing mechanisms recruited to construct simulations during language comprehension are also used during visual perception, and that these mechanisms can be quite specific.     

The dynamic influence of emotional words on sentence comprehension: An ERP study

In the present study, we explored the influence of emotional words on the semantic integration of their following neutral nouns during sentence comprehension. We manipulated the emotionality of verbs and the semantic congruity of their following (neutral) object nouns in sentences. Event-related potentials were recorded to the verbs, which were either negative or neutral, and to the object nouns, which were either semantically congruent or incongruent relative to the preceding contexts. We found an N400 and a P600 effect in response to the semantic congruity of the nouns when they followed the neutral verbs. However, the P600 (but not the N400) semantic congruity effect may have been attenuated when the nouns followed the negative verbs. Meanwhile, the negative verbs elicited a larger P2 and N400 than did the neutral verbs. The results indicate that the attention captured by emotional words impaired reanalysis of the following incongruent information, demonstrating a dynamic influence of emotional words on the semantic processing of following information during sentence comprehension.     

Auditory verb perception recruits motor systems in the developing brain: an fMRI investigation

This study investigated neural activation patterns during verb processing in children, using fMRI (functional Magnetic Resonance Imaging). Preschool children (aged 4–6) passively listened to lists of verbs and adjectives while neural activation was measured. Findings indicated that verbs were processed differently than adjectives, as the verbs recruited motor systems in the frontal cortex during auditory perception, but the adjectives did not. Further evidence suggested that different types of verbs activated different regions in the motor cortex. The results demonstrate that the motor system is recruited during verb perception in the developing brain, reflecting the embodied nature of language learning and processing.     

Syntactic priming and the lexical boost effect during sentence production and sentence comprehension: An fMRI study

Behavioral syntactic priming effects during sentence comprehension are typically observed only if both the syntactic structure and lexical head are repeated. In contrast, during production syntactic priming occurs with structure repetition alone, but the effect is boosted by repetition of the lexical head. We used fMRI to investigate the neuronal correlates of syntactic priming and lexical boost effects during sentence production and comprehension. The critical measure was the magnitude of fMRI adaptation to repetition of sentences in active or passive voice, with or without verb repetition. In conditions with repeated verbs, we observed adaptation to structure repetition in the left IFG and MTG, for active and passive voice. However, in the absence of repeated verbs, adaptation occurred only for passive sentences. None of the fMRI adaptation effects yielded differential effects for production versus comprehension, suggesting that sentence comprehension and production are subserved by the same neuronal infrastructure for syntactic processing.     

动词理解中空间表征的激活过程

探讨动词理解中空间表征的激活过程。被试听以不同空间轴向动词作谓语的句子后辨认视觉刺激的形状。实验1以肯定句为材料探讨语义理解对视知觉任务的影响。实验2以客观原因否定句为材料排除句子表征的影响。实验3以主观原因否定句为材料探讨动词空间元素的激活机制。总的结果表明,动词理解过程中激活其表征中的空间元素,这种激活是自动的、非策略性的,不受情境中客观原因或主观意愿否定的影响。动词理解空间效应反映了语言表征中的知觉运动特征     

Word order in sentence processing: an experimental study of verb placement in German

We examine the question of whether the human comprehension device exhibits word-order preferences during on-line sentence comprehension. The focus is on the positioning of finite verbs and auxiliaries relative to subjects and objects in German. Results from three experiments (using self-paced reading and event-related brain potentials) show that native speakers of German prefer to process finite verbs in second position (i.e., immediately after the subject and before the object). We will account for this order preference in terms of the relative processing costs associated with SV_fO and SOV_f. Our finding that word-order preferences play an important role in the on-line comprehension of German sentences is compatible with results from previous studies on English and other languages.     

Understanding of action-related and abstract verbs in comparison: a behavioral and TMS study

Does the comprehension of both action-related and abstract verbs rely on motor simulation? In a behavioral experiment, in which a semantic task was used, response times to hand-action-related verbs were briefer than those to abstract verbs and both decreased with repetition of presentation. In a transcranial magnetic stimulation (TMS) experiment, single-pulse stimulation was randomly delivered over hand motor area of the left primary motor cortex to measure cortical-spinal excitability at 300 or 500 ms after verb presentation. Two blocks of trials were run. In each block, the same verbs were randomly presented. In the first block, stimulation induced an increase in motor evoked potentials only when TMS was applied 300 ms after action-related verb presentation. In the second block, no modulation of motor cortex was found according to type of verb and stimulation-delay. These results confirm that motor simulation can be used to understand action rather than abstract verbs. Moreover, they suggest that with repetition, the semantic processing for action verbs does not require activation of primary motor cortex anymore.     

The effect of language on visual contrast sensitivity

Embodied cognition and perceptual symbol theories assume that higher cognition interacts with and is grounded in perception and action. Recent experiments have shown that language processing interacts with perceptual processing in various ways, indicating that linguistic representations have a strong perceptual character. In the present study, we have used signal detection theory to investigate whether the comprehension of written sentences, implying either horizontal or vertical orientation, could improve the participants' visual sensitivity for discriminating between horizontal or vertical square-wave gratings and noise. We tested this prediction by conducting one main and one follow-up experiment. Our results indicate that language can, indeed, affect perception at such a low level of the visual process and thus provide further support for the embodied theories of cognition.     

Verbal Integration: The Interaction of Participant Roles and Sentential Argument Structure

This paper explores the interaction between sentence level syntactic information and the semantic information that is carried with the verb during sentence comprehension. A cross-modal integration task was employed to examine whether the number of participant roles (thematic roles associated with the central meaning of the verb) causes an increase in processing load during integration of the verb into on-going sentence comprehension. The effect of preceding sentential structural information (varied with respect to the number of argument and/or adjunct NPs preceding the verb) was also manipulated. Independent of the structural information preceding the verb, verbs with two partici-pant roles were integrated into the sentence faster than verbs with three participant roles. This finding suggests that participant roles are stored with the representation of the verb and made immediately available during integration and comprehension. In addition, the syntactic distinction between arguments and adjuncts is also shown to play an immediate role in parsing and integration of language on-line.     

Effects of Verbal Event Structure on Online Thematic Role Assignment

Event structure describes the relationships between general semantics (Aktionsart) of the verb and its syntactic properties, separating verbs into two classes: telic verbs, which denote change of state events with an inherent end-point or boundary (catch, rescue), and atelic, which refer to homogenous activities (tease, host). As telic verbs describe events, in which the internal argument (Patient) is affected, we hypothesized that processing of telic verb template would activate syntactic position of the Patient during sentence comprehension. Event-related brain potentials (ERPs) were recorded from 20 English speakers, who read sentences with reduced Object relative clauses, in which the verb was either telic or atelic. ERPs in relative clauses diverged on the definite article preceding the Agent: the atelic condition was characterized by larger amplitude negativity at the N100. Such processing differences are explained by activation of the syntactic position for the Patient by the event structure template of telic verbs.     

Integration of motion parallax with binocular disparity specifying different surface shapes

We investigated the interaction between motion parallax and binocular disparity cues in the perception of surface shape and depth magnitude by the use of the random dot stimuli in which these cues specified sinusoidal depth surfaces undulating with different spatial frequencies. When ambiguous motion parallax is inconsistent with unambiguous disparity cue, the reasonable solution for the visual system is to convert the motion signal to the flow on the surface specified by disparity. Two experiments, however, found that the visual system did not always use this reasonable solution; observers often perceived the surface specified by a composite of the two cues, or the surface specified by parallax alone. In the perception of this composite of the two cues, the apparent depth magnitude increased with the increase of the depth magnitude specified by both cues. This indicates that the visual system can combine the depth magnitude information from parallax and disparity in an additive fashion. The interference with parallax by disparity implies that the parallax processing is not independent of the disparity processing.     

Reading action word affects the visual perception of biological motion

In the present study, we investigate whether reading an action-word can influence subsequent visual perception of biological motion. The participant's task was to perceptually judge whether a human action identifiable in the biological motion of a point-light display embedded in a high density mask was present or not in the visual sequence, which lasted for 633 ms on average. Prior to the judgement task, participants were exposed to an abstract verb or an action verb for 500 ms, which was related to the human action according to a congruent or incongruent semantic relation. Data analysis showed that correct judgements were not affected by action verbs, whereas a facilitation effect on response time (49 ms on average) was observed when a congruent action verb primed the judgement of biological movements. In relation with the existing literature, this finding suggests that the perception, the planning and the linguistic coding of motor action are subtended by common motor representations.