Spatial distance effects on incremental semantic interpretation of abstract sentences: Evidence from eye tracking

A large body of evidence has shown that visual context information can rapidly modulate language comprehension for concrete sentences and when it is mediated by a referential or a lexical-semantic link. What has not yet been examined is whether visual context can also modulate comprehension of abstract sentences incrementally when it is neither referenced by, nor lexically associated with, the sentence. Three eye-tracking reading experiments examined the effects of spatial distance between words (Experiment 1) and objects (Experiment 2 and 3) on participants’ reading times for sentences that convey similarity or difference between two abstract nouns (e.g., ‘Peace and war are certainly different...’). Before reading the sentence, participants inspected a visual context with two playing cards that moved either far apart or close together. In Experiment 1, the cards turned and showed the first two nouns of the sentence (e.g., ‘peace’, ‘war’). In Experiments 2 and 3, they turned but remained blank. Participants’ reading times at the adjective (Experiment 1: first-pass reading time; Experiment 2: total times) and at the second noun phrase (Experiment 3: first-pass times) were faster for sentences that expressed similarity when the preceding words/objects were close together (vs. far apart) and for sentences that expressed dissimilarity when the preceding words/objects were far apart (vs. close together). Thus, spatial distance between words or entirely unrelated objects can rapidly and incrementally modulate the semantic interpretation of abstract sentences.     

Disruptions to number bisection after brain injury: Neglecting parts of the Mental Number Line or working memory impairments?

The aim of this study was to investigate the mechanisms underlying consistent directional number bisection bias in a chronic neuropsychological sample, not selected based on behaviour or lesion definitions. Patients completed a test battery that included measures of number bisection, line bisection, verbal working memory, visual-spatial working memory, egocentric neglect and allocentric neglect. Neither the neglect nor working memory measures were found to significantly correlate with number bisection. Furthermore, when outlier patients with very distinct number bisection biases were compared to patients who did not show any number bisection difficulties, no differences were found between the two groups on any of the other behavioural measures. We conclude that number bisection difficulties are not consistently based on any single deficit, be it neglect or working memory, and biases in number bisection should not be assumed to directly reflect problems in either of these areas.     

Delineation of a spatial working memory profile using a non-verbal eye-tracking paradigm in young children with autism and Williams syndrome

Working memory deficits profoundly inhibit children’s ability to learn. While deficits have been identified in disorders such as autism spectrum disorder (ASD) and Williams syndrome (WS), findings are equivocal, and very little is known about the nature of these deficits early in development. A major barrier to advances in this area is the availability of tasks suitable for young children with neurodevelopmental disorders who experience difficulties with following verbal instructions or who are distressed by formal testing demands. To address these issues, a novel eye-tracking paradigm was designed based on an adaptation of the classic A not B paradigm in order to examine the early foundations of spatial working memory capabilities in 26 developmentally delayed preschool children with ASD, 18 age- and IQ-matched children with WS, and 19 age-matched typically-developing (TD) children. The results revealed evidence that foundational spatial working memory performance in ASD and WS was comparable with that of TD children. Performance was associated with intellectual ability in the ASD and TD groups, but not in the WS group. Performance was not associated with adaptive behavior in any group. These findings are discussed in the context of previous research that has been largely limited to older and substantially less developmentally delayed children with these neurodevelopmental disorders.     

Linguistic and Perceptual Mapping in Spatial Representations: An Attentional Account

Building on evidence for embodied representations, we investigated whether Spanish spatial terms map onto the NEAR/FAR perceptual division of space. Using a long horizontal display, we measured congruency effects during the processing of spatial terms presented in NEAR or FAR space. Across three experiments, we manipulated the task demands in order to investigate the role of endogenous attention in linguistic and perceptual space mapping. We predicted congruency effects only when spatial properties were relevant for the task (reaching estimation task, Experiment 1) but not when attention was allocated to other features (lexical decision, Experiment 2; and color, Experiment 3). Results showed faster responses for words presented in Near‐space in all experiments. Consistent with our hypothesis, congruency effects were observed only when a reaching estimate was requested. Our results add important evidence for the role of top‐down processing in congruency effects from embodied representations of spatial terms.     

Working Memory Updating: Load and Binding

In the present study, we aimed to examine how specific objects are updated in working memory. We compared conditions in which contents or content-context bindings from working memory were both encoded and updated (Experiment 1). In addition, for bindings, we manipulated the memory load (i.e., number of contents) to maintain during updating. Results indicated that memory load did not specifically affect the process; rather, the content-context binding (vs. single contents) was critical in determining the increase in response latencies. Results were replicated even in Experiment 2, in which we manipulated the spatial locations of the to-be-recognized probes. Results showed evidence of a potential dissociation between updating of memory contents-only and content-context bindings. In addition, memory load and spatial coherence between phases and probe recognition did not interact with updating performance. Overall, results were taken as a contribution toward mapping the complex nature of the updating mechanism.     

ERP evidence of early cross-modal links between auditory selective attention and visuo-spatial memory

Previous dual-task research pairing complex visual tasks involving non-spatial cognitive processes during dichotic listening have shown effects on the late component (Ndl) of the negative difference selective attention waveform but no effects on the early (Nde) response suggesting that the Ndl, but not the Nde, is affected by non-spatial processing in a dual-task. Thus to further explore the nature of this dissociation and whether the Nd waveform is affected by spatial processing; fourteen adult participants performed auditory dichotic listening in conjunction with visuo-spatial memory in a cross-modal dual-task paradigm. The results showed that the visuo-spatial memory task decreased both the Nde and Ndl waveforms, and also attenuated P300 and increased its latency. This pattern of results suggests that: (1) the Nde reflects a memory trace that is shared with vision when the information is spatial in nature, and (2) P300 latency appears to be influenced by the discriminability of stimuli underlying the Nde and Ndl memory trace.     

Bisecting the mental number line in near and far space

Much evidence suggests that common posterior parietal mechanisms underlie the orientation of attention in physical space and along the mental number line. For example, the small leftward bias (pseudoneglect) found in paper-and-pencil line bisection is also found when participants “bisect” number pairs, estimating (without calculating) the number midway between two others. For bisection of physical lines, pseudoneglect has been found to shift rightward as lines are moved from near space (immediately surrounding the body) to far space. We investigated whether the presentation of stimuli in near or far space also modulated spatial attention for the mental number line. Participants bisected physical lines or number pairs presented at four distances (60, 120, 180, 240 cm). Clear rightward shifts in bias were observed for both tasks. Furthermore, the rate at which this shift occurred in the two tasks, as measured by least-squares regression slopes, was significantly correlated across participants, suggesting that the transition from near to far distances induced a common modulation of lateral attention in physical and numerical space. These results demonstrate a tight coupling between number and physical space, and show that even such prototypically abstract concepts as number are modulated by our on-line interactions with the world.     

Spatial working memory effects in early visual cortex

The present study investigated how spatial working memory recruits early visual cortex. Participants were required to maintain a location in working memory while changes in blood oxygen level dependent (BOLD) signals were measured during the retention interval in which no visual stimulation was present. We show working memory effects during the retention period in early visual cortex which were retinotopically organized in the sense that evoked BOLD responses were specific to the position of the remembered location on an imaginary clock. We demonstrate that this activity is similar to activity observed in conditions in which participants have to direct spatial attention to the same location. We suggest that during the retention interval modulation of neurons coding the remembered location evoke a baseline shift, providing converging evidence for the notion that spatial working memory may use spatial attention as a rehearsal mechanism.     

Source‐Goal Asymmetries in Motion Representation: Implications for Language Production and Comprehension

Recent research has demonstrated an asymmetry between the origins and endpoints of motion events, with preferential attention given to endpoints rather than beginnings of motion in both language and memory. Two experiments explore this asymmetry further and test its implications for language production and comprehension. Experiment 1 shows that both adults and 4‐year‐old children detect fewer within‐category changes in source than goal objects when tested for memory of motion events; furthermore, these groups produce fewer references to source than goal objects when describing the same motion events. Experiment 2 asks whether the specificity of encoding source/goal relations differs in both spatial memory and the comprehension of novel spatial vocabulary. Results show that endpoint configuration changes are detected more accurately than source configuration changes by both adults and young children. Furthermore, when interpreting novel motion verbs, both age groups expect more fine‐grained lexical distinctions in the domain of endpoint configurations compared to that of source configurations. These studies demonstrate that a cognitive‐attentional bias in spatial representation and memory affects both the detail of linguistic encoding during the use of spatial language and the specificity of hypotheses about spatial referents that learners build during the acquisition of the spatial lexicon.     

No two cues are alike: Depth of learning during infancy is dependent on what orients attention

Human infants develop a variety of attentional mechanisms that allow them to extract relevant information from a cluttered multimodal world. We know that both social and nonsocial cues shift infants’ attention, but not how these cues differentially affect learning of multimodal events. Experiment 1 used social cues to direct 8- and 4-month-olds’ attention to two audiovisual events (i.e., animations of a cat or dog accompanied by particular sounds) while identical distractor events played in another location. Experiment 2 directed 8-month-olds’ attention with colorful flashes to the same events. Experiment 3 measured baseline learning without attention cues both with the familiarization and test trials (no cue condition) and with only the test trials (test control condition). The 8-month-olds exposed to social cues showed specific learning of audiovisual events. The 4-month-olds displayed only general spatial learning from social cues, suggesting that specific learning of audiovisual events from social cues may be a function of experience. Infants cued with the colorful flashes looked indiscriminately to both cued locations during test (similar to the 4-month-olds learning from social cues) despite attending for equal duration to the training trials as the 8-month-olds with the social cues. Results from Experiment 3 indicated that the learning effects in Experiments 1 and 2 resulted from exposure to the different cues and multimodal events. We discuss these findings in terms of the perceptual differences and relevance of the cues.