Integrating faces, houses, motion, and action: spontaneous binding across ventral and dorsal processing streams

Perceiving an event requires the integration of its features across numerous brain maps and modules. Visual object perception is thought to be mediated by a ventral processing stream running from occipital to inferotemporal cortex, whereas most spatial processing and action control is attributed to the dorsal stream connecting occipital, parietal, and frontal cortex. Here we show that integration operates not only on ventral features and objects, such as faces and houses, but also across ventral and dorsal pathways, binding faces and houses to motion and manual action. Furthermore, these bindings seem to persist over time, as they influenced performance on future task-relevant visual stimuli. This is reflected by longer reaction times for repeating one, but alternating other features in a sequence, compared to complete repetition or alternation of features. Our findings are inconsistent with the notion that the dorsal stream is operating exclusively online and has no access to memory.     

Face and location processing in children with early unilateral brain injury

Human visuospatial functions are commonly divided into those dependent on the ventral visual stream (ventral occipitotemporal regions), which allows for processing the ‘what’ of an object, and the dorsal visual stream (dorsal occipitoparietal regions), which allows for processing ‘where’ an object is in space. Information about the development of each of the two streams has been accumulating, but very little is known about the effects of injury, particularly very early injury, on this developmental process. Using a set of computerized dorsal and ventral stream tasks matched for stimuli, required response, and difficulty (for typically-developing individuals), we sought to compare the differential effects of injury to the two systems by examining performance in individuals with perinatal brain injury (PBI), who present with selective deficits in visuospatial processing from a young age. Thirty participants (mean = 15.1 years) with early unilateral brain injury (15 right hemisphere PBI, 15 left hemisphere PBI) and 16 matched controls participated. On our tasks children with PBI performed more poorly than controls (lower accuracy and longer response times), and this was particularly prominent for the ventral stream task. Lateralization of PBI was also a factor, as the dorsal stream task did not seem to be associated with lateralized deficits, with both PBI groups showing only subtle decrements in performance, while the ventral stream task elicited deficits from RPBI children that do not appear to improve with age. Our findings suggest that early injury results in lesion-specific visuospatial deficits that persist into adolescence. Further, as the stimuli used in our ventral stream task were faces, our findings are consistent with what is known about the neural systems for face processing, namely, that they are established relatively early, follow a comparatively rapid developmental trajectory (conferring a vulnerability to early insult), and are biased toward the right hemisphere.     

Defining the cortical visual systems: "what", "where", and "how"

The visual system historically has been defined as consisting of at least two broad subsystems subserving object and spatial vision. These visual processing streams have been organized both structurally as two distinct pathways in the brain, and functionally for the types of tasks that they mediate. The classic definition by Ungerleider and Mishkin labeled a ventral "what" stream to process object information and a dorsal "where" stream to process spatial information. More recently, Goodale and Milner redefined the two visual systems with a focus on the different ways in which visual information is transformed for different goals. They relabeled the dorsal stream as a "how" system for transforming visual information using an egocentric frame of reference in preparation for direct action. This paper reviews recent research from psychophysics, neurophysiology, neuropsychology and neuroimaging to define the roles of the ventral and dorsal visual processing streams. We discuss a possible solution that allows for both "where" and "how" systems that are functionally and structurally organized within the posterior parietal lobe.     

Dorsal stream deficits suggest hidden dyslexia among deaf poor readers: correlated evidence from reduced perceptual speed and elevated coherent motion detection thresholds

Prelingual deafness and developmental dyslexia have confounding developmental effects on reading acquisition. Therefore, standard reading assessment methods for diagnosing dyslexia in hearing people are ineffective for use with deaf people. Recently, Samar, Parasnis, and Berent (2002) reported visual evoked potential evidence that deaf poor readers, compared to deaf good readers, have dorsal stream visual system deficits like those previously found for hearing dyslexics. Here, we report new psychometric and psychophysical evidence that deficits in dorsal stream function, likely involving extrastriate area MT, are associated with relatively poor reading comprehension in deaf adults. Poorer reading comprehension within a group of 23 prelingually deaf adults was associated with lower scores on the Symbol Digit Modality Test, a perceptual speed test commonly used to help identify dyslexia in hearing people. Furthermore, coherent dot motion detection thresholds, which reflect the functional status of area MT, correlated negatively with reading scores in each visual quadrant. Elevated motion thresholds for deaf poor readers were not due to general cognitive differences in IQ but were specifically correlated with poor perceptual speed. With IQ controlled, a highly reliable right visual field advantage for coherent motion detection was found. Additional analyses suggested that the functional status of dorsal stream motion detection mechanisms in deaf people is related to reading comprehension, but the direction and strength of lateralization of those mechanisms is independent of reading comprehension. Our results generally imply that dyslexia is a hidden contributor to relatively poor reading skill within the deaf population and that assessment of dorsal stream function may provide a diagnostic biological marker for dyslexia in deaf people.     

Long trajectory for the development of sensitivity to global and biological motion

We used a staircase procedure to test sensitivity to (1) global motion in random-dot kinematograms moving at 4° and 18° s(-1) and (2) biological motion. Thresholds were defined as (1) the minimum percentage of signal dots (i.e. the maximum percentage of noise dots) necessary for accurate discrimination of upward versus downward motion or (2) the maximum percentage of noise dots tolerated for accurate discrimination of biological from non-biological motion. Subjects were adults and children aged 6-8, 9-11, and 12-14 years (n = 20 per group). Contrary to earlier research, results revealed a similar, long developmental trajectory for sensitivity to global motion at both slower and faster speeds and for biological motion. Thresholds for all three tasks improved monotonically between 6 and 14 years of age, at which point they were adult-like. The results suggest that the extrastriate mechanisms that integrate local motion cues over time and space take many years to mature.     

Brain areas sensitive to coherent visual motion

Detection of coherent motion versus noise is widely used as a measure of global visual-motion processing. To localise the human brain mechanisms involved in this performance, functional magnetic resonance imaging (fMRI) was used to compare brain activation during viewing of coherently moving random dots with that during viewing spatially and temporally comparable dynamic noise. Rates of reversal of coherent motion and coherent-motion velocities (5 versus 20 deg s-1) were also compared. Differences in local activation between conditions were analysed by statistical parametric mapping. Greater activation by coherent motion compared to noise was found in V5 and putative V3A, but not in V1. In addition there were foci of activation on the occipital ventral surface, the intraparietal sulcus, and superior temporal sulcus. Thus, coherent-motion information has distinctive effects in a number of extrastriate visual brain areas. The rate of motion reversal showed only weak effects in motion-sensitive areas. V1 was better activated by noise than by coherent motion, possibly reflecting activation of neurons with a wider range of motion selectivities. This activation was at a more anterior location in the comparison of noise with the faster velocity, suggesting that 20 deg s-1 is beyond the velocity range of the V1 representation of central visual field. These results support the use of motion-coherence tests for extrastriate as opposed to V1 function. However, sensitivity to motion coherence is not confined to V5, and may extend beyond the classically defined dorsal stream.     

Testing the dorsal stream attention hypothesis: Electrophysiological correlates and the effects of ventral stream damage

The roles of dorsal and ventral processing streams in visual orienting and conscious perception were examined in two experiments. The first employed high density EEG with source localization. The second comprised a neuropsychological case study. Visual orienting was assessed with an attention procedure, where peripheral letters cued participants towards a target location. In the perception procedure participants responded to the same letters by performing an explicit conscious discrimination. In Experiment 1, the peripheral letters elicited rapid dorsal stream activation in the attention procedure, and this activation preceded top-down enhancement of target processing in occipital cortex. In the perception procedure early ventral stream activation was seen. In addition, peripheral letters elicited an “early directing attention negativity” (EDAN) over parietal recording sites in the attention procedure, but not in the perception procedure. In Experiment 2, a patient with a bilateral ventral stream lesion but preserved dorsal stream function showed clear disruption to performance in the perception procedure, whilst exhibiting a normal visual orienting effect in the attention procedure. Taken together these findings (1) highlight the distinct roles of the dorsal and ventral streams in attention and perception, and (2) suggest how these streams might interact, via reentrant effects of attention on perceptual processing.     

Global dot integration in typically developing children and in Williams Syndrome

Williams Syndrome (WS) is a neurodevelopmental disorder that results in deficits in visuospatial perception and cognition. The dorsal stream vulnerability hypothesis in WS predicts that visual motion processes are more susceptible to damage than visual form processes. We asked WS participants and typically developing children to detect the global structure Glass patterns, under “static” and “dynamic” conditions in order to evaluate this hypothesis. Sequentially presented Glass patterns are coined as dynamic because they induce illusory motion, which is modeled after the interaction between orientation (form) and direction (motion) mechanisms. If the dorsal stream vulnerability holds in WS participants, then they should process real and illusory motion atypically. However, results are consistent with the idea that form and motion integration mechanisms are functionally delayed or attenuated in WS. Form coherence thresholds for both static and dynamic Glass patterns in WS were similar to those of 4–5 year old children, younger than what is predicted by mental age. Dynamic presentation of Glass patterns improved thresholds to the same degree as typical participants. Motion coherence thresholds in WS were similar to those of mental age matches. These data pose constraints on the dorsal vulnerability hypothesis, and refine our understanding of the relationship between form and motion processing in development.     

Global dot integration in typically developing children and in Williams Syndrome

Williams Syndrome (WS) is a neurodevelopmental disorder that results in deficits in visuospatial perception and cognition. The dorsal stream vulnerability hypothesis in WS predicts that visual motion processes are more susceptible to damage than visual form processes. We asked WS participants and typically developing children to detect the global structure Glass patterns, under “static” and “dynamic” conditions in order to evaluate this hypothesis. Sequentially presented Glass patterns are coined as dynamic because they induce illusory motion, which is modeled after the interaction between orientation (form) and direction (motion) mechanisms. If the dorsal stream vulnerability holds in WS participants, then they should process real and illusory motion atypically. However, results are consistent with the idea that form and motion integration mechanisms are functionally delayed or attenuated in WS. Form coherence thresholds for both static and dynamic Glass patterns in WS were similar to those of 4–5 year old children, younger than what is predicted by mental age. Dynamic presentation of Glass patterns improved thresholds to the same degree as typical participants. Motion coherence thresholds in WS were similar to those of mental age matches. These data pose constraints on the dorsal vulnerability hypothesis, and refine our understanding of the relationship between form and motion processing in development.     

The dorsal stream and the visual horizon

Today many philosophers of mind accept that the two cortical streams of visual processing in humans can be distinguished in terms of conscious experience. The ventral stream is thought to produce representations that may become conscious, and the dorsal stream is thought to handle unconscious vision for action. Despite a vast literature on the topic of the two streams, there is currently no account of the way in which the relevant empirical evidence could fit with basic Husserlian phenomenology of vision. Here I offer such an account. In this article, I show how the empirical evidence ought to be understood in a way that is informed by phenomenology. The differences in the two streams are better described as differences in spatial and temporal processing. Rather than simply “unconscious,” the dorsal stream can be better described as making a special contribution to what Husserl identified as the visual horizon.     

Linking form and motion in the primate brain

Understanding dynamic events entails the integration of information about form and motion that is crucial for fast and successful interactions in complex environments. A striking example of our sensitivity to dynamic information is our ability to recognize animate figures by the way they move and infer motion from still images. Accumulating evidence for form and motion interactions contrasts with the traditional dissociation between shape and motion-related processes in the ventral and dorsal visual pathways. By combining findings from physiology and brain imaging it can be demonstrated that the primate brain converts information about spatiotemporal sequences into meaningful actions through interactions between early and higher visual areas processing form and motion and frontal-parietal circuits involved in the understanding of actions.     

孤独症谱系障碍者的生物运动探测障碍：基于行为与神经的证据

关于孤独症谱系障碍个体探测生物运动的能力是否受损,已有行为研究尚存分歧。导致分歧的原因可能是实验刺激、实验任务和测量指标存在差异。然而,神经研究却一致证实其潜在的神经机制存在异常。领域特殊性观点认为该障碍可能是基于后侧颞上沟功能异常的社会性功能障碍,也可能是基于镜像神经元功能异常的社会性功能障碍;而领域一般性观点认为该障碍可能是基于背侧视觉流功能异常的视运动知觉障碍,也可能基于脑功能联结异常的弱中央统合障碍。据此,本文将从研究范式、行为表现及潜在机制三个方面梳理相关研究,以期为后续研究提供新方向。     

M-stream deficits and reading-related visual processes in developmental dyslexia

Some visual processing deficits in developmental dyslexia have been attributed to abnormalities in the subcortical M stream and/or the cortical dorsal stream of the visual pathways. The nature of the relationship between these visual deficits and reading is unknown. The purpose of the present article was to characterize reading-related perceptual processes that may link the visual deficits to reading problems. We identified contrast sensitivity, position encoding, oculomotor control, visual attention, parafoveal/foveal interactions, and saccadic suppression as potential reading-related dorsal stream processes. We then evaluated the role of each process in reading and the status of each process in dyslexia. In theory, a number of dorsal stream processes (e.g., oculomotor control and visual attention) might contribute to reading problems in developmental dyslexia. More work is needed to demonstrate the connection empirically.     

Dorsal and ventral visual streams: Typical and atypical development

The literature on visuospatial processing describes two distinct pathways within the brain: a dorsal route extending from the visual cortex into the parietal lobes that is critical for spatial processing and a ventral route extending from the visual cortex into the temporal lobes that is critical for form perception. These visual streams appear to differ in their developmental trajectories and their vulnerabilities to diverse neurodevelopmental conditions. The present work aims to investigate development and vulnerability in two aspects of dorsal and ventral visual-stream function, namely attention to location and attention to identity. In Study 1, we compare typically-developing (TD) youth aged 9 to 16 years with young adults aged 18 to 22 years on computerized location and identity tasks. In Study 2, we compare children and adolescents who have congenital hypothyroidism (CH), a pediatric endocrine disorder, with age-matched TD controls on the same tasks. The results from Study 1 show that the youths were less accurate than the adults at judging identity, whereas both groups were equally accurate at judging location. The results from Study 2 show that the youths with CH were slower but not less accurate than the TD youths in making both identity and location judgments. The results are interpreted as signifying later development of ventral (identity) stream functions compared to dorsal (location) but equal vulnerability of both functions in CH.     

Task dependent processing of visual information about target acceleration

The objective of this study was to investigate the sensitivity of the perceptual and motor systems to target acceleration information using verbal magnitude estimations of target acceleration and manual interception of these targets. The results showed that in the perceptual task the participants were responding mainly to acceleration threshold values, which is acceleration as a function of initial, final, and average velocities, rather then to the absolute accelerations. When manually intercepting the targets the participants responded mainly to the absolute acceleration value and target initial velocity. Thus, these results suggest that target motion can be processed in the ventral (perception) and dorsal (action) visual streams however different motion characteristics are processed in these streams depending on the required output.     

Neural correlates of coherent and biological motion perception in autism

Recent evidence suggests those with autism may be generally impaired in visual motion perception. To examine this, we investigated both coherent and biological motion processing in adolescents with autism employing both psychophysical and fMRI methods. Those with autism performed as well as matched controls during coherent motion perception but had significantly higher thresholds for biological motion perception. The autism group showed reduced posterior Superior Temporal Sulcus (pSTS), parietal and frontal activity during a biological motion task while showing similar levels of activity in MT+/V5 during both coherent and biological motion trials. Activity in MT+/V5 was predictive of individual coherent motion thresholds in both groups. Activity in dorsolateral prefrontal cortex (DLPFC) and pSTS was predictive of biological motion thresholds in control participants but not in those with autism. Notably, however, activity in DLPFC was negatively related to autism symptom severity. These results suggest that impairments in higher-order social or attentional networks may underlie visual motion deficits observed in autism.     

Objects,numbers, fingers,space: clustering of ventral and dorsal functions in young children and adults

In the primate brain, sensory information is processed along two partially segregated cortical streams: the ventral stream, mainly coding for objects' shape and identity, and the dorsal stream, mainly coding for objects' quantitative information (including size, number, and spatial position). Neurophysiological measures indicate that such functional segregation is present early on in infancy, and that the two streams follow independent maturational trajectories during childhood. Here we collected, in a large sample of young children and adults, behavioural measures on an extensive set of functions typically associated with either the dorsal or the ventral stream. We then used a correlational approach to investigate the presence of inter‐individual variability resulting in clustering of functions. Results show that dorsal‐ and ventral‐related functions follow two uncorrelated developmental trajectories. Moreover, within each stream, some functions show age‐independent correlations: finger gnosis, non‐symbolic numerical abilities and spatial abilities within the dorsal stream, and object and face recognition abilities within the ventral stream. This pattern of clear within‐stream cross‐task correlation seems to be lost in adults, with two notable exceptions: performance in face and object recognition on one side, and in symbolic and non‐symbolic comparison on the other, remain correlated, pointing to distinct shape recognition and quantity comparison systems.     

Dorsal stream activation during retrieval of object size and shape

We investigated dorsal visual stream involvement in the retrieval of a variety of visual attributes of common objects, using functional magnetic resonance imaging. Seven subjects made binary decisions about the shape, color, and size of named objects during scanning. Bilateral parietal activity was significantly greater during retrieval of shape and size information than during retrieval of color information. Consistent with a domain-specific distributed model of semantic organization, the finding that dorsal stream activity is associated with size and shape retrieval, as compared with color retrieval, may indicate that both size and shape information are learned partly through dorsally mediated processes, such as visually guided grasping. These results demonstrate that both visual-processing streams (i.e., the ventral “what” pathway and the dorsal “where” pathway) are involved in the storage and/or retrieval of knowledge of object appearance but that, just as in vision, these two pathways may play different roles in conceptual processing.     

Weighing the evidence for a dorsal processing bias under continuous flash suppression

With the introduction of continuous flash suppression (CFS) as a method to render stimuli invisible and study unconscious visual processing, a novel hypothesis has gained popularity. It states that processes typically ascribed to the dorsal visual stream can escape CFS and remain functional, while ventral stream processes are suppressed when stimuli are invisible under CFS. This notion of a CFS-specific “dorsal processing bias” has been argued to be in line with core characteristics of the influential dual-stream hypothesis of visual processing which proposes a dissociation between dorsally mediated vision-for-action and ventrally mediated vision-for-perception. Here, we provide an overview of neuroimaging and behavioral studies that either examine this dorsal processing bias or base their conclusions on it. We show that both evidence for preserved ventral processing as well as lack of dorsal processing can be found in studies using CFS. To reconcile the diverging results, differences in the paradigms and their effects are worthy of future research. We conclude that given the current level of information a dorsal processing bias under CFS cannot be universally assumed.     

视觉预期的类型及神经机制

视觉预期是一种运用视觉信息的部分资源和先行资源对即将发生的事件进行预测的能力。为了人们更加清楚地认识视觉预期的内在加工过程,同时也有助于国内外研究者更为科学深入地探讨这种自上而下的加工,本文主要从婴幼儿和成人运动员两方面来阐述视觉预期的相关研究。首先从婴幼儿对物体相关属性和行为目标的视觉预期两方面探讨了视觉预期的类型,然后论述了成人视觉预期的神经机制。最后,指出今后的研究应加强视觉预期相关技术在临床诊断中的应用,注重环境在视觉预期中的作用,从神经网络角度研究视觉预期的神经基础。