Modal and amodal completion generate different shapes

Mechanisms of contour completion are critical for computing visual surface structure in the face of occlusion. Theories of visual completion posit that mechanisms of contour interpolation operate independently of whether the completion is modal or amodal--thereby generating identical shapes in the two cases. This identity hypothesis was tested in two experiments using a configuration of two overlapping objects and a modified Kanizsa configuration. Participants adjusted the shape of a comparison display in order to match the shape of perceived interpolated contours in a standard completion display. Results revealed large and systematic shape differences between modal and amodal contours in both configurations. Participants perceived amodal (i.e., partly occluded) contours to be systematically more angular--that is, closer to a corner--than corresponding modal (i.e., illusory) contours. The results falsify the identity hypothesis in its current form: Corresponding modal and amodal contours can have different shapes, and, therefore, mechanisms of contour interpolation cannot be independent of completion type.     

Perceptual organization without perception. The subliminal learning of global contour

A critical step in visual perceptual processing is integrating local visual elements into contours so that shapes can be derived from them. It is often assumed that contour integration may reflect hardwired coding of low-level visual features. In this study, we present novel evidence indicating that integration of local elements into contours can be learned subliminally, despite being irrelevant to the training task and despite the local properties of the display varying randomly during training. Learning occurred only when contours were consistently paired with task-relevant targets--echoing the findings of previous studies on subliminal learning of low-level features. Our data indicate that task-irrelevant, exposure-based learning extends beyond local low-level visual features and may play a critical role at multiple levels of visual perceptual organization.     

Weighing the evidence for a dorsal processing bias under continuous flash suppression

With the introduction of continuous flash suppression (CFS) as a method to render stimuli invisible and study unconscious visual processing, a novel hypothesis has gained popularity. It states that processes typically ascribed to the dorsal visual stream can escape CFS and remain functional, while ventral stream processes are suppressed when stimuli are invisible under CFS. This notion of a CFS-specific “dorsal processing bias” has been argued to be in line with core characteristics of the influential dual-stream hypothesis of visual processing which proposes a dissociation between dorsally mediated vision-for-action and ventrally mediated vision-for-perception. Here, we provide an overview of neuroimaging and behavioral studies that either examine this dorsal processing bias or base their conclusions on it. We show that both evidence for preserved ventral processing as well as lack of dorsal processing can be found in studies using CFS. To reconcile the diverging results, differences in the paradigms and their effects are worthy of future research. We conclude that given the current level of information a dorsal processing bias under CFS cannot be universally assumed.     

Are there unconscious perceptual processes?

Blindsight and vision for action seem to be exemplars of unconscious visual processes. However, researchers have recently argued that blindsight is not really a kind of unconscious vision but is rather severely degraded conscious vision. Morten Overgaard and colleagues have recently developed new methods for measuring the visibility of visual stimuli. Studies using these methods show that reported clarity of visual stimuli correlates with accuracy in both normal individuals and blindsight patients. Vision for action has also come under scrutiny. Recent findings seem to show that information processed by the dorsal stream for online action contributes to visual awareness. Some interpret these results as showing that some dorsal stream processes are conscious visual processes (e.g., Gallese, 2007; Jacob & Jeannerod, 2003). The aim of this paper is to provide new support for the more traditional view that blindsight and vision for action are genuinely unconscious perceptual processes. I argue that individuals with blindsight do not have access to the kind of purely qualitative color and size information which normal individuals do. So, even though people with blindsight have a kind of cognitive consciousness, visual information processing in blindsight patients is not associated with a distinctly visual phenomenology. I argue further that while dorsal stream processing seems to contribute to visual awareness, only information processed by the early dorsal stream (V1, V2, and V3) is broadcast to working memory. Information processed by later parts of the dorsal stream (the parietal lobe) never reaches working memory and hence does not correlate with phenomenal awareness. I conclude that both blindsight and vision for action are genuinely unconscious visual processes.     

Orientation Invariance and Geometric Primitives in Shape Recognition

Although it is generally assumed that vision is orientation invariant, that is, that shapes can be recognized regardless of viewing angle, there is little evidence that speaks directly to this issue, and what evidence there is fails to support orientation invariance. We propose an explanation for the previous results in terms of the kinds of shape primitives used by the visual system in achieving orientation invariance: Whereas contours are used at stages of vision that ore not orientation invariant, surfaces and/or volumes are used at stages of vision that are orientation invariant. The stimuli in previously reported studies were wire forms, which can represented only in terms of contour. In four experiments, testing both short-term and long-term memory for shape, we replicated the previous failures of orientation invariance using wire forms, but found relatively good or perfect orientation invariance with equivalently shaped surfaces.     

Rapid learning in attention shifts: A review

Many lines of evidence show that the human visual system does not simply passively register whatever appears in the visual field. The visual system seems to preferentially “choose” stimuli according to what is most relevant for the task at hand, a process called attentional selection. Given the large amount of information in any given visual scene, and well-documented capacity limitations for the representation of visual stimuli, such a strategy seems only reasonable. Consistent with this, human observers are surprisingly insensitive to large changes in their visual environment when they attend to something else in the visual scene. Here I argue that attentional selection of pertinent information is heavily influenced by the stimuli most recently viewed that were important for behaviour. I will describe recent evidence for the existence of a powerful memory system, not under any form of voluntary control, which aids observers in orienting quickly and effectively to behaviourally relevant stimuli in the visual environment, in particular the stimuli that have been important in the immediate past. I will also discuss research into the potential neural mechanisms involved in these learning effects. Finally, I will discuss how these putative memory mechanisms may help in maintaining the apparent stability and continuity of the ever-changing visual environment, which is such a crucial component of our everyday visual experience.     

Is interpolation cognitively encapsulated? Measuring the effects of belief on Kanizsa shape discrimination and illusory contour formation

Contour interpolation is a perceptual process that fills-in missing edges on the basis of how surrounding edges (inducers) are spatiotemporally related. Cognitive encapsulation refers to the degree to which perceptual mechanisms act in isolation from beliefs, expectations, and utilities (Pylyshyn, 1999). Is interpolation encapsulated from belief? We addressed this question by having subjects discriminate briefly-presented, partially-visible fat and thin shapes, the edges of which either induced or did not induce illusory contours (relatable and non-relatable conditions, respectively). Half the trials in each condition incorporated task-irrelevant distractor lines, known to disrupt the filling-in of contours. Half of the observers were told that the visible parts of the shape belonged to a single thing (group strategy); the other half were told that the visible parts were disconnected (ungroup strategy). It was found that distractor lines strongly impaired performance in the relatable condition, but minimally in the non-relatable condition; that strategy did not alter the effects of the distractor lines for either the relatable or non-relatable stimuli; and that cognitively grouping relatable fragments improved performance whereas cognitively grouping non-relatable fragments did not. These results suggest that (1) filling-in effects during illusory contour formation cannot be easily removed via strategy; (2) filling-in effects cannot be easily manufactured from stimuli that fail to elicit interpolation; and (3) actively grouping fragments can readily improve discrimination performance, but only when those fragments form interpolated contours. Taken together, these findings indicate that discriminating filled-in shapes depends on strategy but the filling-in process itself may be encapsulated from belief.     

Context-sensitive binding by the laminar circuits of V1 and V2: A unified model of perceptual grouping,attention, and orientation contrast

A detailed neural model is presented of how the laminar circuits of visual cortical areas V1 and V2 implement context-sensitive binding processes such as perceptual grouping and attention. The model proposes how specific laminar circuits allow the responses of visual cortical neurons to be determined not only by the stimuli within their classical receptive fields, but also to be strongly influenced by stimuli in the extra-classical surround. This context-sensitive visual processing can greatly enhance the analysis of visual scenes, especially those containing targets that are low contrast, partially occluded, or crowded by distractors. We show how interactions of feedforward, feedback, and horizontal circuitry can implement several types of contextual processing simultaneously, using shared laminar circuits. In particular, we present computer simulations that suggest how top-down attention and preattentive perceptual grouping, two processes that are fundamental for visual binding, can interact, with attentional enhancement selectively propagating along groupings of both real and illusory contours, thereby showing how attention can selectively enhance object representations. These simulations also illustrate how attention may have a stronger facilitatory effect on low contrast than on high contrast stimuli, and how pop-out from orientation contrast may occur. The specific functional roles which the model proposes for the cortical layers allow several testable neurophysiological predictions to be made. The results presented here simulate only the boundary grouping system of adult cortical architecture. However, we also discuss how this model contributes to a larger neural theory of vision that suggests how intracortical and intercortical feedback help to stabilize development and learning within these cortical circuits. Although feedback plays a key role, fast feedforward processing is possible in response to unambiguous information. Model circuits are capable of synchronizing quickly, but context-sensitive persistence of previous events can influence how synchrony develops. Although these results focus on how the interblob cortical processing stream controls boundary grouping and attention, related modelling of the blob cortical processing stream suggests how visible surfaces are formed, and modelling of the motion stream suggests how transient responses to scenic changes can control long-range apparent motion and also attract spatial attention.     

Linking form and motion in the primate brain

Understanding dynamic events entails the integration of information about form and motion that is crucial for fast and successful interactions in complex environments. A striking example of our sensitivity to dynamic information is our ability to recognize animate figures by the way they move and infer motion from still images. Accumulating evidence for form and motion interactions contrasts with the traditional dissociation between shape and motion-related processes in the ventral and dorsal visual pathways. By combining findings from physiology and brain imaging it can be demonstrated that the primate brain converts information about spatiotemporal sequences into meaningful actions through interactions between early and higher visual areas processing form and motion and frontal-parietal circuits involved in the understanding of actions.     

Multidimensional visual statistical learning

Recent studies of visual statistical learning (VSL) have demonstrated that statistical regularities in sequences of visual stimuli can be automatically extracted, even without intent or awareness. Despite much work on this topic, however, several fundamental questions remain about the nature of VSL. In particular, previous experiments have not explored the underlying units over which VSL operates. In a sequence of colored shapes, for example, does VSL operate over each feature dimension independently, or over multidimensional objects in which color and shape are bound together? The studies reported here demonstrate that VSL can be both object-based and feature-based, in systematic ways based on how different feature dimensions covary. For example, when each shape covaried perfectly with a particular color, VSL was object-based: Observers expressed robust VSL for colored-shape sub-sequences at test but failed when the test items consisted of monochromatic shapes or color patches. When shape and color pairs were partially decoupled during learning, however, VSL operated over features: Observers expressed robust VSL when the feature dimensions were tested separately. These results suggest that VSL is object-based, but that sensitivity to feature correlations in multidimensional sequences (possibly another form of VSL) may in turn help define what counts as an object.     

Kanizsa-type subjective contours do not guide attentional deployment in visual search but line termination contours do

We used visual search to explore whether attention could be guided by Kanizsa-type subjective contours and by subjective contours induced by line ends. Unlike in previous experiments, we compared search performance with subjective contours against performance with real, luminance contours, and we had observers search for orientations or shapes produced by subjective contours, rather than searching for the presence of the contours themselves. Visual search for one orientation or shape among distractors of another orientation or shape was efficient when the items were defined by luminance contours. Search was much less efficient among items defined by Kanizsa-type subjective contours. Search remained efficient when the items were defined by subjective contours induced by line ends. The difference between Kanizsa-type subjective contour and subjective contours induced by line ends is consistent with physiological evidence suggesting that the brain mechanisms underlying the perception of these two kinds of subjective contours may be different.     

A search asymmetry reversed by figure-ground assignment

We report evidence demonstrating that a search asymmetry favoring concave over convex targets can be reversed by altering the figure-ground assignment of edges in shapes. Visual search for a concave target among convex distractors is faster than search for a convex target among concave distractors (a search asymmetry). By using shapes with ambiguous local figure-ground relations, we demonstrated that search can be efficient (with search slopes around 10 ms/item) or inefficient (with search slopes around 30–40 ms/item) with the same stimuli, depending on whether edges are assigned to concave or convex "figures." This assignment process can operate in a top-down manner, according to the task set. The results suggest that attention is allocated to spatial regions following the computation of figure-ground relations in parallel across the elements present. This computation can also be modulated by top-down processes.     

The interaction between social saliency and perceptual saliency

The ability to select visual targets in hierarchical stimuli can be affected by both perceptual saliency and social saliency. However, the functional relations between the effects are not understood. Here we examined whether these two factors interact or combine in an additive way. Participants first learnt to associate geometric shapes with three people (e.g., triangle–self, square–stranger). After learning the associations, participants were presented with compound stimuli (e.g., a global triangle formed by a set of local squares) and had to select a target at the global or local level. In Experiment 1 the task was to identify the person associated with the local or global shape. In Experiment 2 the task was simply to identify the shape. We manipulated perceptual saliency by blurring local elements to form perceptually global salient stimuli or by contrasting the colours of neighbouring local elements (red vs. white) to form perceptually local salient stimuli. In Experiment 1 (person discrimination) there was a strong effect of saliency on local targets (there were faster and more accurate responses to high than to low saliency targets) when social and perceptual saliency occurred at same level. However, both perceptual and social saliency effects were eliminated when the effect of saliency at one level competed with that at the other level. In Experiment 2 (shape discrimination), there were only effects of perceptual saliency. The data indicate that social saliency interacts with perceptual saliency when explicit social categorizations are made, consistent with both factors modulating a common process of visual selection.     

The finger in flight: real-time motor control by visually masked color stimuli

Current theories of dual visual systems suggest that color is processed in a ventral cortical stream that eventually gives rise to visual awareness but is only indirectly involved in visuomotor control mediated by the dorsal stream. If the dorsal stream is indeed less sensitive to color than the ventral stream, color stimuli blocked from awareness by visual masking should also be blocked from guiding fast motor responses. In this study, pointing movements to one of two isoluminant color targets were preceded by consistent or inconsistent color primes. Trajectories were strongly affected by priming, with kinematics implying a continuous flow of color information into executive brain areas while the finger was already moving. Motor effects were more sensitive to color of the primes than were deliberate attempts to identify the primes in forced-choice tasks based on visual awareness. Priming was observed even when masking was complete.     

Infants' perception of information along object boundaries: concavities versus convexities

Object parts are signaled by concave discontinuities in shape contours. In seven experiments, we examined whether 5- and 6 1/2-month-olds are sensitive to concavities as special aspects of contours. Infants of both ages detected discrepant concave elements amid convex distractors but failed to discriminate convex elements among concave distractors. This discrimination asymmetry is analogous to the finding that concave targets among convex distractors pop out for adults, whereas convex targets among concave distractors do not. Thus, during infancy, as during adulthood, concavities appear to be salient regions of shape contours. The current study also found that infants' detection of concavity is impaired if the contours that define concavity and convexity are not part of closed shapes. Thus, for infants, as for adults, concavities and convexities are defined more readily in the contours of closed shapes. Taken together, the results suggest that some basic aspects of part perception from shape contours are available by at least 5 months of age.     

Grasping with the eyes: The role of elongation in visual recognition of manipulable objects

Processing within the dorsal visual stream subserves object-directed action, whereas visual object recognition is mediated by the ventral visual stream. Recent findings suggest that the computations performed by the dorsal stream can nevertheless influence object recognition. Little is known, however, about the type of dorsal stream information that is available to assist in object recognition. Here, we present a series of experiments that explored different psychophysical manipulations known to bias the processing of a stimulus toward the dorsal visual stream in order to isolate its contribution to object recognition. We show that elongated-shaped stimuli, regardless of their semantic category and familiarity, when processed by the dorsal stream, elicit visuomotor grasp-related information that affects how we categorize manipulable objects. Elongated stimuli may reduce ambiguity during grasp preparation by providing a coarse cue to hand shaping and orientation that is sufficient to support action planning. We propose that this dorsal-stream-based analysis of elongation along a principal axis is the basis for how the dorsal visual object processing stream can affect categorization of manipulable objects.     

Integrating faces, houses, motion, and action: spontaneous binding across ventral and dorsal processing streams

Perceiving an event requires the integration of its features across numerous brain maps and modules. Visual object perception is thought to be mediated by a ventral processing stream running from occipital to inferotemporal cortex, whereas most spatial processing and action control is attributed to the dorsal stream connecting occipital, parietal, and frontal cortex. Here we show that integration operates not only on ventral features and objects, such as faces and houses, but also across ventral and dorsal pathways, binding faces and houses to motion and manual action. Furthermore, these bindings seem to persist over time, as they influenced performance on future task-relevant visual stimuli. This is reflected by longer reaction times for repeating one, but alternating other features in a sequence, compared to complete repetition or alternation of features. Our findings are inconsistent with the notion that the dorsal stream is operating exclusively online and has no access to memory.     

The role of constant curvature in 2-D contour shape representations

In early cortex, visual information is encoded by retinotopic orientation-selective units. Higher-level representations of abstract properties, such as shape, require encodings that are invariant to changes in size, position, and orientation. Within the domain of open, 2-D contours, we consider how an economical representation that supports viewpoint-invariant shape comparisons can be derived from early encodings. We explore the idea that 2-D contour shapes are encoded as joined segments of constant curvature. We report three experiments in which participants compared sequentially presented 2-D contour shapes comprised of constant curvature (CC) or non-constant curvature (NCC) segments. We show that, when shapes are compared across viewpoint or for a retention interval of 1000 ms, performance is better for CC shapes. Similar recognition performance is observed for both shape types, however, if they are compared at the same viewpoint and the retention interval is reduced to 500 ms. These findings are consistent with a symbolic encoding of 2-D contour shapes into CC parts when the retention intervals over which shapes must be stored exceed the duration of initial, transient, visual representations.     

The dorsal stream and the visual horizon

Today many philosophers of mind accept that the two cortical streams of visual processing in humans can be distinguished in terms of conscious experience. The ventral stream is thought to produce representations that may become conscious, and the dorsal stream is thought to handle unconscious vision for action. Despite a vast literature on the topic of the two streams, there is currently no account of the way in which the relevant empirical evidence could fit with basic Husserlian phenomenology of vision. Here I offer such an account. In this article, I show how the empirical evidence ought to be understood in a way that is informed by phenomenology. The differences in the two streams are better described as differences in spatial and temporal processing. Rather than simply “unconscious,” the dorsal stream can be better described as making a special contribution to what Husserl identified as the visual horizon.