Amodal completion and relationalism

Amodal completion is usually characterized as the representation of those parts of the perceived object that we get no sensory stimulation from. In the case of the visual sense modality, for example, amodal completion is the representation of occluded parts of objects we see. I argue that relationalism about perception, the view that perceptual experience is constituted by the relation to the perceived object, cannot give a coherent account of amodal completion. The relationalist has two options: construe the perceptual relation as the relation to the entire perceived object or as the relation to the unoccluded parts of the perceived object. I argue that neither of these options are viable.

     

Investigating global effects in visual occlusion: from a partly occluded square to the back of a tree-trunk.

'Classic' occlusion examples, such as a square partly occluded by a rectangle, have given rise to so-called local and global accounts of amodal completion. Without denying the influence of local configurations, I take the position that, in the long run, any theory of amodal completion should account for global properties. After a brief review of local and global accounts, two extensions of the stimulus domain are proposed to further illustrate the necessity of global accounts. The first is the domain of so-called fuzzy regularities, i.e., regularities which are not based on metrical identities. It is argued and demonstrated that observers are even susceptible to these fuzzy regularities and that they complete partly occluded shapes accordingly. The second extension is towards 3D object completion. Theories of object representation that describe intrinsic regularities of objects appear to be most suitable to predict relative preferences of alternative object completions. Consequently, fuzzy object completions, such as the completion of the back of a tree-trunk, can be explained better by global constraints.     

Visual cognition influences early vision: the role of visual short-term memory in amodal completion

A partly occluded visual object is perceptually filled in behind the occluding surface, a process known as amodal completion or visual interpolation. Previous research focused on the image-based properties that lead to amodal completion. In the present experiments, we examined the role of a higher-level visual process-visual short-term memory (VSTM)-in amodal completion. We measured the degree of amodal completion by asking participants to perform an object-based attention task on occluded objects while maintaining either zero or four items in visual working memory. When no items were stored in VSTM, participants completed the occluded objects; when four items were stored in VSTM, amodal completion was halted (Experiment 1). These results were not caused by the influence of VSTM on object-based attention per se (Experiment 2) or by the specific location of to-be-remembered items (Experiment 3). Items held in VSTM interfere with amodal completion, which suggests that amodal completion may not be an informationally encapsulated process, but rather can be affected by high-level visual processes.     

The effects of occlusion and past experience on the allocation of object-based attention

There is considerable evidence indicating that cuing a specific portion of an object results in the entire object’s being attended to. In the present study, we examined whether previous experience with an object could halt perceptual (i.e., amodal) completion. In Experiment 1, two parallel rectangles were initially displayed, and then the middle portions of these objects were occluded. Attentional cuing effects were found for both discrete portions of the completed rectangles. In the final two experiments, four discrete objects were initially displayed, followed by the same occluder as that used in the first experiment. The appearance of the occluder (500 msec before the cue in Experiment 2, 100 msec before the cue in Experiment 3) allowed the four discrete objects to be completed into two rectangles. Attentional cuing effects were found for the completed rectangles in both experiments, indicating that previous experience was not sufficient to halt the amodal completion of objects.     

Amodal completion, depth stratification, and illusory figures: a test of Kanizsa's explanation.

Subjective contours have been explained by Kanizsa as being a consequence of amodal completion of incomplete figures. According to the theory of amodal completion, figural incompleteness triggers the emergence of an illusory object superimposed on the gaps in the inducers, which in turn hide parts of the pattern, thus suggesting that the plane of the illusory object must always be seen to be above the plane of the inducers. A figure was created in which subjective contours are seen despite the fact that the perceived depth relationships run counter to that required by the theory of amodal completion. In four experiments, this depth relationship is confirmed by using direct and indirect measures which assess both registered and apprehended depth. By emphasizing a logical inconsistency in the explanation based on amodal completion, the results show that amodal completion, at least in Kanizsa-like patterns, cannot be considered as a causal factor for subjective contour figures.     

Volume completion in 4.5-month-old infants

In this study, we examined 4.5-month-old infants' visual completion of self-occluding three-dimensional objects. A previous study on this topic reported that 6-month-old, but not 4-month-old infants extrapolate a convex, symmetric prism from a limited view of its surfaces (Soska & Johnson, 2008). As of yet, studies on the development of amodal completion of three-dimensional, self-occluding objects are scarce. Given 4-month-old infants' abilities to derive three-dimensional shape from a variety of visual cues, three-dimensional amodal completion may well depend on the perceptual strength of three-dimensionality in the stimulus displays. The first experiments (1A and 1B) tested this hypothesis by means of a habituation paradigm and showed that 4.5-month-old infants are indeed able to amodally complete the back of a self-occluding object when sufficient three-dimensional cues are available. Further support for volume completion in 4.5-month-old infants was found in a second experiment, again using a habituation paradigm, that measured perceived connectedness between two visually separated, self-occluding, three-dimensional objects.     

Perceptual causality in the amodal completion of kinetic structures

Perceptual causality as an amodal completion of kinetic structures was demonstrated. The experimental situation was as follows: a square appeared on the left, moved from left to right till it touched one side of a stationary rectangle (a perceptual screen), and disappeared; after a while, another square appeared at the other side of the rectangle and moved right. The first square moved faster than the second one. Sometimes, two moving objects were perceived, with an amodal launching effect: the first moving object seemed to collide with the second one behind the screen. When both the screen and the occluding interval were small, despite the discrepancy of velocities, a single moving object was perceived, but the object seemed to abruptly change its speed behind the screen. The perception of an amodal completion of movement raises some theoretical issues: the discrepancy between amodal completion of kinetic structures and that of static ones, the problem of perceptual identity, and figure-ground segregation in dynamic scene. The dilemma of the naive subject will also be discussed. Received: 11 June 1997 / Accepted: 14 October 1998     

Spatial updating relies on an egocentric representation of space: Effects of the number of objects

Models of spatial updating attempt to explain how representations of spatial relationships between the actor and objects in the environment change as the actor moves. In allocentric models, object locations are encoded in an external reference frame, and only the actor’s position and orientation in that reference frame need to be updated. Thus, spatial updating should be independent of the number of objects in the environment (set size). In egocentric updating models, object locations are encoded relative to the actor, so the location of each object relative to the actor must be updated as the actor moves. Thus, spatial updating efficiency should depend on set size. We examined which model better accounts for human spatial updating by having people reconstruct the locations of varying numbers of virtual objects either from the original study position or from a changed viewing position. In consistency with the egocentric updating model, object localization following a viewpoint change was affected by the number of objects in the environment.     

Hand-movement profiles in a tactual—tactual matching task: Effects of spatial factors and laterality

We examined the effect of spatial factors and hemispheric lateralization upon hand-scanning strategies in 14 right-handed men tested in a tactual—tactual matching task. The experiment involved comparisons (judgments of same or different) between two objects sequentially touched by the fingertips of the left or right hand. Stimuli were made of smoothly joined cubes whose junctions were not haptically discernible. Exploratory strategies were inferred from the durations and locations of hand contacts with any of the cubes composing the stimuli. Accuracy was greater when the same stimulus was touched twice by the same hand than when different hands were used to feel it. With regard to strategies, both hands touched the upper parts of the object longer than the lower parts. Subjects also inspected more portions of the objects ipsilateral to the hand used. Overall differences in time spent touching cubes were greater for the right hand than for the left hand, showing that touch times were less evenly distributed on object parts for the former than for the latter. In this study, the process of information gathering by touch appears to be determined by the intertwining integration of contextual factors (e.g., stimulus position in space), biomechanical constraints on hand movements, and such cognitive factors as hemispheric differences on the ability to encode spatial pattern information.     

Object-Based Visual Selection: Evidence From Perceptual Completion

A large body of evidence suggests that visual attention selects objects as well as spatial locations. If attention is to be regarded as truly object based, then it should operate not only on object representations that are explicit in the image, but also on representations that are the result of earlier perceptual completion processes. Reporting the results of two experiments, we show that when attention is directed to part of a perceptual object, other parts of that object enjoy an attentional advantage as well. In particular, we show that this object-specific attentional advantage accrues to partly-occluded objects and to objects defined by subjective contours. The results corroborate the claim that perceptual completion precedes object-based attentional selection.     

Complete mergeability and amodal completion.

When image fragments are taken to correspond to the visible portions of a single occluded object, the object is said to 'amodally complete' behind the occluder. Kellman and Shipley (Kellman, P. J., & Shipley, T. F. (1991). A theory of visual interpolation in objective perception. Cognitive Psychology, 23, 144-221) argued that when the virtual contour extensions of such image fragments subtend an obtuse or right angle, the contours are 'relatable' and therefore complete. However, edge and surface relatability are neither necessary nor sufficient for completion to be perceived (Tse, P. U. (1999) Volume completion. Cognitive Psychology). Evidence is offered that completion is not driven directly by image cues such as contour relatability, but is driven, rather, by intermediate representations, such as volumes that are inferred from global image cue relationships. Evidence suggests that several factors, none of which is necessary for amodal completion to occur, contribute to the perceived strength of amodal completion, including similarity of pattern or substance, proximity, and good volume continuation or complete mergeability. Two partially occluded volumes are completely mergeable when they can be extended into occluded space along the trajectory defined by their visible surfaces such that they merge entirely with each other. Mergeability is not measurable in the image because it describes an inferred relationship among volumes that must themselves be inferred from the image.     

How does our search engine “see” the world? The case of amodal completion

This article illustrates a dissociation between the perceived attributes of an object and the ability of those attributes to guide the deployment of attention in visual search. Orientation is an attribute that guides search. Thus, a vertical line will “pop out” amid horizontal distractors. Amodal completion can create perceptually convincing oriented stimuli when two elements appear to form a complete object partially hidden behind an occluder. Previous work (e.g., Rensink &; Enns, Vision Research, 38, 2489–2505, 1998) has shown a preattentive role for amodal completion in search tasks. Here, we show that orientation based on perceptually compelling amodal completion may fail to guide attention. The broader conclusion is that introspection is a poor guide to the capabilities of our internal search engine.     

Amodal representation of occluded surfaces: role of invisible stimuli in apparent motion correspondence

A series of demonstrations were created where the perceived depth of targets was controlled by stereoscopic disparity. A closer object (a cloud) was made to jump back and forth horizontally, partially occluding a farther object (a full moon). The more distant moon appeared stationary even though the unoccluded portion of it, a crescent, changed position. Reversal of the relative depth of the moon and cloud gave a totally different percept: the crescent appeared to flip back and forth in the front depth plane. Thus, the otherwise-robust apparent motion of the moon crescents was completely abolished in the cloud-closer case alone. This motion-blocking effect is attributed to the 'amodal presence' of the occluded surface continuing behind the occluding surface. To measure the effect of this occluded 'invisible' surface quantitatively, a bistable apparent motion display was used (Ramachandran and Anstis 1983a): two small rectangular-shaped targets changed their positions back and forth between two frames, and the disparity of a large centrally positioned rectangle was varied. When the perceived depths supported the possibility of amodal completion behind the large rectangle, increased vertical motion of the targets was found, suggesting that the amodal presence of the targets behind the occluder had effectively changed the center position of the moving targets for purposes of motion correspondence. Amodal contours are literally 'invisible', yet it is hypothesized that they have a neural representation at sufficiently early stages of visual processing to alter the correspondence solving process for apparent motion.     

Perception of partly occluded figures by baboons (Papio papio)

Comparative literature provides conflicting findings whether animals experience amodal completion. Five experiments were conducted to verify if baboons perceive partly occluded objects as complete. The first three experiments used a go/no-go procedure and a video monitor for stimulus presentation. These experiments failed to reveal amodal completion, suggesting that the stimuli were processed as 2-D images rather than 3-D objects. In contrast, completion was demonstrated in a fourth experiment with cardboard stimuli in a two-alternative forced-choice (2AFC) discrimination task presented in a Wisconsin General Test Apparatus. Although in experiment 5 the same 2AFC procedure was used as in experiment 4, completion was absent when the stimuli were shown with a computer graphic system. The results suggest that baboons share with humans the ability for amodal completion, but also underline some procedural factors that might affect the elicitation of this capacity.     

SPREADING OF VISUAL ATTENTION TO MODALLY VERSUS AMODALLY COMPLETED REGIONS

Abstract— Regions of objects that are partially obscured at the current retinal image are often perceptually filled in by the visual system (Kanizsa, 1979). In some cases (modal completion), this causes the filled-in region to appear tinged with the color and brightness of unobscured parts of that object, but m other cases (amodal completion), it does not (Michotte & Burke, 1951). It has recently been argued that modal and amodal completion both arise in preattentive vision, and may operate equivalently at that level (Davis & Driver, 1994, He & Nakayama, 1992, Shipley & Kellman, 1992). In this article, we show that they have different effects on attentive vision, with attention tending to spread to (and from) modally completed regions and their visible inducers, but not to (or from) comparable amodally completed regions and their inducers. This finding is consistent with visual attention operating on surfaces (e g, He & Nakayama, 1995) in a viewer-centered representation of the scene, after the operation of filling-in processes.     

Object-position binding in visual memory for natural scenes and object arrays

Nine experiments examined the means by which visual memory for individual objects is structured into a larger representation of a scene. Participants viewed images of natural scenes or object arrays in a change detection task requiring memory for the visual form of a single target object. In the test image, 2 properties of the stimulus were independently manipulated: the position of the target object and the spatial properties of the larger scene or array context. Memory performance was higher when the target object position remained the same from study to test. This same-position advantage was reduced or eliminated following contextual changes that disrupted the relative spatial relationships among contextual objects (context deletion, scrambling, and binding change) but was preserved following contextual change that did not disrupt relative spatial relationships (translation). Thus, episodic scene representations are formed through the binding of objects to scene locations, and object position is defined relative to a larger spatial representation coding the relative locations of contextual objects.     

The effects of kinetic occlusion and categorization on amodal completion. A comment on Gerbino and Salmaso (1987)

The experimental study of Gerbino and Salmaso (1987) focused on the process of amodal completion, i.e. the process that leads to the impression of a total pattern in the absence of information about all parts of the pattern. One of the questions that they have attempted to answer with respect to this process is whether or not it depends on the categorization of the modal part (i.e. the part about which visual information is present) as a modification of a complete prototype. The major conclusion of their experiments is that amodal completion does not depend upon categorization. Furthermore, they interpret their results as indicating that neither the truncated form of the occluded part nor the unification/segregation of contour segments are phenomenally real. We designed some variants of the tunnel effect to demonstrate (1) that the explicit categorization of some parts of the input can have an influence on amodal completion and (2) that the truncated form of a pattern can be phenomenally real. Our results corroborate these hypotheses and can, therefore, interpreted as refuting two rather central claims of Gerbino and Salmaso (1987). The conclusion of our experiment must be that amodal completion is not as primary as they have supposed but can be influenced by kinetic occlusion and categorization stored in visual memory.     

Modal and amodal completion generate different shapes

Mechanisms of contour completion are critical for computing visual surface structure in the face of occlusion. Theories of visual completion posit that mechanisms of contour interpolation operate independently of whether the completion is modal or amodal--thereby generating identical shapes in the two cases. This identity hypothesis was tested in two experiments using a configuration of two overlapping objects and a modified Kanizsa configuration. Participants adjusted the shape of a comparison display in order to match the shape of perceived interpolated contours in a standard completion display. Results revealed large and systematic shape differences between modal and amodal contours in both configurations. Participants perceived amodal (i.e., partly occluded) contours to be systematically more angular--that is, closer to a corner--than corresponding modal (i.e., illusory) contours. The results falsify the identity hypothesis in its current form: Corresponding modal and amodal contours can have different shapes, and, therefore, mechanisms of contour interpolation cannot be independent of completion type.     

Aesthetic issues in spatial composition: effects of vertical position and perspective on framing single objects

Aesthetic preference for the vertical composition of single-object pictures was studied through a series of two-alternative forced-choice experiments. The results reveal the influence of several factors, including spatial asymmetries in the functional properties of the object and the typical position of the object relative to the observer. With asymmetric side views of objects, people generally prefer objects typically located below the observer's viewpoint (e.g., a bowl or swimming stingray) to be below the center of the frame and objects typically located above the observer's viewpoint (e.g., a light fixture or flying eagle) to be above the center of the frame. In addition, people generally prefer symmetric views of those same objects from directly above or directly below to be closer to the center of the frame. We suggest that these results can be unified by the hypothesis that people prefer the object's "affordance space" to be centered within the frame.     

Interpolation processes in object perception: reply to Anderson (2007)

P. J. Kellman, P. Garrigan, & T. F. Shipley presented a theory of 3-D interpolation in object perception. Along with results from many researchers, this work supports an emerging picture of how the visual system connects separate visible fragments to form objects. In his commentary, B. L. Anderson challenges parts of that view, especially the idea of a common underlying interpolation component in modal and amodal completion (the identity hypothesis). Here the authors analyze Anderson's evidence and argue that he neither provides any reason to abandon the identity hypothesis nor offers a viable alternative theory. The authors offer demonstrations and analyses indicating that interpolated contours can appear modally despite absence of the luminance relations, occlusion geometry, and surface attachment that Anderson claims to be necessary. The authors elaborate crossing interpolations as key cases in which modal and amodal appearance must be consequences of interpolation. Finally, the authors dispute Anderson's assertion that vision researchers are misguided in using objective performance methods, and they argue that his challenges to relatability fail because contour and surface processes, as well as local and global influences, have been distinguished experimentally.