Mechanisms of modal and amodal interpolation

P. J. Kellman and T. F. Shipley (1992) and P. J. Kellman, P. Garrigan, and T. F. Shipley (2005) suggested that completion of partly occluded objects and illusory objects involve the same or similar mechanisms at critical stages of contour interpolation. B. L. Anderson, M. Singh, and R. W. Fleming and B. L. Anderson (2007) presented a number of arguments against this view. The author analyzes 3 of these arguments, as well as B. L. Anderson's ecological justification for believing that these mechanisms must be very different, and suggests that their conclusions are unwarranted. The author also outlines a model consistent with the identity hypothesis and with recent physiological evidence, including a quantitative proposal for contour interpolation strength. The model suggests that V1 and V2 receive from higher visual areas feedback that modulates their responses to stimuli eliciting modal completion, amodal completion, and collinear contour facilitation. The model qualitatively explains the unstable percepts evoked by various recently devised stimuli.     

Complete mergeability and amodal completion.

When image fragments are taken to correspond to the visible portions of a single occluded object, the object is said to 'amodally complete' behind the occluder. Kellman and Shipley (Kellman, P. J., & Shipley, T. F. (1991). A theory of visual interpolation in objective perception. Cognitive Psychology, 23, 144-221) argued that when the virtual contour extensions of such image fragments subtend an obtuse or right angle, the contours are 'relatable' and therefore complete. However, edge and surface relatability are neither necessary nor sufficient for completion to be perceived (Tse, P. U. (1999) Volume completion. Cognitive Psychology). Evidence is offered that completion is not driven directly by image cues such as contour relatability, but is driven, rather, by intermediate representations, such as volumes that are inferred from global image cue relationships. Evidence suggests that several factors, none of which is necessary for amodal completion to occur, contribute to the perceived strength of amodal completion, including similarity of pattern or substance, proximity, and good volume continuation or complete mergeability. Two partially occluded volumes are completely mergeable when they can be extended into occluded space along the trajectory defined by their visible surfaces such that they merge entirely with each other. Mergeability is not measurable in the image because it describes an inferred relationship among volumes that must themselves be inferred from the image.     

Modal and amodal completion generate different shapes

Mechanisms of contour completion are critical for computing visual surface structure in the face of occlusion. Theories of visual completion posit that mechanisms of contour interpolation operate independently of whether the completion is modal or amodal--thereby generating identical shapes in the two cases. This identity hypothesis was tested in two experiments using a configuration of two overlapping objects and a modified Kanizsa configuration. Participants adjusted the shape of a comparison display in order to match the shape of perceived interpolated contours in a standard completion display. Results revealed large and systematic shape differences between modal and amodal contours in both configurations. Participants perceived amodal (i.e., partly occluded) contours to be systematically more angular--that is, closer to a corner--than corresponding modal (i.e., illusory) contours. The results falsify the identity hypothesis in its current form: Corresponding modal and amodal contours can have different shapes, and, therefore, mechanisms of contour interpolation cannot be independent of completion type.     

Prior experience affects amodal completion in pigeons

In a three-alternative forced-choice task, 4 pigeons were trained to discriminate a target stimulus consisting of two colored shapes, one of which partially occluded the other, from two foil stimuli that portrayed either a complete or an incomplete version of the occluded shape. The dependent measure was the percentage of total errors that the birds committed to the complete foil. At the outset of training, the pigeons committed approximately 50% of total errors to the complete foil, but as training progressed, the percentage of errors to the complete foil rose. When the pigeons were given a second exposure to the initial set of stimuli, they committed 70% of total errors to the complete foil, suggesting that they now saw the complete foil as more similar to the occluded target than the incomplete foil. These results suggest that experience with 2-D images may facilitate amodal completion in pigeons, perhaps via perceptual learning.     

Curved apparent motion induced by amodal completion

We investigated whether amodal completion can bias apparent motion (AM) to deviate from its default straight path toward a longer curved path, which would violate the well-established principle that AM follows the shortest possible path. Observers viewed motion sequences of two alternating rectangular tokens positioned at the ends of a semicircular occluder, with varying interstimulus intervals (ISIs; 100-500?ms). At short ISIs, observers tended to report simple straight-path motion-that is, outside the occluder. But at long ISIs, they became increasingly likely to report a curved-path motion behind the occluder. This tendency toward reporting curved-path motion was influenced by the shape of tokens, display orientation, the gap between tokens and the occluder, and binocular depth cues. Our results suggest that the visual system tends to minimize unexplained absence of a moving object, as well as its path length, such that AM deviates from the shortest path when amodal integration of motion trajectory behind the curved occluder can account for the objective invisibility of the object during the ISI.     

Perceptual causality in the amodal completion of kinetic structures

Perceptual causality as an amodal completion of kinetic structures was demonstrated. The experimental situation was as follows: a square appeared on the left, moved from left to right till it touched one side of a stationary rectangle (a perceptual screen), and disappeared; after a while, another square appeared at the other side of the rectangle and moved right. The first square moved faster than the second one. Sometimes, two moving objects were perceived, with an amodal launching effect: the first moving object seemed to collide with the second one behind the screen. When both the screen and the occluding interval were small, despite the discrepancy of velocities, a single moving object was perceived, but the object seemed to abruptly change its speed behind the screen. The perception of an amodal completion of movement raises some theoretical issues: the discrepancy between amodal completion of kinetic structures and that of static ones, the problem of perceptual identity, and figure-ground segregation in dynamic scene. The dilemma of the naive subject will also be discussed. Received: 11 June 1997 / Accepted: 14 October 1998     

Investigating local and global effects of surface colours and contours in amodal completion

ABSTRACT

We studied interpretations of partly occluded shapes. Models that account for amodal completion mostly deal with local and global contour characteristics. In the current study, we were interested in the effects of colour on local and global contour completions. In our stimuli, local contour completions comprised simple linear extensions of the partly occluded contours, whereas global contour completions accounted for global shape regularities. Our stimuli were designed such that the visible surface colour could also be completed in a local or global fashion, being consistent or inconsistent with contour completions. We tested the preferred interpretations of the partly occluded shapes by using a sequential matching task. Participants had to judge whether a test shape could be a previously shown partly occluded shape. We found that interpretations of partly occluded shapes depend on both colour and contour characteristics. Additional time bin analyses revealed that for fast responses colour and contour completions already depend on the visible context of the partly occluded shapes, while for slow responses the congruency between colour and contour completions play a role as well.     

Shrinkage and expansion by amodal completion: a critical review

The whole literature on the so-called dimensional effects of amodal completion (shrinkage of a partially occluded figure and expansion of modally visible parts of the same figure) is critically reviewed. It is claimed that phenomenal shrinkage is the sum of at least two illusions independent of figure ground distinction: (1) shrinkage of spaces divided into a few parts, and (2) shrinkage of empty spaces. It is also shown that a partially occluded figure can widen, rather than shrink. It is concluded that the stratification in two phenomenally superimposed figures accompanies the shrinkage effect, but is irrelevant to its generation. Further experiments are needed in order to draw a well-grounded conclusion on the expansion effect.     

Visual illusory productions with or without amodal completion.

A new type of illusory contour is presented whose appearance is generated by the graphic representation of groups of human figures interacting in a coordinated manner with external reality. When numerous pictorial indicators of cause-effect relationships are provided, and appropriate techniques and sufficiently ambiguous observation conditions are used, hallucinatory objects congruent with expectations linked to the meaning of the configurations appear. There is thus a high-level semantic component that is active in the formation of visual illusory contours and is even capable of interacting with other known factors: brightness contrast, the number of elements, the degree of alignment of the elements, etc. This new type of illusory contour fits current definitions and can be experimentally modified. The variations in subjective clarity scores are presented for a study in which twenty subjects observed nineteen experimental figures, certain variables of which were manipulated. The issue is worthy of further experimental investigation.     

Tits use amodal completion in predator recognition: a field experiment

Amodal completion enables an animal to perceive partly concealed objects as an entirety, and to interact with them appropriately. Several studies, based upon either operant conditioning or filial imprinting techniques, have shown that various animals (both mammals and birds) can perform amodal completion. Before this study, the use of amodal completion by untrained animals in the recognition of objects had not been considered. Using two feeders, we observed in a field experiment the reaction of tits to the torso of a sparrowhawk (partly occluded or an ‘amputated’ dummy) in two different treatments (sparrowhawk torso vs. complete dummy pigeon; and torso vs. complete dummy sparrowhawk). It is clear that the birds considered the two torso variants as predators and kept away from both of them when the second feeder offered a ‘pigeon’ instead. On the other hand, when a ‘complete sparrowhawk’ was present on the second feeder, the number of visits to the occluded torso remained low; while the number of visits to the amputated one increased threefold. Birds risked perching near what was clearly an amputated torso; while the fear of a “hiding” (occluded) torso remained unchanged, when the second feeder did not provide a safe alternative. Such discrimination between torsos requires the ability for amodal completion. Our results demonstrate that in their recognition process, the birds not only use simple sign stimuli, but also complex cognitive functions.     

Time course of amodal completion revealed by a shape discrimination task

We measured the extent of amodal completion as a function of stimulus duration over the range of 15–210 msec, for both moving and stationary stimuli. Completion was assessed using a performancebased measure: a shape discrimination task that is easy if the stimulus is amodally completed and difficult if it is not. Specifically, participants judged whether an upright rectangle was longer horizontally or vertically, when the rectangle was unoccluded, occluded at its corners by four negative-contrast squares, or occluded at its corners by four zero-contrast squares. In the zero-contrast condition, amodal completion did not occur because there were no occlusion cues; in the unoccluded condition, the entire figure was present. Thus, comparing performance in the negative-contrast condition to these two extremes provided a quantitative measure of amodal completion. This measure revealed a rapid but measurable time course for amodal completion. Moving and stationary stimuli took the same amount of time to be completed (≈ 75 msec), but moving stimuli had slightly stronger completion at long durations.     

Using neural response properties to draw the distinction between modal and amodal representations

ABSTRACT

Barsalou has recently argued against the strategy of identifying amodal neural representations by using their cross-modal responses (i.e., their responses to stimuli from different modalities). I agree that there are indeed modal structures that satisfy this “cross-modal response” criterion (CM), such as distributed and conjunctive modal representations. However, I argue that we can distinguish between modal and amodal structures by looking into differences in their cross-modal responses. A component of a distributed cell assembly can be considered unimodal because its responses to stimuli from a given modality are stable, whereas its responses to stimuli from any other modality are not (i.e., these are lost within a short time, plausibly as a result of cell assembly dynamics). In turn, conjunctive modal representations, such as superior colliculus cells in charge of sensory integration, are multimodal because they have a stable response to stimuli from different modalities. Finally, some prefrontal cells constitute amodal representations because they exhibit what has been called ‘adaptive coding’. This implies that their responses to stimuli from any given modality can be lost when the context and task conditions are modified. We cannot assign them a modality because they have no stable relation with any input type.

Abbreviatons: CM: cross-modal response criterion; CCR: conjuntive cross-modal representations; fMRI: functional magnetic resonance imaging; MVPA: multivariate pattern analysis; pre-SMA: pre-supplementary motor area; PFC: prefrontal cortex; SC: superior colliculus; GWS: global workspace     

Visual cognition influences early vision: the role of visual short-term memory in amodal completion

A partly occluded visual object is perceptually filled in behind the occluding surface, a process known as amodal completion or visual interpolation. Previous research focused on the image-based properties that lead to amodal completion. In the present experiments, we examined the role of a higher-level visual process-visual short-term memory (VSTM)-in amodal completion. We measured the degree of amodal completion by asking participants to perform an object-based attention task on occluded objects while maintaining either zero or four items in visual working memory. When no items were stored in VSTM, participants completed the occluded objects; when four items were stored in VSTM, amodal completion was halted (Experiment 1). These results were not caused by the influence of VSTM on object-based attention per se (Experiment 2) or by the specific location of to-be-remembered items (Experiment 3). Items held in VSTM interfere with amodal completion, which suggests that amodal completion may not be an informationally encapsulated process, but rather can be affected by high-level visual processes.     

Redundant amodal properties facilitate operant learning in 3-month-old infants

The current study examined the role redundant amodal properties play in an operant learning task in 3-month-old human infants. Prior studies have suggested that the presence of redundant amodal information facilitates detection and discrimination of amodal properties and potentially functions to influence general learning processes such as associative conditioning. The current study examined how human infants use redundant amodal information (visual and haptic) about the shape of an object to influence learning of an operant response. Infants learned to kick to move a mobile of cylinders while either holding a cylinder, a rectangular cube, or no object. Kick rate served as the dependent measure. The results showed that infants given matching redundant amodal properties (e.g., viewed cylinders while holding a cylinder) showed facilitated operant learning whereas infants given mismatching redundant amodal properties showed inhibited operant learning. These results support and extend the Intersensory Redundancy Hypothesis by demonstrating that amodal redundancy influences complex learning processes such as operant conditioning.     

Simultaneous completions of modal and amodal figures: Visual evoked potentials reveal asymmetrical interference effects

Modal and amodal completion processes are thought to affect the emergence and the potency of each other. To see whether one dominates over the other, we measured the Npd, that is, the negativity of visual-evoked potentials whose amplitude increases with perceptual difficulty. In the first experiment, the Npds to illusory (modal) squares and diamonds placed over amodal diamonds and squares, respectively, were found to be greater when targets were the amodal figures than when targets were the modal figures, thus suggesting that modal figures created more interference. A second experiment showed that greater Npds were specific to interference and not to the greater difficulty at focusing on amodal figures rather than on modal figures. A third experiment showed that the interference also occurs with real figures in replacement of modal ones. Overall, the results suggest a certain dominance of modal completion over amodal completion when both occur in the same display.     

Volume completion in 4.5-month-old infants

In this study, we examined 4.5-month-old infants' visual completion of self-occluding three-dimensional objects. A previous study on this topic reported that 6-month-old, but not 4-month-old infants extrapolate a convex, symmetric prism from a limited view of its surfaces (Soska & Johnson, 2008). As of yet, studies on the development of amodal completion of three-dimensional, self-occluding objects are scarce. Given 4-month-old infants' abilities to derive three-dimensional shape from a variety of visual cues, three-dimensional amodal completion may well depend on the perceptual strength of three-dimensionality in the stimulus displays. The first experiments (1A and 1B) tested this hypothesis by means of a habituation paradigm and showed that 4.5-month-old infants are indeed able to amodally complete the back of a self-occluding object when sufficient three-dimensional cues are available. Further support for volume completion in 4.5-month-old infants was found in a second experiment, again using a habituation paradigm, that measured perceived connectedness between two visually separated, self-occluding, three-dimensional objects.     

The effect of a modal completion on visual matching

In a series of five experiments, we investigated how amodal completion affects pattern recognition, and tested possible models of processes underlying completion of simple shapes. Inferences about processing models were based mainly upon the comparison of ‘same’ latencies in a simultaneous matching task. The major result of experiments 1–4 regards two conditions where a complete target had to be matched with a given stimulus region, belonging to a composite comparison pattern. Matching is faster when this stimulus region is amodally completed than when it looks like an incomplete shape. In experiment 5 we compared complete vs incomplete targets, that were either phenomenally or topographically identical to a given region of the comparison pattern. The failure to show any effect of target completeness suggests that phenomenal identity may be as effective as topographical identity.     

Evidence of amodal representation of small numbers across visuo-tactile modalities in 5-month-old infants

Two experiments investigated 5-month-old infants’ amodal sensitivity to numerical correspondences between sets of objects presented in the tactile and visual modes. A classical cross-modal transfer task from touch to vision was adopted. Infants were first tactually familiarized with two or three different objects presented one by one in their right hand. Then, they were presented with visual displays containing two or three objects. Visual displays were presented successively (Experiment 1) or simultaneously (Experiment 2). In both experiments, results showed that infants looked longer at the visual display which contained a different number of objects from the tactile familiarization phase. Taken together, the results revealed that infants can detect numerical correspondences between a sequence of tactile and visual stimulation, and they strengthen the hypothesis of amodal and abstract representation of small numbers of objects (two or three) across sensory modalities in 5-month-old infants.     

The effects of kinetic occlusion and categorization on amodal completion. A comment on Gerbino and Salmaso (1987)

The experimental study of Gerbino and Salmaso (1987) focused on the process of amodal completion, i.e. the process that leads to the impression of a total pattern in the absence of information about all parts of the pattern. One of the questions that they have attempted to answer with respect to this process is whether or not it depends on the categorization of the modal part (i.e. the part about which visual information is present) as a modification of a complete prototype. The major conclusion of their experiments is that amodal completion does not depend upon categorization. Furthermore, they interpret their results as indicating that neither the truncated form of the occluded part nor the unification/segregation of contour segments are phenomenally real. We designed some variants of the tunnel effect to demonstrate (1) that the explicit categorization of some parts of the input can have an influence on amodal completion and (2) that the truncated form of a pattern can be phenomenally real. Our results corroborate these hypotheses and can, therefore, interpreted as refuting two rather central claims of Gerbino and Salmaso (1987). The conclusion of our experiment must be that amodal completion is not as primary as they have supposed but can be influenced by kinetic occlusion and categorization stored in visual memory.     

Actuality and the amodal perspective

In this paper, I examine our intuitive understanding of metaphysical contingency, and ask what features a metaphysical picture must possess in order to satisfy our intuitions about modal matters. After spelling out what I think are the central intuitions in this domain, I examine the debate between the two most widely held views on the nature of modality, namely, modal realism and modal actualism. I argue that while each of these views is able to accommodate some of our intuitions, it leaves others unsatisfied. I then present an alternative metaphysical picture, which I argue can accommodate our intuitions in a way that the traditional views cannot. More specifically, I argue that our intuitions about modality call for a pluralist view of the structure of reality—a view on which there is more than one ultimate ‘shape’ to the fundamental facts, each corresponding to a distinct metaphysically privileged perspective on reality.