与用客体表征连续性解释OSPBs效应的商榷

Mitroff等人的研究发现了OSPBs效应量反映的客体运动方式与主观报告结果相分离的现象,并以两可刺激情景或实体性原则违背假设对该现象作了解释。本文以3个实验与其研究进行了商榷。结果表明,两可刺激情景与实体性违背均不能解释上述分离现象(实验1);其实验范式中混入了距离因素(实验2与实验3)和方位朝向因素(实验1)。基于本研究的结果,笔者认为Mitroff等人的OSPBs效应是由距离效应和方位倾斜效应所致,即可能主要反映了基于空间的选择性注意的影响,而不能以客体表征连续性加以解释。     

The relationship between apparent motion and object files

Object files (OFs) play an important role in theories of mid-level vision. On some influential views, OFs operate and persist only via spatiotemporal continuity. One open question concerns what occurs when direct spatiotemporal continuity is absent: Do OFs move in accordance with any motion correspondence ultimately resolved? Specifically, do OFs accord with apparent motion (AM) correspondences, which arise despite a lack of continuous spatiotemporal stimulation? In Experiment 1, subjects were presented with an AM display consisting of two circles that, across two frames, were seen as moving between two noncontiguous locations. The two objects were primed with two symbols and were then moved in a single step; a third symbol appeared, and could either match the symbol from the closer or the further object. We found a robust object specific preview benefit (OSPB) for the shorter path, in other words, the path along which AM was perceived. In order to control for the possibility that priming occurs at any nearby object, in Experiment 2, the original two objects never disappeared, but two new objects appeared in the would-be AM locations. No AM was perceived, and no OSPB obtained. In the third experiment the OSPB effect persisted even when motion along the shorter path included an unlikely featural transformation (circles turning into squares). In Experiment 4, which was nearly identical to Experiment 2, no OSPB obtained despite unique featural matches between the initial and new objects, seemingly because no AM was perceived. In Experiment 5, we failed to find an effect of featural priming, even when distance between the objects was equated. Finally, we extended the OSPB effect to two additional kinds of AM—line motion (Experiment 6) and phi motion (Experiment 7), supplying strong evidence that AM correspondences and OF correspondences are controlled by the same basic rules.     

The persistence of object file representations

Coherent visual experience of dynamic scenes requires not only that the visual system segment scenes into component objects but that these object representations persist, so that an object can be identified as the same object from an earlier time. Object files (OFs) are visual representations thought to mediate such abilities: OFs lie between lower level sensory processing and higher level recognition, and they track salient objects over time and motion. OFs have traditionally been studied via object-specific preview benefits (OSPBs), in which discriminations of an object's features are speeded when an earlier preview of those features occurred on the same object, as opposed to on a different object, beyond general displaywide priming. Despite its popularity, many fundamental aspects of the OF framework remain unexplored. For example, although OFs are thought to be involved primarily in online visual processing, we do not know how long such representations persist; previous studies found OSPBs for up to 1500 msec but did not test for longer durations. We explored this issue using a modified object reviewing paradigm and found that robust OSPBs persist for more than five times longer than has previously been tested-for at least 8 sec, and possibly for much longer. Object files may be the "glue" that makes visual experience coherent not just in online moment-by-moment processing, but on the scale of seconds that characterizes our everyday perceptual experiences. These findings also bear on research in infant cognition, where OFs are thought to explain infants' abilities to track and enumerate small sets of objects over longer durations.     

特征变化的连续性影响客体连续表征的维持

本研究采用客体回溯范式考察了特征变化的连续性对维持客体连续表征的作用。实验1和实验2分别探索了形状维度上的变化方式（不变、渐变、突变）和亮度维度上的变化方式（不变、渐变、随机变化）对客体预览利化效应的影响。在特征连续条件下（不变或渐变）,两个实验都获得了客体预览利化效应。而在特征不连续变化条件下（突变或随机变化）,该效应消失。这些结果说明特征变化的连续性同样影响客体连续表征的维持。     

Occluded motion alters event perception

We employed audiovisual stream/bounce displays, in which two moving objects with crossing trajectories are more likely to be perceived as bouncing off, rather than streaming through, each other when a brief sound is presented at the coincidence of the two objects. However, Kawachi and Gyoba (Perception 35:1289–1294, 2006b) reported that the presence of an additional moving object near the two objects altered the perception of a bouncing event to that of a streaming event. In this study, we extended this finding and examined whether alteration of the event perception could be induced by the visual context, such as by occluded object motion near the stream/bounce display. The results demonstrated that even when the sound was presented, the continuous occluded motion strongly biased observers’ percepts toward the streaming percept during a short occlusion interval (approximately 100 ms). In contrast, when the continuous occluded motion was disrupted by introducing a spatiotemporal gap in the motion trajectory or by removing occlusion cues such as deletion/accretion, the bias toward the streaming percept declined. Thus, we suggest that a representation of object motion generated under a limited occlusion interval interferes with audiovisual event perception.     

Are objects required for object-files? Roles of segmentation and spatiotemporal continuity in computing object persistence

Two central tasks of visual processing are (1) to segment undifferentiated retinal images into discrete objects, and (2) to represent those objects as the same persisting individuals over time and motion. Here we explore the interaction of these two types of processing in the context of object files—mid-level visual representations that “stick” to moving objects on the basis of spatiotemporal properties. Object files can be revealed by object-specific preview benefits (OSPBs), wherein a “preview” of information on a moving object speeds the recognition of that information at a later point when it appears again on the same object (compared to when it reappears on a different moving object), beyond display-wide priming. Here we explore the degree of segmentation required to establish object files in the first place. Surprisingly, we find that no explicit segmentation is required until after the previews disappear, when using purely motion-defined objects (consisting of random elements on a random background). Moreover, OSPBs are observed in such displays even after moderate (but not long) delays between the offset of the preview information and the onset of the motion. These effects indicate that object files can be established without initial static segmentation cues, so long as there is spatiotemporal continuity between the previews and the eventual appearance of the objects. We also find that top-down strategies can sometimes mimic OSPBs, but that these strategies can be eliminated by novel manipulations. We discuss how these results alter our understanding of the nature of object files, and also why researchers must take care to distinguish “true OSPBs” from “illusory OSPBs”.     

Surface feature congruency effects in the object-reviewing paradigm are dependent on task memory demands

Perception of object continuity depends on establishing correspondence between objects viewed across disruptions in visual information. The role of spatiotemporal information in guiding object continuity is well documented; the role of surface features, however, is controversial. Some researchers have shown an object-specific preview benefit (OSPB)—a standard index of object continuity—only when correspondence could be based on an object’s spatiotemporal information, whereas others have found color-based OSPB, suggesting that surface features can also guide object continuity. This study shows that surface feature-based OSPB is dependent on the task memory demands. When the task involved letters and matching just one target letter to the preview ones, no color congruency effect was found under spatiotemporal discontinuity and spatiotemporal ambiguity (Experiments 1–3), indicating that the absence of feature-based OSPB cannot be accounted for by salient spatiotemporal discontinuity. When the task involved complex shapes and matching two target shapes to the preview ones, color-based OSPB was obtained. Critically, however, when a visual working memory task was performed concurrently with the matching task, the presence of a nonspatial (but not a spatial) working memory load eliminated the color-based OSPB (Experiments 4 and 5). These results suggest that the surface feature congruency effects that are observed in the object-reviewing paradigm (with the matching task) reflect memory-based strategies that participants use to solve a memory-demanding task; therefore, they are not reliable measures of online object continuity and cannot be taken as evidence for the role of surface features in establishing object correspondence.     

两种时空线索条件下表面颜色特征线索对客体保持的作用*

采用客体回溯范式,以客体预览利化效应(object specific previewing benefit, OSPB)作为指标,考察表面特征线索对客体保持的作用。实验1使用双向隧道创建时空线索不明确的条件,研究表面颜色特征线索的作用。实验2使用单向隧道使时空线索明确,研究表面颜色特征线索与时空线索一致、冲突情境下的客体保持。实验1和实验2均出现了OSPB效应,且实验2冲突情境的OSPB效应低于一致情境。研究结果表明在时空线索不明确的条件下,仅凭表面颜色特征线索就能实现客体保持;在时空线索明确的条件下,时空线索是客体保持的主要线索,同时表面颜色特征线索也起一定的作用。     

A computational and perceptual account of motion lines

To indicate motion in a static drawing, artists often include lines trailing a moving object. The use of these motion lines is notable because they do not seem to be related to anything in the optic array. The dynamic behavior of a neural-network model for contour detection is analyzed and it is shown that it generates trails of oriented responses behind moving stimuli. The properties of the oriented response trails are shown to correspond to motion lines. The model generates trails of different orientations depending on the speed and length of the movement, and thereby predicts different uses of two types of motion lines. The model further predicts that motion lines should bias real motion in some situations. An experiment relating motion lines to ambiguous motion percepts demonstrates that motion lines contribute to motion percepts.     

The link between brain learning, attention, and consciousness

The processes whereby our brains continue to learn about a changing world in a stable fashion throughout life are proposed to lead to conscious experiences. These processes include the learning of top-down expectations, the matching of these expectations against bottom-up data, the focusing of attention upon the expected clusters of information, and the development of resonant states between bottom-up and top-down processes as they reach an attentive consensus between what is expected and what is there in the outside world. It is suggested that all conscious states in the brain are resonant states and that these resonant states trigger learning of sensory and cognitive representations. The models which summarize these concepts are therefore called Adaptive Resonance Theory, or ART, models. Psychophysical and neurobiological data in support of ART are presented from early vision, visual object recognition, auditory streaming, variable-rate speech perception, somatosensory perception, and cognitive-emotional interactions, among others. It is noted that ART mechanisms seem to be operative at all levels of the visual system, and it is proposed how these mechanisms are realized by known laminar circuits of visual cortex. It is predicted that the same circuit realization of ART mechanisms will be found in the laminar circuits of all sensory and cognitive neocortex. Concepts and data are summarized concerning how some visual percepts may be visibly, or modally, perceived, whereas amodal percepts may be consciously recognized even though they are perceptually invisible. It is also suggested that sensory and cognitive processing in the What processing stream of the brain obey top-down matching and learning laws that are often complementary to those used for spatial and motor processing in the brain's Where processing stream. This enables our sensory and cognitive representations to maintain their stability as we learn more about the world, while allowing spatial and motor representations to forget learned maps and gains that are no longer appropriate as our bodies develop and grow from infanthood to adulthood. Procedural memories are proposed to be unconscious because the inhibitory matching process that supports these spatial and motor processes cannot lead to resonance.     

Complex conditional control by pigeons in a continuous virtual environment

We tested two pigeons in a continuously streaming digital environment. Using animation software that constantly presented a dynamic, three‐dimensional (3D) environment, the animals were tested with a conditional object identification task. The correct object at a given time depended on the virtual context currently streaming in front of the pigeon. Pigeons were required to accurately peck correct target objects in the environment for food reward, while suppressing any pecks to intermixed distractor objects which delayed the next object's presentation. Experiment 1 established that the pigeons’ discrimination of two objects could be controlled by the surface material of the digital terrain. Experiment 2 established that the pigeons’ discrimination of four objects could be conjunctively controlled by both the surface material and topography of the streaming environment. These experiments indicate that pigeons can simultaneously process and use at least two context cues from a streaming environment to control their identification behavior of passing objects. These results add to the promise of testing interactive digital environments with animals to advance our understanding of cognition and behavior.     

Independent perceptual reversals for simultaneously presented ambiguous figures

In two successive experiments using the divided visual field paradigm with vertical or horizontal division, two ambiguous figures, the Rubin’s vase-face or the Necker cube, were projected to the right and left or to the upper and lower visual hemifields of 108 healthy volunteers. Stimulation time was 120 s. The main hypotheses were (a) that different percepts of the same ambiguous figure may be simultaneously experienced in the two hemifields and (b) that the type (vertical vs. horizontal) of visual field division influences the reversal frequency and the temporal interdependence of the percepts.Results from the first experiment showed that the temporal interdependence of reversals was very low for both ambiguous figures, suggesting that during part of the stimulation time the subjects could experience different percepts of the same figure (e.g. a vase in the right and face profiles in the left visual hemifields). The second experiment showed that this perceptual dissociation occurred on average during one third of the stimulation time. In both experiments the type of visual field division did not influence either frequency or temporal interdependence of the reversals. When one single ambiguous figure was presented in the centre of the screen, the number of reversals was approximately the sum of the reversals observed with two figures presented simultaneously each in one hemifield.     

The eyeglass reversal

Some figures, such as the Necker cube, are spontaneously reversible between alternative percepts. Before learning those skilled reversals, how do people achieve reversals for the very first time? It has been known that, in the case of a first reversal, peoplecan be expected to see the reversal when given specific information about how the figuresareambiguous. This point was confirmed by using drawing versions of reversible figures. To demonstrate how intention plays a role in the initial reversal of a real object, a pair of regular eyeglasses, reversible in perspective, were presented to naïve observers in monocular vision. When the eyeglasses were viewed inwardly and the observers were given information that the eyeglasses could be ambiguous, they were able to easily see the reversal. When the eyeglasses were viewed outwardly, observers saw it only after they had been informed of exactly what the two alternative percepts were.Interestingly, many observers often mistakenly saw the inwardly viewed eyeglasses as placed outwardly from the beginning of the observation, while they saw the outwardly viewed eyeglasses correctly. Taking these results together, for the first reversal of a real object, the specificity of intention varies with the ambiguity of the object.     

Sensory memory of structure-from-motion is shape-specific

Perceptual priming can stabilize the phenomenal appearance of multistable visual displays (Leopold, Wilke, Maier, & Logothetis, Nature Neuroscience, 5, 605–609, 2002). Prior exposure to such displays induces a sensory memory of their appearance, which persists over long intervals and intervening stimulation, and which facilitates renewed perception of the same appearance. Here, we investigated perceptual priming for the apparent rotation in depth of ambiguous structure-from-motion (SFM) displays. Specifically, we generated SFM objects with different three-dimensional shapes and presented them in random order and with intervening blank periods. To assess perceptual priming, we established the probability that a perceived direction of rotation would persist between successive objects. In general, persistence was greatest between identical objects, intermediate between similar objects, and negligible between dissimilar objects. These results demonstrate unequivocally that sensory memory for apparent rotation is specific to three-dimensional shape, contrary to previous reports (e.g., Maier, Wilke, Logothetis, & Leopold, Current Biology, 13, 1076–1085, 2003). Because persistence did not depend on presentation order for any pair of objects, it provides a commutative measure for the similarity of object shapes. However, it is not clear exactly which features or aspects of object shape determine similarity. At least, we did not find simple, low-level features (such as volume overlap, heterogeneity, or rotational symmetry) that could have accounted for all observations. Accordingly, it seems that sensory memory of SFM (which underlies priming of ambiguous rotation) engages higher-level representations of object surface and shape.     

工作记忆对动态范式中基于客体的返回抑制的影响

采用双任务干扰范式探讨了工作记忆对动态范式中基于客体的返回抑制的影响。三个实验分别考察了在言语、空间和视觉工作记忆负载条件下基于客体的返回抑制效应,结果发现只有在空间工作记忆负载条件下,动态范式中的返回抑制才受到损害。这表明空间工作记忆不但在静态范式中的IOR信息的维持和更新中起着重要的作用,在动态范式中的IOR信息的维持和更新中同样起着重要的作用。同时也为动态范式中基于客体的返回抑制的空间抑制动态更新说提供了新的证据     

See an object,hear an object file: Object correspondence transcends sensory modality

An important task of perceptual processing is to parse incoming information into distinct units and to keep track of those units over time as the same, persisting representations. Within the study of visual perception, maintaining such persisting object representations is helped by “object files”—episodic representations that store (and update) information about objects' properties and track objects over time and motion via spatiotemporal information. Although object files are typically discussed as visual, here we demonstrate that object–file correspondence can be computed across sensory modalities. An object file can be initially formed with visual input and later accessed with corresponding auditory information, suggesting that object files may be able to operate at a multimodal level of perceptual processing.     

Young infants' perception of unity and form in occlusion displays

Young infants have been reported to perceive the unity of a center-occluded object when the visible ends of the object are aligned and undergo common motion but not when the edges of the object are misaligned (Johnson & Aslin, 1996). Using a recognition-based paradigm, the authors investigated the possibility that past research failed to provide sufficiently sensitive assessments of infants' perception of the unity of misaligned edges in partial occlusion displays. Positive evidence was obtained in 4-month-olds for veridical perception of the motion and location of a hidden region but not its orientation, whereas 7-month-olds, in contrast to the younger infants, appeared to respond to the orientation of the hidden region. Overall, the results suggest that habituation designs tapping recognition processes may be particularly efficacious in revealing infants' perceptual organization. In addition, the findings provide corroborative evidence for the importance of both motion and orientation in young infants' object segregation and for the difficulty in achieving percepts of the global form of a partly occluded object.     

Perceiving object motion using vision and touch

In a previous experiment, we showed that bistable visual object motion was partially disambiguated by tactile input. Here, we investigated this effect further by employing a more potent visuotactile stimulus. Monocular viewing of a tangible wire-frame sphere (TS) rotating about its vertical axis produced bistable alternations of direction. Touching the TS biased simultaneous and subsequent visual perception of motion. Both of these biases were in the direction of the tactile stimulation and, therefore, constituted facilitation or priming, as opposed to interference or adaptation. Although touching the TS biased visual perception, tactile stimulation was not able to override the ambiguous visual percept. This led to periods of sensory conflict, during which visual and tactile motion percepts were incongruent. Visual and tactile inputs can sometimes be fused to form a coherent percept of object motion but, when they are in extreme conflict, can also remain independent.     

Sensory memory of illusory depth in structure-from-motion

When multistable displays (stimuli consistent with two or more equally plausible perceptual interpretations) are presented intermittently, their perceptions are stabilized by sensory memory. Independent memory traces are generated not only for different types of multistable displays (Maier, Wilke, Logothetis, & Leopold, Current Biology 13:1076–1085, 2003), but also for different ambiguous features of binocular rivalry (Pearson & Clifford, Journal of Vision 4:196–202, 2004). In the present study, we examined whether a similar independence of sensory memories is observed in structure-from-motion (SFM), a multistable display with two ambiguous properties. In SFM, a 2-D planar motion creates a vivid impression of a rotating 3-D volume. Both the illusory rotation and illusory depth (i.e., how close parts of an object appear to the observer) of an SFM object are ambiguous. We dissociated the sensory memories of these two ambiguous properties by using an intermittent presentation in combination with a forced-ambiguous-switch paradigm (Pastukhov, Vonau, & Braun, PLoS ONE 7:e37734, 2012). We demonstrated that the illusory depth of SFM generates a sensory memory trace that is independent from that of illusory rotation. Despite this independence, the specificities levels of the sensory memories were identical for illusory depth and illusory rotation. The history effect was weakened by a change in the volumetric property of a shape (whether it was a hollow band or a filled drum volume), but not by changes in color or size. We discuss how these new results constrain models of sensory memory and SFM processing.     

What does the Ternus display tell us about motion processing in human vision?

The Ternus display is a moving visual stimulus which elicits two very different percepts, according to the length of the interstimulus interval (ISI) between each frame of the motion sequence. These two percepts, referred to as element motion and group motion, have previously been analysed in terms of the operation of a low-level, dedicated short-range motion process (in the case of element motion), and of a higher-level, attentional long-range motion process (in the case of group motion). We used a novel Ternus configuration to show that both element and group motion are, in fact, mediated solely by a process sensitive to changes in the spatial appearance of the Ternus elements. In light of this, it appears that Ternus displays tell us nothing about low-level motion processing, implying that previous studies using Ternus displays, for instance those dealing with dyslexia, require reinterpretation. Further manipulations of the Ternus display revealed that the orientation and spatial-frequency discrimination of the process underlying the analysis of Ternus displays is far worse than thresholds for spatial vision. We conclude that Ternus displays are analysed via a long-range motion, or feature-tracking, process, and that this process is distinct from spatial vision.