The role of elaboration in the persistence of awareness for degraded objects

When a fragmented line-drawing of an object moves relative to a background of randomly oriented lines, the previously hidden object can be segregated from the background and consequently enters awareness. In this shape-from-motion paradigm, the percept of the object briefly persists after the motion stops, demonstrating the maintenance of a bound percept in awareness. This study investigated how the manipulation of object features that are crucial to recognition influences both the binding process and the maintenance of objects in awareness. Overall, we found that objects that took longer to recognize (i.e., objects missing their vertices) were nonetheless maintained in awareness for longer. We argue that this effect is mediated by additional elaborative processing that is required to bind these less recognizable forms, which generates stronger and more robust representations. These representations are then more easily maintained in awareness, suggesting an important role of elaborative mechanisms for conscious representations.     

Infants’ ability to extract three-dimensional shape from coherent motion

Our capacity to perceive three-dimensional (3D) object structure from two-dimensional (2D) retinal input is fundamental to object perception. The present research examined infants’ ability to extract 3D form from structure-from-motion (SFM) displays using a familiarization/visual-paired-comparison paradigm. In SFM displays dots are projected onto the surfaces of a shape that rotates around a 3D axis and it is the coherent structure of the dots’ motion that gives rise to the percept of shape. Infants mean age 4.5 and 9 months were familiarized to a SFM display (e.g., cylinder); in test they were presented the familiar SFM display paired with a novel SFM display (e.g., cube). Infants in both age groups displayed a significant preference for the novel SFM test display. These results are consistent with those obtained previously using habituation paradigms and provide converging evidence for infants’ early emerging capacity to use coherent motion – in the absence of figural information – as a cue to depth structure. In addition, these results demonstrate that infants’ ability to extract 3D shape from coherent motion can be successfully assessed with a neuroimaging-friendly protocol, which was one of the goals of this study.     

Sensory memory of structure-from-motion is shape-specific

Perceptual priming can stabilize the phenomenal appearance of multistable visual displays (Leopold, Wilke, Maier, & Logothetis, Nature Neuroscience, 5, 605–609, 2002). Prior exposure to such displays induces a sensory memory of their appearance, which persists over long intervals and intervening stimulation, and which facilitates renewed perception of the same appearance. Here, we investigated perceptual priming for the apparent rotation in depth of ambiguous structure-from-motion (SFM) displays. Specifically, we generated SFM objects with different three-dimensional shapes and presented them in random order and with intervening blank periods. To assess perceptual priming, we established the probability that a perceived direction of rotation would persist between successive objects. In general, persistence was greatest between identical objects, intermediate between similar objects, and negligible between dissimilar objects. These results demonstrate unequivocally that sensory memory for apparent rotation is specific to three-dimensional shape, contrary to previous reports (e.g., Maier, Wilke, Logothetis, & Leopold, Current Biology, 13, 1076–1085, 2003). Because persistence did not depend on presentation order for any pair of objects, it provides a commutative measure for the similarity of object shapes. However, it is not clear exactly which features or aspects of object shape determine similarity. At least, we did not find simple, low-level features (such as volume overlap, heterogeneity, or rotational symmetry) that could have accounted for all observations. Accordingly, it seems that sensory memory of SFM (which underlies priming of ambiguous rotation) engages higher-level representations of object surface and shape.     

Flank transparency: transparent filters seen in dynamic two-color displays

Flank transparency is the perception of a colored transparent filter evoked by apparent-motion displays containing as few as two colors. Displays of flank transparency contain a random array of line segments placed on a uniform background. Small flanks are added to the line segments if the segments fall in the interior of a moving virtual shape, such as a virtual disk. This leads to the perception of a colored transparent disk with well-defined boundaries moving over the array of lines. Current qualitative and quantitative models of luminance and color conditions for perceptual transparency do not account for flank transparency as they require displays containing at least three different colors.     

Multiplicative effects of intention on the perception of bistable apparent motion

When viewing ambiguous displays, observers can, via intentional efforts, affect which perceptual interpretation they perceive. Specifically, observers can increase the probability of seeing the desired percept. Little is known, however, about how intentional efforts interact with sensory inputs in exerting their effects on perception. In two experiments, the current study explored the possibility that intentional efforts might operate by multiplicatively enhancing the stimulus-based activation of the desired perceptual representation. Such a possibility is suggested by recent neurophysiological research on attention. In support of this idea, when we presented bistable apparent motion displays under stimulus conditions differentially favoring one motion percept over the other, observers' intentional efforts to see a particular motion were generally more effective under conditions in which stimulus factors favored the intended motion percept.     

Sensory memory of illusory depth in structure-from-motion

When multistable displays (stimuli consistent with two or more equally plausible perceptual interpretations) are presented intermittently, their perceptions are stabilized by sensory memory. Independent memory traces are generated not only for different types of multistable displays (Maier, Wilke, Logothetis, & Leopold, Current Biology 13:1076–1085, 2003), but also for different ambiguous features of binocular rivalry (Pearson & Clifford, Journal of Vision 4:196–202, 2004). In the present study, we examined whether a similar independence of sensory memories is observed in structure-from-motion (SFM), a multistable display with two ambiguous properties. In SFM, a 2-D planar motion creates a vivid impression of a rotating 3-D volume. Both the illusory rotation and illusory depth (i.e., how close parts of an object appear to the observer) of an SFM object are ambiguous. We dissociated the sensory memories of these two ambiguous properties by using an intermittent presentation in combination with a forced-ambiguous-switch paradigm (Pastukhov, Vonau, & Braun, PLoS ONE 7:e37734, 2012). We demonstrated that the illusory depth of SFM generates a sensory memory trace that is independent from that of illusory rotation. Despite this independence, the specificities levels of the sensory memories were identical for illusory depth and illusory rotation. The history effect was weakened by a change in the volumetric property of a shape (whether it was a hollow band or a filled drum volume), but not by changes in color or size. We discuss how these new results constrain models of sensory memory and SFM processing.     

A Theory of Perceptual Objects

Objects are central in visual, auditory, and tactual perception. But what counts as a perceptual object? I address this question via a structural unity schema, which specifies how a collection of parts must be arranged to compose an object for perception. On the theory I propose, perceptual objects are composed of parts that participate in causally sustained regularities. I argue that this theory falls out of a compelling account of the function of object perception, and illustrate its applications to multisensory perception. I also argue that the account avoids problems faced by standard views of visual and auditory objects.     

注意促进运动知觉判断的时间进程

本研究通过控制深度视觉线索, 分析3D SFM (structure from motion)知觉中的眼动特征, 探讨注意对SFM知觉判断的影响及其时间进程。结果显示, 有线索刺激比模糊刺激的判断更加快、更加肯定(百分比更高); 眼睛移动方向和微眼跳方向都分别与知觉判断的运动方向具有一致性; 微眼跳频次、峰速度和幅度也都分别表现出深度线索的促进效应。实验结果表明, SFM知觉过程大致分为速度计算和构建三维结构两个阶段; 注意对SFM知觉的调节作用主要发生在构建三维结构阶段; 注意从150 ms开始指向选择对象, 驻留持续约200 ms后, 从局部运动矢量流转移到整体运动方向的知觉判断。     

Illusory figures based on local kinematics.

A new type of motion-induced illusory figure determined by local kinematic information is investigated. The new figure is induced by radial line patterns subjected to either figure motion (the lines change as if they were stationary and a triangle was rotating in front of them) or background motion (the lines change as if they were being rotated behind a stationary triangle). Although the two kinds of motion are equivalent from the viewpoint of relative displacements, perceptually they yield very different results. With background motion, observers tend to perceive rigid figures that have a triangular shape. With figure motion, observers report seeing deforming figures with shapes that vary depending on the number of lines in the display. We consider two alternative accounts for this asymmetry which we term the background superiority effect (BSE). The first account proposes that the effect is due to retinal persistence and to figure stability. Against this line of explanation, we demonstrate that observers also see rigid triangular shapes in displays where both the figure and the radial lines rotate (double motion displays). The second account proposes that the effect depends on the availability of local kinematic information constraining contour orientation. This second line of explanation is consistent with observers' reports of bowed edges in double motion displays rotating in phase or in counterphase. Candidate mechanisms for extracting local kinematic information are discussed.     

In and out of consciousness: Sustained electrophysiological activity reflects individual differences in perceptual awareness

Although significant advances in our understanding of the cognitive and neural processes involved in conscious awareness have occurred in recent years, the precise mechanisms that support consciousness remain elusive. Examining the neural correlates associated with the moment a stimulus enters or exits conscious awareness is one way to potentially identify the neural mechanisms that give rise to consciousness. In the present study, we recorded neural activity using electroencephalography (EEG) while participants observed a bilateral shape-from-motion (SFM) display. While the display is in motion, the observer perceives an object that is immediately segregated from a noisy background. After the motion stops, the observer's experience of the object remains momentarily in awareness, before it eventually fades out of consciousness back into the noisy background. Consistent with subjective reports of perceptual experience, we observed a prominent sustained posterior contralateral negativity known as the contralateral delay activity (CDA). This activity was sustained only in conditions associated with sustained awareness. Interestingly, the amplitude of the CDA was correlated with individual differences in visual awareness, suggesting that this activity plays a significant role in the maintenance of objects in consciousness. The CDA is typically associated with visual short-term memory (VSTM), suggesting that conscious visual awareness may be mediated by the same neural and cognitive mechanisms that support VSTM. Our results demonstrate that the CDA may reflect the contents of conscious awareness, and therefore can provide a measure to track when information moves in and out of consciousness.     

Pigeons discriminate continuous versus discontinuous line segments

Three experiments examined various facets of the perception of continuous and discontinuous line segments in pigeons. Pigeons were presented with 2 straight lines that were interrupted by a gap. In some instances, the lines were the same angle and were positioned so that they appeared (to human observers) to form a continuous line. In other instances, the lines were different angles or the same angle but spatially misaligned. The birds were trained to classify each stimulus as continuous or discontinuous using a go/no-go procedure. A series of tests followed in which the birds received novel discontinuous displays made up of familiar line segments, continuous and discontinuous stimuli made up of novel line segments (novel straight lines or curved lines), and familiar displays in which the gap was covered with a gray square. Results from the tests indicated that 2 of the 3 pigeons had learned a continuous-discontinuous categorization and that they appeared to use the relationship between the 2 line segments in discriminating the displays.     

Accuracy of target detection in new-object and old-object displays

In 4 experiments, the authors investigated accuracy of detecting a target among nontargets. In some experiments, the target was a second-order square of stationary lines on a background of downward-moving lines, and nontargets were second-order squares of upward-moving lines. In other experiments, target and nontarget squares and background were shades of gray. The principal comparison was between "new" and "old" object displays. In new-object displays, search items appeared abruptly and one might be a target. In old-object displays, search items appeared abruptly, and after a delay one might become a target. Search displays in both conditions terminated shortly after target onset. Except when target onset was associated with the sole luminance change in a display, targets were much better detected in new- than in old-object displays. It is suggested that object onsets elicit a brief stimulus-driven enhancement of attention to the new objects.     

Connectedness affects dot numerosity judgment: Implications for configural processing

Participants judged the number of dots in visual displays with brief presentations (200 msec), such that the numerosity judgment was based on an instantaneous impression without counting. In some displays, pairs of adjacent dots were connected by line segments, whereas, in others, line segments were freely hanging without touching the dots. In Experiments 1, 2A, and 2B, connecting pairs of dots by line segments led to underestimation of dot numbers in those patterns. In Experiment 3, we controlled for the number of freely hanging line segments, whereas Experiment 4 showed that line segments that were merely attached to dots without actually connecting them did not produce a considerable underestimation effect. Experiment 5 showed that a connectedness effect existed when stimulus duration was reduced (50 msec) or extended (1,000 msec). We conclude that connectivity affects dot numerosity judgments, consistent with earlier findings of a configural effect in numerosity processing. Implications of the role of connectedness in object representation are discussed.     

The construction of perceptual grouping displays using GERT

To study perceptual grouping processes, vision scientists often use stimuli consisting of spatially separated local elements that, together, elicit the percept of a global structure. We developed a set of methods for constructing such displays and implemented them in an open-source MATLAB toolbox, GERT (Grouping Elements Rendering Toolbox). The main purpose of GERT is to embed a contour in a field of randomly positioned elements, while avoiding the introduction of a local density cue. However, GERT's modular implementation enables the user to create a far greater variety of perceptual grouping displays, using these same methods. A generic rendering engine grants access to a variety of element-drawing functions, including Gabors, Gaussians, letters, and polygons.     

Perceptual processing of partially and fully assimilated words in French

Models of speech perception attribute a different role to contextual information in the processing of assimilated speech. This study concerned perceptual processing of regressive voice assimilation in French. This phonological variation is asymmetric in that assimilation is partial for voiced stops and nearly complete for voiceless stops. Two auditory-visual cross-modal form priming experiments were used to examine perceptual compensation for assimilation in French words with voiceless versus voiced stop offsets. The results show that, for the former segments, assimilating context enhances underlying form recovery, whereas it does not for the latter. These results suggest that two sources of information -- contextual information and bottom-up information from the assimilated forms themselves -- are complementary and both come into play during the processing of fully or partially assimilated word forms.     

Visible persistence and form correspondence in Ternus apparent motion.

Visual stimuli remain visible for some time after their physical offset (visible persistence). Visible persistence has been hypothesized to play an important role in determining the pattern of correspondence matching in the Ternus apparent-motion display. In this display, one or more elements reappears in overlapping locations at different times, whereas another element appears alternately to the right or the left of these elements. Usually either the elements are perceived to move coherently as a group (group motion), or one element may be perceived to hop over one or more other elements (element motion). According to the visible-persistence account of the perceptual organization of the Ternus display, element motion is seen when the temporal gap between elements in overlapping locations is small enough to be bridged by visible persistence; if it is not, group motion is seen. We conducted four experiments to test this visible-persistence account. In Experiments 1 and 2, a form correspondence cue (line length) was introduced to bias the visual system toward the element-motion interpretation, while visible persistence was either reduced or eliminated. The element-motion percept dominated despite the elimination of visible persistence. In Experiments 3 and 4, we found that Ternus elements presented without interruption, and thus presumably persisting over time, can be perceived in group motion. Together, the results indicate that visible persistence is neither necessary nor sufficient to account for the pattern of correspondence matches in the Ternus display.     

Attentional consequences of object appearance and disappearance.

This study compared the attentional effects of object appearances (onsets) and disappearances (offsets) in moderately complex displays. Four experiments showed that onsets produce the inhibition of return (IOR) effect that has been found with simpler displays. In contrast, although offsets did produce inhibitory effects, these effects did not follow the spatial or temporal pattern of IOR. Two further experiments used a very salient object disappearance to determine whether the typical pattern for IOR could be instantiated; it was not. The results indicate that object appearances are more potent perceptual events than object disappearances. In addition, object disappearances have different attentional consequences than object appearances: Disappearances provoke earlier and spatially narrower inhibition. The results are consistent with the view that inhibition serves a functional role in increasing the efficiency of visual search processes.     

Perceptual adaptation to structure-from-motion depends on the size of adaptor and probe objects,but not on the similarity of their shapes

Perceptual adaptation destabilizes the phenomenal appearance of multistable visual displays. Prolonged dominance of a perceptual state fatigues the associated neural population, lowering the likelihood of renewed perception of the same appearance (Nawrot & Blake in Perception & Psychophysics, 49, 230–44, 1991). Here, we used a selective adaptation paradigm to investigate perceptual adaptation for the illusory rotation of ambiguous structure-from-motion (SFM) displays. Specifically, we generated SFM objects with different three-dimensional shapes and presented them in random order, separating successive objects by brief blank periods, which included a mask. To assess the specificity of perceptual adaptation to the shape of SFM objects, we established the probability that a perceived direction of rotation persisted between successive objects of similar or dissimilar shape. We found that the strength of negative aftereffects depended on the volume, but not the shape, of adaptor and probe objects. More voluminous objects were both more effective as adaptor objects and more sensitive as probe objects. Surprisingly, we found these volume effects to be completely independent, since any relationship between two shapes (such as overlap between volumes, similarity of shape, or similarity of velocity profiles) failed to modulate the negative aftereffect. This pattern of results was the opposite of that observed for sensory memory of SFM objects, which reflects similarity between objects, but not volume of individual objects (Pastukhov et al. in Attention, Perception & Psychophysics, 75, 1215–1229, 2013). The disparate specificities of perceptual adaptation and sensory memory for identical SFM objects suggest that the two aftereffects engage distinct neural representations, consistent with recent brain imaging results (Schwiedrzik et al. in Cerebral Cortex, 2012).     

Stimulus frequency influences spontaneous perceptual reversals in ambiguous apparent motion

The temporal integration of continuous sensory information into a temporally extended percept becomes evident in spontaneous reversals of ambiguous apparent motion. To study the temporal relation of spontaneous percept reversals and temporal stimulus properties, we systematically varied presentation frequency in an ambiguous-apparent-motion paradigm. Moreover, we triggered percept reversals in a manner that was not consciously perceived by manipulating the duration of single frames. We found that the reversal rate depended on the stimulus frequency (with higher frequencies resulting in faster percept reversals) and that we could externally trigger perceptual reversals. Our findings support the idea that spontaneous reversals of ambiguous apparent motion are influenced by bottom-up effects at early processing levels. The paradigm allows for specific contrasts of spontaneous and externally triggered (but otherwise identical) perceptual reversals and, by this means, for further study of the underlying mechanisms.     

Structure-from-motion: dissociating perception, neural persistence, and sensory memory of illusory depth and illusory rotation

In the structure-from-motion paradigm, physical motion on a screen produces the vivid illusion of an object rotating in depth. Here, we show how to dissociate illusory depth and illusory rotation in a structure-from-motion stimulus using a rotationally asymmetric shape and reversals of physical motion. Reversals of physical motion create a conflict between the original illusory states and the new physical motion: Either illusory depth remains constant and illusory rotation reverses, or illusory rotation stays the same and illusory depth reverses. When physical motion reverses after the interruption in presentation, we find that illusory rotation tends to remain constant for long blank durations (T _blank ≥ 0.5 s), but illusory depth is stabilized if interruptions are short (T _blank ≤ 0.1 s). The stability of illusory depth over brief interruptions is consistent with the effect of neural persistence. When this is curtailed using a mask, stability of ambiguous vision (for either illusory depth or illusory rotation) is disrupted. We also examined the selectivity of the neural persistence of illusory depth. We found that it relies on a static representation of an interpolated illusory object, since changes to low-level display properties had little detrimental effect. We discuss our findings with respect to other types of history dependence in multistable displays (sensory stabilization memory, neural fatigue, etc.). Our results suggest that when brief interruptions are used during the presentation of multistable displays, switches in perception are likely to rely on the same neural mechanisms as spontaneous switches, rather than switches due to the initial percept choice at the stimulus onset.