Capacity limit of ensemble perception of multiple spatially intermixed sets

The visual system is remarkably efficient at extracting summary statistics from the environment. Yet at any given time, the environment consists of many groups of objects distributed over space. Thus, the challenge for the visual system is to summarize over multiple groups. The current study investigates the capacity and computational efficiency of ensemble perception, in the context of perceiving mean sizes of multiple spatially intermixed groups of circles. In a series of experiments, participants viewed an array of one to eight sets of circles. Each set contained four circles in the same colors, but with different sizes. Participants estimated the mean size of a probed set. The set that would be probed was either known before onset of the array (pre-cue condition) or afterwards (post-cue condition). By comparing estimation error in the pre-cue and post-cue conditions, we found that participants could reliably estimate mean sizes for approximately two sets (Experiment 1). Importantly, this capacity was robust against attention bias toward individual objects in the sets (Experiment 2). Varying the exposure time to stimulus arrays did not increase the capacity limit, suggesting that ensemble perception could be limited by an internal resource constraint, rather than the speed of information encoding (Experiment 3). Moreover, we found that the visual system could not encode and hold more individual items than ensemble representations (Experiment 4). Taken together, these results suggest that ensemble perception provides an efficient way of information processing but with constraints.     

Visually guided grasping of common objects: Effects of priming

Priming effects were tested on the planning of the grasping of common objects under full vision during action performance. Healthy participants took part in four experiments which manipulated the nature of the prime (objects, circular block, rectangular bar) and priming context (blocked vs. mixed). Each experiment relied on four priming conditions: (1) congruent orientation, (2) incongruent orientation, (3) neutral prime, and (4) no prime. Priming was observed to have a facilitating effect on visually guided grasping when the object to be grasped was primed by a congruently oriented identical object. This effect was rather independent of the priming context (experimental set-up). Our data suggest an object's functional identity may contribute to the priming effect, as well as its intrinsic (e.g., shape, size) and extrinsic (orientation) visual characteristics. We showed that the planning of visually guided grasping is influenced by prior visual experience, and thus that grasping is not based exclusively on real-time processing of visual information.     

Perception and imagery of faces generate similar gender aftereffects

Visual adaptation is known to bias perception away from the properties of the adapting stimuli, toward opposite properties, resulting in perceptual aftereffects. For example, prolonged exposure to a face has been shown to produce an identity aftereffect, biasing perception of a subsequent face toward the opposite identity. Such repulsive aftereffects have been observed for both visually perceived and visually imagined faces, suggesting that both perception and imagery yield typical aftereffects. However, recent studies have reported opposite patterns of aftereffects for perception and imagery of face gender. In these studies, visually perceived faces produced typical effects in which perception of androgynous faces was biased away from the gender of the adaptor, whereas imagery of the same stimuli produced atypical aftereffects, biasing the perceived gender of androgynous faces toward the gender of the adaptor. These findings are highly unusual and warrant further research. The present study aimed to gather new evidence on the direction of gender aftereffects following perception and imagery of faces. Experiment 1 had participants view and imagine female and male faces of famous and non-famous individuals. To determine the effect of concomitant visual stimulation on imagery and adaptation, participants visualized faces both in the presence and in the absence of a visual input. In Experiment 2, participants were adapted to perceived and imagined faces of famous and non-famous actors matched on gender typicality. This manipulation allowed us to determine the effect of face familiarity on the magnitude of gender aftereffects. Contrary to evidence from previous studies, our results demonstrated that both perception and imagery produced typical aftereffects, biasing the perceived gender of androgynous faces in the opposite direction to the gender of the adaptor. Famous faces yielded largest adaptation effects across tasks. Experiment 2 confirmed that these effects depended on familiarity rather than on sexual dimorphism. In both experiments, this effect was greater for perception than imagery. Additionally, imagery of famous faces produced strongest aftereffects when it was performed in the absence of visual stimulation. The implications of these findings are discussed.     

基于数量感知的数量适应

数量适应是指观察者在知觉上适应刺激数量的过程, 这一过程可以通过考察适应后其数量感知的变化加以揭示。目前对这一现象的争论焦点在于它是对数量的单独适应还是对非数量表面信息的适应。本研究通过改变刺激点大小和刺激组块两种方式, 探讨非数量表面信息对数量感知和数量适应的影响。实验一证明刺激点大小不会对数量感知产生显著影响。实验二发现刺激组块会对数量感知产生显著影响。实验三在前两个实验基础上发现：刺激大小不对数量感知产生显著影响, 也不影响数量适应, 而刺激组块能显著改变数量感知, 并按照改变后的数量感进行适应。三个实验的结果说明：表面信息只有在影响到数量感知时才会影响适应, 数量适应是基于数量感知的加工而产生的适应现象。     

Short-term plasticity of the visuomotor map during grasping movements in humans

During visually guided grasping movements, visual information is transformed into motor commands. This transformation is known as the "visuomotor map." To investigate limitations in the short-term plasticity of the visuomotor map in normal humans, we studied the maximum grip aperture (MGA) during the reaching phase while subjects grasped objects of various sizes. The objects seen and the objects grasped were physically never the same. When a discrepancy had been introduced between the size of the visual and the grasped objects, and the subjects were fully adapted to it, they all readily interpolated and extrapolated the MGA to objects not included in training trials. In contrast, when the subjects were exposed to discrepancies that required a slope change in the visuomotor map, they were unable to adapt adequately. They instead retained a subject-specific slope of the relationship between the visual size and MGA. We conclude from these results that during reaching for grasping, normal subjects are unable to abandon a straight linear function determining the relationship between visual object size and MGA. Moreover, the plasticity of the visuomotor map is, at least in short term, constrained to allow only offset changes, that is, only "rigid shifts" are possible between the visual and motor coordinate systems.     

A double dissociation between action and perception in the context of visual illusions: opposite effects of real and illusory size

The idea that there are two distinct cortical visual pathways, a dorsal action stream and a ventral perception stream, is supported by neuroimaging and neuropsychological evidence. Yet there is an ongoing debate as to whether or not the action system is resistant to pictorial illusions in healthy participants. In the present study, we disentangled the effects of real and illusory object size on action and perception by pitting real size against illusory size. In our task, two objects that differed slightly in length were placed within a version of the Ponzo illusion. Even though participants erroneously perceived the physically longer object as the shorter one (or vice versa), their grasping was remarkably tuned to the real size difference between the objects. These results provide the first demonstration of a double dissociation between action and perception in the context of visual illusions and together with previous findings converge on the idea that visually guided action and visual perception make use of different metrics and frames of reference.     

Dorsal stream activation during retrieval of object size and shape

We investigated dorsal visual stream involvement in the retrieval of a variety of visual attributes of common objects, using functional magnetic resonance imaging. Seven subjects made binary decisions about the shape, color, and size of named objects during scanning. Bilateral parietal activity was significantly greater during retrieval of shape and size information than during retrieval of color information. Consistent with a domain-specific distributed model of semantic organization, the finding that dorsal stream activity is associated with size and shape retrieval, as compared with color retrieval, may indicate that both size and shape information are learned partly through dorsally mediated processes, such as visually guided grasping. These results demonstrate that both visual-processing streams (i.e., the ventral “what” pathway and the dorsal “where” pathway) are involved in the storage and/or retrieval of knowledge of object appearance but that, just as in vision, these two pathways may play different roles in conceptual processing.     

Ensemble coding remains accurate under object and spatial visual working memory load

A number of studies have provided evidence that the visual system statistically summarizes large amounts of information that would exceed the limitations of attention and working memory (ensemble coding). However the necessity of working memory resources for ensemble coding has not yet been tested directly. In the current study, we used a dual task design to test the effect of object and spatial visual working memory load on size averaging accuracy. In Experiment 1, we tested participants’ accuracy in comparing the mean size of two sets under various levels of object visual working memory load. Although the accuracy of average size judgments depended on the difference in mean size between the two sets, we found no effect of working memory load. In Experiment 2, we tested the same average size judgment while participants were under spatial visual working memory load, again finding no effect of load on averaging accuracy. Overall our results reveal that ensemble coding can proceed unimpeded and highly accurately under both object and spatial visual working memory load, providing further evidence that ensemble coding reflects a basic perceptual process distinct from that of individual object processing.     

视时距知觉适应后效的空间选择性

时距知觉适应后效是指长时间适应于某一特定时距会导致个体对后续时距产生知觉偏差。其中对视时距知觉适应后效空间选择性的探讨存在争议,有研究支持位置不变性,也有研究支持位置特异性。这类研究能有效揭示时距编码的认知神经机制,位置不变性可能意味着时距编码位于较高级的脑区,而位置特异性则可能意味着时距编码位于初级视觉皮层。未来还可以探究时距知觉适应后效的视觉坐标表征方式,开展多通道研究以及相应的神经基础研究。     

Taking a hands-on approach: apparent grasping ability scales the perception of object size

We examined whether the apparent size of an object is scaled to the morphology of the relevant body part with which one intends to act on it. To be specific, we tested if the visually perceived size of graspable objects is scaled to the extent of apparent grasping ability for the individual. Previous research has shown that right-handed individuals perceive their right hand as larger and capable of grasping larger objects than their left. In the first 2 experiments, we found that objects looked smaller when placed in or judged relative to their right hand compared to their left. In the third experiment, we directly manipulated apparent hand size by magnifying the participants' hands. Participants perceived objects to be smaller when their hand was magnified than when their hand was unmagnified. We interpret these results as demonstrating that perceivers use the extent of their hands' grasping abilities as "perceptual rulers" to scale the apparent size of graspable objects. Furthermore, hand size manipulations did not affect the perceived size of objects too big to be grasped, which suggests that hand size is only used as a scaling mechanism when the object affords the relevant action, in this case, grasping.     

A color-contingent prism displacement aftereffect

Observers were trained to point with feedback to red and blue dots whose images had been laterally displaced in opposite directions by a reversible prism. On pretraining and posttraining trials the red and blue dots were aligned vertically in the absence of visual orientation cues. The alignment was modified by the pointing training on the posttraining trials. The colors were aligned in the direction of their prior prismatic displacement. One control experiment showed that the alignment aftereffect requires feedback during the pointing task. Another experiment in which observers pointed to the red and blue dots with opposite arms showed that pointing to both dots with the same arm was necessary to produce the alignment aftereffect. Changes in the perceived position of objects in the visual field occur when changes in perceived limb position cannot compensate for a sensorimotor conflict. Eye torsion or fixation displacements are proposed as alternative mechanisms mediating the aftereffect.     

Opposite effects of visual versus imagined presentation of faces on subsequent sex perception

Viewing faces of one sex changes the perception of subsequently seen ambiguous faces. Here we investigate if the mechanisms responsible for this sex aftereffect are also activated during mental imagery of faces. Participants categorized the sex of ambiguous faces after either viewing images of male or female actors' faces or imagining these same faces. As in previous studies, the ambiguous images were categorized as female more often after viewing male faces than after viewing female faces. The opposite effect was found for imagined faces, however; the ambiguous images were categorized as female more often after imagining female faces than after imagining male faces. Although our results are inconsistent with findings that imagined faces cause either no aftereffects or similar aftereffects to visually presented faces, our results are consistent with recent evidence that visual and imagined presentation of faces cause opposite adaptation effects on an early electrophysiological response associated with face processing.     

Visuo-haptic integration in object identification using novel objects

Although some studies have shown that haptic and visual identification seem to rely on similar processes, few studies have directly compared the two. We investigated haptic and visual object identification by asking participants to learn to recognize (Experiments 1, and 3), or to match (Experiment 2) novel objects that varied only in shape. Participants explored objects haptically, visually, or bimodally, and were then asked to identify objects haptically and/or visually. We demonstrated that patterns of identification errors were similar across identification modality, independently of learning and testing condition, suggesting that the haptic and visual representations in memory were similar. We also demonstrated that identification performance depended on both learning and testing conditions: visual identification surpassed haptic identification only when participants explored the objects visually or bimodally. When participants explored the objects haptically, haptic and visual identification were equivalent. Interestingly, when participants were simultaneously presented with two objects (one was presented haptically, and one was presented visually), object similarity only influenced performance when participants were asked to indicate whether the two objects were the same, or when participants had learned about the objects visually—without any haptic input. The results suggest that haptic and visual object representations rely on similar processes, that they may be shared, and that visual processing may not always lead to the best performance.     

Relating the perception of visual ensemble statistics to individual levels of autistic traits

Integrating information across the visual field into an ensemble (e.g., seeing the forest from the trees) is an effective strategy to efficiently process the visual world, and one that is often impaired in autism spectrum disorder. Individual differences in sensory processing predict ensemble encoding, providing a potential mechanism for differing perceptual strategies across individuals, and possibly across diagnostic groups exhibiting atypical sensory processing. Here, we explore whether ensemble encoding is associated with traits associated with autism spectrum disorder (ASD). Participants (N=68) were presented with an ensemble display consisting of circles of varying sizes and colors, and were asked to remember the size of the red and blue circles, while ignoring the green circles. Participants were then cued to a target location after a brief delay, and instructed to report the remembered size of the circle they had previously viewed in that location, as ensemble information commonly biases memory for individual objects toward the probed mean of a set of similar objects. The Autism-spectrum Quotient (AQ) was completed to measure each individual’s level of autistic traits. We found that an individual’s level of ensemble perception, measured as their bias toward the probed mean, was negatively associated with a higher level of ASD traits. These results suggest that individuals with higher levels of ASD traits are less likely to integrate perceptual information. These findings may shed light on different perceptual processing within the autism spectrum, and provide insight into the relationship between individual differences and ensemble encoding.     

Face encoding is not categorical: Consistent evidence across multiple types of contingent aftereffects

ABSTRACT

Race-contingent aftereffects indicate that faces of different races are encoded via dissociable visual channels. Race-contingent aftereffects reflect perceptions of typicality, indicating a gradual transition of activity across channels as faces change from looking more typical of one race to the other We examine whether faces forming more discrete categories (sex: male/female; species: human/monkey) are encoded in a similar fashion, or whether they are instead encoded via more dichotomous categorical judgements. Curves representing the rate of change of aftereffect magnitude as stimuli changed from male to female produced shallow slopes, closely resembling ratings of typicality, but differing significantly from slopes for categorical judgements. For species, aftereffect slopes were significantly shallower than both ratings of typicality and categorical judgements. Overall, these results suggest that the encoding of facial properties such as these is not categorical, but instead involves a graded response as stimulus typicality varies. Aftereffect slopes were similar across the two experiments, raising the possibility of a common system that is recruited during contingent adaptation, regardless of the specific dimension involved or the categories used by the experimenter.     

Pulling faces: an investigation of the face-distortion aftereffect

After adaptation to a face distorted to look unnaturally thin or fat, a normal face appears distorted in the opposite direction (Webster and MacLin 1999 Psychonomic Bulletin & Review 6 647-653). When the adapting face is oriented 45 degrees from vertically upright and the test face 45 degrees in the opposite direction, the axis of perceived distortion changes with the orientation of the face. The magnitude of this aftereffect shows a reduction of approximately 40% from that found when both adapting and test faces are tilted identically. This finding suggests that to a large degree the aftereffect is mediated not by low-level retinotopic (image-based) visual mechanisms but at a higher level of object-based processing. Aftereffects of a similar magnitude are obtained when adapting and test images are both either upright or inverted, or for an upright adapter and an inverted test; but aftereffects are smaller when the adapter is inverted and the test upright. This pattern of results suggests that the face-distortion aftereffect is mediated by object-processing mechanisms including, but not restricted to, configurational face-processing mechanisms.     

The role of higher level adaptive coding mechanisms in the development of face recognition

Developmental improvements in face identity recognition ability are widely documented, but the source of children’s immaturity in face recognition remains unclear. Differences in the way in which children and adults visually represent faces might underlie immaturities in face recognition. Recent evidence of a face identity aftereffect (FIAE), in which adaptation (exposure) to a particular identity causes a previously neutral face to take on the computationally opposite identity, suggests that adults code faces in an opponent fashion relative to an average face. One previous study showed comparable FIAEs in 8-year-olds and adults but did not demonstrate that adaptation was selective for high-level representations in both groups. Using a developmentally appropriate FIAE task, we investigated whether children show adult-like adaptation for facial identity when adapting and test images differ in size. Both age groups showed an equivalent FIAE, suggesting that qualitative changes in the use of higher level adaptive coding mechanisms do not drive the developmental improvements in face recognition ability, at least from 8 years of age.     

EYEMOVEMENT AND PERCEPTUAL ADAPTATION TO CURVATURE

It is proposed that perceptual adaptation is basically an immediate localized consequence of stimulation but can become generalized through a process of conditioning by temporal contiguity. Experimental conditions were designed to assess the aftereffect of adaptation to curvature under various combinations of eye position and eye movement activity for adapting vs. test periods. In general, the results support the hypothesis that perceptual adaptation to a visual stimulus can be associated with the nonvisual factors present at the time the adaptation occurs.     

Interactions between simultaneous contrast and adaptation to gradual change of luminance

Following adaptation to a field of light which was modulated by a rising ramp so that it repetitively grows gradually brighter, a steady test field of light appears to be gradually growing dimmer. In this study, if a small grey spot of constant luminance was centered in the brightening field, it appeared to be growing gradually dimmer by simultaneous contrast. This apparent dimming led to a brightening aftereffect in the spot. It was shown that this spot aftereffect had two independent components: the apparent dimming of the adapting spot produced its own aftereffect (contrast produced an aftereffect) and also the dimming aftereffect in the surround field spatially induced an aftereffect into the spot during the test period (aftereffect produced simultaneous contrast). Thus simultaneous contrast can both precede and follow successive contrast in the visual system.     

Matching cue size and task properties in exogenous attention

Exogenous attention is an involuntary, reflexive orienting response that results in enhanced processing at the attended location. The standard view is that this enhancement generalizes across visual properties of a stimulus. We test whether the size of an exogenous cue sets the attentional field and whether this leads to different effects on stimuli with different visual properties. In a dual task with a random-dot kinematogram (RDK) in each quadrant of the screen, participants discriminated the direction of moving dots in one RDK and localized one red dot. Precues were uninformative and consisted of either a large or a small luminance-change frame. The motion discrimination task showed attentional effects following both large and small exogenous cues. The red dot probe localization task showed attentional effects following a small cue, but not a large cue. Two additional experiments showed that the different effects on localization were not due to reduced spatial uncertainty or suppression of RDK dots in the surround. These results indicate that the effects of exogenous attention depend on the size of the cue and the properties of the task, suggesting the involvement of receptive fields with different sizes in different tasks. These attentional effects are likely to be driven by bottom-up mechanisms in early visual areas.