Figural aftereffects in the perception of faces

We examined figural aftereffects in images of human faces, for which changes in configuration are highly discriminable. Observers either matched or rated faces before or after viewing distorted images of faces. Prior adaptation strongly biases face perception by causing the original face to appear distorted in a direction opposite to the adapting distortion. Aftereffects transferred across different faces and were similar for upright or inverted faces, but were weaker when the adapting and test faces had different orientations (e.g., adapt inverted and test upright). Thus the aftereffects depend on which images are distorted, and not simply on the type of distortion introduced. We further show that the aftereffects are asymmetric, for adapting to the original face has little effect on the perception of a distorted face. This asymmetry suggests that adaptation may play an important normalizing role in face perception. Our results suggest that in normal viewing, figural aftereffects may strongly influence form perception and could provide a novel method for probing properties of human face perception.     

Atypical updating of face representations with experience in children with autism

Face identity aftereffects are significantly diminished in children with autism relative to typical children, which may reflect reduced perceptual updating with experience. Here, we investigated whether this atypicality also extends to non‐face stimulus categories, which might signal a pervasive visual processing difference in individuals with autism. We used a figural aftereffect task to measure directly perceptual updating following exposure to distorted upright faces, inverted faces and cars, in typical children and children with autism. A size‐change between study and test stimuli limited the likelihood that any processing atypicalities reflected group differences in adaptation to low‐level features of the stimuli. Results indicated that, relative to typical children, figural aftereffects for upright faces, but not inverted faces or cars, were significantly attenuated in children with autism. Moreover, the group difference was amplified when we isolated the ‘face‐selective’ component of the aftereffect, by partialling out the mid‐level shape adaptation common to upright and inverted face stimuli. Notably, the aftereffects of typical children were disproportionately larger for upright faces than for inverted faces and cars, but the magnitude of aftereffects of autistic children was not similarly modulated according to stimulus category. These findings are inconsistent with a pervasive adaptive coding atypicality relative to typical children, and suggest that reduced perceptual updating may constitute a high‐level, and possibly face‐selective, visual processing difference in children with autism.     

Fitting the child's mind to the world: adaptive norm-based coding of facial identity in 8-year-olds

In adults, facial identity is coded by opponent processes relative to an average face or norm, as evidenced by the face identity aftereffect: adapting to a face biases perception towards the opposite identity, so that a previously neutral face (e.g. the average) resembles the identity of the computationally opposite face. We investigated whether children as young as 8 use adaptive norm-based coding to represent faces, a question of interest because 8-year-olds are less accurate than adults at recognizing faces and do not show the adult neural markers of face expertise. We found comparable face identity aftereffects in 8-year-olds and adults: perception of identity in both groups shifted in the direction predicted by norm-based coding. This finding suggests that, by 8 years of age, the adaptive computational mechanisms used to code facial identity are like those of adults and hence that children's immaturities in face processing arise from another source.     

The role of higher level adaptive coding mechanisms in the development of face recognition

Developmental improvements in face identity recognition ability are widely documented, but the source of children’s immaturity in face recognition remains unclear. Differences in the way in which children and adults visually represent faces might underlie immaturities in face recognition. Recent evidence of a face identity aftereffect (FIAE), in which adaptation (exposure) to a particular identity causes a previously neutral face to take on the computationally opposite identity, suggests that adults code faces in an opponent fashion relative to an average face. One previous study showed comparable FIAEs in 8-year-olds and adults but did not demonstrate that adaptation was selective for high-level representations in both groups. Using a developmentally appropriate FIAE task, we investigated whether children show adult-like adaptation for facial identity when adapting and test images differ in size. Both age groups showed an equivalent FIAE, suggesting that qualitative changes in the use of higher level adaptive coding mechanisms do not drive the developmental improvements in face recognition ability, at least from 8 years of age.     

The auditory motion aftereffect: its tuning and specificity in the spatial and frequency domains

In this paper, the auditory motion aftereffect (aMAE) was studied, using real moving sound as both the adapting and the test stimulus. The sound was generated by a loudspeaker mounted on a robot arm that was able to move quietly in three-dimensional space. A total of 7 subjects with normal hearing were tested in three experiments. The results from Experiment 1 showed a robust and reliable negative aMAE in all the subjects. After listening to a sound source moving repeatedly to the right, a stationary sound source was perceived to move to the left. The magnitude of the aMAE tended to increase with adapting velocity up to the highest velocity tested (20 degrees/sec). The aftereffect was largest when the adapting and the test stimuli had similar spatial location and frequency content. Offsetting the locations of the adapting and the test stimuli by 20 degrees reduced the size of the effect by about 50%. A similar decline occurred when the frequency of the adapting and the test stimuli differed by one octave. Our results suggest that the human auditory system possesses specialized mechanisms for detecting auditory motion in the spatial domain.     

Aftereffect of high-speed motion.

A visual illusion known as the motion aftereffect is considered to be the perceptual manifestation of motion sensors that are recovering from adaptation. This aftereffect can be obtained for a specific range of adaptation speeds with its magnitude generally peaking for speeds around 3 deg s-1. The classic motion aftereffect is usually measured with a static test pattern. Here, we measured the magnitude of the motion aftereffect for a large range of velocities covering also higher speeds, using both static and dynamic test patterns. The results suggest that at least two (sub)populations of motion-sensitive neurons underlie these motion aftereffects. One population shows itself under static test conditions and is dominant for low adaptation speeds, and the other is prevalent under dynamic test conditions after adaptation to high speeds. The dynamic motion aftereffect can be perceived for adaptation speeds up to three times as fast as the static motion aftereffect. We tested predictions that follow from the hypothesised division in neuronal substrates. We found that for exactly the same adaptation conditions (oppositely directed transparent motion with different speeds), the aftereffect direction differs by 180 degrees depending on the test pattern. The motion aftereffect is opposite to the pattern moving at low speed when the test pattern is static, and opposite to the high-speed pattern for a dynamic test pattern. The determining factor is the combination of adaptation speed and type of test pattern.     

Effects of normal and abnormal visual experience on the development of opposing aftereffects for upright and inverted faces

We used opposing figural aftereffects to investigate whether there are at least partially separable representations of upright and inverted faces in patients who missed early visual experience because of bilateral congenital cataracts (mean age at test 19.5 years). Visually normal adults and 10-year-olds were tested for comparison. Adults showed the expected opposing aftereffects for upright and inverted faces. Ten-year-olds showed an adultlike aftereffect for upright faces but, unlike the adult group, no aftereffect for inverted faces. Patients failed to show an aftereffect for either upright or inverted faces. Overall, the results suggest that early visual input is necessary for the later development of (at least partially) separable representations of upright and inverted faces, a developmental process that takes many years to reach an adult-like refinement.     

Categorical perception of face identity in noise isolates configural processing.

Neuropsychological evidence suggests that face recognition based on configural (holistic) information can occur in isolation from recognition based on local feature cues. The present study shows that configural processing can be isolated experimentally in normal subjects. A phenomenon is reported that exists only for upright whole faces, namely categorical perception (CP) of face identity in noise. Three discrimination tasks (ABX, better likeness, and similarity ratings) were used to test for perceptual distortion across the category boundary predicted from binary classification of face morphs. Noise was added such that any single local region provided unreliable cues to identity. Under these conditions, CP was found for upright faces but not for inverted faces or single features, even with more than 10,000 trials. The CP-in-noise signature phenomenon was then used to show that configural processing survives image plane rotations of 45 degrees-90 degrees.     

THE GENERALITY OF NEGATIVE AFTEREFFECT FOLLOWING ADAPTATION TO CURVATURE

Twenty-six subjects made judgments of curvature by the method of magnitude estimation. The influence of prior adaptation to a moderate degree of curvature was assessed for test-curvatures greater and less than the adapting curvature and in the same and opposite directions. The median aftereffect was negative in all cases but not statistically significant for the most extreme difference between adapting and test curvatures. It is argued that negative aftereffect for all test-curvatures along the same stimulus-continuum is a necessary condition for postulating that these experimental effects represent a general normalizing tendency in perception.     

Effect of image orientation on the eye direction aftereffect

After observing a face with the eyes looking to the left or right (adaptation stimulus), the perception of the eye direction of the subsequent face (test stimulus) is biased in the opposite direction of the adapted eye direction; this is called the eye direction aftereffect (EDAE). In the present study, the adaptation stimuli were rotated 90° (clockwise or counterclockwise) or 180° relative to the viewer. The EDAE was measured using upright test stimuli. For the 90° rotation, prior observation of the leftward and rightward eye directions biased the perceived eye directions of the upright test stimuli to the right and left, respectively. These results suggest that the adaptation was induced utilizing an object-based (or face-based) reference frame. For the 180° rotation, however, the results suggest that the adaptation was induced in a viewer-centered reference frame. The involvement of an object-based reference frame suggests that the EDAE reflected the adaptation of a relatively higher-level mechanism at least when the rotation angle from the upright position did not exceed 90°.     

Do the upright eyes have it?

Eye contact is crucial for social communication. A perceived direct gaze facilitates detection, whereas face inversion diminishes this facilitative effect (Senju, Hasegawa, & Tojo, 2005). In the present study, we adopted a visual search paradigm to investigate why a direct gaze facilitates detection in an upright face, but not in an upside-down face. Upright eyes were found to facilitate detection even when other parts of the face were inverted or absent, whereas inverted eyes had no effect on search performance. A critical role for the morphological information of upright eyes, which can be distorted by “eye inversion,” in direct gaze processing is suggested.     

Color—luminance relationships and the McCollough effect

The McCollough effect is an orientation-specific color aftereffect induced by adapting to colored gratings. We examined how the McCollough effect depends on the relationships between color and luminance within the inducing and test gratings and compared the aftereffects to the color changes predicted from selective adaptation to different color—luminance combinations. Our results suggest that the important contingency underlying the McCollough effect is between orientation and color—luminance direction and are consistent with sensitivity changes within mechanisms tuned to specific color—luminance directions. Aftereffects are similar in magnitude for adapting color pairs that differ only in S cone excitation or L and M cone excitation, and they have a similar dependence on spatial frequency. In particular, orientation-specific aftereffects are induced for S cone colors even when the grating frequencies are above the S cone resolution limit. Thus, the McCollough effect persists even when different cone classes encode the orientation and color of the gratings.     

The role of eyes in early face processing: a rapid adaptation study of the inversion effect

The current study employed a rapid adaptation procedure to test the neuronal mechanisms of the face inversion effect (FIE) on the early face-sensitive event-related potential (ERP) component N170. Five categories of face-related stimuli (isolated eyes, isolated mouths, eyeless faces, mouthless faces, and full faces) and houses were presented in upright and inverted orientations as adaptors for inverted full face test stimuli. Strong adaptation was found for all face-related stimuli except mouths. The adaptation effect was larger for inverted than upright stimuli, but only when eyes were present. These results underline an important role of eyes in early face processing. A mechanism of eye-dependent orientation sensitivity during the structural encoding stage of faces is proposed.     

Testing a two-component model of face identification: effects of inversion, contrast reversal, and direction of lighting

Enns and Shore (1997 Perception & Psychophysics 59 23-31) found additive effects of test orientation (upright or inverted) and direction of lighting (brow or chin lit) when they studied the inversion effect on face identification. A two-stage model was inferred in which inversion was processed by an orientation-sensitive component after which chin-lighting was processed by a lighting-sensitive component. Face identification is also strongly influenced by contrast reversal. A study is reported which aimed to (i) determine if contrast reversal interacts with lighting direction or orientation, findings that would support Enns and Shore's model; and (ii) to test their assumption that holistic encoding is prerequisite for their model by inducing featural encoding through training names to inverted faces. Names for unfamiliar brow-lit positive-contrast faces were trained with the faces upright or inverted. Identification accuracy was measured with combinations of orientation, lighting, and contrast. Consistent with their model, test orientation and direction of lighting were additive after training on upright faces and lighting and contrast reversal interacted. When holistic encoding was prevented following training on inverted faces, test orientation and lighting direction interacted for positive-contrast faces. Negative faces showed only an effect of direction of lighting. These results support Enns and Shore's two-stage model and their interpretation that orientation and direction of lighting interact following featural encoding of faces.     

The representations of spacing and part-based information are associated for upright faces but dissociated for objects: Evidence from individual differences

Considerable evidence suggests that qualitatively different processes are involved in the perception of faces and objects. According to a central hypothesis, the extraction of information about the spacing among face parts (e.g., eyes and mouth) is a primary function of face processing mechanisms that is dissociated from the extraction of information about the shape of these parts. Here, we used an individual-differences approach to test whether the shape of face parts and the spacing among them are indeed processed by dissociated mechanisms. To determine whether the pattern of findings that we reveal is unique for upright faces, we also presented similarly manipulated nonface stimuli. Subjects discriminated upright or inverted faces or houses that differed in parts or spacing. Only upright faces yielded a large positive correlation across subjects between performance on the spacing and part discrimination tasks. We found no such correlation for inverted faces or houses. Our findings suggest that face parts and spacing are processed by associated mechanisms, whereas the parts and spacing of nonface objects are processed by distinct mechanisms. These results may be consistent with the idea that faces are special, in that they are processed as nondecomposable wholes.     

Color-luminance relationships and the McCollough effect

The McCollough effect is an orientation-specific color aftereffect induced by adapting to colored gratings. We examined how the McCollough effect depends on the relationships between color and luminance within the inducing and test gratings and compared the aftereffects to the color changes predicted from selective adaptation to different color-luminance combinations. Our results suggest that the important contingency underlying the McCollough effect is between orientation and color-luminance direction and are consistent with sensitivity changes within mechanisms tuned to specific color-luminance directions. Aftereffects are similar in magnitude for adapting color pairs that differ only in S cone excitation or L and M cone excitation, and they have a similar dependence on spatial frequency. In particular, orientation-specific aftereffects are induced for S cone colors even when the grating frequencies are above the S cone resolution limit. Thus, the McCollough effect persists even when different cone classes encode the orientation and color of the gratings.     

Aftereffects for face attributes with different natural variability: adapter position effects and neural models

Adaptation to distorted faces is commonly interpreted as a shift in the face-space norm for the adapted attribute. This article shows that the size of the aftereffect varies as a function of the distortion level of the adapter. The pattern differed for different facial attributes, increasing with distortion level for symmetric deviations of eye height and decreasing for asymmetric deviations. These results are interpreted in terms of different coding ranges for the 2 facial attributes, arising from differences in eye-height variability in natural face images (large for symmetric, small for asymmetric). Neural models developed in low-level vision also are applied to facial attributes, contrasting a 2-pool (norm-based) and a multichannel (exemplar-based) model. The adapter position effects generally support a norm-based model, as did a finding that perception of stimuli further from the norm than the adapter was shifted in the direction of the norm, rather than repulsed away from the adapter.     

Adaptation to spiral motion in crowding condition

When a single, moving stimulus is presented in the peripheral visual field, its direction of motion can be easily distinguished, but when the same stimulus is flanked by other similar moving stimuli, observers are unable to report its direction of motion. In this condition, known as 'crowding', specific features of visual stimuli do not access conscious perception. The aim of this study was to investigate whether adaptation to spiral motion is preserved in crowding conditions. Logarithmic spirals were used as adapting stimuli. A rotating spiral stimulus (target spiral) was presented, flanked by spirals of the same type, and observers were adapted to its motion. The observers' task was to report the rotational direction of a directionally ambiguous motion (test stimulus) presented afterwards. The directionally ambiguous motion consisted of a pair of spirals flickering in counterphase, which were mirror images of the target spiral. Although observers were not aware of the rotational direction of the target and identified it at chance levels, the direction of rotation reported by the observers during the test phase (motion aftereffect) was contrarotational to the direction of the adapting spiral. Since all contours of the adapting and test stimuli were 90 degrees apart, local motion detectors tuned to the directions of the mirror-image spiral should fail to respond, and therefore not adapt to the adapting spiral. Thus, any motion aftereffect observed should be attributed to adaptation of global motion detectors (ie rotation detectors). Hence, activation of rotation-selective cells is not necessarily correlated with conscious perception.     

Privileged detection of conspecifics: Evidence from inversion effects during continuous flash suppression

The rapid visual detection of other people in our environment is an important first step in social cognition. Here we provide evidence for selective sensitivity of the human visual system to upright depictions of conspecifics. In a series of seven experiments, we assessed the impact of stimulus inversion on the detection of person silhouettes, headless bodies, faces and other objects from a wide range of animate and inanimate control categories. We used continuous flash suppression (CFS), a variant of binocular rivalry, to render stimuli invisible at the beginning of each trial and measured the time upright and inverted stimuli needed to overcome such interocular suppression. Inversion strongly interfered with access to awareness for human faces, headless human bodies, person silhouettes, and even highly variable body postures, while suppression durations for control objects were not (inanimate objects) or only mildly (animal faces and bodies) affected by inversion. Furthermore, inversion effects were eliminated when the normal body configuration was distorted. The absence of strong inversion effects in a binocular control condition not involving interocular suppression suggests that non-conscious mechanisms mediated the effect of inversion on body and face detection during CFS. These results indicate that perceptual mechanisms that govern access to visual awareness are highly sensitive to the presence of conspecifics.     

The development of spatial frequency biases in face recognition

Previous research has suggested that a mid-band of spatial frequencies is critical to face recognition in adults, but few studies have explored the development of this bias in children. We present a paradigm adapted from the adult literature to test spatial frequency biases throughout development. Faces were presented on a screen with particular spatial frequencies blocked out by noise masks. A mid-band bias was found in adults and 9- and 10-year-olds for upright faces but not for inverted faces, suggesting a face-sensitive effect. However, 7- and 8-year-olds did not demonstrate the mid-band bias for upright faces but rather processed upright and inverted faces similarly. This suggests that specialization toward the mid-band for upright face recognition develops gradually during childhood and may relate to an advanced level of face expertise.