Effect of image orientation on the eye direction aftereffect

After observing a face with the eyes looking to the left or right (adaptation stimulus), the perception of the eye direction of the subsequent face (test stimulus) is biased in the opposite direction of the adapted eye direction; this is called the eye direction aftereffect (EDAE). In the present study, the adaptation stimuli were rotated 90° (clockwise or counterclockwise) or 180° relative to the viewer. The EDAE was measured using upright test stimuli. For the 90° rotation, prior observation of the leftward and rightward eye directions biased the perceived eye directions of the upright test stimuli to the right and left, respectively. These results suggest that the adaptation was induced utilizing an object-based (or face-based) reference frame. For the 180° rotation, however, the results suggest that the adaptation was induced in a viewer-centered reference frame. The involvement of an object-based reference frame suggests that the EDAE reflected the adaptation of a relatively higher-level mechanism at least when the rotation angle from the upright position did not exceed 90°.     

Discrimination of faces and houses by rhesus monkeys: the role of stimulus expertise and rotation angle

The face inversion effect, or impaired recognition of upside down compared to upright faces, is used as a marker for the configural processing of faces in primates. The inversion effect in humans and chimpanzees is strongest for categories of stimuli for which subjects have considerable expertise, primarily conspecifics’ faces. Moreover, discrimination performance decreases linearly as faces are incrementally rotated from upright to inverted. This suggests that rotated faces must be transformed, or normalized back into their most typical viewpoint before configural processing can ensue, and the greater the required normalization, the greater the likelihood of errors resulting. Previous studies in our lab have demonstrated a general face inversion effect in rhesus monkeys that was not influenced by expertise. Therefore, the present study examined the influence of rotation angle on the visual perception of face and nonface stimuli that varied in their level of expertise to further delineate the processes underlying the inversion effect in rhesus monkeys. Five subjects discriminated images in five orientation angles. Results showed significant linear impairments for all stimulus categories, including houses. However, compared to the upright images, only rhesus faces resulted in worse performance at rotation angles greater than 45°, suggesting stronger configural processing for stimuli for which subjects had the greatest expertise.     

Effect of inversion on the recognition of external and internal facial features

The purpose of the present study was to find out whether inversion affects recognition of external and internal facial features. 24 participants matched, under two experimental conditions (pair and multiple-choice matchings), upright target faces with three categories of facial test stimuli: full faces, external features and internal features, which were presented in either upright or inverted orientations. Data analysis showed that matching of facial stimuli was faster, more accurate and more consistent under upright than under inverted orientations for all stimulus categories; mostly for full faces, and least for internal features. As a rule, there were no speed-accuracy trade-offs. Implications of the data for accounts of the inversion effect in face recognition in terms of a shift from configurational to componential processing were discussed.     

Discrimination learning of rotated faces: a Markov analysis of coding and association processes]

30 subjects participated in a discrimination experiment learning face-letter associations under four rotation conditions (45 degrees, 90 degrees, 135 degrees, 180 degrees). Under each condition two thirds of the faces were presented twice, upright and rotated away from the vertical; the remaining faces were presented once, upright or rotated. Learning is described by a joint Markov model: For faces that are presented twice it assumes a separate association and encoding process (two-stage-model), for faces that are presented once it assumes an association process (all-or-none-model). The Markov model fits the data for all four rotation conditions. The angle of rotation does not affect learning for faces that are presented once. For faces that are presented twice it influences both the association and the encoding process. For the angles employed, the effect of rotation can be approximated linearly. The results suggest that the encoding of a rotated face differs increasingly from an upright face as a function of these angles of rotation. This confirms analogous conclusions from mental rotation experiments.     

Effects of multimodal presentation and stimulus familiarity on auditory and visual processing

Two experiments examined the effects of multimodal presentation and stimulus familiarity on auditory and visual processing. In Experiment 1, 10-month-olds were habituated to either an auditory stimulus, a visual stimulus, or an auditory-visual multimodal stimulus. Processing time was assessed during the habituation phase, and discrimination of auditory and visual stimuli was assessed during a subsequent testing phase. In Experiment 2, the familiarity of the auditory or visual stimulus was systematically manipulated by prefamiliarizing infants to either the auditory or visual stimulus prior to the experiment proper. With the exception of the prefamiliarized auditory condition in Experiment 2, infants in the multimodal conditions failed to increase looking when the visual component changed at test. This finding is noteworthy given that infants discriminated the same visual stimuli when presented unimodally, and there was no evidence that multimodal presentation attenuated auditory processing. Possible factors underlying these effects are discussed.     

Pre-verbal infants perceive emotional facial expressions categorically

Adults perceive emotional expressions categorically, with discrimination being faster and more accurate between expressions from different emotion categories (i.e. blends with two different predominant emotions) than between two stimuli from the same category (i.e. blends with the same predominant emotion). The current study sought to test whether facial expressions of happiness and fear are perceived categorically by pre-verbal infants, using a new stimulus set that was shown to yield categorical perception in adult observers (Experiments 1 and 2). These stimuli were then used with 7-month-old infants (N = 34) using a habituation and visual preference paradigm (Experiment 3). Infants were first habituated to an expression of one emotion, then presented with the same expression paired with a novel expression either from the same emotion category or from a different emotion category. After habituation to fear, infants displayed a novelty preference for pairs of between-category expressions, but not within-category ones, showing categorical perception. However, infants showed no novelty preference when they were habituated to happiness. Our findings provide evidence for categorical perception of emotional expressions in pre-verbal infants, while the asymmetrical effect challenges the notion of a bias towards negative information in this age group.     

自我旋转面孔识别的ERPs研究

本研究采用事件相关电位技术考察平面旋转角度对自我面孔识别影响的时间进程。实验采用面孔异同匹配范式(same-different judgment), 首先呈现一张正立的自我或他人内特征的探测面孔, 然后再呈现一张旋转至某个角度(0°、90°、180°)的自我或他人的目标面孔, 要求被试判断两张面孔是否属于同一个人, 并记录其判断的反应时和ERP成分。实验发现, 在N170 (180~240 ms)和N2 (240~300 ms)成分上, 旋转至90°、180°的面孔刺激比正立条件下的面孔刺激分别在枕颞叶和额区诱发了更大的平均波幅。在LPP (400~500 ms)成分上, 对于自我面孔, 正立条件、旋转至90°、旋转至180°所诱发的波幅差异显著。而对于他人面孔, 3个角度所诱发的波幅无显著差异。结果表明, 面孔识别早期阶段是自动化的结构编码, 旋转角度增加了面孔结构编码的难度; 在面孔识别晚期阶段, 大脑对面孔的特异性信息进行精细加工, 自我面孔会占用个体有限认知资源进行下一步精细的心理旋转加工, 因此平面旋转角度会调节晚期个体对自我面孔的加工过程, 并且其影响时间约为100 ms。     

The Thatcher illusion: rotating the viewer instead of the picture

Faces are difficult to recognise when presented upside down. This effect of face inversion was effectively demonstrated with the 'Thatcher illusion' by Thompson (1980 Perception 9 483-484). It has been tacitly assumed that this effect is due to inversion relative to retinal coordinates. Here we tested whether it is due to egocentric (i.e. retinal) inversion or whether the orientation of the body with respect to gravity also influences the face-inversion effect. A 3-D human turntable was used to test subjects in 5 different body-tilt (roll) orientations: 0 degree, 45 degrees, 90 degrees, 135 degrees, and 180 degrees. The stimuli consisted of 4 'normal' and 4 'thatcherised' faces and were presented in 8 different orientations in the picture plane. The subjects had to decide in a yes-no task whether the faces were 'normal' or 'thatcherised'. Analysis of the d' values revealed a significant effect of stimulus orientation and body tilt. The significant effect of body tilt was due to a drop in d' values in the 135 degrees orientation. This result is compared to findings of studies on the subjective visual vertical, where larger errors occurred in body-tilt orientations between 90 degrees and 180 degrees. The present findings suggest that the face-inversion effect relies mainly on retinal coordinates, but that in head-down body-tilt orientations around 135 degrees the gravitational reference frame has a major influence on the perception of faces.     

Multistability of overlapped face stimuli is dependent upon orientation

Stimuli composed of two overlapped faces, one rotated 45 degrees clockwise and the other 45 degrees counterclockwise, produce perceptual rivalry whereby both faces cannot be simultaneously perceived. We obtained subjective and quantitative measures of this rivalry effect and examined if it persists with inverted stimuli. Our results show that upright stimuli are multistable, with alternations occurring from one face to the other within 2 s. Inverted stimuli were instead perceived as ambiguous in half of the trials, indicating weaker perceptual rivalry in that condition. We suggest that overlapped faces produce perceptual rivalry because each face is readily interpreted into a Gestalt, an effect that in turn is dependent upon orientation.     

Apparent reversals of a rotating mask: a new demonstration of cognition in perception.

A mask of a face rotated about its vertical axis of symmetry can appear to oscillate rather than rotate. Do stimulus features (e.g., shape) or cognitive factors (e.g., differential familiarity with convex and concave views of faces) explain this new illusion? In Experiment 1, differential familiarity was varied across stimuli by using familiar and unfamiliar objects rotating at 4 rpm and within stimuli by showing the objects upright and inverted. True motion was seen more with unfamiliar objects than with familiar objects and more with an inverted mask than with an upright mask. The results of Experiment 2, which was done with static views, suggest that the upright and inverted masks present similar structure to the visual system. In Experiment 3, the objects were shown rotating at 8 rpm; the results are similar to those of Experiment 1. These experiments favor a differential familiarity account of this illusory motion. Cognitive constraints on perceived motion and perceived rigidity are discussed.     

Apparent reversals of a rotating mask: A new demonstration of cognition in perception

A mask of a face rotated about its vertical axis of symmetry can appear to oscillate rather than rotate. Do stimulus features (e.g., shape) or cognitive factors (e.g., differential familiarity with convex and concave views of faces) explain this new illusion? In Experiment 1, differential familiarity was varied across stimuli by using familiar and unfamiliar objects rotating at 4 rpm and within stimuli by showing the objects upright and inverted. True motion was seen more with unfamiliar objects than with familiar objects and more with an inverted mask than with an upright mask. The results of Experiment 2, which was done with static views, suggest that the upright and inverted masks present similar structure to the visual system. In Experiment 3, the objects were shown rotating at 8 rpm; the results are similar to those of Experiment 1. These experiments favor a differential familiarity account of this illusory motion. Cognitive constraints on perceived motion and perceived rigidity are discussed.     

An inversion effect modified by expertise in capuchin monkeys

The face inversion effect may be defined as the general impairment in recognition that occurs when faces are rotated 180°. This phenomenon seems particularly strong for faces as opposed to other objects and is often used as a marker of a specialized face-processing mechanism. Four brown capuchin monkeys (Cebus apella) were tested on their ability to discriminate several classes of facial and non-facial stimuli presented in both their upright and inverted orientations in an oddity task. Results revealed significantly better performance on upright than inverted presentations of capuchin and human face stimuli, but not on chimpanzee faces or automobiles. These data support previous studies in humans and other primates suggesting that the inversion effect occurs for stimuli for which subjects have developed an expertise.     

New evidence for infant colour categories

Bornstein, Kessen, and Weiskopf (1976) reported that pre‐linguistic infants perceive colour categorically for primary boundaries: Following habituation, dishabituation only occurred if the test stimulus was from a different adult category to the original. Here, we replicated this important study and extended it to include secondary boundaries, with a crucial modification: The separations between habituated and novel stimuli were equated in a perceptually uniform metric (Munsell), rather than in wavelength. Experiment 1 found Categorical Perception and no within‐category novelty preference for primary boundary blue‐green and secondary boundary blue‐purple. Experiment 2 replicated the categorical effect for blue‐purple and found no within‐category novelty preference with increased stimulus separation. Experiment 3 showed category effects for a lightness/saturation boundary, pink‐red. Novelty preference requires a categorical difference between the habituated and novel stimulus. The implications for the origin of linguistic colour categories are discussed.     

Face processing in humans and new world monkeys: the influence of experiential and ecological factors

This study tests whether the face-processing system of humans and a nonhuman primate species share characteristics that would allow for early and quick processing of socially salient stimuli: a sensitivity toward conspecific faces, a sensitivity toward highly practiced face stimuli, and an ability to generalize changes in the face that do not suggest a new identity, such as a face differently oriented. The look rates by adult tamarins and humans toward conspecific and other primate faces were examined to determine if these characteristics are shared. A visual paired comparison (VPC) task presented subjects with either a human face, chimpanzee face, tamarin face, or an object as a sample, and then a pair containing the previous stimulus and a novel stimulus was presented. The stimuli were either presented all in an upright orientation, or all in an inverted orientation. The novel stimulus in the pair was either an orientation change of the same face/object or a new example of the same type of face/object, and the stimuli were shown either in an upright orientation or in an inverted orientation. Preference to novelty scores revealed that humans attended most to novel individual human faces, and this effect decreased significantly if the stimuli were inverted. Tamarins showed preferential looking toward novel orientations of previously seen tamarin faces in the upright orientation, but not in an inverted orientation. Similarly, their preference to look longer at novel tamarin and human faces within the pair was reduced significantly with inverted stimuli. The results confirmed prior findings in humans that novel human faces generate more attention in the upright than in the inverted orientation. The monkeys also attended more to faces of conspecifics, but showed an inversion effect to orientation change in tamarin faces and to identity changes in tamarin and human faces. The results indicate configural processing restricted to particular kinds of primate faces by a New World monkey species, with configural processing influenced by life experience (human faces and tamarin faces) and specialized to process orientation changes specific to conspecific faces.     

The effect of face inversion on the detection of emotional faces in visual search

Past literature has indicated that face inversion either attenuates emotion detection advantages in visual search, implying that detection of emotional expressions requires holistic face processing, or has no effect, implying that expression detection is feature based. Across six experiments that utilised different task designs, ranging from simple (single poser, single set size) to complex (multiple posers, multiple set sizes), and stimuli drawn from different databases, significant emotion detection advantages were found for both upright and inverted faces. Consistent with past research, the nature of the expression detection advantage, anger superiority (Experiments 1, 2 and 6) or happiness superiority (Experiments 3, 4 and 5), differed across stimulus sets. However both patterns were evident for upright and inverted faces. These results indicate that face inversion does not interfere with visual search for emotional expressions, and suggest that expression detection in visual search may rely on feature-based mechanisms.     

Rotating objects to determine orientation, not identity: evidence from a backward-masking/dual-task procedure

The effects of picture-plane rotations on times taken to name familiar objects (RTs) may reflect a process of mental rotation to stored viewpoint-specific representations: the rotate-to-recognize hypothesis. Alternatively, mental rotation might be used after stored object representations are activated by a misoriented stimulus in order to verify a weak or distorted shape percept: the double-checking hypothesis. We tested these two accounts of rotation effects in object recognition by having subjects verify the orientations (to within 90 degrees) and basic-level names of 14-msec, backward-masked depictions of common objects. The stimulus-mask interval (SOA) varied from 14 to 41 msec, permitting interpolation of the SOA required for 75% accuracy (SOAc). Whereas the SOAc to verify orientation increased with rotation up to 180 degrees, the SOAc to verify identity was briefer and asymptoted at approximately 60 degrees. We therefore reject the rotate-to-recognize hypothesis, which implies that SOAc should increase steadily with rotation in both tasks. Instead, we suggest that upright and near-upright stimuli are matched by a fast direct process and that misoriented stimuli are matched at a featural level by a slightly slower view-independent process. We also suggest that rotation effects on RTs reflect a postrecognition stage of orientation verification: the rotate-to-orient hypothesis, a version of double-checking that also explains the well-known reduction in orientation effects on RTs when naming repeated objects.     

A sideways look at configural encoding: two different effects of face rotation

Inversion has a disproportionate disruptive effect on the recognition of faces. This may be due to the disruption of holistic or configural encoding employed to recognise upright faces. The paradigm developed by Tanaka and Farah (1993 Quarterly Journal of Experimental Psychology, Section A 46 225-246) was used to investigate the effect of 90 degrees (or orthogonal) rotation on configural encoding. Faces learnt in the orthogonal condition were not recognised as well as upright faces, but a whole-face advantage was found in both cases. This whole-face advantage did not occur for inverted faces. It appears that 90 degrees rotation affects recognition but not specifically configural encoding. It is concluded that rotating a face can have at least two different effects on face processing depending on the range of rotation. Implications for the nature of facial dimensions and the expertise account of the inversion effect are considered.     

Faces retain attention

In the present study, we investigated whether faces have an advantage in retaining attention over other stimulus categories. In three experiments, subjects were asked to focus on a central go/no-go signal before classifying a concurrently presented peripheral line target. In Experiment 1, the go/no-go signal could be superimposed on photographs of upright famous faces, matching inverted faces, or meaningful objects. Experiments 2 and 3 tested upright and inverted unfamiliar faces, printed names, and another class of meaningful objects in an identical design. A fourth experiment provided a replication of Experiment 1, but with a 1,000-msec stimulus onset asynchrony between the onset of the central face/nonface stimuli and the peripheral targets. In all the experiments, the presence of an upright face significantly delayed target response times, in comparison with each of the other stimulus categories. These results suggest a general attentional bias, so that it is particularly difficult to disengage processing resources from faces.     

The role of eyes in early face processing: a rapid adaptation study of the inversion effect

The current study employed a rapid adaptation procedure to test the neuronal mechanisms of the face inversion effect (FIE) on the early face-sensitive event-related potential (ERP) component N170. Five categories of face-related stimuli (isolated eyes, isolated mouths, eyeless faces, mouthless faces, and full faces) and houses were presented in upright and inverted orientations as adaptors for inverted full face test stimuli. Strong adaptation was found for all face-related stimuli except mouths. The adaptation effect was larger for inverted than upright stimuli, but only when eyes were present. These results underline an important role of eyes in early face processing. A mechanism of eye-dependent orientation sensitivity during the structural encoding stage of faces is proposed.     

Fine orientation discrimination and shape constancy in young infants

The present study aimed to investigate simultaneously fine orientation discrimination and shape constancy in young infants. The design employed two variants of the habituation paradigm. Infants in one group were habituated to a single orientation (5 or 15 degrees) of a single stimulus presented repeatedly, and they were then tested with the complementary orientation (15 or 5 degrees). Infants in a second group were habituated to several orientations (5, 10, and 15 degrees) of the same stimulus, and they were then tested with a familiar orientation of the stimulus, with two novel orientations of the same stimulus, and with a new stimulus. Between-groups comparison showed that infants habituated more efficiently to re-presentations of a single orientation than to multiple orientations of the same stimulus, providing evidence of fine orientation discrimination; posthabituation comparison within the single-orientation group confirmed that infants discriminated small orientation changes. Posthabituation comparison within the multiple-orientation group showed that infants generalized over novel orientation changes of the familiar stimulus though they discriminated change to a novel stimulus. Cumulatively, the results of this study demonstrate that under one set of conditions young infants show sensitivity to relatively fine variations in pattern orientation, but that under a different set of conditions young infants give evidence of shape constancy with the same patterns.