Data‐driven approaches to information access

This paper summarizes three lines of research that are motivated by the practical problem of helping users find information from external data sources, most notably computers. The application areas include information retrieval, text categorization, and question answering. A common theme in these applications is that practical information access problems can be solved by analyzing the statistical properties of words in large volumes of real world texts. The same statistical properties constrain human performance, thus we believe that solutions to practical information access problems can shed light on human knowledge representation and reasoning.     

Oxytocin attenuates racial categorization in 14-month-old infants

Intergroup bias – the preferential attitudes one holds towards one's social group – is a ubiquitous socio-cognitive phenomenon. In fact, studies show that already in the first months of life, infants manifest a preference for members of their own social group. This points to the possibility of inborn mechanisms involved in social group cognition. Here we assess the effect of a biological activation of infants’ affiliative motivation on their social categorization capacity. In a first visit to the lab, mothers self-administered either Oxytocin (OT) or placebo (PL) via a nasal spray and then engaged in a face-to-face interaction with their 14-month-old infants, a procedure previously shown to increase OT levels in infants. Infants then performed a racial categorization task presented on an eye-tracker. Mothers and infants returned a week later and repeated the procedure while self-administering the complementary substance (i.e., PL or OT, respectively). In total, 24 infants completed the two visits. We found that whereas infants in the PL condition on the first visit exhibited racial categorization, infants in the OT condition in their first visit did not. Moreover, these patterns remained a week later despite the change in substance. Thus, OT inhibited racial categorization when infants first encountered the to-be-categorized faces. These findings highlight the role of affiliative motivation in social categorization, and suggest that the neurobiology of affiliation may provide insights on mechanisms that may be involved in the downstream prejudicial consequences of intergroup bias.     

Immediate and long-term retention of basic-level categories in 24-month-olds

This study assessed the effect of presenting single versus multiple exemplars of basic-level categories on 24-month-olds' long-term memory for categorical information. Sixty-four infants were tested in a paired-comparison recognition memory paradigm immediately and one week after familiarization with basic-level categories. Infants were randomly assigned to one of two familiarization conditions and one of two test conditions. In one familiarization condition (Varied Exemplar), they briefly viewed four different exemplars of each of 16 basic-level categories. In the other familiarization condition (Single Exemplar), they viewed only one instance of each category on four different trials. Test trials consisted of either an exemplar seen during familiarization (Familiar-Exemplar Test) or novel intracategory exemplar (Unfamiliar-Exemplar Test) paired with a stimulus from a novel category. Both immediately following familiarization and one week later, infants looked longer at test stimuli from the novel category irrespective of familiarization or test condition.     

Ensemble coding of facial identity is not refined by experience: Evidence from other-race and inverted faces

The ability to recognize identity despite within-person variability in appearance is likely a face-specific skill and shaped by experience. Ensemble coding – the automatic extraction of the average of a stimulus array – has been proposed as a mechanism underlying face learning (allowing one to recognize novel instances of a newly learned face). We investigated whether ensemble encoding, like face learning and recognition, is refined by experience by testing participants with upright own-race faces and two categories of faces with which they lacked experience: other-race faces (Experiment 1) and inverted faces (Experiment 2). Participants viewed four images of an unfamiliar identity and then were asked whether a test image of that same identity had been in the study array. Each test image was a matching exemplar (from the array), matching average (the average of the images in the array), non-matching exemplar (a novel image of the same identity), or non-matching average (an average of four different images of the same identity). Adults showed comparable ensemble coding for all three categories (i.e., reported that matching averages had been present more than non-matching averages), providing evidence that this early stage of face learning is not shaped by face-specific experience.     

Automatic gaze to the nose region cannot be inhibited during observation of facial expression in Eastern observers

Humans can extract a great deal of information about others very quickly. This is partly because the face automatically captures observers’ attention. Specifically, the eyes can attract overt attention. Although it has been reported that not only the eyes but also the nose can capture initial oculomotor movement in Eastern observers, its generalizability remains unknown. In this study, we applied the “don’t look” paradigm wherein participants are asked not to fixate on a specific facial region (i.e., eyes, nose, and mouth) during an emotion recognition task with upright (Experiment 1) and inverted (Experiment 2) faces. In both experiments, we found that participants were less able to inhibit the initial part of their fixations to the nose, which can be interpreted as the nose automatically capturing attention. Along with previous studies, our overt attention tends to be attracted by a part of the face, which is the nose region in Easterner observers.     

Emotional facial expressions affect visual rule learning in 7- to 8-month-old infants

Rule learning (RL) is an implicit learning mechanism that allows infants to detect and generalize rule-like repetition-based patterns (such as ABB and ABA) from a sequence of elements. Increasing evidence shows that RL operates both in the auditory and the visual domain and is modulated by the perceptual expertise with the to-be-learned stimuli. Yet, whether infants’ ability to detect a high-order rule from a sequence of stimuli is affected by affective information remains a largely unexplored issue. Using a visual habituation paradigm, we investigated whether the presence of emotional expressions with a positive and a negative value (i.e., happiness and anger) modulates 7- to 8-month-old infants’ ability to learn a rule-like pattern from a sequence of faces of different identities. Results demonstrate that emotional facial expressions (either positive and negative) modulate infants’ visual RL mechanism, even though positive and negative facial expressions affect infants’ RL in a different manner: while anger disrupts infants’ ability to learn the rule-like pattern from a face sequence, in the presence of a happy face infants show a familiarity preference, thus maintaining their learning ability. These findings show that emotional expressions exert an influence on infants’ RL abilities, contributing to the investigation on how emotion and cognition interact in face processing during infancy.     

Image-size disparity reduces difference detection in face matching

Face matching is the act of deciding whether two facial images depict the same person or different people. The real-world face-matching task of checking photo IDs typically occurs under conditions of image-size disparity: A small picture is compared with a life-size face. We examined the effect of image-size disparity on face-matching accuracy. In three experiments, subjects were presented with pairs of equivalently or disparately sized images that depicted the same person or different people. Subjects made same/different judgments and, in two experiments, also reported confidence. Difference detection was significantly poorer given disparate (versus equivalent) image size. Confidence was significantly higher when responses were correct versus incorrect. These findings held whether viewing and decision time was unlimited or limited. Our results raise the practical concern that image-size disparity may undermine difference detection in ID checking, while also indicating that people have some insight into the accuracy of their face-matching judgments.