A rational analysis of the acquisition of multisensory representations

How do people learn multisensory, or amodal, representations, and what consequences do these representations have for perceptual performance? We address this question by performing a rational analysis of the problem of learning multisensory representations. This analysis makes use of a Bayesian nonparametric model that acquires latent multisensory features that optimally explain the unisensory features arising in individual sensory modalities. The model qualitatively accounts for several important aspects of multisensory perception: (a) it integrates information from multiple sensory sources in such a way that it leads to superior performances in, for example, categorization tasks; (b) its performances suggest that multisensory training leads to better learning than unisensory training, even when testing is conducted in unisensory conditions; (c) its multisensory representations are modality invariant; and (d) it predicts ‘‘missing” sensory representations in modalities when the input to those modalities is absent. Our rational analysis indicates that all of these aspects emerge as part of the optimal solution to the problem of learning to represent complex multisensory environments.     

Online recognition of music is influenced by relative and absolute pitch information

Three experiments explored online recognition in a nonspeech domain, using a novel experimental paradigm. Adults learned to associate abstract shapes with particular melodies, and at test they identified a played melody's associated shape. To implicitly measure recognition, visual fixations to the associated shape versus a distractor shape were measured as the melody played. Degree of similarity between associated melodies was varied to assess what types of pitch information adults use in recognition. Fixation and error data suggest that adults naturally recognize music, like language, incrementally, computing matches to representations before melody offset, despite the fact that music, unlike language, provides no pressure to execute recognition rapidly. Further, adults use both absolute and relative pitch information in recognition. The implicit nature of the dependent measure should permit use with a range of populations to evaluate postulated developmental and evolutionary changes in pitch encoding.     

Color charts, esthetics, and subjective randomness

Color charts, or grids of evenly spaced multicolored dots or squares, appear in the work of modern artists and designers. Often the artist/designer distributes the many colors in a way that could be described as "random," that is, without an obvious pattern. We conduct a statistical analysis of 125 "random-looking" art and design color charts and show that they differ significantly from truly random color charts in the average distance between adjacent colors. We argue that this attribute generalizes results in subjective randomness in a black/white setting and gives further evidence supporting a connection between subjective randomness and what is esthetically pleasing.     

Liking and identifying emotionally expressive music: age and gender differences

Adults and children 5, 8, and 11 years of age listened to short excerpts of unfamiliar music that sounded happy, scary, peaceful, or sad. Listeners initially rated how much they liked each excerpt. They subsequently made a forced-choice judgment about the emotion that each excerpt conveyed. Identification accuracy was higher for young girls than for young boys, but both genders reached adult-like levels by age 11. High-arousal emotions (happiness and fear) were better identified than low-arousal emotions (peacefulness and sadness), and this advantage was exaggerated among younger children. Whereas children of all ages preferred excerpts depicting high-arousal emotions, adults favored excerpts depicting positive emotions (happiness and peacefulness). A preference for positive emotions over negative emotions was also evident among females of all ages. As identification accuracy improved, liking for positively valenced music increased among 5- and 8-year-olds but decreased among 11-year-olds.     

Happy to See Me,Aren’t You,Sally? Signal Detection Analysis of Emotion Detection in Briefly Presented Male and Female Faces

Using signal detection methods, possible effects of emotion type (happy, angry), gender of the stimulus face, and gender of the participant on the detection and response bias of emotion in briefly presented faces were investigated. Fifty-seven participants (28 men, 29 women) viewed 90 briefly presented faces (30 happy, 30 angry, and 30 neutral, each with 15 male and 15 female faces) answering yes if the face was perceived as emotional and no if it was not perceived as emotional. Sensitivity [d', z(hit rate) minus z(false alarm rate)] and response bias (β, likelihood ratio of "signal plus noise" vs. "noise") were measured for each face combination for each presentation time (6.25, 12.50, 18.75, 25.00, 31.25 ms). The d' values were higher for happy than for angry faces and higher for angry-male than for angry-female faces, and there were no effects of gender-of-participant. Results also suggest a greater tendency for participants to judge happy-female faces as emotional, as shown by lower β values for these faces as compared to the other emotion-gender combinations. This happy-female response bias suggests, at least, a partial explanation to happy-superiority effects in studies where performance is only measured as percent correct responses, and, in general, that women are expected to be happy.     

Time perception in response to ashamed faces in children and adults

The present study investigated the effect of the perception of faces expressing shame on time perception in children aged 5 and 8 years, as well as in adults, as a function of their ability to recognize this emotional expression. The participants' ability to recognize the expression of shame among faces expressing different emotions was tested. They were then asked to perform a temporal bisection task involving both neutral and ashamed faces. The results showed that, from the age of 8 years, the participants who recognized the facial expressions of shame underestimated their presentation time compared to that of neutral faces. In contrast, no time distortion was observed in the children who did not recognize the ashamed faces or in those younger children who did recognize them. The results are discussed in terms of self-conscious emotions which develop to involve an attentional mechanism.     

Validation of the Revised Illness Perception Questionnaire (IPQ-R) in a sample of persons recovering from myocardial infarction--the Swedish version

When people's health is threatened, they generally develop illness perceptions to make sense of their illness. The Illness Perception Questionnaire (IPQ-R), developed by Moss-Morris et al (2002), has been widely used in many countries to measure such representations. However, since studies in this crucial research area are lacking in Sweden a Swedish version of IPQ-R was validated with a focus on the seven subscales: timeline acute/chronic, timeline cyclical, consequences, personal control, treatment control, illness coherence and emotional representations. Using confirmatory factor analysis, the aim of the present study was to validate the internal structure of the Swedish version in a sample of 202 persons (144 men and 58 women) who had been diagnosed with myocardial infarction four months earlier. Additionally, inter-correlations among the seven subscales and external concurrent validity were also investigated. The results of confirmatory factor analysis revealed that, in line with the English version of the IPQ-R, the specified seven-factor model had a satisfactory fit. One item was however not considered reliable and was therefore excluded from the instrument. The internal consistency (Cronbach's alpha coefficients) and the inter-factor correlations were relatively similar to those reported in the validation study of the original English IPQ-R. In tests of concurrent validity, the seven IPQ-R subscales were, as hypothesized, mainly associated with external variables. To conclude, the Swedish version of the IPQ-R's seven dimensions, with one item removed, (total 37 items) was found to be a reliable and valid measure of illness perception.     

Multiple group membership influences face-recognition: Recall and neurological evidence

The limited face-recognition research involving targets categorizable on multiple dimensions has provided contradictory evidence as to how partial-ingroup members are processed and recognized. This research demonstrates that partial-ingroup members are recognized in a manner distinct from double-ingroup and double-outgroup targets. Specifically, when race and university-affiliation are crossed, university-affiliation does not influence recognition for own-race targets, but does for other-race targets, in that other-race/own-university targets are recalled more accurately than other-race/other-university targets. The neurological mechanisms involved in the effect are explored through the inclusion of electroencephalography.     

I know you're me, but who am I? Perspective taking and seeing the other in the self

Research examining the consequences of perspective-taking on cognition suggests that through perceiver–target overlap, perspective-taking can lead to greater valuing of targets, greater helping of targets, and a reduction in stereotyping of targets and the groups to which they belong. Research has also begun to focus more closely on the ways perceivers come to think and act like targets. This research, however evocative, is not conclusive. The current studies set out to provide firmer support. Reported here, two studies found that perspective-taking influences perceiver–target overlap, which mediates changes in self-concept (ratings of the self on researcher-related attributes and beliefs after taking the perspective of a researcher in Study 1 and attitudes toward African Americans after taking the perspective of a racist in Study 2). In the same studies, overlap simultaneously mediated valuing of the targets (target ratings on positive attributes in Study 1 and liking for the target in Study 2).