Attention and the multiple stages of multisensory integration: A review of audiovisual studies

Multisensory integration and crossmodal attention have a large impact on how we perceive the world. Therefore, it is important to know under what circumstances these processes take place and how they affect our performance. So far, no consensus has been reached on whether multisensory integration and crossmodal attention operate independently and whether they represent truly automatic processes. This review describes the constraints under which multisensory integration and crossmodal attention occur and in what brain areas these processes take place. Some studies suggest that multisensory integration and crossmodal attention take place in higher heteromodal brain areas, while others show the involvement of early sensory specific areas. Additionally, the current literature suggests that multisensory integration and attention interact depending on what processing level integration takes place. To shed light on this issue, different frameworks regarding the level at which multisensory interactions takes place are discussed. Finally, this review focuses on the question whether audiovisual interactions and crossmodal attention in particular are automatic processes. Recent studies suggest that this is not always the case. Overall, this review provides evidence for a parallel processing framework suggesting that both multisensory integration and attentional processes take place and can interact at multiple stages in the brain.     

Gaze avoidance in social phobia: Objective measure and correlates

Gaze aversion could be a central component of the physiopathology of social phobia. The emotions of the people interacting with a person with social phobia seem to model this gaze aversion. Our research consists of testing gaze aversion in subjects with social phobia compared to control subjects in different emotional faces of men and women using an eye tracker. Twenty-six subjects with DSM-IV social phobia were recruited. Twenty-four healthy subjects aged and sex-matched constituted the control group. We looked at the number of fixations and the dwell time in the eyes area on the pictures. The main findings of this research are: confirming a significantly lower amount of fixations and dwell time in patients with social phobia as a general mean and for the 6 basic emotions independently from gender; observing a significant correlation between the severity of the phobia and the degree of gaze avoidance. However, no difference in gaze avoidance according to subject/picture gender matching was observed. These findings confirm and extend some previous results, and suggest that eye avoidance is a robust marker of persons with social phobia, which could be used as a behavioral phenotype for brain imagery studies on this disorder.     

Visual working memory and threat monitoring: Spider fearfuls show disorder-specific change detection

Previous studies of biased information processing in anxiety addressed biases of attention and memory, but little is known about the processes taking place between them: visual working memory (VWM) and monitoring of threat. We investigated these processes with a change detection paradigm. In Experiment 1, spider fearfuls (SF) and non-anxious controls (NAC) judged two subsequently presented displays as same or different. The displays consisted of several pictures, one of which could depict a spider. In Experiment 2, SF and NAC, both without snake fear, were tested with displays including either a spider or a snake image to determine the material-specificity of biased VWM. Both groups showed increased change detection for threat images. This effect was significantly stronger in SF, for spider images only, indicating a threat-specific VWM bias. Thus, contrary to the assumptions made by most cognitive models of anxiety, an explicit memory bias was found.     

Speaking, writing, and memory span in children: output modality affects cognitive performance

Low‐level processes of children's written language production are cognitively more costly than those involved in speaking. This has been shown by French authors who compared oral and written memory span performance. The observed difficulties of children's, but not of adults' low‐level processes in writing may stem from graphomotoric as well as from orthographic inadequacies. We report on five experiments designed to replicate and expand the original results. First, the French results were successfully replicated for German third‐graders, and for university students. Then, the developmental changes of the cognitive costs of writing were examined during primary school, comparing the performance of second‐ and fourth‐graders. Next, we show that unpractised writing modes, which were experimentally induced, also lead to a decrease of memory performance in adults, which supports the assumption that a lack of graphomotoric automation is responsible for the observed effects in children. However, unpractised handwriting yields clearer results than unpractised typing. Lastly, we try to separate the influences of graphomotoric as opposed to orthographic difficulties by having the words composed through pointing on a “spelling board”. This attempt, however, has not been successful, probably because the pointing to letters introduced other low‐level costs. In sum, throughout the four years of primary school, German children show worse memory span performance in writing compared to oral recall, with an overall increase in both modalities. Thus, writing had not fully caught up with speaking regarding the implied cognitive costs by the end of primary school. Therefore, conclusions relate to the question of how to assess properly any kind of knowledge and abilities through language production.     

Looking away from death: Defensive attention as a form of terror management

Previous research has suggested that the physical aspects of human nature in general, and physical human frailties in particular become disagreeable and repugnant following death primes. The current research tested this hypothesis in two studies using an eye-tracking methodology. Participants were subliminally primed with death or with a control word and then viewed a series of arrays containing four pictures each, during which their eye-movements were monitored. In Study 1, the arrays included pictures of physical injury or neutral objects, and in Study 2 pictures of physical injury, threatening images, and neutral objects. The results indicated that in both studies death primes significantly decreased gaze duration towards pictures of physical injury, and did not have a significant effect on gaze duration towards neutral images. However, in Study 2 death primes increased gaze duration towards threatening images. The discussion examines the role of motivated unconscious attention in terror management processes.     

A sub-process view of working memory capacity: Evidence from effects of speech on prose memory

In this article we outline a “sub-process view” of working memory capacity (WMC). This view suggests that any relationship between WMC and another construct (e.g., reading comprehension) is actually a relationship with a specific part of the WMC construct. The parts, called sub-processes, are functionally distinct and can be measured by intrusion errors in WMC tasks. Since the sub-processes are functionally distinct, some sub-process may be related to a certain phenomenon, whereas another sub-process is related to other phenomena. In two experiments we show that a sub-process (measured by immediate/current-list intrusions) is related to the effects of speech on prose memory (semantic auditory distraction), whereas another sub-process (measured by delayed/prior-list intrusions), known for its contribution to reading comprehension, is not. In Experiment 2 we developed a new WMC task called “size-comparison span” and found that the relationship between WMC and semantic auditory distraction is actually a relationship with a sub-process measured by current-list intrusions in our new task.     

Visual perspective in autobiographical memories: Reliability,consistency, and relationship to objective memory performance

Visual perspective in autobiographical memories was examined in terms of reliability, consistency, and relationship to objective memory performance in a sample of 99 individuals. Autobiographical memories may be recalled from two visual perspectives—a field perspective in which individuals experience the memory through their own eyes, or an observer perspective in which individuals experience the memory from the viewpoint of an observer in which they can see themselves. Participants recalled nine word-cued memories that differed in emotional valence (positive, negative and neutral) and rated their memories on 18 scales. Results indicate that visual perspective was the most reliable memory characteristic overall and is consistently related to emotional intensity at the time of recall and amount of emotion experienced during the memory. Visual perspective is unrelated to memory for words, stories, abstract line drawings or faces.     

Learning to like it: Aesthetic perception of bodies,movements and choreographic structure

Appreciating human movement can be a powerful aesthetic experience. We have used apparent biological motion to investigate the aesthetic effects of three levels of movement representation: body postures, movement transitions and choreographic structure. Symmetrical (ABCDCBA) and asymmetrical (ABCDBCA) sequences of apparent movement were created from static postures, and were presented in an artificial grammar learning paradigm. Additionally, “good” continuation of apparent movements was manipulated by changing the number of movement path reversals within a sequence. In an initial exposure phase, one group of participants saw only symmetrical sequences, while another group saw only asymmetrical sequences. In a subsequent test phase, both groups rated all sequences on an aesthetic evaluation scale. We found that posture, movement, and choreographic structure all influenced aesthetic ratings. Separate ratings for the static body postures presented individually showed that both groups preferred a posture that maximized spatial symmetry. Ratings for the experimental sequences showed that both groups gave higher ratings to symmetrical sequences with “good” continuation and lower ratings to sequences with many path reversals. Further, participants who had been initially familiarized with asymmetrical sequences showed increased liking for asymmetrical sequences, suggesting a structural mere exposure effect. Aesthetic preferences thus depend on body postures, apparent movement continuation and choreographic structure. We propose a hierarchical model of aesthetic perception of human movement with distinct processing levels for body postures, movements and choreographic structure.     

Experimentally-induced dissociation impairs visual memory

Dissociation is a phenomenon common in a number of psychological disorders and has been frequently suggested to impair memory for traumatic events. In this study we explored the effects of dissociation on visual memory. A dissociative state was induced experimentally using a mirror-gazing task and its short-term effects on memory performance were investigated. Sixty healthy individuals took part in the experiment. Induced dissociation impaired visual memory performance relative to a control condition; however, the degree of dissociation was not associated with lower memory scores in the experimental group. The results have theoretical and practical implications for individuals who experience frequent dissociative states such as patients with posttraumatic stress disorder (PTSD).