Audiotactile multisensory interactions in human information processing

Abstract:  The last few years has seen a very rapid growth of interest in how signals from different sensory modalities are integrated in the brain to form the unified percepts that fill our daily lives. Research on multisensory interactions between vision, touch, and proprioception has revealed the existence of multisensory spatial representations that code the location of external events relative to our own bodies. In this review, we highlight recent converging evidence from both human and animal studies that has revealed that spatially-modulated multisensory interactions also occur between hearing and touch, especially in the space immediately surrounding the head. These spatial audiotactile interactions for stimuli presented close to the head can affect not only the spatial aspects of perception, but also various other non-spatial aspects of audiotactile information processing. Finally, we highlight some of the most important questions for future research in this area.     

Infant touching behaviour during mother–infant face‐to‐face interactions

The study of infant communication during mother–infant interactions has largely focused on infants' distal behaviours, while neglecting their more proximal behaviours, such as touch. Yet, touch is an important modality through which infants and mothers communicate; it is also a vital means through which infants self‐regulate and explore their surroundings. The present study was designed to investigate the touching behaviours of 44, 51/2‐month‐old, healthy, full‐term infants during face‐to‐face mother–infant interactions. A still‐face (SF) procedure was used in order to examine differences in the types and locations of infant touch across normal and perturbed interaction periods, when mothers exhibit changes in their emotional availability. Results revealed that infant touch varied with changes in maternal availability. During the SF period, when mothers were unavailable, infants used more active, soothing, and reactive tactile behaviours (stroke, finger, pat, and pull), and they spent more time touching themselves. In contrast, infants used mostly passive touch (static) during the Normal periods, when their mothers were available. They also spent a significant portion of time touching their mothers. The variations in infant touch across periods suggest that infants communicate their affective states through touch. The findings also support the regulatory and exploratory roles of infant touch, especially during periods of maternal unavailability. Copyright © 2007 John Wiley & Sons, Ltd.     

Preference for free or forced choice in Sumatran orangutans (Pongo abelii)

Empirical investigations of humans, pigeons, rats, and monkeys have indicated that these species will select free over forced choice, even when faced with identical outcomes. However, the same has yet to be quantitatively confirmed in nonhuman great apes. This experiment is the first systematic investigation of preference for free or forced choice in great apes using a paradigm in which extraneous variables are highly controlled. Three orangutans were given a choice of one of two virtual routes, one that provided a choice and one that did not via a touchscreen computer program. Choice of either route was rewarded with the same type and quantity of food. Initial results indicated a preference for free choice across all three participants. However, in two control conditions, orangutans' preferences varied, suggesting a weaker tendency to exercise choice than species previously tested. We suggest further investigation of preference for free and forced choice in orangutans and other great apes through alternative experimental paradigms that focus on increasing the fidelity of free and forced choice options.     

Visual search by chimpanzees (Pan): assessment of controlling relations.

Three experimentally sophisticated chimpanzees (Pan), Akira, Chloe, and Ai, were trained on visual search performance using a modified multiple-alternative matching-to-sample task in which a sample stimulus was followed by the search display containing one target identical to the sample and several uniform distractors (i.e., negative comparison stimuli were identical to each other). After they acquired this task, they were tested for transfer of visual search performance to trials in which the sample was not followed by the uniform search display (odd-item search). Akira showed positive transfer of visual search performance to odd-item search even when the display size (the number of stimulus items in the search display) was small, whereas Chloe and Ai showed a transfer only when the display size was large. Chloe and Ai used some nonrelational cues such as perceptual isolation of the target among uniform distractors (so-called pop-out). In addition to the odd-item search test, various types of probe trials were presented to clarify the controlling relations in multiple-alternative matching to sample. Akira showed a decrement of accuracy as a function of the display size when the search display was nonuniform (i.e., each "distractor" stimulus was not the same), whereas Chloe and Ai showed perfect performance. Furthermore, when the sample was identical to the uniform distractors in the search display, Chloe and Ai never selected an odd-item target, but Akira selected it when the display size was large. These results indicated that Akira's behavior was controlled mainly by relational cues of target-distractor oddity, whereas an identity relation between the sample and the target strongly controlled the performance of Chloe and Ai.     

Maternal attitudes during pregnancy predict mother-infant physical proximity six months after birth

The purpose of this study was to develop an instrument for assessing maternal attitudes. Three photographs representing infants or mother-infant dyads were presented to 26 mothers in the second half of pregnancy and six months after birth. Nine mothers were clinical cases, seventeen mothers were nonpathological controls. Thirty-three semantic categories were used to code the mothers' responses to the pictures. Mothers' responses were coded independently by two researchers. The factor analysis of the codes yielded an ‘attraction to, vs rejection of, children’ factor. Compared with the control group, the mean factor score of the clinical group was significantly lower, i. e. reflected less attraction (p < 0.01). To study the relation between the attraction factor and the physical proximity of mothers and infants, 21 of these mother-infant dyads were videotaped in a semi-structured play interaction six months after birth. Recordings were coded independently by two researchers for various indices of proximity (spatial proximity, kisses, embraces, touches). The factor analysis of the codes yielded a factor contrasting distant vs close and tender interaction. A significant correlation was found between the attraction scores of pregnant women and the proximity scores of mother-infant interaction (r = 0.46; p < 0.05). These results suggest that this instrument is useful in assessing maternal attitudes of psychiatrically disturbed pregnant women and that maternal attitudes of pregnant women are significant predictors of physical proximity in motherinfant interaction at the end of the first semester.     

The effects of motion on in-vehicle touch screen system operation: A battle management system case study

The use of in-vehicle touch screen devices is currently common in both military and civilian vehicles; despite this, the effects of motion on touch screen device operation within vehicles remains largely unexplored. This article describes a study that examined, using driving simulation, the influences of motion on performance, workload and usability when using a touch screen in-vehicle battle management system. Acting in the role of battle management system operator, 20 participants undertook four simulated drives, two under high motion (representative of an unsealed road) and two under normal motion (representative of a sealed road), whilst performing various battle management tasks. In the high motion condition, lower accuracy and longer task completion times were found, along with greater levels of subjective and physiological workload and lower levels of perceived device usability, when compared to the normal motion condition. The findings indicate that, compared to normal motion, the high motion condition impaired key aspects of battle management system operation. In closing, the importance of considering motion and its effects during touch screen system design is discussed.     

Coordination tending towards an anti-phase relationship determines greater sway reduction during entrainment with a simulated partner

The increased risk of falls in the older aged population demands the development of assistive robotic devices capable of effective balance support. For the development and increased user acceptance of such devices, which provide balance support in a human-like way, it is important to understand the simultaneous occurrence of entrainment and sway reduction in human-human interaction. However, sway reduction has not been observed yet during a human touching an external, continuously moving reference, which rather increased human body sway. Therefore, we investigated in 15 healthy young adults (27.20±3.55 years, 6 females) how different simulated sway-responsive interaction partners with different coupling modes affect sway entrainment, sway reduction and relative interpersonal coordination, as well as how these human behaviours differ depending on the individual body schema accuracy. For this, participants were lightly touching a haptic device that either played back an average pre-recorded sway trajectory (“Playback”) or moved based on the sway trajectory simulated by a single-inverted pendulum model with either a positive (Attractor) or negative (Repulsor) coupling to participant's body sway. We found that body sway reduced not only during the Repulsor-interaction, but also during the Playback-interaction. These interactions also showed a relative interpersonal coordination tending more towards an anti-phase relationship, especially the Repulsor. Moreover, the Repulsor led to the strongest sway entrainment. Finally, a better body schema contributed to a reduced body sway in both the “reliable” Repulsor and the “less reliable” Attractor mode. Consequently, a relative interpersonal coordination tending more towards an anti-phase relationship and an accurate body schema are important to facilitate sway reduction.     

Establishing Functional Classes In A Chimpanzee (Pan troglodytes) With A Two-item Sequential-Responding Procedure

A 9-year-old female chimpanzee was trained on a two-item sequential-responding task. Attempts were made with successive-reversal training to establish functional classes. In Experiment 1, the subject was exposed to between-session successive-reversal training in which one of two pairs of stimuli was reversed, and transfer of reversal responding to the other pair was tested with nonreinforcement probe trials. She did not show transfer during the course of reversals. Stimulus control established in the original training was maintained on nonreinforcement probe trials. In Experiment 2, within-session reversals were introduced. She showed transfer from the initially reversed pair to the other. The results were consistent with Vaughan's (1988) results with pigeons on successive discriminations, which indicated the formation of functional classes. In Experiment 3, crossover and wild-card tests were conducted to clarify the stimulus control of sequential responding. The results suggested that the sequential responding was controlled only by the first stimulus of each pair. To establish control by both first and second stimuli, trial-unique stimuli or wild cards were substituted for one of the items of the lists in Experiment 4. Further transfer tests, in which stimuli for the two new pairs appeared, were also given to the subject. She successfully responded to these two merged lists and reversed the order as the result of reversal training.     

Instructions as discriminative stimuli

Four undergraduates were exposed to a fixed-ratio schedule under an instruction to respond slowly and to a differential-reinforcement-of-low-rate 5-s schedule under an instruction to respond rapidly. Following this, a fixed-interval schedule was in effect under those same two sets of instructions. For 3 of 4 subjects, response rates were higher with the instruction to respond slowly than with the instruction to respond rapidly during the fixed-interval schedule. For the remaining subject, low-rate responding with the instruction to respond rapidly continued during the first 17 reinforcements of the fixed-interval schedule. Such control by instructions was not observed for other subjects exposed only to a fixed-interval schedule, with or without instructions. The results demonstrate that the effect of instructions can be altered by contingencies and suggest that instructions can function as discriminative stimuli.