Assessing the influence of schematic drawings of body parts on tactile discrimination performance using the crossmodal congruency task

Seeing one's own body (either directly or indirectly) can influence visuotactile crossmodal interactions. Recently, it has been shown that even viewing a simple line drawing of a hand can also modulate such crossmodal interactions, as if the picture of the hand somehow corresponds to (or primes) the participants' own hand. Alternatively, however, it could be argued that the modulatory effects of viewing the picture of a hand on visuotactile interactions might simply be attributed to cognitive processes such as the semantic referral to the relevant body part or to the orientation cues provided by the hand picture instead. In the present study, we evaluated these various different interpretations of the hand picture effect. Participants made speeded discrimination responses to the location of brief vibrotactile targets presented to either the tip or base of their forefinger, while trying to ignore simultaneously-presented visual distractors presented to either side of central fixation. We compared the modulatory effect of the picture of a hand with that seen when the visual distractors were presented next to words describing the tip and base of the forefinger (Experiment 1), or were superimposed over arrows which provided another kind of directional cue (Experiment 2). Tactile discrimination performance was modulated in the hand picture condition, but not in the word or arrow conditions. These results therefore suggest that visuotactile interactions are specifically modulated by the image of the hand rather than by cognitive cues such as simply semantic referral to the relevant body sites and/or any visual orientation cues provided by the picture of a hand.     

Playing an action video game reduces gender differences in spatial cognition

We demonstrate a previously unknown gender difference in the distribution of spatial attention, a basic capacity that supports higher-level spatial cognition. More remarkably, we found that playing an action video game can virtually eliminate this gender difference in spatial attention and simultaneously decrease the gender disparity in mental rotation ability, a higher-level process in spatial cognition. After only 10 hr of training with an action video game, subjects realized substantial gains in both spatial attention and mental rotation, with women benefiting more than men. Control subjects who played a non-action game showed no improvement. Given that superior spatial skills are important in the mathematical and engineering sciences, these findings have practical implications for attracting men and women to these fields.     

Recent developments in the study of tactile attention.

The last few years have seen a rapid growth of research on the topic of tactile attention. We review the evidence showing that attention can be directed to the tactile modality, or to the region of space where tactile stimuli are presented, in either an endogenous or exogenous (top-down or bottom-up) manner. We highlight the latest findings on the interaction between these two forms of attentional orienting in touch. We also review the latest research on tactile numerosity judgments and change detection highlighting the severe cognitive (attentional) limitations that constrain people's ability to process more complex tactile information displays. These findings are particularly important given that tactile interfaces are currently being developed for a number of different application domains.     

Crossmodal binding: Evaluating the “unity assumption” using audiovisual speech stimuli

We investigated whether the “unity assumption,” according to which an observer assumes that two different sensory signals refer to the same underlying multisensory event, influences the multisensory integration of audiovisual speech stimuli. Syllables (Experiments 1, 3, and 4) or words (Experiment 2) were presented to participants at a range of different stimulus onset asynchronies using the method of constant stimuli. Participants made unspeeded temporal order judgments regarding which stream (either auditory or visual) had been presented first. The auditory and visual speech stimuli in Experiments 1–3 were either gender matched (i.e., a female face presented together with a female voice) or else gender mismatched (i.e., a female face presented together with a male voice). In Experiment 4, different utterances from the same female speaker were used to generate the matched and mismatched speech video clips. Measuring in terms of the just noticeable difference the participants in all four experiments found it easier to judge which sensory modality had been presented first when evaluating mismatched stimuli than when evaluating the matched-speech stimuli. These results therefore provide the first empirical support for the “unity assumption” in the domain of the multisensory temporal integration of audiovisual speech stimuli.     

Perceptual and decisional contributions to audiovisual interactions in the perception of apparent motion: a signal detection study

Motion information available to different sensory modalities can interact at both perceptual and post-perceptual (i.e., decisional) stages of processing. However, to date, researchers have only been able to demonstrate the influence of one of these components at any given time, hence the relationship between them remains uncertain. We addressed the interplay between the perceptual and post-perceptual components of information processing by assessing their influence on performance within the same experimental paradigm. We used signal detection theory to discriminate changes in perceptual sensitivity (d') from shifts in response criterion (c) in performance on a detection (Experiment 1) and a classification (Experiment 2) task regarding the direction of auditory apparent motion streams presented in noise. In the critical conditions, a visual motion distractor moving either leftward or rightward was presented together with the auditory motion. The results demonstrated a significant decrease in sensitivity to the direction of the auditory targets in the crossmodal conditions as compared to the unimodal baseline conditions that was independent of the relative direction of the visual distractor. In addition, we also observed significant shifts in response criterion, which were dependent on the relative direction of the distractor apparent motion. These results support the view that the perceptual and decisional components involved in audiovisual interactions in motion processing can coexist but are largely independent of one another.     

The modulation of haptic line bisection by a visual illusion and optokinetic stimulation

Research has shown that a variety of different sensory manipulations, including visual illusions, transcutaneous nerve stimulation, vestibular caloric stimulation, optokinetic stimulation, and prism adaptation, can all influence people's performance on spatial tasks such as line bisection. It has been suggested that these manipulations may act upon the 'higher-order' levels of representation used to code spatial information. We investigated whether we could influence haptic line bisection in normal participants crossmodally by varying the visual background that participants viewed. In experiment 1, participants haptically bisected wooden rods while looking at a variant of the Oppel - Kundt visual illusion. Haptic-bisection judgments were influenced by the orientation of the visual illusion (in line with previous unimodal visual findings). In experiment 2, haptic-bisection judgments were also influenced by the presence of a leftward or rightward moving visual background. In experiments 3 and 4, the position of the to-be-bisected stimuli was varied with respect to the participant's body midline. The results confirmed an effect of optokinetic stimulation, but not of the Oppel -Kundt illusion, on participants' tactile-bisection errors, suggesting that the two manipulations might differentially affect haptic processing. Taken together, these results suggest that the 'higher-order' levels of spatial representation upon which perceptual judgments and/or motor responses are made may have multisensory or amodal characteristics.     

Discriminating speech rhythms in audition,vision, and touch

We investigated the extent to which people can discriminate between languages on the basis of their characteristic temporal, rhythmic information, and the extent to which this ability generalizes across sensory modalities. We used rhythmical patterns derived from the alternation of vowels and consonants in English and Japanese, presented in audition, vision, both audition and vision at the same time, or touch. Experiment 1 confirmed that discrimination is possible on the basis of auditory rhythmic patterns, and extended it to the case of vision, using ‘aperture-close’ mouth movements of a schematic face. In Experiment 2, language discrimination was demonstrated using visual and auditory materials that did not resemble spoken articulation. In a combined analysis including data from Experiments 1 and 2, a beneficial effect was also found when the auditory rhythmic information was available to participants. Despite the fact that discrimination could be achieved using vision alone, auditory performance was nevertheless better. In a final experiment, we demonstrate that the rhythm of speech can also be discriminated successfully by means of vibrotactile patterns delivered to the fingertip. The results of the present study therefore demonstrate that discrimination between language's syllabic rhythmic patterns is possible on the basis of visual and tactile displays.     

Effectively responding to tactile stimulation: Do homologous cue and effector locations really matter?

We report a study designed to investigate the extent to which speeded behavioral responses following tactile stimulation are influenced by differences in neural conduction latencies at different body sites and/or by the characteristics of the compatibility between the cue and effector. The results showed that it may not be particularly desirable to present tactile cues (e.g., warning signals) to an interface operator's feet if a speeded foot response is required, for even though such an arrangement maximizes the set-level compatibility between the stimulus and the response, it turns out that response latencies are primarily determined by conduction latencies through the peripheral nervous system.     

Are the spatial features of bodily threat limited to the exact location where pain is expected?

Previous research has revealed that anticipating pain at a particular location of the body prioritizes somatosensory input presented there. The present study tested whether the spatial features of bodily threat are limited to the exact location of nociception. Participants judged which one of two tactile stimuli, presented to either hand, had been presented first, while occasionally experiencing a painful stimulus. The distance between the pain and tactile locations was manipulated. In Experiment 1, participants expected pain either proximal to one of the tactile stimuli (on the hand; near condition) or more distant on the same body part (arm; far condition). In Experiment 2, the painful stimulus was expected either proximal to one of the tactile stimuli (hand; near) or on a different body-part at the same body side (leg; far). The results revealed that in the near condition of both experiments, participants became aware of tactile stimuli presented to the “threatened” hand more quickly as compared to the “neutral” hand. Of particular interest, the data in the far conditions showed a similar prioritization effect when pain was expected at a different location of the same body part as well as when pain was expected at a different body part at the same body side. In this study, the encoding of spatial features of bodily threat was not limited to the exact location where pain was anticipated but rather generalized to the entire body part and even to different body parts at the same side of the body.