Task-irrelevant sounds influence both temporal order and apparent-motion judgments about tactile stimuli applied to crossed and uncrossed hands

It has been suggested that judgments about the temporal–spatial order of successive tactile stimuli depend on the perceived direction of apparent motion between them. Here we manipulated tactile apparent-motion percepts by presenting a brief, task-irrelevant auditory stimulus temporally in-between pairs of tactile stimuli. The tactile stimuli were applied one to each hand, with varying stimulus onset asynchronies (SOAs). Participants reported the location of the first stimulus (temporal order judgments: TOJs) while adopting both crossed and uncrossed hand postures, so we could scrutinize skin-based, anatomical, and external reference frames. With crossed hands, the sound improved TOJ performance at short (≤300 ms) and at long (>300 ms) SOAs. When the hands were uncrossed, the sound induced a decrease in TOJ performance, but only at short SOAs. A second experiment confirmed that the auditory stimulus indeed modulated tactile apparent motion perception under these conditions. Perceived apparent motion directions were more ambiguous with crossed than with uncrossed hands, probably indicating competing spatial codes in the crossed posture. However, irrespective of posture, the additional sound tended to impair potentially anatomically coded motion direction discrimination at a short SOA of 80 ms, but it significantly enhanced externally coded apparent motion perception at a long SOA of 500 ms. Anatomically coded motion signals imply incorrect TOJ responses with crossed hands, but correct responses when the hands are uncrossed; externally coded motion signals always point toward the correct TOJ response. Thus, taken together, these results suggest that apparent-motion signals are likely taken into account when tactile temporal–spatial information is reconstructed.

     

Processing load impairs coordinate integration for the localization of touch

To perform an action toward a touch, the tactile spatial representation must be transformed from a skin-based, anatomical reference frame into an external reference frame. Evidence suggests that, after transformation, both anatomical and external coordinates are integrated for the location estimate. The present study investigated whether the calculation and integration of external coordinates are automatic processes. Participants made temporal order judgments (TOJs) of two tactile stimuli, one applied to each hand, in crossed and uncrossed postures. The influence of the external coordinates of touch was indicated by the performance difference between crossed and uncrossed postures, referred to as the crossing effect. To assess automaticity, the TOJ task was combined with a working memory task that varied in difficulty (size of the working memory set) and quality (verbal vs. spatial). In two studies, the crossing effect was consistently reduced under processing load. When the load level was adaptively adjusted to individual performance (Study 2), the crossing effect additionally varied as a function of the difficulty of the secondary task. These modulatory effects of processing load on the crossing effect were independent of the type of working memory. The sensitivity of the crossing effect to processing load suggests that coordinate integration for touch localization is not fully automatic. To reconcile the present results with previous findings, we suggest that the genuine remapping process—that is, the transformation of anatomical into external coordinates—proceeds automatically, whereas their integration in service of a combined location estimate is subject to top-down control.     

The effect of hand position and pattern motion on temporal order judgments

Subjects made temporal order judgments (TOJs) of tactile stimuli presented to the fingerpads. The subjects judged which one of two locations had been stimulated first. The tactile stimuli were patterns that simulated movement across the fingerpads. Although irrelevant to the task, the direction of movement of the patterns biased the TOJs. If the pattern at one location moved in the direction of the second location, the subjects tended to judge the first location as leading the second location. If the pattern moved in the opposite direction, that location was judged as trailing. In a series of experiments, the effect of the spatial position of the hands and fingers on TOJs and the perception of the direction of pattern movement were examined. Changing the position of the hands so that the patterns no longer moved directly toward each other reduced or eliminated the effect of motion on TOJs. In a variation of Aristotle's illusion, the moving patterns were presented to crossed and uncrossed fingers. The results indicated that, contrary to Aristotle's illusion, the subjects processed the moving patterns relative to an environmental framework, rather than to the local direction of motion on the fingerpads. Presenting the patterns to crossed hands produced results similar to those obtained with crossed fingers: The subjects processed the patterns according to an environmental framework.     

The crossed-hands deficit in tactile temporal-order judgments: the effect of training

Several recent studies have shown that judgments of temporal order for tactile stimuli presented to the two hands are greatly affected by crossing the hands. The size of the threshold for judging temporal order may be up to four times larger with the hands crossed as compared to the hands uncrossed. The results from these recent studies suggest that with crossed hands, contrary to many situations involving the integration of tactile and proprioceptive information, subjects have difficulty in adjusting their perception of tactile inputs to correspond with the spatial positions of the hands. In the present study we examined the effect of training in judging temporal order on the size of this crossed-hands deficit--the difference in the thresholds for temporal-order judgments when the hands are crossed and uncrossed. All training procedures produced significant declines in the size of the deficit. With training, the difference between crossed-hands and uncrossed-hands temporal-order thresholds dropped from several hundred milliseconds to as little as 19 ms. A group of percussionists with experience in playing with crossed hands showed the same crossed-hands effects as non-musicians. The results were consistent in showing that the crossed-hands deficit was never completely eliminated but was greatly reduced with training. The implication is that subjects are able to adjust to the crossed-hands posture with modest amounts of training. The results are discussed in terms of the explanations that have been offered for the crossed-hands deficit.     

Effects of posture on tactile localization by 4 years of age are modulated by sight of the hands: evidence for an early acquired external spatial frame of reference for touch

Adults show a deficit in their ability to localize tactile stimuli to their hands when their arms are in the less familiar, crossed posture. It is thought that this ‘crossed‐hands deficit’ arises due to a conflict between the anatomical and external spatial frames of reference within which touches can be encoded. The ability to localize a single tactile stimulus applied to one of the two hands across uncrossed‐hands and crossed‐hands postures was investigated in typically developing children (aged 4 to 6 years). The effect of posture was also compared across conditions in which children did, or did not, have visual information about current hand posture. All children, including the 4‐year‐olds, demonstrated the crossed‐hands deficit when they did not have sight of hand posture, suggesting that touch is located in an external reference frame by this age. In this youngest age group, when visual information about current hand posture was available, tactile localization performance was impaired specifically when the children's hands were uncrossed. We propose that this may be due to an early difficulty with integrating visual representations of the hand within the body schema.     

Multisensory temporal order judgments: when two locations are better than one

In Experiment 1, participants were presented with pairs of stimuli (one visual and the other tactile) from the left and/or right of fixation at varying stimulus onset asynchronies and were required to make unspeeded temporal order judgments (TOJs) regarding which modality was presented first. When the participants adopted an uncrossed-hands posture, just noticeable differences (JNDs) were lower (i.e., multisensory TOJs were more precise) when stimuli were presented from different positions, rather than from the same position. This spatial redundancy benefit was reduced when the participants adopted a crossed-hands posture, suggesting a failure to remap visuotactile space appropriately. In Experiment 2, JNDs were also lower when pairs of auditory and visual stimuli were presented from different positions, rather than from the same position. Taken together, these results demonstrate that people can use redundant spatial cues to facilitate their performance on multisensory TOJ tasks and suggest that previous studies may have systematically overestimated the precision with which people can make such judgments. These results highlight the intimate link between spatial and temporal factors in determining our perception of the multimodal objects and events in the world around us.     

Crossing the arms confuses the clocks: Sensory feedback and the bimanual advantage

The bimanual advantage refers to the finding that tapping with two fingers on opposite hands exhibits reduced timing variability, as compared with tapping with only one finger. Two leading theories propose that the bimanual advantage results from the addition of either sensory (i.e., enhanced feedback) or cognitive (i.e., multiple timekeeper) processes involved in timing. Given that crossing the arms impairs perception of tactile stimuli and modulates cortical activation following tactile stimulation, we investigated the role of crossing the arms in the bimanual advantage. Participants tapped unimanually or bimanually with their arms crossed or uncrossed on a tabletop or in the air. With arms crossed, we expected increased interval timing variance. Similarly, for air tapping, we expected reduced bimanual advantage, due to reduced sensory feedback. A significant bimanual advantage was observed for the uncrossed, but not the crossed posture in tabletop tapping. Furthermore, removing tactile feedback from taps eliminated the bimanual advantage for both postures. Together, these findings suggest that crossing the arms likely impairs integration of internal (i.e., effector-specific) and external (i.e., environment-specific) information and that this multisensory integration is crucial to reducing timing variability during repetitive coordinated bimanual tasks.     

The effect of motion on tactile and visual temporal order judgments

Four experiments were conducted, three with tactile stimuli and one with visual stimuli, in which subjects made temporal order judgments (TOJs). The tactile stimuli were patterns that moved laterally across the fingerpads. The subject's task was to judge which finger received the pattern first. Even though the movement was irrelevant to the task, the subjects' TOJs were greatly affected by the direction of movement of the patterns. Accuracy in judging temporal order was enhanced when the patterns moved in a direction that was consistent with the temporal order of presentation--for example, when the movement on each fingerpad was from right to left and the temporally leading site of stimulation was to the right of the temporally trailing site of stimulation. When movement was inconsistent with the temporal order of presentation, accuracy was considerably reduced, often well below chance.The bias in TOJs was unaffected by training or by presenting the stimuli to fingers on opposite hands. In a fourth experiment, subjects judged the temporal order of visual stimuli that, like the tactile stimuli, moved in a direction that was either consistent or inconsistent with the TOJ. The results were similar to those obtained with tactile stimuli. It is suggested that the bias may be affected by attentional mechanisms and by apparent motion generated between the two sites on the skin.     

Perceptual learning following a long-lasting tactile reversal.

Crossing 2 adjacent fingers produces a distorted perception when 2 tactile stimuli are touched to the crossed fingertips. This is because a given pair of fingers has a functional range of action within which spatial perception is correct (uncrossed fingers) and beyond which perceived location of tactile stimuli is wrong (crossed fingers). The present study tested the possibility that this range of action could be modified following a long-lasting crossing. Therefore, the functional range of action of the 2nd and 3rd fingers was tested every month in 6 volunteers who maintained the finger crossing for as long as 6 months. The results show that after a variable period of time the range of action was enlarged such that spatial perception was correct with crossed fingers as well. The perceptual organization of the human hand therefore depends on experience and is not rigidly determined on a genetic basis.     

Visuo-tactile links in covert exogenous spatial attention remap across changes in unseen hand posture

We investigated the effect of unseen hand posture on cross-modal, visuo-tactile links in covert spatial attention. In Experiment 1, a spatially nonpredictive visual cue was presented to the left or right hemifield shortly before a tactile target on either hand. To examine the spatial coordinates of any cross-modal cuing, the unseen hands were either uncrossed or crossed so that the left hand lay to the right and vice versa. Tactile up/down (i.e., index finger/thumb) judgments were better on the same side of external space as the visual cue, for both crossed and uncrossed postures. Thus, which hand was advantaged by a visual cue in a particular hemifield reversed across the different unseen postures. In Experiment 2, nonpredictive tactile cues now preceded visual targets. Up/down judgments for the latter were better on the same side of external space as the tactile cue, again for both postures. These results demonstrate cross-modal links between vision and touch in exogenous covert spatial attention that remap across changes in unseen hand posture, suggesting a modulatory role for proprioception.     

Audiotactile temporal order judgments

We report a series of three experiments in which participants made unspeeded 'Which modality came first?' temporal order judgments (TOJs) to pairs of auditory and tactile stimuli presented at varying stimulus onset asynchronies (SOAs) using the method of constant stimuli. The stimuli were presented from either the same or different locations in order to explore the potential effect of redundant spatial information on audiotactile temporal perception. In Experiment 1, the auditory and tactile stimuli had to be separated by nearly 80 ms for inexperienced participants to be able to judge their temporal order accurately (i.e., for the just noticeable difference (JND) to be achieved), no matter whether the stimuli were presented from the same or different spatial positions. More experienced psychophysical observers (Experiment 2) also failed to show any effect of relative spatial position on audiotactile TOJ performance, despite having much lower JNDs (40 ms) overall. A similar pattern of results was found in Experiment 3 when silent electrocutaneous stimulation was used rather than vibrotactile stimulation. Thus, relative spatial position seems to be a less important factor in determining performance for audiotactile TOJ than for other modality pairings (e.g., audiovisual and visuotactile).     

触觉时序知觉手臂交叉效应的性别差异

本研究探讨触觉时序知觉的手臂交叉效应是否存在性别差异。通过两个实验在较短和较长的SOA条件下考察男性和女性被试在基于体觉和基于外部空间的触觉时序判断任务中的表现。结果表明,男性与女性被试在基于体觉和基于外部空间的触觉时序判断任务中均存在手臂交叉效应,SOA较短时男性被试的手臂交叉效应显著小于女性被试,但在SOA较长的条件下手臂交叉效应没有明显的性别差异。触觉时序知觉手臂交叉效应的性别差异可能与空间知觉能力和生理解剖学因素有关。     

Multisensory prior entry.

Despite 2 centuries of research, the question of whether attending to a sensory modality speeds the perception of stimuli in that modality has yet to be resolved. The authors highlight weaknesses inherent in this previous research and report the results of 4 experiments in which a novel methodology was used to investigate the effects on temporal order judgments (TOJs) of attending to a particular sensory modality or spatial location. Participants were presented with pairs of visual and tactile stimuli from the left and/or right at varying stimulus onset asynchronies and were required to make unspeeded TOJs regarding which stimulus appeared first. The results provide the strongest evidence to date for the existence of multisensory prior entry and support previous claims for attentional biases toward the visual modality and toward the right side of space. These findings have important implications for studies in many areas of human and animal cognition.     

Integration of hand and finger location in external spatial coordinates for tactile localization

Tactile stimulus location is automatically transformed from somatotopic into external spatial coordinates, rendering information about the location of touch in three-dimensional space. This process is referred to as tactile remapping. Whereas remapping seems to occur automatically for the hands and feet, the fingers may constitute an exception in that some studies have implied purely somatotopic coding of touch to the fingers. When participants judge the order of two tactile stimuli, they often err when the stimulated body parts (usually the two hands) are crossed, presumably because somatotopic and external coordinates are in conflict in crossed postures. Using this task, we investigated, first, whether the fingers are unlike other limbs with regard to spatial coding, by testing whether crossing effects, indicative of external coding, were observable when stimulating two fingers, either on the same or on different hands. Second, we investigated the interaction of hand and finger posture in tactile localization of finger stimuli. Crossing effects emerged when fingers and hands were crossed, suggesting external coding for all body parts. Crossing effects were larger when both hand and finger were located in the hemifield opposite to their body side, and smaller when only hand or finger lay in the opposite hemifield. We suggest that tactile location is estimated by integrating the external location of all relevant body parts, here of a finger and its belonging hand, and that such integrative coding may represent a general principle for body part processing as well as for tool use.     

Congruency effects between auditory and tactile motion: Extending the phenomenon of cross-modal dynamic capture

Behavioral studies of multisensory integration in motion perception have focused on the particular case of visual and auditory signals. Here, we addressed a new case: audition and touch. In Experiment 1, we tested the effects of an apparent motion stream presented in an irrelevant modality (audition or touch) on the perception of apparent motion streams in the other modality (touch or audition, respectively). We found significant congruency effects (lower performance when the direction of motion in the irrelevant modality was incongruent with the direction of the target) for the two possible modality combinations. This congruency effect was asymmetrical, with tactile motion distractors having a stronger influence on auditory motion perception than vice versa. In Experiment 2, we used auditory motion targets and tactile motion distractors while participants adopted one of two possible postures: arms uncrossed or arms crossed. The effects of tactile motion on auditory motion judgments were replicated in the arms-uncrossed posture, but they dissipated in the arms-crossed posture. The implications of these results are discussed in light of current findings regarding the representation of tactile and auditory space.     

Integration of anatomical and external response mappings explains crossing effects in tactile localization: A probabilistic modeling approach

To act upon a tactile stimulus its original skin-based, anatomical spatial code has to be transformed into an external, posture-dependent reference frame, a process known as tactile remapping. When the limbs are crossed, anatomical and external location codes are in conflict, leading to a decline in tactile localization accuracy. It is unknown whether this impairment originates from the integration of the resulting external localization response with the original, anatomical one or from a failure of tactile remapping in crossed postures. We fitted probabilistic models based on these diverging accounts to the data from three tactile localization experiments. Hand crossing disturbed tactile left–right location choices in all experiments. Furthermore, the size of these crossing effects was modulated by stimulus configuration and task instructions. The best model accounted for these results by integration of the external response mapping with the original, anatomical one, while applying identical integration weights for uncrossed and crossed postures. Thus, the model explained the data without assuming failures of remapping. Moreover, performance differences across tasks were accounted for by non-individual parameter adjustments, indicating that individual participants’ task adaptation results from one common functional mechanism. These results suggest that remapping is an automatic and accurate process, and that the observed localization impairments in touch result from a cognitively controlled integration process that combines anatomically and externally coded responses.     

Tactile--visual temporal ventriloquism: no effect of spatial disparity

Participants made visual temporal order judgments (TOJs) about which of two lights appeared first while task-irrelevant vibrotactile stimuli delivered to the index finger were presented before the first and after the second light. Temporally misaligned tactile stimuli captured the onsets of the lights, thereby improving sensitivity on the visual TOJ task, indicative of tactile-visual (TV) temporal ventriloquism (Experiment 1). The size of this effect was comparable to auditory-visual (AV) temporal ventriloquism (Experiment 2). Spatial discordance between the TV stimuli, as in the AV case, did not harm the effect (Experiments 3 and 4). TV stimuli thus behaved like AV stimuli, demonstrating that spatial co-occurrence is not a necessary constraint for intersensory pairing to occur.     

Tactile—visual temporal ventriloquism: No effect of spatial disparity

Participants made visual temporal order judgments (TOJs) about which of two lights appeared first while taskirrelevant vibrotactile stimuli delivered to the index finger were presented before the first and after the second light. Temporally misaligned tactile stimuli captured the onsets of the lights, thereby improving sensitivity on the visual TOJ task, indicative of tactile-visual (TV) temporal ventriloquism (Experiment 1). The size of this effect was comparable to auditory-visual (AV) temporal ventriloquism (Experiment 2). Spatial discordance between the TV stimuli, as in the AV case, did not harm the effect (Experiments 3 and 4). TV stimuli thus behaved like AV stimuli, demonstrating that spatial co-occurrence is not a necessary constraint for intersensory pairing to occur.     

Tactile localization performance in children with developmental coordination disorder (DCD) corresponds to their motor skill and not their cognitive ability

When localizing touches to the hands, typically developing children and adults show a “crossed hands effect” whereby identifying which hand received a tactile stimulus is less accurate when the hands are crossed than uncrossed. This demonstrates the use of an external frame of reference for locating touches to one’s own body. Given that studies indicate that developmental vision plays a role in the emergence of external representations of touch, and reliance on vision for representing the body during action is atypical in developmental coordination disorder (DCD), we investigated external spatial representations of touch in children with DCD using the “crossed hands effect”. Nineteen children with DCD aged 7–11 years completed a tactile localization task in which posture (uncrossed, crossed) and view (hands seen, unseen) were varied systematically. Their performance was compared to that of 35 typically developing controls (19 of a similar age and cognitive ability, and 16 of a younger age but similar fine motor ability). Like controls, the DCD group exhibited a crossed hands effect, whilst their overall tactile localization performance was weaker than their peers of similar age and cognitive ability, but in line with younger controls of similar motor ability. For children with movement difficulties, these findings indicate tactile localization impairments in relation to age expectations, but apparently typical use of an external reference frame for localizing touch.     

Change of reference frame for tactile localization during child development

Temporal order judgements (TOJ) for two tactile stimuli, one presented to the left and one to the right hand, are less precise when the hands are crossed over the midline than when the hands are uncrossed. This ‘crossed hand’ effect has been considered as evidence for a remapping of tactile input into an external reference frame. Since late, but not early, blind individuals show such remapping, it has been hypothesized that the use of an external reference frame develops during childhood. Five‐ to 10‐year‐old children were therefore tested with the tactile TOJ task, both with uncrossed and crossed hands. Overall performance in the TOJ task improved with age. While children older than 5½ years displayed a crossed hand effect, younger children did not. Therefore the use of an external reference frame for tactile, and possibly multisensory, localization seems to be acquired at age 5.