Perceptual and motor congruency effects in time–space association

It is well established that temporal events are represented on a spatially oriented mental time line from left to right. Depending on the task characteristics, the spatial representation of time may be linked to different types of dimensions, including manual response codes and physical space codes. The aim of the present study was to analyze whether manual response and physical space codes are independent of each other or whether they interact when both types of information are involved in the task. The participants performed a temporal estimation task with two lateralized response buttons in four experiments. In the first experiment, the target stimuli were presented on the left side, at the center, or on the right side of the space, whereas the reference stimuli were always presented centrally. The reverse situation was presented in the second experiment. In the third experiment, both stimuli were presented in opposite spatial positions (e.g., left–right), whereas in the last experiment, both stimuli were presented in the same spatial position (e.g., left–left). In all experiments, perceptual and motor congruency effects were found, but no modulation of the congruency effects was found when both the perceptual and motor components were congruent. The results indicated that physical, spatial, and manual response codes are independent from each other for time–space associations, even when both codes are involved in the task. These results are discussed in terms of the “intermediate-coding” account.     

Action and perception: Evidence against converging selection processes

In a series of experiments we investigated whether identification of a lateralized visual target would benefit from concurrent execution of a reaching movement on the same side of space. Participants were tested in a dual-task paradigm. In one task, they performed a speeded reach movement towards a lateralized target button. The reach was cued by an auditory stimulus, and performed out of the participant's sight. In the other task, participants identified one of two simultaneous visual stimuli presented to the left and right visual fields, close to movement target locations. If motor activity were effective in modulating perceptual processes via a visuo-attentional shift, identification performance should have improved when the visual stimulus appeared at the movement target location. In fact, identification was not affected by the side of reach. Such results suggest substantially independent selection processes in motor and visual domains.     

Priming the mental time line

Growing experimental evidence suggests that temporal events are represented on a mental time line, spatially oriented from left to right. Support for the spatial representation of time comes mostly from studies that have used spatially organized responses. Moreover, many of these studies did not avoid possible confounds attributable to target stimuli that simultaneously convey both spatial and temporal dimensions. Here we show that task-irrelevant, lateralized visuospatial primes affect auditory duration judgments. Responses to short durations were faster when the auditory target was paired with left- than with right-sided primes, whereas responses to long durations were faster when paired with right- than with left-sided primes. Thus, when the representations of physical space and time are concurrently activated, physical space may influence time even when a lateralized, spatially encoded response is not required by the task. The time-space interaction reported here cannot be ascribed to any Spatial-Temporal Association of Response Codes effect. It supports the hypothesis that the representation of time is spatially organized, with short durations represented on the left space and longer ones on the right.     

Time perception with and without a concurrent nontemporal task

Prospective time estimates were obtained from human subjects for stimulus durations ranging from 2 to 23 sec. Presence and absence of a concurrent nontemporal task was manipulated within subjects in three experiments. In addition, location of the task within temporal reproduction trials and psychophysical method were varied between groups in Experiments 2 and 3, respectively. For long-duration stimuli, the results of all three experiments conformed to results in the literature, showing a decrease in perceived duration under concurrent task conditions, in accord with attentional resource allocation models of timing. The effects of task location and psychophysical method on time estimates were also compatible with this analysis. However, psychophysical functions obtained under task conditions were fit well by power functions, an outcome that would not be anticipated on the basis of attention theory. The slopes of the functions under no-task conditions were steeper than those under task conditions. The data support the perceptual hypothesis that different sources of sensory input mediate timing under task and no-task conditions.     

The role of stimulus-based and response-based spatial information in sequence learning

In 4 experiments, relational structures were independently varied in stimulus and response sequences in a serial reaction time task. Moreover, the use of spatial and symbolic stimuli and responses was varied between experiments. In Experiment 1, spatial stimuli (asterisk locations) triggered spatial responses (keystrokes); in Experiment 2, spatial stimuli triggered symbolic responses (verbal digit naming); in Experiment 3, symbolic stimuli (digits) triggered keystrokes; and in Experiment 4, digits triggered verbal responses. The results showed that there is a remarkably stronger effect of relational structures in spatial sequences than in symbolic sequences, irrespective of whether stimulus or response sequences are concerned. This suggests that learning is particularly effective for sequences of spatial locations. It is argued that spatial learning is a critical determinant for the debate on perceptual and motor learning.     

盲人的时间水平方向隐喻的通道特异性

通过2个实验, 考察了感觉通道对盲人的时间水平方向隐喻的影响。实验1发现, 盲人只在动作水平上存在同阅读方向一致的时间水平方向隐喻, 对表征过去的词或句子按左键反应和对表征将来的词或句子按右键反应时更快, 表明盲人用于隐喻时间的空间信息是知觉性的。实验2比较了明眼人可视组被试和明眼人遮眼组被试的时间空间隐喻, 发现明眼人可视组被试只在动作水平上存在时间水平方向隐喻, 明眼人遮眼组被试只在刺激在右侧时呈现才出现动作水平的时间水平方向隐喻。综合分析表明, 盲人和明眼人可视组被试的反应更为接近, 表明盲人的时间空间隐喻未受听觉信息的影响。盲人通过运动通道获得的空间认知代偿了视觉通道信息的缺失。     

Implicit motor sequence learning is not purely perceptual

Many reports have indicated that implicit learning of sequences in a choice response time task is primarily perceptual; subjects learn the sequence of stimuli rather than the sequence of motor responses. Three experiments tested whether implicit motor sequence learning could be purely perceptual: no support was found for that hypothesis. Subjects who merely watched stimuli did not learn the sequence implicitly (Experiment 1), and sequence learning transferred robustly to a different set of stimulus cues (Experiment 2). In the final experiment, the stimulus-response mapping was changed at transfer so that one group of subjects pushed the same sequence of keys but saw new stimuli, whereas another group pushed a different sequence of keys but saw the same stimuli. Transfer to the new mapping was shown only if the motor sequence was kept constant, not the perceptual sequence. It is proposed that subjects learn a sequence of response locations in this and similar tasks.     

Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming.

Reaction time (RT) differences to visual stimuli as a function of expectancy have been attributed to changes in perceptual processing or entirely to shifts in decision and response criteria. To help distinguish between these competing interpretations, event-related brain potentials (ERPs) were recorded to lateralized flashes delivered to visual field locations precued by a central arrow (valid stimuli) or not precued (invalid stimuli). Validly cued stimuli in both simple and choice RT tasks elicited consistent amplitude enhancements of the early, sensory-evoked PI component of the ERP recorded at scalp sites overlying lateral prestriate visual cortex (90-130 ms poststimulus). In contrast, the subsequent N1 component (150-200 ms) was enhanced by validly cued stimuli in the choice RT task condition only. These electrophysiological findings support models proposing that the behavioral effects of precuing expected target locations are due, at least in part, to changes in sensory-perceptual processing. Furthermore, these data provide specific information regarding the neural mechanisms underlying such effects.     

Time course of free-choice priming effects explained by a simple accumulator model

Unconscious visual stimuli can be processed by human observers and modulate their behavior. This has been shown for masked prime stimuli that influence motor responses to subsequent target stimuli. Beyond this, masked stimuli can also affect participants' behavior when they are free to choose one of two response alternatives. This finding demonstrates that an apparently free-choice between alternative behaviors can be subject to influences that are outside of awareness. We report three experiments which exhibit that the temporal dynamic of free-choice priming effects corresponds to that of forced-choice priming effects. Forced-choice priming effects were relatively robust against variations of prime stimuli but sensitive to physical features of target stimuli. Free-choice priming effects, in contrast, depended largely on the stimulus-response compatibility of the prime. A simple accumulator model which accounts for forced-choice response priming can also explain free-choice priming effects by the assumption that unconscious stimuli can initiate motor responses when participants are engaged in a speeded choice-reaction time task. According to our analyses free-choice priming results from a response selection mechanism which integrates conscious and unconscious information from external, stimulus driven sources and also from internal sources.     

Implied body action directs spatial attention

Research confirms that the body influences perception, but little is known about the embodiment of attention. We investigated whether the implied actions of others direct spatial attention, using a lateralized covert-orienting task with nonpredictive central cues depicting static, right/left-facing bodies poised in midaction. Validity effects (decreased response times for validly compared with invalidly cued trials) indicated orienting in the direction of the implied action. In Experiment 1, we compared action (running, throwing) with nonaction (standing) cues. Only the action cues produced validity effects, suggesting that implied action directs attention. The action cues produced faster responses overall, suggesting that action cues prime motor responses. In Experiment 2, we determined whether action cues shifted attention in a specific direction rather than to a general side of space: Two cues had similar action speed and motor effort but differed in implied direction (jumping, vertical; throwing, horizontal). Validity effects were found only for the throw cues for which the implied motion direction was consistent with lateralized target locations. In Experiment 3, we compared block-like stimuli to the throwing action stimuli to examine whether lower level perceptual information could account for the attention effects alone. Validity effects were found only for the human-action stimuli. Overall, the results suggest that predictive simulations of action shift attention in action-consistent directions.     

Attention‐shift vs. response‐priming explanations for the spatial cueing effect in cross‐modal tasks

The task‐irrelevant spatial location of a cue stimulus affects the processing of a subsequent target. This “Posner effect” has been explained by an exogenous attention shift to the spatial location of the cue, improving perceptual processing of the target. We studied whether the left/right location of task‐irrelevant and uninformative tones produces cueing effects on the processing of visual targets. Tones were presented randomly from left or right. In the first condition, the subsequent visual target, requiring response either with the left or right hand, was presented peripherally to left or right. In the second condition, the target was a centrally presented left/right‐pointing arrow, indicating the response hand. In the third condition, the tone and the central arrow were presented simultaneously. Data were recorded on compatible (the tone location and the response hand were the same) and incompatible trials. Reaction times were longer on incompatible than on compatible trials. The results of the second and third conditions are difficult to explain with the attention‐shift model emphasizing improved perceptual processing in the cued location, as the central target did not require any location‐based processing. Consequently, as an alternative explanation they suggest response priming in the hand corresponding to the spatial location of the tone. Simultaneous lateralized readiness potential (LRP) recordings were consistent with the behavioral data, the tone cues eliciting on incompatible trials a fast preparation for the incorrect response and on compatible trials preparation for the correct response.     

On the interplay of visuospatial and audiotemporal dominance: Evidence from a multimodal kappa effect

When participants judge multimodal audiovisual stimuli, the auditory information strongly dominates temporal judgments, whereas the visual information dominates spatial judgments. However, temporal judgments are not independent of spatial features. For example, in the kappa effect, the time interval between two marker stimuli appears longer when they originate from spatially distant sources rather than from the same source. We investigated the kappa effect for auditory markers presented with accompanying irrelevant visual stimuli. The spatial sources of the markers were varied such that they were either congruent or incongruent across modalities. In two experiments, we demonstrated that the spatial layout of the visual stimuli affected perceived auditory interval duration. This effect occurred although the visual stimuli were designated to be task-irrelevant for the duration reproduction task in Experiment 1, and even when the visual stimuli did not contain sufficient temporal information to perform a two-interval comparison task in Experiment 2. We conclude that the visual and auditory marker stimuli were integrated into a combined multisensory percept containing temporal as well as task-irrelevant spatial aspects of the stimulation. Through this multisensory integration process, visuospatial information affected even temporal judgments, which are typically dominated by the auditory modality.     

On the source and scope of priming effects of masked stimuli on endogenous shifts of spatial attention

Unconscious stimuli can influence participants’ motor behavior as well as more complex mental processes. Previous cue-priming experiments demonstrated that masked cues can modulate endogenous shifts of spatial attention as measured by choice reaction time tasks. Here, we applied a signal detection task with masked luminance targets to determine the source and the scope of effects of masked stimuli. Target-detection performance was modulated by prime-cue congruency, indicating that prime-cue congruency modulates signal enhancement at early levels of target processing. These effects, however, were only found when the prime was perceptually similar to the cue indicting that primes influence early target processing in an indirect way by facilitating cue processing. Together with previous research we conclude that masked stimuli can modulate perceptual and post-central levels of processing. Findings mark a new limit of the effects of unconscious stimuli which seem to have a smaller scope than conscious stimuli.     

Lateralized effects of target location on reaction times when preparing for manual aiming at a visual target

To elucidate the temporal characteristics of information processing for motor action differing in complexity in relation to both perceptual and cognitive information processing, we investigated whether the reaction times (RTs) to a visual target would be affected by task complexity (finger lifting or manual aiming), pre-cueing (with a pre-cue or without a pre-cue), or target location (five horizontal positions). Using the right hand, seven right-handed subjects performed two tasks, finger lifting and manual aiming at a target, with or without a pre-cue. The pre-cue announced the location of the target to be presented. An ANOVA showed significant interactions between task and location and between pre-cue and location with no significant interaction between task and pre-cue, indicating that the task-location interaction does not depend on whether or not a pre-cue is given. The manual-aiming RTs were longer than the finger-lifting RTs, and the effects of the target location on the RTs differed for finger lifting and manual aiming. It can be assumed that the longer RTs of manual aiming reflect the time for information processing that is needed when preparing for the aiming action per se, which is an extra movement performed in addition to the simple initiation of finger lifting. Differential RTs (DRTs) calculated by subtracting the finger-lifting RTs from the aiming RTs were therefore examined. The DRTs significantly differed for target locations (i.e., a lateralized effect), with the DRTs for an ipsilateral target appearing to be significantly shorter than those for contralateral and central targets. The lateralized effect appearing on the DRTs may be mediated by the processing of visual-spatial information about visual targets as motor preparations are made for manual aiming.     

Time does not flow without language: Spatial distance affects temporal duration regardless of movement or direction

Much evidence has suggested that people conceive of time as flowing directionally in transverse space (e.g., from left to right for English speakers). However, this phenomenon has never been tested in a fully nonlinguistic paradigm where neither stimuli nor task use linguistic labels, which raises the possibility that time is directional only when reading/writing direction has been evoked. In the present study, English-speaking participants viewed a video where an actor sang a note while gesturing and reproduced the duration of the sung note by pressing a button. Results showed that the perceived duration of the note was increased by a long-distance gesture, relative to a short-distance gesture. This effect was equally strong for gestures moving from left to right and from right to left and was not dependent on gestures depicting movement through space; a weaker version of the effect emerged with static gestures depicting spatial distance. Since both our gesture stimuli and temporal reproduction task were nonlinguistic, we conclude that the spatial representation of time is nondirectional: Movement contributes, but is not necessary, to the representation of temporal information in a transverse timeline.     

Tau and Kappa Effects: The Case of Space-Like-Extent Frequencies

The organization of tonal-temporal information in a memory task was studied in two experiments. The stimuli consisted of four different configurations of eight beeps, presented sequentially. In two configurations, the stimuli were tonal-time congruent, with (constant or variable) inter-stimulus tonal distances corresponding to (constant or variable) inter-stimulus time intervals. In the two other configurations, the stimuli were tonal-time incongruent, with (constant or variable) inter-stimulus tonal distances not corresponding to (variable or constant) inter-stimulus time intervals. After a learning phase consisting of 20 presentations of the target configuration, participants reproduced the spatial (Experiment 1) or temporal (Experiment 2) characteristics of the target 60 times in succession without ever re-examining the target configuration. Classically, in incongruent space-time conditions, the effects of variable inter-stimulus time intervals or inter-stimulus space intervals on the reproduction of constant distances (Tau effect) and constant durations (Kappa effect), respectively, are observed. However, our results showed that this was not the case when the spatial dimension was substituted for the tonal dimension (i.e., the distances between consecutive tones). The results are discussed in the light of the properties of the physical versus frequential space, that is, of a tonal dimension in which the different frequencies were considered as the spatial dimension.     

Temporal preparation improves temporal resolution: Evidence from constant foreperiods

Recent research shows that temporal preparation within a constant foreperiod design improves the spatial resolution of visual perception. The present experiments were designed to investigate whether similar benefits of temporal preparation can be observed in a task that requires high temporal resolution. In three experiments, we assessed the effect of temporal preparation on temporal order judgments (TOJs). In Experiment 1, short foreperiods facilitated TOJ for two spatially adjacent dots. This finding was replicated in Experiment 2, in which the temporal order of two spatially overlapping stimuli (“+” and “x”) had to be discriminated. Experiment 3 investigated the time course of temporal preparation by extending these findings to a wide range of different foreperiod durations. The present findings corroborate recent evidence for a perceptual locus of temporal preparation. Most importantly, they show that temporal preparation within a constant foreperiod design improves the temporal resolution of visual perception, independently of whether TOJ requires a decision about the location or about the identity of the target stimuli.     

Coupling kinematics of memory and kinematics of movement: the conditions for a psychological relativity

The organization of spatial and temporal information relative to memory-movement interactions was studied in a recall task. Stimuli consisted of four different configurations of eight dots, presented sequentially. In two configurations, the stimuli were spatiotemporal congruent, with (constant or variable) inter-stimulus distances corresponding to (constant or variable) inter-stimulus time intervals. In the other two configurations, the stimuli were spatiotemporal incongruent, with (constant or variable) inter-stimulus distances not corresponding to (variable or constant) inter-stimulus time intervals. After a learning phase consisting of 20 presentations of the target configuration, participants performed a series of pointing movements to reproduce both spatial and temporal characteristics of the stimulus 60 times in succession without ever re-examining the target configuration. Classically, in incongruent spatiotemporal conditions, the reproduction of, respectively, constant distances or constant time intervals are strongly disturbed by the simultaneous perception of variable inter-stimulus time intervals (Tau effect) or variable distances (Kappa effect). We assume that these spatiotemporal dependencies, which occur when the response relates to one dimension only, crucially depend on the non-integration of motoric aspects in memory.     

Stop using time reproduction tasks in a comparative perspective without further analyses of the role of the motor response: The example of children

The temporal reproduction task is often used to investigate inter-individual differences in the ability to perceive time without any further analyses of the contribution of motor responses to temporal performance. The present study examined the role of motor responses in the reproduction of a 2.5 s and a 4.5 s signal duration in children and adults, with the former producing longer motor responses. The results showed that the 2.5 s duration was overestimated, especially by the younger children, whereas the 4.5 s duration was underestimated in all age groups. Further analyses indicated that the developmental differences related to motor response time explained the age-related difference in temporal reproduction for the shorter duration but not for the longer duration. The modelling of our data suggests that, for the shorter signal duration, the children initiated their responses at the same time as the adults, but that they reproduced longer durations because their motor response took more time to complete. In contrast, for the 4.5 s duration, the children initiated their responses earlier than the adults. However, they reproduced duration values close to the target time because their motor responses took longer. In addition, whatever the duration value to be reproduced, the representation of the sample duration was more variable in the younger children.     

S-R correspondence effects of irrelevant visual affordance: Time course and specificity of response activation

It has been suggested that representations for action, elicited by an object's visual affordance, serve to potentiate motor components (such as a specific hand) to respond to the most afforded action. In three experiments, participants performed speeded left-right button press responses to an imperative target superimposed onto a prime image of an object suggesting a visual affordance oriented to left or right visual space. The time course of response activation was measured by varying the onset time between the prime and target. Long-lasting and gradually developing correspondence effects were found between the suggested affordance of the prime and the side of response, with little effect of response modality (hands uncrossed, hands crossed, or foot response). We conclude that visual affordances can evoke an abstract spatial response code, potentiating a wide variety of lateralized responses corresponding with the affordance.