Perceptual and motor congruency effects in time–space association

It is well established that temporal events are represented on a spatially oriented mental time line from left to right. Depending on the task characteristics, the spatial representation of time may be linked to different types of dimensions, including manual response codes and physical space codes. The aim of the present study was to analyze whether manual response and physical space codes are independent of each other or whether they interact when both types of information are involved in the task. The participants performed a temporal estimation task with two lateralized response buttons in four experiments. In the first experiment, the target stimuli were presented on the left side, at the center, or on the right side of the space, whereas the reference stimuli were always presented centrally. The reverse situation was presented in the second experiment. In the third experiment, both stimuli were presented in opposite spatial positions (e.g., left–right), whereas in the last experiment, both stimuli were presented in the same spatial position (e.g., left–left). In all experiments, perceptual and motor congruency effects were found, but no modulation of the congruency effects was found when both the perceptual and motor components were congruent. The results indicated that physical, spatial, and manual response codes are independent from each other for time–space associations, even when both codes are involved in the task. These results are discussed in terms of the “intermediate-coding” account.     

Space-time compatibility effects in the auditory modality

Previous research suggests that past and future temporal concepts are spatially represented from left to right along a mental line. And these concepts can both prime motor responses to left or right space and direct visual spatial attention. The present study aimed at investigating the nature of this space-time conceptual metaphor in different auditory tasks. In the first experiment, subjects categorized time-related words (past or future) that were presented binaurally. In the second experiment, subjects detected left-ear or right-ear targets following time-related words. The similar space-time compatibility effects were found in these two experiments. Our results demonstrate that the activation of temporal concepts can both prime motor responses to left or right space and influence the orientation of auditory spatial attention, suggesting that the modality of the stimulus input is unimportant for the left-right mapping of time. These results are explained by the "intermediate coding" account.     

An effect of spatial-temporal association of response codes: understanding the cognitive representations of time

The present study addresses the question of how such an abstract concept as time is represented by our cognitive system. Specifically, the aim was to assess whether temporal information is cognitively represented through left-to-right spatial coordinates, as already shown for other ordered sequences (e.g., numbers). In Experiment 1, the task-relevant information was the temporal duration of a cross. RTs were shorter when short and long durations had to be responded to with left and right hands, respectively, than with the opposite stimulus-response mapping. The possible explanation that the foreperiod effect (i.e., shorter RTs for longer durations) is greater with right than with left hand responses is discarded by results of Experiment 2, in which right and left hand responses alternated block-wise in a variable foreperiod paradigm. Other explanations concerning manual or hemispheric asymmetries may be excluded based on the results of control experiments, which show that the compatibility effect between response side and cross duration occurs for accuracy when responses are given with crossed hands (Experiment 3), and for RTs when responses are given within one hand (Experiment 4). This pattern suggests that elapsing time, similarly to other ordered information, is represented in some circumstances through an internal spatial reference frame, in a way that may influence motor performance. Finally, in Experiment 5, the temporal duration was parametrically varied using different values for each response category (i.e., 3 short and 3 long durations). The compatibility effect between hand and duration was replicated, but followed a rectangular function of the duration. The shape of this function is discussed in relation to the specific task demands.     

Priming the mental time-line: effects of modality and processing mode

The notion of a mental time-line (i.e., past corresponds to left and future corresponds to right) supports the conceptual metaphor view assuming that abstract concepts like “time” are grounded in cognitively more accessible concepts like “space.” In five experiments, we further investigated the relationship between temporal and spatial representations and examined whether or not the spatial correspondents of time are unintentionally activated. We employed a priming paradigm, in which visual or auditory prime words (i.e., temporal adverbs such as yesterday, tomorrow) preceded a colored square. In all experiments, participants discriminated the color of this square by responding with the left or the right hand. Although the temporal reference of the priming adverb was task irrelevant in Experiment 1, visually presented primes facilitated responses to the square in correspondence with the direction of the mental time-line. This priming effect was absent in Experiments 2, 3, and 5, in which the primes were presented auditorily and the temporal reference of the words could be ignored. The effect, however, emerged when attention was oriented to the temporal content of the auditory prime words in Experiment 4. The results suggest that task demands differentially modulate the activation of the mental time-line within the visual and auditory modality and support a flexible association between conceptual codes.     

言语编码和视空编码在时间—空间联结中的作用

时间和空间存在反应编码联合效应（spatial—temporal association of response codes effect, STEARC）,该效应的编码是视觉空间性还是言语性还存在争议。本研究借鉴Georges（2015）的研究方式,以2秒内的时距为刺激,实验1采用言语反应和空间反应,词语和空间与时距的关系分为一致和不一致。结果发现言语反应时,短时距用“左边”反应快,长时距用“右边”反应快,空间反应时,时距和空间的一致性效应消失,表明言语编码参与两种反应形式的STEARC效应。实验2将词语改为箭头朝向（视觉编码条件）,发现视觉编码和空间编码存在于相对应的反应形式中。研究表明时空关系的编码形式与具体任务要求有关。     

时序表征的空间特性

时间是个高度抽象的概念,必须依靠具体的、易感知的事物进行表征。时间表征本质上是隐喻性的,而时间的空间隐喻是时间隐喻表征的原型。受到数字空间表征研究的启示,发现时序表征同样具有空间特性。时序表征具有空间特性具有一定的普遍性,但是在具体的水平或垂直空间维度、“左-右”或“右-左”空间方向上存在一定的灵活性;此外时序能够导致空间注意的转移。     

空间-时间关联的中介共同表征结构:来自反转STEARC效应的证据

通过3个双任务实验(诱导任务和特征任务)探讨空间-时间联合编码(STEARC)效应的加工机制。实验1采用时间信息作为诱导任务材料,实验2采用空间信息作为诱导任务材料,在特征任务中都发现映射不一致组被试(看到过去/左侧刺激时按右键反应,看到未来/右侧刺激时按左键反应)出现反转STEARC效应,映射一致组被试表现出常规的STEARC效应,表明从时间信息加工到空间反应过程符合中介共同表征结构。实验3分离两种任务的反应方式(手动和眼动),发现不一致映射规则下,被试仍然表现出常规的STEARC效应,表明这种中介共同表征结构存在特定联结效应,即在不同反应器中出现时间和空间相互独立的表征结构。总体而言,研究支持空间-时间关联符合中介共同表征结构,并且这种关联中存在反应器特定联结效应。     

Prismatic Lenses Shift Time Perception

ABSTRACT— Previous studies have demonstrated the involvement of spatial codes in the representation of time and numbers. We took advantage of a well-known spatial modulation (prismatic adaptation) to test the hypothesis that the representation of time is spatially oriented from left to right, with smaller time intervals being represented to the left of larger time intervals. Healthy subjects performed a time-reproduction task and a time-bisection task, before and after leftward and rightward prismatic adaptation. Results showed that prismatic adaptation inducing a rightward orientation of spatial attention produced an overestimation of time intervals, whereas prismatic adaptation inducing a leftward shift of spatial attention produced an underestimation of time intervals. These findings not only confirm that temporal intervals are represented as horizontally arranged in space, but also reveal that spatial modulation of time processing most likely occurs via cuing of spatial attention, and that spatial attention can influence the spatial coding of quantity in different dimensions.     

An investigation of spatial representation of pitch in individuals with congenital amusia

Spatial representation of pitch plays a central role in auditory processing. However, it is unknown whether impaired auditory processing is associated with impaired pitch–space mapping. Experiment 1 examined spatial representation of pitch in individuals with congenital amusia using a stimulus–response compatibility (SRC) task. For amusic and non-amusic participants, pitch classification was faster and more accurate when correct responses involved a physical action that was spatially congruent with the pitch height of the stimulus than when it was incongruent. However, this spatial representation of pitch was not as stable in amusic individuals, revealed by slower response times when compared with control individuals. One explanation is that the SRC effect in amusics reflects a linguistic association, requiring additional time to link pitch height and spatial location. To test this possibility, Experiment 2 employed a colour-classification task. Participants judged colour while ignoring a concurrent pitch by pressing one of two response keys positioned vertically to be congruent or incongruent with the pitch. The association between pitch and space was found in both groups, with comparable response times in the two groups, suggesting that amusic individuals are only slower to respond to tasks involving explicit judgments of pitch.     

The Mechanisms of Space‐Time Association: Comparing Motor and Perceptual Contributions in Time Reproduction

The spatial‐temporal association indicates that time is represented spatially along a left‐to‐right line. It is unclear whether the spatial‐temporal association is mainly related to a perceptual or a motor component. In addition, the spatial‐temporal association is not consistently found using a time reproduction task. Our rationale for this finding is that, classically, a non‐lateralized button for performing the task has been used. Using two lateralized response buttons, the aim of the study was to find a spatial‐temporal association in a time reproduction task. To account for the perceptual component, reference and target stimuli were presented in different spaces through four experiments. In all experiments, a Spatial‐Temporal Association of Response Codes (STEARC) effect was found and this effect was not modulated by the spatial position of both reference and target stimuli. The results suggested that the spatial‐temporal association was mainly derived from the spatial information provided by response buttons, reflecting a motor but not visuospatial influence.     

Changing auditory time with prismatic goggles

The aim of the present study was to explore the spatial organization of auditory time and the effects of the manipulation of spatial attention on such a representation. In two experiments, we asked 28 adults to classify the duration of auditory stimuli as "short" or "long". Stimuli were tones of high or low pitch, delivered left or right of the participant. The time bisection task was performed either on right or left stimuli regardless of their pitch (Spatial experiment), or on high or low tones regardless of their location (Tonal experiment). Duration of left stimuli was underestimated relative to that of right stimuli, in the Spatial but not in the Tonal experiment, suggesting that a spatial representation of auditory time emerges selectively when spatial-encoding is enforced. Further, when we introduced spatial-attention shifts using the prismatic adaptation procedure, we found modulations of auditory time processing as a function of prismatic deviation, which correlated with the interparticipant adaptation effect. These novel findings reveal a spatial representation of auditory time, modulated by spatial attention.     

Visual and auditory accessory stimulus offset and the Simon effect

We investigated the effect on the right and left responses of the disappearance of a task-irrelevant stimulus located on the right or left side. Participants pressed a right or left response key on the basis of the color of a centrally located visual target. Visual (Experiment 1) or auditory (Experiment 2) task-irrelevant accessory stimuli appeared or disappeared at locations to the right or left of the central target. In Experiment 1, responses were faster when onset or offset of the visual accessory stimulus was spatially congruent with the response. In Experiment 2, responses were again faster when onset of the auditory accessory stimulus and the response were on the same side. However, responses were slightly slower when offset of the auditory accessory stimulus and the response were on the same side than when they were on opposite sides. These findings indicate that transient change information is crucial for a visual Simon effect, whereas sustained stimulation from an ongoing stimulus also contributes to an auditory Simon effect.     

The propositional structure of discourse in the two cerebral hemispheres

Readers construct at least two interrelated representations when they comprehend a text: (a) a representation of the explicit ideas in a text and the relations among them (i.e., a propositional representation) and (b) a representation of the context or situation to which a text refers (i.e., a discourse model). In a recent study, found evidence that readers' representations were structured according to propositional relations, but only in the left hemisphere. Both hemispheres, however, appeared to represent contextually relevant semantic information. The goal in the current study was to examine further the organization of explicit text concepts in the two hemispheres. We used an item-priming-in-recognition paradigm in combination with a lateralized visual-field manipulation. We found evidence for a propositionally structured representation in the left hemisphere, that is, priming effects that reflected the linear distance between primes and targets in the propositional structure of passages. We also found that the right hemisphere represented explicit text concepts, but we found no evidence that these concepts were organized structurally. In a second experiment, we found our item priming effects reflected the representation of text information in memory and did not reflect lexical-semantic priming at test.     

Crossmodal spatial attention shift produced by centrally presented gaze cues1

Abstract: Despite previous failures to identify visual‐upon‐auditory spatial‐cuing effects, recent studies have demonstrated that the abrupt onset of a lateralized visual stimulus triggers a shift of spatial attention in response to auditory judgment. Nevertheless, whether a centrally presented visual stimulus orients auditory attention remained unclear. The present study investigated whether centrally presented gaze cues trigger a reflexive shift of attention in response to auditory judgment. Participants fixated on a schematic face in which the eyes looked left or right (the cue). A target sound was then presented to the left or right of the cue. Participants judged the direction of the target as quickly as possible. Even though participants were told that the gaze direction did not predict the direction of the target, the response time was significantly faster when the gaze was in the target direction than when it was in the non‐target direction. These findings provide initial evidence for visual‐upon‐auditory spatial‐cuing effects produced by centrally presented cues, suggesting that a reflexive crossmodal shift of attention does occur with a centrally presented visual stimulus.     

A multisensory interaction effect in the conceptual realm of time

Recent studies on the conceptualization of abstract concepts suggest that the concept of time is represented along a left-right horizontal axis, such that left-to-right readers represent past on the left and future on the right. Although it has been demonstrated with strong consistency that the localization (left or right) of visual stimuli could modulate temporal judgments, results obtained with auditory stimuli are more puzzling, with both failures and successes at finding the effect in the literature. The present study supports an account based on the relative relevance of visual versus auditory-spatial information in the creation of a frame of reference to map time: The auditory location of words interacted with their temporal meaning only when auditory information was made more relevant than visual spatial information by blindfolding participants.     

Crossmodal links between audition and touch in covert endogenous spatial attention

We report three experiments designed to investigate the nature of any crossmodal links between audition and touch in sustained endogenous covert spatial attention, using the orthogonal spatial cuing paradigm. Participants discriminated the elevation (up vs. down) of auditory and tactile targets presented to either the left or the right of fixation. In Experiment 1, targets were expected on a particular side in just one modality; the results demonstrated that the participants could spatially shift their attention independently in both audition and touch. Experiment 2 demonstrated that when the participants were informed that targets were more likely to be on one side for both modalities, elevation judgments were faster on that side in both audition and touch. The participants were also able to "split" their auditory and tactile attention, albeit at some cost, when targets in the two modalities were expected on opposite sides. Similar results were also reported in Experiment 3 when participants adopted a crossed-hands posture, thus revealing that crossmodal links in audiotactile attention operate on a representation of space that is updated following posture change. These results are discussed in relation to previous findings regarding crossmodal links in audiovisual and visuotactile covert spatial attentional orienting.     

盲人的时间水平方向隐喻的通道特异性

通过2个实验, 考察了感觉通道对盲人的时间水平方向隐喻的影响。实验1发现, 盲人只在动作水平上存在同阅读方向一致的时间水平方向隐喻, 对表征过去的词或句子按左键反应和对表征将来的词或句子按右键反应时更快, 表明盲人用于隐喻时间的空间信息是知觉性的。实验2比较了明眼人可视组被试和明眼人遮眼组被试的时间空间隐喻, 发现明眼人可视组被试只在动作水平上存在时间水平方向隐喻, 明眼人遮眼组被试只在刺激在右侧时呈现才出现动作水平的时间水平方向隐喻。综合分析表明, 盲人和明眼人可视组被试的反应更为接近, 表明盲人的时间空间隐喻未受听觉信息的影响。盲人通过运动通道获得的空间认知代偿了视觉通道信息的缺失。     

Interactions between perceptual and numerical space

Interactions between numbers and space have become a major issue in numerical cognition. Neuropsychological studies suggest that the interactions occur, before response selection, at a spatially organized representation of numbers (the mental number line). Reaction time (RT) studies, on the other hand, usually point to associations between response codes that do not necessarily imply a number line. There is only one such study that has found a spationumerical interaction between perception and semantics (SNIPS) effect before response selection. Here, in Experiment 1, we isolated the SNIPS effect from other numerical effects and corroborated the prediction that it can be induced by both left and right spatial cues. In Experiment 2, we isolated the peak of the time course of the SNIPS effect and corroborated the prediction that it occurs when a cue follows a target, and not when both appear simultaneously. The results reconcile neuropsychological and RT studies and support the hypothesis that numbers are represented along a left-to-right spatially organized mental number line. [corrected]     

SNARC效应: 现状、理论与建议

SNARC效应是当对数字进行奇偶判断时,即使数的奇偶性与数的大小无关,但右手（左手）对相对大（小）的数的反应快。首先介绍SNARC效应的起源和理论解释,然后总结SNARC效应的特性,论述SNARC效应和Simon效应以及MARC 效应的关系,并对SNARC效应的脑机制进行了概述,最后提出3个有待深入研究的问题：（1）SNARC效应的加工处理机制;（2）SANRC效应的理论探索;（3）SNARC效应的本质。     

Influence of endogenous and exogenous orientations of attention on inhibition of return in a cross-modal target-target aiming task

The authors conducted 2 experiments in which participants (N = 16 in each) executed successive unimanual aiming movements to target locations that were indicated by the onset of either an auditory or a visual stimulus. In Experiment 1 (exogenous orientation), inhibition of return (IOR) effects were observed, with reliable reaction time (RT) costs associated with movements returning to the same target and a trend toward larger IOR effects in left than in right space. There was no influence of stimulus modality on the magnitude of IOR. IOR was also observed in Experiment 2 (endogenous orientation), except the influence of stimulus modality reliably mediated those effect. In that case, IOR was evident only when the previous modality was visual and the current modality was auditory. Together, the results of those 2 experiments suggest that in situations in which 2 paired movements constitute the response criteria, IOR is both supramodal and lateralized to contralateral space.