Mental representations of magnitude and order: A dissociation by sensorimotor learning

Numbers and spatially directed actions share cognitive representations. This assertion is derived from studies that have demonstrated that the processing of small- and large-magnitude numbers facilitates motor behaviors that are directed to the left and right, respectively. However, little is known about the role of sensorimotor learning for such number–action associations. In this study, we show that sensorimotor learning in a serial reaction-time task can modify the associations between number magnitudes and spatially directed movements. Experiments 1 and 3 revealed that this effect is present only for the learned sequence and does not transfer to a novel unpracticed sequence. Experiments 2 and 4 showed that the modification of stimulus–action associations by sensorimotor learning does not occur for other sets of ordered stimuli such as letters of the alphabet. These results strongly suggest that numbers and actions share a common magnitude representation that differs from the common order representation shared by letters and spatially directed actions. Only the magnitude representation, but not the order representation, can be modified episodically by sensorimotor learning.     

Organization of visuo-spatial serial memory: interaction of temporal order with spatial and temporal grouping

This study investigates whether memory for sequences of spatial locations can be represented hierarchically, that is, as successive groups containing the order of constituent locations. Two grouping manipulations are used: Temporal grouping, based on the verbal serial memory literature, and spatial grouping, based on recent empirical work on visuo-spatial serial memory. In Experiment 1, we examine the relationship between spatial grouping and temporal order and showed that recall performance increases when both temporal and spatial organization correlate, but decreases when they clash. Experiments 2 and 3 show that the latter result is confounded by differences in path length (length of spatial path defined by the locations) between conditions, and that no effect of the spatial organization is observed when path length is controlled for. In Experiment 4, an alternative method to spatial grouping, temporal grouping, is used to induce hierarchical organization. A recall advantage is found in the temporal grouping condition. The results suggest that hierarchical representations can be imposed on order information for visuo-spatial sequences, either when participants have pre-existing knowledge about the form of the path formed by the sequence or when temporal boundaries delimit chunks; that increased path length is the cause of the performance decrement observed when dots from separate spatial groups are presented successively; and that path length and more generally sequence characteristics should be taken into account in designing future research on visuo-spatial serial memory.     

The unimportance of explicit spatial information in serial recall of visually presented lists

The superiority of auditory over visual presentation in short-term serial recall may be due to the fact that typically only temporal cues to order have been provided in the two modalities. Auditory information is usually ordered along a temporal continuum, whereas visual information is ordered spatially, as well. It is therefore possible that recall following visual presentation may benefit from spatial cues to order. Subjects were tested for serial recall of letter-sequences presented visually either with or without explicit spatial cues to order. No effect of any kind was found, a result which suggests (a) that spatial information is not utilized when it is redundant with temporal information and (b) that the auditory-visual difference would not be modified by the presence of explicit spatial cues to order.     

Are spatial and temporal attention independent?

Participants searched for one of two target letters in a rapid serial visual presentation (RSVP) sequence of 17 successive frames, each containing four letters arranged into a box around a central fixation point. In control trial blocks, the participants had no information about when or where one of the target letters would appear. In other trial blocks, visual cues were given to indicate with 100% validity either the spatial location of the target, the time at which it would be presented, or both where and when it would appear. The results showed that both types of cues were effective on their own in speeding target identification, and their effects combined additively when the cues were presented and used together. These results support a growing body of evidence indicating that early attentional selection of information in vision is independently attuned to spatial and temporal properties of the environment.     

Multiple roles for time in short-term memory: evidence from serial recall of order and timing

Three experiments are reported that examine the relationship between short-term memory for time and order information, and the more specific claim that order memory is driven by a timing signal. Participants were presented with digits spaced irregularly in time and postcued (Experiments 1 and 2) or precued (Experiment 3) to recall the order or timing of the digits. The primary results of interest were as follows: (a) Instructing participants to group lists had similar effects on serial and timing recall in inducing a pause in recall between suggested groups; (b) the timing of recall was predicted by the timing of the input lists in both serial recall and timing recall; and (c) when the recall task was precued, there was a tendency for temporally isolated items to be more accurately recalled than temporally crowded items. The results place constraints on models of serial recall that assume a timing signal generates positional representations and suggest an additional role for information about individual durations in short-term memory.     

Evidence from mutual masking for serial processing of tachistoscopic letter patterns.

This experiment deomonstrates serial processing of tachistoscopic patterns when all potential artifacts are eliminated. Two nonsense arrays of six letters were tachistoscopically exposed successively at the same positions. Ss identified more letters from the temporally first string on the left of fixation and more from the second on the right, indicating left-to-right serial processing. Variations among Ss in the location of the crossover in curves indicate individual differences in processing time. Therefore, this study demonstrates definitively that tachistoscopic performance at various positions can reflect a sequential left-to-right processing of information, possibly at different rates.     

Spatial stimulus-response compatibility and coding of tactile motor events: influence of distance between stimulated and responding body parts, spatial complexity of the task and sex of subject

We studied spatial stimulus response compatibility in the somatosensory modality by instructing 16 men and 16 women to press a key using the left or the right thumb in response to a nonnoxious electric stimulation delivered either to the left or to the right little finger or, in different blocks, to the left or to the right malleolar region. The task was performed in compatible (stimulus and key-response on the same side of the corporeal midline) and in incompatible conditions (stimulus and key-response on opposite sides of the corporeal midline). In Exp. 1 subjects were tested while keeping their limbs in anatomic position; in Exp. 2 subjects performed the task while keeping the left upper and lower limbs on the right side and the right limbs on the left side of the bodily midline (crossed position). The compatibility effect was observed in both experiments and was higher for stimuli delivered to the little finger than to the malleolar region. This suggests that the cost of inhibiting compatible responses is maximal when stimulated and responding body parts are contiguous. Moreover, in the spatially most demanding task (Exp. 2) men outperformed women for both speed and accuracy suggesting a sex related specialisation in the spatial processing of somatosensory information.     

Temporal order of strokes primes letter recognition

Does the perception of objects that are the result of human actions reflect the underlying temporal structure of the actions that gave rise to them? We tested whether the temporal order of letter strokes influences letter recognition. In three experiments, participants were asked to identify letters that temporally unfolded as an additive sequence of letter strokes, either consistent or inconsistent with common writing action. Participants were significantly faster to identify letters from consistent temporal sequences, indicating that the initial part of the sequence contained sufficient information to prime letter recognition. We suggest that letter perception reflects the temporal structure of letter production; in other words, Simon sees as Simon does.     

Temporal order of strokes primes letter recognition

Does the perception of objects that are the result of human actions reflect the underlying temporal structure of the actions that gave rise to them? We tested whether the temporal order of letter strokes influences letter recognition. In three experiments, participants were asked to identify letters that temporally unfolded as an additive sequence of letter strokes, either consistent or inconsistent with common writing action. Participants were significantly faster to identify letters from consistent temporal sequences, indicating that the initial part of the sequence contained sufficient information to prime letter recognition. We suggest that letter perception reflects the temporal structure of letter production; in other words, Simon sees as Simon does.     

The accuracy of spatial information from temporally and spatially organized mental maps

The way a space is learned can result in a mental mapthat is either temporally or spatially organized (Curiel & Radvansky, 1998). The present study examined the availability of spatial information under maplearning conditions where either temporal or spatial organization has been previously observed. The finding was that people were fairly accurate in tasks that explicitly required the use of spatial information. However, there was a particular advantage for having a spatially organized mental mapin a direction judgment task, especially for short distances where fine-grained knowledge was required. In contrast, there was no clear advantage for either group in a distance estimation task. These data are interpreted in the context of Huttenlocher’s category adjustment model.     

Cross-cultural differences in mental representations of time: evidence from an implicit nonlinguistic task

Across cultures people construct spatial representations of time. However, the particular spatial layouts created to represent time may differ across cultures. This paper examines whether people automatically access and use culturally specific spatial representations when reasoning about time. In Experiment 1, we asked Hebrew and English speakers to arrange pictures depicting temporal sequences of natural events, and to point to the hypothesized location of events relative to a reference point. In both tasks, English speakers (who read left to right) arranged temporal sequences to progress from left to right, whereas Hebrew speakers (who read right to left) arranged them from right to left, replicating previous work. In Experiments 2 and 3, we asked the participants to make rapid temporal order judgments about pairs of pictures presented one after the other (i.e., to decide whether the second picture showed a conceptually earlier or later time-point of an event than the first picture). Participants made responses using two adjacent keyboard keys. English speakers were faster to make "earlier" judgments when the "earlier" response needed to be made with the left response key than with the right response key. Hebrew speakers showed exactly the reverse pattern. Asking participants to use a space-time mapping inconsistent with the one suggested by writing direction in their language created interference, suggesting that participants were automatically creating writing-direction consistent spatial representations in the course of their normal temporal reasoning. It appears that people automatically access culturally specific spatial representations when making temporal judgments even in nonlinguistic tasks.     

Sequence learning in Parkinson's disease: the effect of spatial stimulus-response compatibility

Patients with Parkinson's disease (PD) have repeatedly demonstrated reduced sequence-specific learning effects in serial reaction time tasks (SRTs). Previous research with PD patients has mainly employed the 'classical' SRT task, involving a spatially compatible assignment of stimuli and responses. From cognitive research, it is known that spatial compatibility triggers rapid, automatic responses in the direction of the stimulus. Automatic responding has shown to be disinhibited in PD patients and may therefore interfere with stimulus anticipation during the learning process. The aim of the present study was to test this hypothesis by investigating if reduced sequence-specific learning depends on spatial stimulus-response compatibility. PD patients and age-matched controls were examined either with an SRT variant involving central stimulus presentation, thereby preventing automatic linking of stimulus and response locations, or with a spatially compatible SRT task. Patients showed reduced sequence-specific learning effects only when the stimulus-response assignment was spatially compatible. This pattern of results confirms the hypothesis that sequence learning deficits in PD may result from a predominance of automatic response activation over learning-based stimulus anticipations during the learning phase.     

空间-时间关联的中介共同表征结构:来自反转STEARC效应的证据

通过3个双任务实验(诱导任务和特征任务)探讨空间-时间联合编码(STEARC)效应的加工机制。实验1采用时间信息作为诱导任务材料,实验2采用空间信息作为诱导任务材料,在特征任务中都发现映射不一致组被试(看到过去/左侧刺激时按右键反应,看到未来/右侧刺激时按左键反应)出现反转STEARC效应,映射一致组被试表现出常规的STEARC效应,表明从时间信息加工到空间反应过程符合中介共同表征结构。实验3分离两种任务的反应方式(手动和眼动),发现不一致映射规则下,被试仍然表现出常规的STEARC效应,表明这种中介共同表征结构存在特定联结效应,即在不同反应器中出现时间和空间相互独立的表征结构。总体而言,研究支持空间-时间关联符合中介共同表征结构,并且这种关联中存在反应器特定联结效应。     

Visual distraction and visuo‐spatial memory: A sandwich effect

The functional characteristics of visuo‐spatial serial memory and its sensitivity to irrelevant visual information are examined in the present study, through the investigation of the sandwich effect (e.g., ). The memory task was one of serial recall for the position of a sequence of seven spatially and temporally separated dots. The presence of irrelevant dots interpolated with to‐be‐remembered dots affected performance over most serial positions (Experiment 1) but that effect was significantly reduced when the interpolated dots were distinct from the to‐be‐remembered dots by colour and shape (Experiment 2). Parallels are made between verbal and spatial serial memory, and the reduction of the sandwich effect is discussed in terms of the contribution of perceptual organisation and attentional factors in short‐term memory.     

Concurrent learning of temporal and spatial sequences

In a serial reaction time task, stimulus events simultaneously defined spatial and temporal sequences. Responses were based on the spatial dimension. The temporal sequence was incidental to the task, defined by the response-to-stimulus intervals in Experiment 1 and stimulus onset asynchronies in Experiment 2. The two sequences were either of equal length and correlated or of unequal length. In both experiments, spatial learning occurred regardless of sequence length condition. In contrast, temporal learning occurred only in the correlated condition. These results suggest that timing is an integrated part of action representations and that incidental learning for a temporal pattern does not occur independently from the action. Interestingly, sequence learning was enhanced in the correlated condition, reflecting the integration of spatial-temporal information.     

Priming the mental time line

Growing experimental evidence suggests that temporal events are represented on a mental time line, spatially oriented from left to right. Support for the spatial representation of time comes mostly from studies that have used spatially organized responses. Moreover, many of these studies did not avoid possible confounds attributable to target stimuli that simultaneously convey both spatial and temporal dimensions. Here we show that task-irrelevant, lateralized visuospatial primes affect auditory duration judgments. Responses to short durations were faster when the auditory target was paired with left- than with right-sided primes, whereas responses to long durations were faster when paired with right- than with left-sided primes. Thus, when the representations of physical space and time are concurrently activated, physical space may influence time even when a lateralized, spatially encoded response is not required by the task. The time-space interaction reported here cannot be ascribed to any Spatial-Temporal Association of Response Codes effect. It supports the hypothesis that the representation of time is spatially organized, with short durations represented on the left space and longer ones on the right.     

Ecological Representations

Abstract

Representations feature heavily in cognitive science theories about our behavioral repertoire. Their critical feature is its ability to designate (stand in for) spatially or temporally distant properties, so that organizing our behavior with respect to mental/neural representations means organizing our behavior with respect to the otherwise unavailable property they designate. Representations are a powerful tool, but serious problems (grounding, system-detectable error) remain unsolved. Ecological explanations reject representations. However, this has left us without a straightforward vocabulary to engage with “representation-hungry” problems involving spatial or temporal distance, nor the role of the nervous system in cognition. To develop such a vocabulary, here we show that ecological information functions to designate the ecologically scaled dynamical world to an organism. We then show that this designation analysis of information leads to an ecological conceptualization of the neural activity caused by information, and finally we argue these together can support intentional behavior with respect to spatially and temporally distal properties. The way they do so (via designation) does mean information and the related neural activity can be conceptualized as representations; but they do so in a grounded way that remains true to key ecological ontological commitments. We advocate this path for expanding the ecological approach.     

Visual distraction and visuo-spatial memory: a sandwich effect

The functional characteristics of visuo-spatial serial memory and its sensitivity to irrelevant visual information are examined in the present study, through the investigation of the sandwich effect (e.g., Hitch, 1975). The memory task was one of serial recall for the position of a sequence of seven spatially and temporally separated dots. The presence of irrelevant dots interpolated with to-be-remembered dots affected performance over most serial positions (Experiment 1) but that effect was significantly reduced when the interpolated dots were distinct from the to-be-remembered dots by colour and shape (Experiment 2). Parallels are made between verbal and spatial serial memory, and the reduction of the sandwich effect is discussed in terms of the contribution of perceptual organisation and attentional factors in short-term memory.     

Visuo-spatial representations of the alphabet in synaesthetes and non-synaesthetes

Visuo-spatial representations of the alphabet (so-called 'alphabet forms') may be as common as other types of sequence-space synaesthesia, but little is known about them or the way they relate to implicit spatial associations in the general population. In the first study, we describe the characteristics of a large sample of alphabet forms visualized by synaesthetes. They most often run from left to right and have salient features (e.g., bends, breaks) at particular points in the sequence that correspond to chunks in the 'Alphabet Song' and at the alphabet mid-point. The Alphabet Song chunking suggests that the visuo-spatial characteristics are derived, at least in part, from those of the verbal sequence learned earlier in life. However, these synaesthetes are no faster at locating points in the sequence (e.g., what comes before/after letter X?) than controls. They tend to be more spatially consistent (measured by eye tracking) and letters can act as attentional cues to left/right space in synaesthetes with alphabet forms (measured by saccades), but not in non-synaesthetes. This attentional cueing suggests dissociation between numbers (which reliably act as attentional cues in synaesthetes and non-synaesthetes) and letters (which act as attentional cues in synaesthetes only).     

Relations between timing,position, and grouping in short-term memory

This article is concerned with how information about time and position in a sequence is represented in short-term memory and expressed in the dynamics of serial recall. Temporal-distinctiveness theories of memory predict that isolating a list item in time will improve recall accuracy for that item. Although the majority of research in short-term memory has failed to demonstrate a temporal isolation effect (TIE), there are occasions on which a TIE is observed. The disparity in results has been explained by assuming that participants can adaptively weight temporal and nontemporal information at retrieval, with differences between experiments promoting or discouraging reliance on time as a source of episodic information. A particular focus of the present study is the finding that the TIE is substantially observed in standard serial recall only when participants are instructed to group the list into minisequences. The findings of two experiments using instructed grouping replicated this effect but showed that it is attributable to a longer gap at the group boundary enhancing the positive effect of grouping on recall accuracy. These results show that the hierarchical representations usually associated with temporal grouping are also elicited by instructed grouping but that an additional and nonspecific benefit to recall obtains from lengthening the pause between groups. An additional role for time is identified in the timing of responses: The dynamics of input sequences tend to be mirrored in output sequences for ungrouped lists, whereas the primacy pattern in grouped lists is for a longer duration to speed access to the following group when that duration occurs at an instructed group boundary.