Letters in time and retinotopic space

Various phenomena in tachistoscopic word identification and priming (WRODS and LTRS are confused with and prime WORDS and LETTERS) suggest that position-specific channels are not used in the processing of letters in words. Previous approaches to this issue have sought alternative matching rules because they have assumed that these phenomena reveal which stimuli are good but imperfect matches to a particular word-such imperfect matches being taken by the word recognition system as partial evidence for that word. The new Letters in Time and Retinotopic Space model (LTRS) makes the alternative assumption that these phenomena reveal the rates at which different features of the stimulus are extracted, because the stimulus is ambiguous when some features are missing from the percept. LTRS is successfully applied to tachistoscopic identification and form priming data with manipulations of duration and target-foil and prime-target relationships.     

Seeing and hearing and space and space and time

A previous experiment had shown spatial location to be judged in terms of the framework provided by the modality in which stimuli were presented. In the present study, digits were either auditorally or visually presented, and in either form the three digits appeared successivly to the left, in the center, and to the right of the S. The digit which occurred temporally in the middle of the sequence was never central from the spatial viewpoint. The S was asked to indicate which digit was the middle one. Ss were blind, deaf, or normal. The deaf and two control groups saw visual displays, and the blind and their controls heard auditory displays. The former groups predominantly chose the spatially middle digit and the latter groups the temporally middle. It was concluded that modality of presentation was the trigger which switched in the coding dimension of time or space.     

Dimensional overlap between time and space

Several pieces of evidence suggest that our mental representations of time and space are linked. However, the extent of this linkage between the two domains has not yet been assessed. We present the results of two experiments that draw on the predictions of the dimensional overlap model (Kornblum, Hasbroucq, & Osman, Psychological Review 97:253–270, 1990). The stimulus and response sets in these reaction time experiments were related to either time or space. The obtained stimulus–response congruency effects were of about the same size for identical stimulus–response sets (time–time or space–space) and for different stimulus–response sets (time–space or space–time). These results support the view that our representations of time and space are strongly linked.     

Saccades compress space, time and number

It has been suggested that space, time and number are represented on a common subjective scale. Saccadic eye movements provide a fascinating test. Saccades compress the perceived magnitude of spatial separations and temporal intervals to approximately half of their true value. The question arises as to whether saccades also compress number. They do, and compression follows a very similar time course for all three attributes: it is maximal at saccadic onset and decreases to veridicality within a window of approximately 50ms. These results reinforce the suggestion of a common perceptual metric, which is probably mediated by the intraparietal cortex; they further suggest that before each saccade the common metric for all three is reset, possibly to pave the way for a fresh analysis of the post-saccadic situation.     

Confusion of space and time in the flash-lag effect

The apparent lagging of a short flash in the relation to a moving object, the flash-lag effect (FLE), has so far been measured mainly in terms of illusory spatial offset. We propose a method of measuring the perceived temporal asynchrony of the FLE separately from its perceived spatial offset. We presented a moving stimulus that changed its colour at a certain moment. The observer indicated, in two different tasks, where and when the colour change occurred in relation to a stationary reference flash. Results show that the perceived time of the colour change was not congruent with the perceived location of the colour change: the colour change is perceived simultaneously with the flash, but is shifted in position. The presentation of the reference in the form of a flash is not critical for the occurrence of the FLE, because the same effect was obtained with a constantly visible reference signal, the position of which or time when it changed its colour were varied. The observer was not able to ignore the irrelevant dimension of the reference signal: the apparent time of the colour change was influenced by the position of the reference signal, and the apparent location of the colour change was influenced by the presentation time of the reference signal. The observer's inability to separate the spatial and temporal aspects of the moving stimulus clearly imposes certain limits on theories that are attempting to explain the FLE exclusively in terms of the perceived space and time.     

Binding across space and time in visual working memory

Recent studies of visual short-term memory have suggested that the binding of features such as color and shape into remembered objects is relatively automatic. A series of seven experiments broadened this investigation by comparing the immediate retention of colored shapes with performance when color and shape were separated either spatially or temporally, with participants required actively to form the bound object. Attentional load was manipulated with a demanding concurrent task, and retention in working memory was then tested using a single recognition probe. Both spatial and temporal separation of features tended to impair performance, as did the concurrent task. There was, however, no evidence for greater attentional disruption of performance as a result of either spatial or temporal separation of features. Implications for the process of binding in visual working memory are discussed, and an interpretation is offered in terms of the episodic buffer component of working memory, which is assumed to be a passive store capable of holding bound objects, but not of performing the binding.     

Tracking visual search over space and time

Visual perception consists of early preattentive processing and subsequent attention-demanding processing. Most researchers implicitly treat preattentive processing as a domain-dependent, indivisible stage. We show, however, by interrupting preattentive visual processing of color before its completion, that it can be dissected both temporally and spatially. The experiment depends on changing easy (preattentive) selection into difficult (attention-demanding) selection. We show that although the mechanism subserving preattentive selection completes processing as early as 200 msec after stimulus onset, partial selection information is available well before completion. Furthermore, partial selection occurs first at locations near fixation, spreading radially outward as processing proceeds.     

Memory and learning for visual signals in time and space

Vision is often characterized as a spatial sense, but what does that characterization imply about the relative ease of processing visual information distributed over time rather than over space? Three experiments addressed this question, using stimuli comprising random luminances. For some stimuli, individual items were presented sequentially, at 8 Hz; for other stimuli, individual items were presented simultaneously, as horizontal spatial arrays. For temporal sequences, subjects judged whether each of the last four luminances matched the corresponding luminance in the first four; for spatial arrays, they judged whether each of the right-hand four luminances matched the corresponding left-hand luminance. Overall, performance was far better with spatial presentations, even when the entire spatial array was presented for just tens of milliseconds. Experiment 2 demonstrated that there was no gain in performance from combining spatial and temporal information within a single stimulus. In a final experiment, particular spatial arrays or temporal sequences were made to recur intermittently, interspersed among, non-recurring stimuli. Performance improved steadily as particular stimulus exemplars recurred, with spatial and temporal stimuli being learned at equivalent rates. Logistic regression identified several shortcut strategies that subjects may have exploited while performing our task.     

The role of space and time in object-based visual search

Recently we have provided evidence that observers more readily select a target from a visual search display if the motion trajectory of the display object suggests that the observer has dealt with it before. Here we test the prediction that this object-based memory effect on search breaks down if the spatiotemporal trajectory is disrupted. Observers searched a display for a target shape among multiple distractors. The entire search display then passed behind an occluder and reemerged in either the same or a different configuration. Experiment 1 shows that the same-object benefit for selection disappears whenever a spatial disruption is involved, but that it may survive a brief temporal disruption. Experiment 2 shows that with sufficiently long gaps, a temporal disruption also destroys the same-object benefit for selective attention. Experiment 3 demonstrates that the same-object effect is even stronger when there only is a very small probability that the target can be found at the same location as before. This also made the task sensitive to brief temporal disruptions. We conclude that a coherent spatiotemporal history of a display object supports the selection of its relevant subregions.     

Some open problems in the philosophy of space and time

This article is concerned to formulate some open problems in the philosophy of space and time that require methods characteristic of mathematical traditions in the foundations of geometry for their solution. In formulating the problems an effort has been made to fuse the separate traditions of the foundations of physics on the one hand and the foundations of geometry on the other. The first part of the paper deals with two classical problems in the geometry of space, that of giving operationalism an exact foundation in the case of the measurement of spatial relations, and that of providing an adequate theory of approximation and error in a geometrical setting. The second part is concerned with physical space and space-time and deals mainly with topics concerning the axiomatic theory of bodies, the operational foundations of special relativity and the conceptual foundations of elementary physics.     

On the role of space and time in auditory processing

Unlike visual and tactile stimuli, auditory signals that allow perception of timbre, pitch and localization are temporal. To process these, the auditory nervous system must either possess specialized neural machinery for analyzing temporal input, or transform the initial responses into patterns that are spatially distributed across its sensory epithelium. The former hypothesis, which postulates the existence of structures that facilitate temporal processing, is most popular. However, I argue that the cochlea transforms sound into spatiotemporal response patterns on the auditory nerve and central auditory stages; and that a unified computational framework exists for central auditory, visual and other sensory processing. Specifically, I explain how four fundamental concepts in visual processing play analogous roles in auditory processing.     

Metaphoric structuring: understanding time through spatial metaphors

The present paper evaluates the claim that abstract conceptual domains are structured through metaphorical mappings from domains grounded directly in experience. In particular, the paper asks whether the abstract domain of time gets its relational structure from the more concrete domain of space. Relational similarities between space and time are outlined along with several explanations of how these similarities may have arisen. Three experiments designed to distinguish between these explanations are described. The results indicate that (1) the domains of space and time do share conceptual structure, (2) spatial relational information is just as useful for thinking about time as temporal information, and (3) with frequent use, mappings between space and time come to be stored in the domain of time and so thinking about time does not necessarily require access to spatial schemas. These findings provide some of the first empirical evidence for Metaphoric Structuring. It appears that abstract domains such as time are indeed shaped by metaphorical mappings from more concrete and experiential domains such as space.