A memory-based, Simon-like, spatial congruence effect: Evidence for persisting spatial codes

The Simon effect refers to the finding that in a task where stimulus location is irrelevant, reaction time is faster when stimulus and response locations are congruent than when they are not. Dominant theories of the Simon effect have generally attributed this spatial congruence effect to a spatial code automatically generated upon stimulus presentation. A common assumption of these theories is that this spatial code decays in less than a few hundred milliseconds following stimulus onset. We report two working-memory experiments suggesting a reexamination of this assumption—a Simon-like spatial congruence effect persisted over a delay of as long as 2400 ms. We propose that, in addition to generating short-lived perceptual codes, spatial information may be coded in working memory as part of the context associated with stimulus events. When reactivated by cues from the original event, such information may influence response selection and produce spatial congruence effects (in this case, positive when participants made a “yes” response and negative when they made a “no” response).     

Iconic memory and visible persistence

There are three senses in which a visual stimulus may be said to persist psychologically for some time after its physical offset. First, neural activity in the visual system evoked by the stimulus may continue after stimulus offset (“neural persistence”). Second, the stimulus may continue to be visible for some time after its offset (“visible persistence”). Finally, information about visual properties of the stimulus may continue to be available to an observer for some time after stimulus offset (“informational persistence”). These three forms of visual persistence are widely assumed to reflect a single underlying process: a decaying visual trace that (1) consists of afteractivity in the visual system, (2) is visible, and (3) is the source of visual information in experiments on decaying visual memory. It is argued here that this assumption is incorrect. Studies of visible persistence are reviewed; seven different techniques that have been used for investigating visible persistence are identified, and it is pointed out that numerous studies using a variety of techniques have demonstrated two fundamental properties of visible persistence: theinverse duration effect (the longer a stimulus lasts, the shorter is its persistence after stimulus offset) and theinverse intensity effect (the more intense the stimulus, the briefer its persistence). Only when stimuli are so intense as to produce afterimages do these two effects fail to occur. Work on neural persistences is briefly reviewed; such persistences exist at the photoreceptor level and at various stages in the visual pathways. It is proposed that visible persistence depends upon both of these types of neural persistence; furthermore, there must be an additional neural locus, since a purely stereoscopic (and hence cortical) form of visible persistence exists. It is argued that informational persistence is defined by the use of the partial report methods introduced by Averbach and Coriell (1961) and Sperling (1960), and the term “iconic memory” is used to describe this form of persistence. Several studies of the effects of stimulus duration and stimulus intensity upon the duration of iconic memory have been carried out. Their results demonstrate that the duration of iconic memory is not inversely related to stimulus duration or stimulus intensity. It follows that informational persistence or iconic memory cannot be identified with visible persistence, since they have fundamentally different properties. One implication of this claim that one cannot investigate iconic memory by tasks that require the subject to make phenomenological judgments about the duration of a visual display. In other words, the so-called “direct methods” for studying iconic memory do not provide information about iconic memory. Another implication is that iconic memory is not intimately tied to processes going on in the visual system (as visible persistence is); provided a stimulus is adequately legible, its physical parameters have little influence upon its iconic memory. The paper concludes by pointing out that there exists an alternative to the usual view of iconic memory as a precategorical sensory buffer. According to this alternative, iconic memory is post-categorical, occurring subsequent to stimulus identification. Here, stimulus identification is considered to be a rapid automatic process which does not require buffer storage, but which provides no information about episodic properties of a visual stimulus. Information about these physical stimulus properties must, in some way, be temporarily attached to a representation of the stimulus in semantic memory; and it is this temporarily attached physical information which constitutes iconic memory.     

Object correspondence across brief occlusion is established on the basis of both spatiotemporal and surface feature cues

The correspondence problem is a classic issue in vision and cognition. Frequent perceptual disruptions, such as saccades and brief occlusion, create gaps in perceptual input. How does the visual system establish correspondence between objects visible before and after the disruption? Current theories hold that object correspondence is established solely on the basis of an object’s spatiotemporal properties and that an object’s surface feature properties (such as color or shape) are not consulted in correspondence operations. In five experiments, we tested the relative contributions of spatiotemporal and surface feature properties to establishing object correspondence across brief occlusion. Correspondence operations were strongly influenced both by the consistency of an object’s spatiotemporal properties across occlusion and by the consistency of an object’s surface feature properties across occlusion. These data argue against the claim that spatiotemporal cues dominate the computation of object correspondence. Instead, the visual system consults multiple sources of relevant information to establish continuity across perceptual disruption.     

Duration of visible persistence in relation to stimulus complexity.

Visible persistence refers to the phenomenal impression that a stimulus is still present after its offset. A dispute exists whether visible persistence is due to temporal sluggishness in the visual pathway (neural hypothesis) or whether it is a byproduct of information-extraction processes under cognitive control (process hypothesis). This was investigated by manipulating stimulus complexity in five temporal integration experiments and one recognition memory experiment. According to the process hypothesis, complex stimuli should persist longer than simple stimuli because they require more information extraction. This prediction was not confirmed; in all six experiments, complexity was found to have no reliable effect on the duration of visible persistence. By contrast, and in accordance with earlier findings, complexity was shown to have a significant effect on a short-lived, nonvisible form of memory known as schematic persistenc. This pattern of results supports two major conclusions: First, that the effects of complexity reported in earlier research were probably on schematic--rather than visible--persistence; and second, that visible persistence must be regarded as a residual neural trace of an extinguished stimulus, rather than as a byproduct of information-extraction processes.     

Duration of visible persistence in relation to stimulus complexity

Visible persistence refers to the phenomenal impression that a stimulus is still present after its offset. A dispute exists whether visible persistence is due to temporal sluggishness in the visual pathway (neural hypothesis) or whether it is a byproduct of information-extraction processes under cognitive control (process hypothesis). This was investigated by manipulating stimulus complexity in five temporal integration experiments and one recognition memory experiment. According to the process hypothesis, complex stimuli should persist longer than simple stimuli because they require more information extraction. This prediction was not confirmed; in all six experiments, complexity was found to have no reliable effect on the duration of visible persistence. By contrast, and in accordance with earlier findings, complexity was shown to have a significant effect on a short-lived, nonvisible form of memory known as schematic persistence. This pattern of results supports two major conclusions: First, that the effects of complexity reported in earlier research were probably on schematic—rather than visible—persistence; and second, that visible persistence must be regarded as a residual neural trace of an extinguished stimulus, rather than as a byproduct of information-extraction processes.     

Duration of visible persistence in relation to range of spatial frequencies

Five experiments examined the relationship between range of spatial frequencies contained in a visual display and duration of visible persistence. The high spatial frequency contents of the display were reduced by defocusing the image at the retina. Duration of visible persistence was measured by a task that required perceptual integration of a pattern whose parts were displayed sequentially in time. Experiments 1 and 2 showed that progressive reductions in the high-frequency contents of the display produced corresponding decrements in the duration of visible persistence. Experiments 3, 4, 5 showed that decrements in the duration of visible persistence could not be attributed to changes in the apparent size or in the brightness of the display brought about by defocusing. The results were interpreted in terms of the temporal response properties of perceptual mechanisms attuned to separate ranges of spatial frequencies. Strong parallels were drawn with the multichannel theory of visual information processing proposed by Breitmeyer and Ganz.     

Perceptual equivalence between vision and touch is complexity dependent

We experience the shape of objects in our world largely by way of our vision and touch but the availability and integration of information between the senses remains an open question. The research presented in this article examines the effect of stimulus complexity on visual, haptic and crossmodal discrimination. Using sculpted three-dimensional objects whose features vary systematically, we perform a series of three experiments to determine perceptual equivalence as a function of complexity. Two unimodal experiments - vision and touch-only, and one crossmodal experiment investigating the availability of information across the senses, were performed. We find that, for the class of stimuli used, subjects were able to visually discriminate them reliably across the entire range of complexity, while the experiments involving haptic information show a marked decrease in performance as the objects become more complex. Performance in the crossmodal condition appears to be constrained by the limits of the subjects’ haptic representation, but the combination of the two sources of information is of some benefit over vision alone when comparing the simpler, low-frequency stimuli. This result shows that there is crossmodal transfer, and therefore perceptual equivalency, but that this transfer is limited by the object’s complexity.     

How do we track invisible objects?

We previously demonstrated that observers in multiple object tracking experiments can successfully track targets when all the objects simultaneously vanish for periods lasting several hundred milliseconds (Alvarez, Horowitz, Arsenio, Dimase, &; Wolfe, 2005). How do observers do this? Since observers can track objects that move behind occluders (e.g., Scholl &; Pylyshyn, 1999), they may treat a temporal gap as a case of complete occlusion. If so, performance should improve if occlusion cues (deletion and accretion) are provided and items disappear and reappear one by one (asynchronously), rather than simultaneously. However, we found better performance with simultaneous than with asynchronous disappearance (Experiment 1), whereas occlusion cues were detrimental (Experiment 2). We propose that observers tolerate a gap in tracking by storing the current task state when objects vanish and resuming tracking on the basis of that memory when the objects reappear (a task-switching account).     

Immediate priming and cognitive aftereffects

Three forced-choice perceptual word identification experiments tested the claim that transitions from positive to negative priming as a function of increasing prime duration are due to cognitive aftereffects. These aftereffects are similar in nature to perceptual aftereffects that produce a negative image due to overexposure and habituation to a stimulus. Each experiment tested critical predictions that come from including habituation in a dynamic neural network with multiple levels of processing. The success of this account in explaining the dynamics of repetition priming, associative-semantic priming, and forward masking effects suggests that habituation is a useful mechanism for reducing source confusion between successively presented stimuli. Implications are considered for visible persistence, repetition blindness, attention-based negative priming, attentional blink, inhibition of return, the negative compatibility effect, affect priming, and flanker preview effects.     

Bidirectional contrast effects in the perception of VC-CV sequences

The perceived places of articulation of two successive stop consonants are not independent: Given some ambiguity in the formant transition cues and a closure duration between 100 and 200 msec, contrastive perceptual interactions in both directions have been observed in identification tasks. Retroactive contrast declines as the closure interval is lengthened and is strongly influenced by the range of closure durations employed, whereas proactive contrast appears to be less sensitive to these factors (Experiment 1). Reduced contrast and no effects of closure duration are obtained in a discrimination task with selective attention to one stimulus portion; this suggests that the effects in identification arise largely at a higher level of (phonetic) perception (Experiment 2). The contrast effects do not seem to represent a perceptual compensation for coarticulatory dependencies between stops produced in sequence, for there appears to be little coarticulation as far as place of articulation is concerned (Experiment 3). The most plausible hypothesis is that the presumed contrast effects do not result from any direct interaction of spectral cues across the closure interval but are due to perceptual information conveyed by the closure itself: Closure durations of 100–200 msec happen to be most appropriate for sequences of two nonhomorganic stops. Here, it seems, is another case in which listeners’ tacit knowledge of canonical speech patterns determines perception.     

Effects of display luminance, stimulus meaningfulness, and probe duration on visible and schematic persistence

Partial report performance is conceived of as consisting of two independent sources of information: visible persistence and schematic persistence. Following the work of Di Lollo and Dixon (1988), these two sources of information were separated experimentally by varying interstimulus interval and stimulus onset asynchrony independently. In the present experiment we asked whether visible persistence and schematic persistence would be affected by display luminance, stimulus meaningfulness, or probe duration. The results were fit accurately by an extension of the Di Lollo and Dixon independent-decay model in which display luminance affected visible persistence but stimulus meaningfulness and probe duration affected neither form of persistence directly.     

Stimulus information vs processing time in auditory pattern recognition

Previous studies have shown that pitch perception improves with increases in tone duration. An increase in tone duration increases the information available in the stimulus presentation. Other recent experiments have shown that sufficient perceptual processing time is also necessary for accurate pitch perception. The present study determines the relative contribution of stimulus information and processing time in an absolute pitch indentification task. The results indicate that processing time is more critical than stimulus information. The results are described accurately by a model that describes the perceptual process in terms of the information in the stimulus and the time the information is available for perceptual processing.     

两种时空线索条件下表面颜色特征线索对客体保持的作用*

采用客体回溯范式,以客体预览利化效应(object specific previewing benefit, OSPB)作为指标,考察表面特征线索对客体保持的作用。实验1使用双向隧道创建时空线索不明确的条件,研究表面颜色特征线索的作用。实验2使用单向隧道使时空线索明确,研究表面颜色特征线索与时空线索一致、冲突情境下的客体保持。实验1和实验2均出现了OSPB效应,且实验2冲突情境的OSPB效应低于一致情境。研究结果表明在时空线索不明确的条件下,仅凭表面颜色特征线索就能实现客体保持;在时空线索明确的条件下,时空线索是客体保持的主要线索,同时表面颜色特征线索也起一定的作用。     

ACQUISITION OF SIGN LANGUAGE BY AUTISTIC CHILDREN. I: EXPRESSIVE LABELLING

There has been growing interest in teaching sign language to autistic children who have failed to develop speech. However, controlled experimentation in this area is nonexistent. In the present study, four nonverbal autistic children were taught expressive sign labels for common objects, using a training procedure that consisted of prompting, fading, and stimulus rotation. The efficacy of the procedure was demonstrated in a multiple-baseline design across objects. The results were reliable, replicable across children, and generalizable across therapists. A stimulus control analysis demonstrated that, for three of the children, correct signing was controlled solely by the visual cues associated with the presentation of a given object and was independent of the auditory cues related to the same object. These latter results are discussed with respect to the known perceptual and linguistic deficits of autistic children.     

Perceptual complexity and form class cues in novel word extension tasks: how 4-year-old children interpret adjectives and count nouns

Two experiments examined the role of perceptual complexity, object familiarity and form class cues on how children interpret novel adjectives and count nouns. Four-year-old children participated in a forced-choice match-to-target task in which an exemplar was named with a novel word and children were asked to choose another one that matched the exemplar in either shape or material In experiment 1, 56 children were provided with lexical form class cues suggestive of adjectives. The results of Experiment 1 showed that perceptual complexity and not object familiarity determined whether children made material or shape matches. In Experiment 2, 56 children were provided with lexical form class cues suggestive of count nouns. The results of Experiment 2 showed that neither perceptual complexity nor object familiarity affected children's selections in the matching task. When provided with lexical form class cues suggestive of a count noun, children selected shape matches. Thus the results suggest that the perceptual properties of the objects presented to children coupled with the particular lexical form class cue determine which features of objects children attend to when interpreting novel words.     

Effects of similarity on apparent motion and perceptual grouping

Effects of similarity in colour, luminance, size, and shape on apparent motion and perceptual grouping were examined in part 1 in two parallel experiments on the same seven subjects. In both experiments, the effect of similarity was compared with that of proximity in competitive, bistable stimulus situations. A combination of a larger horizontal separation between the homogeneous stimulus elements and a smaller constant vertical separation between heterogeneous stimulus elements produced two kinds of apparent motion (or perceptual grouping) with equal probabilities. Such matched separations between homogeneous stimulus elements were obtained by the double staircase method in various stimulus conditions. In both experiments on apparent motion and perceptual grouping matched separation was found to increase as the difference between the heterogeneous stimulus elements increased. High correlations (0.71 to 0.94) of matched separations were found between apparent motion and perceptual grouping in four stimulus series: colour, luminance, size, and shape. Six of the seven subjects were also tested in part 2. Here, the effects of differences were found to work additively across different perceptual attributes in both phenomena, when multiple differences were combined in heterogeneous elements. The experimental results are discussed from the point of view that apparent motion is an example of perceptual constancy.     

What Are You Waiting For? Real‐Time Integration of Cues for Fricatives Suggests Encapsulated Auditory Memory

Speech unfolds over time, and the cues for even a single phoneme are rarely available simultaneously. Consequently, to recognize a single phoneme, listeners must integrate material over several hundred milliseconds. Prior work contrasts two accounts: (a) a memory buffer account in which listeners accumulate auditory information in memory and only access higher level representations (i.e., lexical representations) when sufficient information has arrived; and (b) an immediate integration scheme in which lexical representations can be partially activated on the basis of early cues and then updated when more information arises. These studies have uniformly shown evidence for immediate integration for a variety of phonetic distinctions. We attempted to extend this to fricatives, a class of speech sounds which requires not only temporal integration of asynchronous cues (the frication, followed by the formant transitions 150–350 ms later), but also integration across different frequency bands and compensation for contextual factors like coarticulation. Eye movements in the visual world paradigm showed clear evidence for a memory buffer. Results were replicated in five experiments, ruling out methodological factors and tying the release of the buffer to the onset of the vowel. These findings support a general auditory account for speech by suggesting that the acoustic nature of particular speech sounds may have large effects on how they are processed. It also has major implications for theories of auditory and speech perception by raising the possibility of an encapsulated memory buffer in early auditory processing.     

客体工作记忆的保持对时距知觉的影响

初步探讨毫秒范围内,客体信息保持对时间知觉的影响。实验一发现,知觉到的时间不受记忆负荷的影响,但当保持时间短时,低负荷的反应时低于高负荷的反应时;实验二仅要求被试完成时间知觉任务,发现知觉负荷异于记忆负荷对时间知觉的影响。结果说明,客体工作记忆保持对时间知觉的影响受到工作记忆资源的调节。     

How do humans group non-rigid objects in multiple object tracking?: Evidence from grouping by self-rotation

Previous studies on perceptual grouping found that people can use spatiotemporal and featural information to group spatially separated rigid objects into a unit while tracking moving objects. However, few studies have tested the role of objects’ self-motion information in perceptual grouping, although it is of great significance to the motion perception in the three-dimensional space. In natural environments, objects always move in translation and rotation at the same time. The self-rotation of the objects seriously destroys objects’ rigidity and topology, creates conflicting movement signals and results in crowding effects. Thus, this study sought to examine the specific role played by self-rotation information on grouping spatially separated non-rigid objects through a modified multiple object tracking (MOT) paradigm with self-rotating objects. Experiment 1 found that people could use self-rotation information to group spatially separated non-rigid objects, even though this information was deleterious for attentive tracking and irrelevant to the task requirements, and people seemed to use it strategically rather than automatically. Experiment 2 provided stronger evidence that this grouping advantage did come from the self-rotation per se rather than surface-level cues arising from self-rotation (e.g. similar 2D motion signals and common shapes). Experiment 3 changed the stimuli to more natural 3D cubes to strengthen the impression of self-rotation and again found that self-rotation improved grouping. Finally, Experiment 4 demonstrated that grouping by self-rotation and grouping by changing shape were statistically comparable but additive, suggesting that they were two different sources of the object information. Thus, grouping by self-rotation mainly benefited from the perceptual differences in motion flow fields rather than in deformation. Overall, this study is the first attempt to identify self-motion as a new feature that people can use to group objects in dynamic scenes and shed light on debates about what entities/units we group and what kinds of information about a target we process while tracking objects.     

The phenomenology of spatial integration: data and models

A briefly presented visual stimulus followed by darkness seems to persist beyond its physical offset. We are concerned here with the relation between two characteristics of this visible persistence: first, its phenomenological resemblance to the stimulus that spawned it and second, its usefulness as a basis for integrating visual stimuli that are separated in time. We describe two experiments using a task in which two halves of a visual stimulus were presented successively and observers reported how complete the stimulus appeared to be. Stimuli appeared less complete with increases in both the duration of the interval intervening between presentation of the two halves and the duration of the initially presented stimulus half. This data pattern is similar to that obtained in tasks in which spatial integration of two temporally disparate stimuli is necessary for correct responding. On the basis of this similarity, we argue that phenomenological appearance and ability to integrate stimuli over time are two facets of the same perceptual events. We describe a formal model to account for these and other data.