Testing visual short-term memory: Simultaneous versus sequential presentations

Two experiments testing immediate ordered recall are presented; in these experiments, subjects engaged in repetitive speech (“articulatory suppression”) during a visual presentation in order to prevent auditory recoding of the stimuli. In both experiments, a simultaneous presentation produced results that suggested the use of visual short-term memory, whereas a sequential presentation did not. In Experiment 1, visual confusion errors occurred more often than would be expected by chance for a simultaneous presentation but not for a sequential presentation. In Experiment 2, recall from visual short-term memory was expected to suffer more when subjects wrote a prefix than when they spoke a prefix; this effect occurred for a simultaneous presentation but not for a sequential presentation. These results suggest that existence of a visual short term store that retains a simultaneous presentation but not a sequential presentation.     

Comparison Blindness

Change blindness has been linked to comparisons over time when visual input is disturbed by a transient. This is most directly seen in “flicker” paradigms where change is invisible when introduced during a blank period between successive presentations of stimuli, and is implicit in paradigms where a stimulus is changed during a saccade. Difficulties in comparing two simultaneously present stimuli have been considered to be due to transaccadic memory limitations in tasks requiring saccades. We present here experiments that demonstrate the phenomenology of change blindness, but in tasks where two stimuli are present in the central visual field within a single fixation and where there are no transients present. These experiments are based on contrast discriminations of patterns composed of a few simple elements. We have found comparisons over space within a single fixation to be as difficult as comparisons over time. As in the more usual paradigms for change blindness, cueing makes changes easy to detect. These results suggest that a memory bottleneck is not essential to produce change blindness.     

Rats with dorsal hippocampal lesions do react to new stimuli but not to spatial changes of known stimuli

The effect of visual distracting stimuli upon the straight alleyway performance of dorsal hippocampectomized Wistar rats was investigated. In comparison with control animals it was observed that dorsal hippocampectomized animals (1) ambulated more during the preexposure phase, (2) acquired at the same rate a running response for food (training phase), (3) reacted similarly to a new visual stimulus (black cards) presented in a sector of the alleyway, and (4) habituated to successive presentations of that stimulus in the same place. (5) However, dorsal hippocampectomized rats did not react, unlike the controls, to the presentation of the same stimulus in another place of the alleyway but (6) reacted to the visual pattern change of the stimulus (now black/white check cards) in the same place. These results indicate that under certain experimental conditions, hippocampus-lesioned animals are capable of interrupting a running response for food in order to explore a new conspicuously located stimulus, habituate to repeated presentations of that stimulus, and to react to a new pattern of visual stimulation. They suggest that hippocampectomized rats do not lose the capacity to react to a new stimulus; the disruption seems to be related to the spatial context of stimulus presentation, supporting a spatial mapping hypothesis of hippocampal function.     

Storage mode of geometrical dimensions in a two-stimulus matching paradigm

In a two-stimulus matching paradigm requiring “same” and “different” responses to simple geometric dimensions, the successive stimulus presentation mode with several retention intervals was compared to a simultaneous stimulus presentation mode. For the simultaneous condition, the data suggested a wholistic template matching process, but in none of the successive conditions was template matching indicated. The retention interval of the successive condition allows the subject to analyze out the target dimension from the first two-dimensional stimulus. The ability to anticipate the value of the target dimension in the second stimulus could also influence the representation of the first stimulus. The findings shed some light upon the perceptual interactions between dimensions that constitute the stimulus. In particular, an outside-to-inside order of iconic scanning appeared to be supported by the data.     

Action blindness in response to gradual changes

The goal of this study is to characterize observers’ abilities to detect gradual changes and to explore putative dissociations between conscious experience of change and behavioral adaptation to a changing stimulus. We developed a new experimental paradigm in which, on each trial, participants were shown a dot pattern on the screen. Next, the pattern disappeared and participants had to reproduce it. In some conditions, the target pattern was incrementally rotated over successive trials and participants were either informed or not of this change. We analyzed both awareness of the changes and the dynamics of behavioral adaptation, in a way that makes it possible to assess both variability and accuracy as they change over time. Results indicate a dissociation between change awareness and behavioral adaptation to the changes, and support the notion that unconscious representations of visual stimuli are more precise and detailed than previously suggested. We discuss the implications of these results for theories of change detection.     

Comparison is not just subtraction: effects of time- and space-order on subjective stimulus difference

In five experiments, participants made comparative judgments of paired successive or simultaneous stimuli. Time- or space-order errors were obtained, which varied with the interstimulus interval (ISI) or stimulus duration, as well as with the stimulus level. The results, in terms of scaled subjective differences, are well described by Hellstr?m's (1979) sensation-weighting model. With successive presentation, in comparisons of line length and tone loudness, the first stimulus had the greater weight in determining the subjective difference for short ISIs, the second for longer ISIs. In comparisons of duration (auditory and visual), the second stimulus had the greater weight. For simultaneously presented line lengths, the left stimulus had the greater weight.     

Decision latencies of “same” and “different” judgments

When a subject is asked to judge whether two stimuli are “same” or“different,” the time he takes to reach the decision same is frequently unequal to the time he takes to reach the decision different. We studied this discrepancy as a function of several variables, including stimulus modality, “codability” vs.“noncodability” of test stimuli, interstimulus interval, and discrimination difficulty. Results of four different experiments performed on a total of 111 subjects showed codability and discrimination difficulty to be the most important factors. Stimuli that are codable (i.e., which can be categorized by absolute judgment) yield a shorter latency for decision same, and noncodable stimuli (i.e., those requiring a reference stimulus for categorization) yield a longer latency for decision same. The modality of test stimuli, the prothetic or metathetic nature of the dimension to be judged, and simultaneous vs. successive presentation of the stimuli appear not to be crucial factors.     

Informational and neural adaptation curves are asynchronous

Norwich’s entropy theory of perception (plus a few additional assumptions) suggests the existence of an “informational adaptation curve” (change in stimulus equivocation with stimulus duration) for suprathreshold prothetic stimuli that is synchronous with the “neural adaptation curve” (change in firing rate with stimulus duration) observed for sensory neurons. Five experiments are reported in which informational adaptation curves were measured for auditory and visual stimuli by having subjects make absolute identifications of suprathreshold sound or light intensities of various durations. Information transmissions for the shortest duration stimuli (1 and 5 msec, respectively, for light and sound) were surprisingly large (small equivocations), indicating that intensity information is acquired very rapidly by the whole organism. The equations of entropy theory were fitted to adaptation data for peripheral sensory neurons (spiral ganglion cells and retinal ganglion cells) and were compared to the informational adaptation curves. It was found that informational adaptation occurred more rapidly than neural adaptation. That is, the two types of adaptation process are asynchronous. However, for both audition and vision, the total amount of information mediated by the adaptation process (channel capacity) was-about the same for both types of processes (2.03 bits vs. 2.1 bits per stimulus for sound intensity; 1.3 vs. 2.0 bits per stimulus for light intensity). Faster acquisition could be accomplished in the whole organism through convergent neural circuits that increase sampling, rate-by pooling the samples taken by individual receptor systems     

Perceptual load alters visual excitability

Increasing perceptual load reduces the processing of visual stimuli outside the focus of attention, but the mechanism underlying these effects remains unclear. Here we tested an account attributing the effects of perceptual load to modulations of visual cortex excitability. In contrast to stimulus competition accounts, which propose that load should affect simultaneous, but not sequential, stimulus presentations, the visual excitability account makes the novel prediction that load should affect detection sensitivity for both simultaneous and sequential presentations. Participants fixated a stimulus stream, responding to targets defined by either a color (low load) or color and orientation conjunctions (high load). Additionally, detection sensitivity was measured for a peripheral critical stimulus (CS) presented occasionally. Increasing load at fixation reduced sensitivity to the peripheral CSs; this effect was similar regardless of whether CSs were presented simultaneously with central stimuli or during the (otherwise empty) interval between them. Controls ruled out explanations of the results in terms of strategic task prioritization. These findings support a cortical excitability account for perceptual load, challenging stimulus competition accounts.     

Orientation-selective adaptation to crowded illusory lines

Visual adaptation has been successfully used as a psychophysical tool for studying the functional organisation of visual awareness. It has been shown that orientation-selective adaptation to a grating pattern occurs in crowded conditions. In such conditions, simultaneous presentation of flanking distractors pushes the target stimulus out of conscious perception and severely impairs orientation discrimination in the periphery of the visual field. In the present study, orientation-selective adaptation to illusory lines induced by two line gratings abutting each other with a phase shift was examined in crowded and non-crowded conditions. To rule out the effects of lower level adaptations we used an animation paradigm in which the orientations of the two line gratings were altered repeatedly during adaptation phase without any change in the orientation of the resulting illusory line. Although performance of subjects in reporting the orientation of crowded illusory lines was at chance level, orientation-selective adaptation was preserved for crowded as well as non-crowded adapting targets. Two control experiments demonstrated that adaptation to endpoints of real lines at the location of abutting grating lines had minimal effect on the adaptation to illusory lines; and changes in the configuration of endpoints could not be responsible for better performance when adapting and test stimuli were different. We conclude that a crowding effect occurs after illusory lines have been processed in the visual stream. Since illusory lines seem to be represented at relatively early stages of visual processing (e.g. area V2), adaptation to crowded illusory stimuli suggests that neuronal activation in those early stages is not necessarily correlated with conscious perception.     

Parallel encoding within and between elementary stimulus dimensions

Human ability to encode simultaneously different dimensions of a visual display was tested, using an “erasure” technique to control the time for which the visual information remained available for processing. Three separate vocabularies of test item were employed, one varying in terms of color and two in terms of form attributes. Simultaneous presentation of color and form stimuli gave evidence of nearly perfect parallel encoding of both types of attribute. Form-form combinations, on the other hand, indicated only partially simultaneous encoding of the primary form dimensions involved. It was suggested that, while primary encoding of different stimulus dimensions is simultaneous, within the same dimension encoding of discrete stimulus elements may occur seriatim.     

Working memory deficits in boys with attention deficit/hyperactivity disorder (ADHD): An examination of orthographic coding and episodic buffer processes

The episodic buffer component of working memory was examined in children with attention deficit/hyperactivity disorder (ADHD) and typically developing peers (TD). Thirty-two children (ADHD = 16, TD = 16) completed three versions of a phonological working memory task that varied with regard to stimulus presentation modality (auditory, visual, or dual auditory and visual), as well as a visuospatial task. Children with ADHD experienced the largest magnitude working memory deficits when phonological stimuli were presented via a unimodal, auditory format. Their performance improved during visual and dual modality conditions but remained significantly below the performance of children in the TD group. In contrast, the TD group did not exhibit performance differences between the auditory- and visual-phonological conditions but recalled significantly more stimuli during the dual-phonological condition. Furthermore, relative to TD children, children with ADHD recalled disproportionately fewer phonological stimuli as set sizes increased, regardless of presentation modality. Finally, an examination of working memory components indicated that the largest magnitude between-group difference was associated with the central executive. Collectively, these findings suggest that ADHD-related working memory deficits reflect a combination of impaired central executive and phonological storage/rehearsal processes, as well as an impaired ability to benefit from bound multimodal information processed by the episodic buffer.     

Iconic memory and visible persistence

There are three senses in which a visual stimulus may be said to persist psychologically for some time after its physical offset. First, neural activity in the visual system evoked by the stimulus may continue after stimulus offset (“neural persistence”). Second, the stimulus may continue to be visible for some time after its offset (“visible persistence”). Finally, information about visual properties of the stimulus may continue to be available to an observer for some time after stimulus offset (“informational persistence”). These three forms of visual persistence are widely assumed to reflect a single underlying process: a decaying visual trace that (1) consists of afteractivity in the visual system, (2) is visible, and (3) is the source of visual information in experiments on decaying visual memory. It is argued here that this assumption is incorrect. Studies of visible persistence are reviewed; seven different techniques that have been used for investigating visible persistence are identified, and it is pointed out that numerous studies using a variety of techniques have demonstrated two fundamental properties of visible persistence: theinverse duration effect (the longer a stimulus lasts, the shorter is its persistence after stimulus offset) and theinverse intensity effect (the more intense the stimulus, the briefer its persistence). Only when stimuli are so intense as to produce afterimages do these two effects fail to occur. Work on neural persistences is briefly reviewed; such persistences exist at the photoreceptor level and at various stages in the visual pathways. It is proposed that visible persistence depends upon both of these types of neural persistence; furthermore, there must be an additional neural locus, since a purely stereoscopic (and hence cortical) form of visible persistence exists. It is argued that informational persistence is defined by the use of the partial report methods introduced by Averbach and Coriell (1961) and Sperling (1960), and the term “iconic memory” is used to describe this form of persistence. Several studies of the effects of stimulus duration and stimulus intensity upon the duration of iconic memory have been carried out. Their results demonstrate that the duration of iconic memory is not inversely related to stimulus duration or stimulus intensity. It follows that informational persistence or iconic memory cannot be identified with visible persistence, since they have fundamentally different properties. One implication of this claim that one cannot investigate iconic memory by tasks that require the subject to make phenomenological judgments about the duration of a visual display. In other words, the so-called “direct methods” for studying iconic memory do not provide information about iconic memory. Another implication is that iconic memory is not intimately tied to processes going on in the visual system (as visible persistence is); provided a stimulus is adequately legible, its physical parameters have little influence upon its iconic memory. The paper concludes by pointing out that there exists an alternative to the usual view of iconic memory as a precategorical sensory buffer. According to this alternative, iconic memory is post-categorical, occurring subsequent to stimulus identification. Here, stimulus identification is considered to be a rapid automatic process which does not require buffer storage, but which provides no information about episodic properties of a visual stimulus. Information about these physical stimulus properties must, in some way, be temporarily attached to a representation of the stimulus in semantic memory; and it is this temporarily attached physical information which constitutes iconic memory.     

Similarity effects in visual working memory

Perceptual similarity is an important property of multiple stimuli. Its computation supports a wide range of cognitive functions, including reasoning, categorization, and memory recognition. It is important, therefore, to determine why previous research has found conflicting effects of inter-item similarity on visual working memory. Studies reporting a similarity advantage have used simple stimuli whose similarity varied along a featural continuum. Studies reporting a similarity disadvantage have used complex stimuli from either a single or multiple categories. To elucidate stimulus conditions for similarity effects in visual working memory, we tested memory for complex stimuli (faces) whose similarity varied along a morph continuum. Participants encoded 3 morphs generated from a single face identity in the similar condition, or 3 morphs generated from different face identities in the dissimilar condition. After a brief delay, a test face appeared at one of the encoding locations for participants to make a same/different judgment. Two experiments showed that similarity enhanced memory accuracy without changing the response criterion. These findings support previous computational models that incorporate featural variance as a component of working memory load. They delineate limitations of models that emphasize cortical resources or response decisions.     

Rate of response as a visual social stimulus

In Exp. 1, a high rate of responding (chain pulling) of a stimulus monkey was established as a visual positive discriminative stimulus for the operant behavior (bar pressing) of an observer monkey. The terminal performance of the observer under conditions in which a high rate of response of the stimulus monkey alternated in a variable temporal arrangement with a zero rate of response of the stimulus monkey (negative discriminative stimulus) was essentially the same as when nonbehavioral stimuli are correlated with the availability of reinforcement. By manipulating the schedule of reinforcement to change the rate of responding of the stimulus subject without changing its rate of reinforcement, Exp. 2 showed that the effective behavioral stimulus for the observer was the rate of chain pulling by the stimulus subject. A novel intermediate rate of responding by the stimulus monkey resulted in an intermediate rate (generalization) on the part of the observer during an extinction test. These experiments demonstrated that the rate of responding of one organism can function as a discriminative stimulus to control the rate of responding of another organism; and that the rate of responding is similar to other physical stimuli in terms of discrimination and generalization.     

Parallel scanning of auditory and visual information

Two experiments involving memory retrieval of auditorilv and visually presented materials were performed. In Experiment I, subjects were presented with memory sets of 1, 2, or 4 stimuli and then with a test item to be classified as belonging or not belonging to the memory set. In Condition 1, each memory stimulus was a single, auditorily presented letter. In Condition 2, each memory stimulus was a visually presented letter. In Conditions 3 and 4, each memory stimulus was a pair of letters, one presented visually and the other auditorily. Mean reaction time (RT) for the classification task increased as a function of number of memory stimuli at equal rates for all four conditions. This was interpreted as evidence for a parallel scanning process in Conditions 3 and 4 where the auditory item and visual item of each memory stimulus pair can be scanned simultaneously. Experiment II compared memory retrieval for a simultaneous condition in which auditory and visual memory items were presented as pairs with a sequential condition in which mixed auditory-visual memory sets were presented one item at a time. RTs were shorter for the simultaneous condition. This was interpreted as evidence that parallel scanning may depend upon memory input parameters.     

Event-related brain potentials reflect traces of echoic memory in humans

In sequences of identical auditory stimuli, infrequent deviant stimuli elicit an event-related brain potential component called mismatch negativity (MMN). MMN is presumed to reflect the existence of a memory trace of the frequent stimulus at the moment of presentation of the infrequent stimulus. This hypothesis was tested by applying the recognition-masking paradigm of cognitive psychology. In this paradigm, a masking sound presented shortly before or after a test stimulus diminishes the recognition memory of this stimulus, the more so the shorter the interval between the test and masking stimuli. This interval was varied in the present study. It was found that the MMN amplitude strongly correlated with the subject’s ability to discriminate between frequent and infrequent stimuli. This result strongly suggests that MMN providesa measure for a trace of sensory memory, and further, that with MMN, this memory can be studied without performance-related distortions.     

Inhibition between channels selective to contour orientation and wavelength in the human visual system

Recent studies have demonstrated inhibition between channels selective to contour orientation in the human visual system. On the basis of adaptation studies, it has also been suggested that the human visual system contains channels jointly responsive to both contour orientation and wavelength. The present paper investigates inhibition between such channels. Two experiments demonstrated that, with simultaneous presentation of a center vertical target grating and a concentric surround grating, the threshold and the apparent orientation of the center grating depended on the relative orientations of the two gratings and also on whether they were viewed in the same or in different colored light. Color selectivity in both experiments was found across a wider range of angular separations than has generally been reported for successive presentation of the two stimuli. These results suggest inhibition between channels selective to combinations of contour orientation and wavelength in the human visual system.     

Timing the “magical number seven”: Presentation rate and regularity affect verbal working memory performance

The informative value of time and temporal structure often remains neglected in cognitive assessments. However, next to information about stimulus identity we can exploit temporal ordering principles, such as regularity, periodicity, or grouping to generate predictions about the timing of future events. Such predictions may improve cognitive performance by optimising adaptation to dynamic stimuli. Here, we investigated the influence of temporal structure on verbal working memory by assessing immediate recall performance for aurally presented digit sequences (forward digit span) as a function of standard (1000 ms stimulus-onset-asynchronies, SOAs), short (700 ms), long (1300 ms) and mixed (700–1300 ms) stimulus timing during the presentation phase. Participant's digit spans were lower for short and mixed SOA presentation relative to standard SOAs. This confirms an impact of temporal structure on the classic “magical number seven,” suggesting that working memory performance can in part be regulated through the systematic application of temporal ordering principles.     

Release of inattentional blindness by high working memory load: elucidating the relationship between working memory and selective attention

An unexpected stimulus often remains unnoticed if attention is focused elsewhere. This inattentional blindness has been shown to be increased under conditions of high memory load. Here we show that increasing working memory load can also have the opposite effect of reducing inattentional blindness (i.e., improving stimulus detection) if stimulus detection is competing for attention with a concurrent visual task. Participants were required to judge which of two lines was the longer while holding in working memory either one digit (low load) or six digits (high load). An unexpected visual stimulus was presented once alongside the line judgment task. Detection of the unexpected stimulus was significantly improved under conditions of higher working memory load. This improvement in performance prompts the striking conclusion that an effect of cognitive load is to increase attentional spread, thereby enhancing our ability to detect perceptual stimuli to which we would normally be inattentionally blind under less taxing cognitive conditions. We discuss the implications of these findings for our understanding of the relationship between working memory and selective attention.