Spatial asymmetries in viewing and remembering scenes: Consequences of an attentional bias?

Given a single fixation, memory for scenes containing salient objects near both the left and right view boundaries exhibited a rightward bias in boundary extension (Experiment 1). On each trial, a 500-msec picture and 2.5-sec mask were followed by a boundary adjustment task. Observers extended boundaries 5% more on the right than on the left. Might this reflect an asymmetric distribution of attention? In Experiments 2A and 2B, free viewing of pictures revealed that first saccades were more often leftward (62%) than rightward (38%). In Experiment 3, 500-msec pictures were interspersed with 2.5-sec masks. A subsequent object recognition memory test revealed better memory for left-side objects. Scenes were always mirror reversed for half the observers, thus ruling out idiosyncratic scene compositions as the cause of these asymmetries. Results suggest an unexpected leftward bias of attention that selectively enhanced the representations, causing a smaller boundary extension error and better object memory on the views’ left sides.     

Object salience is transiently represented whereas object presence is not: evidence from temporal order judgment

We investigated the temporal dynamics in the processing of object salience and object presence by using a temporal-order-judgment task. In two experiments, observers were presented with displays containing one or two orientation singletons embedded in a background of homogeneously oriented lines. Observers had the task to indicate the temporal order of two colour changes which occurred either at two singleton locations differing in salience (experiment 1) or at two locations differing in singleton presence (experiment 2). Singleton displays were presented for a short or a long duration prior to the colour changes. The results demonstrated that salience affects the perceived temporal order of two colour changes more strongly after a short than after a long presentation duration (experiment 1). Singleton presence affects the perceived temporal order of two colour changes equally after a short and a long presentation duration (experiment 2). The results suggest that object salience and object presence are differently represented in the visual system.     

The contributions of visual and central attention to visual working memory

We investigated the role of two kinds of attention—visual and central attention—for the maintenance of visual representations in working memory (WM). In Experiment 1 we directed attention to individual items in WM by presenting cues during the retention interval of a continuous delayed-estimation task, and instructing participants to think of the cued items. Attending to items improved recall commensurate with the frequency with which items were attended (0, 1, or 2 times). Experiments 1 and 3 further tested which kind of attention—visual or central—was involved in WM maintenance. We assessed the dual-task costs of two types of distractor tasks, one tapping sustained visual attention and one tapping central attention. Only the central attention task yielded substantial dual-task costs, implying that central attention substantially contributes to maintenance of visual information in WM. Experiment 2 confirmed that the visual-attention distractor task was demanding enough to disrupt performance in a task relying on visual attention. We combined the visual-attention and the central-attention distractor tasks with a multiple object tracking (MOT) task. Distracting visual attention, but not central attention, impaired MOT performance. Jointly, the three experiments provide a double dissociation between visual and central attention, and between visual WM and visual object tracking: Whereas tracking multiple targets across the visual filed depends on visual attention, visual WM depends mostly on central attention.     

Flexible working memory representation of the relationship between an object and its location as revealed by interactions with attention

Working memory (WM) selectively maintains a limited amount of currently relevant information in an active state to influence future perceptual processing, thought, and behavior. The representation of the information held in WM is unknown, particularly the degree of separation between the representation of an object’s identity and its location. The present experiments examined the flexibility of object and location WM representations by measuring reaction times on a visual discrimination task during the delay period of a WM recognition task for object identities, locations, or both. The results demonstrate that during WM delay periods, attention is biased toward information that matches the current contents of WM. Attention is not biased toward information that was present in the encoded memory sample but not relevant for the memory recognition test. This specificity of the interaction between WM and attention applies to both the identity and the location of the remembered stimulus and to the relationship between an object and its location. The results suggest that when this relationship is necessary for task performance, WM represents an object and its identity in an integrated manner. However, if this relationship is not task relevant, the object and location information are represented in WM separately.     

The effects of attention on age-related relational memory deficits: evidence from a novel attentional manipulation

Healthy aging is often accompanied by episodic memory decline. Prior studies have consistently demonstrated that older adults show disproportionate deficits in relational memory (RM) relative to item memory (IM). Despite rich evidence of an age-related RM deficit, the source of this deficit remains unspecified. One of the most widely investigated factors of age-related RM impairment is a reduction in attentional resources. However, no prior studies have demonstrated that reduced attentional resources are the critical source of age-related RM deficits. Here, we used qualitatively different attention tasks and tested whether reduced attention for relational processing underlies the RM deficit observed in aging. In Experiment 1, we imposed either item-detection or relation-detection attention tasks on young adults during episodic memory encoding and found that only the concurrent attention task that involves relational processing disproportionately impaired RM performance in young adults. Moreover, by ruling out the possible confound of task difficulty on the disproportionate RM impairment, we further demonstrated that reduced relational attention is a key factor for the age-related RM deficit. In Experiment 2, we replicated the results from Experiment 1 by using different materials of stimuli and found that the effect of relational attention on RM is material general. The results of Experiment 2 also showed that reducing attentional resources for relational processing in young adults strikingly equated their RM performance to that of older adults. Thus, this study documents the first evidence that reduced attentional resources for relational processing are a critical factor for the relational memory impairment observed in aging.     

Retro-cue benefits in working memory without sustained focal attention

In working memory (WM) tasks, performance can be boosted by directing attention to one memory object: When a retro-cue in the retention interval indicates which object will be tested, responding is faster and more accurate (the retro-cue benefit). We tested whether the retro-cue benefit in WM depends on sustained attention to the cued object by inserting an attention-demanding interruption task between the retro-cue and the memory test. In the first experiment, the interruption task required participants to shift their visual attention away from the cued representation and to a visual classification task on colors. In the second and third experiments, the interruption task required participants to shift their focal attention within WM: Attention was directed away from the cued representation by probing another representation from the memory array prior to probing the cued object. The retro-cue benefit was not attenuated by shifts of perceptual attention or by shifts of attention within WM. We concluded that sustained attention is not needed to maintain the cued representation in a state of heightened accessibility.     

Interference between object-based attention and object-based memory

Research has shown that there are at least two kinds of visual selective attention: location based and object based. In the present study, we sought to determine the locus of spatially invariant object-based selection using a dual-task paradigm. In four experiments, observers performed an attention task (object feature report or visual search) with a concurrent memory task (object memory or spatial memory). Object memory was interfered with more by a concurrent object-based attention task than by a concurrent location-based attention task. However, this interference pattern was reversed for spatial memory, with greater interference by a location-based attention task than by an object-based attention task. These findings suggest that object-based attention and locationbased attention are functionally dissociable and that some forms of object-based selection operate within visual short-term memory.     

Change blindness and the primacy of object appearance

A large body of work suggests that the visual system is particularly sensitive to the appearance of new objects. This is based partly on evidence from visual search studies showing that onsets capture attention whereas many other types of visual event do not. Recently, however, the notion that object onset has a special status in visual attention has been challenged. For instance, an object that looms toward an observer has also been shown to capture attention. In two experiments, we investigated whether onset receives processing priority over looming. Observers performed a change detection task in which one of the display objects either loomed or receded, or a new object appeared. Results showed that looming objects were more resistant to change blindness than receding objects. Crucially, however, the appearance of a new object was less susceptible to change blindness than both looming and receding. We argue that the visual system is particularly sensitive to object onsets.     

Goal-directed access to mental objects in working memory: The role of task-specific feature retrieval

In the present study, we examined the hypothesis of task-specific access to mental objects from verbal working memory. It is currently assumed that a mental object is brought into the focus of attention in working memory by a process of object selection, which provides this object for any upcoming mental operation (Oberauer, 2002). We argue that this view must be extended, since the selection of information for processing is always guided by current intentions and task goals. In our experiments, it was required that two kinds of comparison tasks be executed on digits selected from a set of three digits held in working memory. The tasks differed in regard to the object features the comparison was based on. Access to a new mental object (object switch) took consistently longer on the semantic comparison task than on the recognition task. This difference is not attributable to object selection difficulty and cannot be fully accounted for by task difficulty or differences in rehearsal processes. The results support our assumptions that (1) mental objects are selected for a given specific task and, so, are accessed with their specific task-relevant object features; (2) verbal mental objects outside the focus of attention are usually not maintained at a full feature level but are refreshed phonologically by subvocal rehearsal; and (3) if more than phonological information is required, access to mental objects involves feature retrieval processes in addition to object selection.     

Representational momentum and the flash‐lag effect

Representational momentum (RM) is a distortion where the final orientation of a moving object is misremembered as further along its trajectory. Experiments reported here examine RM when an additional object was flashed just as the moving object disappeared. When the task was to judge the flashed object, participants reported that the flash appeared to lag behind (flash‐lag effect; FLE). When the task was to judge the moving object, larger forward distortions for the moving object were found when the flash was present, despite previous evidence that the FLE depends on the moving object's continued presence. The results suggest that some part of the FLE depends upon what precedes the flash. In addition, equivalent RM was observed for implied and smoothly animated events, a possible limit to the velocity effect for RM was found, and larger positive distortions were found for downward rotations.     

Visual short-term memory load strengthens selective attention

Perceptual load theory accounts for many attentional phenomena; however, its mechanism remains elusive because it invokes underspecified attentional resources. Recent dual-task evidence has revealed that a concurrent visual short-term memory (VSTM) load slows visual search and reduces contrast sensitivity, but it is unknown whether a VSTM load also constricts attention in a canonical perceptual load task. If attentional selection draws upon VSTM resources, then distraction effects—which measure attentional “spill-over”—will be reduced as competition for resources increases. Observers performed a low perceptual load flanker task during the delay period of a VSTM change detection task. We observed a reduction of the flanker effect in the perceptual load task as a function of increasing concurrent VSTM load. These findings were not due to perceptual-level interactions between the physical displays of the two tasks. Our findings suggest that perceptual representations of distractor stimuli compete with the maintenance of visual representations held in memory. We conclude that access to VSTM determines the degree of attentional selectivity; when VSTM is not completely taxed, it is more likely for task-irrelevant items to be consolidated and, consequently, affect responses. The “resources” hypothesized by load theory are at least partly mnemonic in nature, due to the strong correspondence they share with VSTM capacity.     

Only “efficient” emotional stimuli affect the content of working memory during free-recollection from natural scenes

Emotional events are thought to have privileged access to attention and memory, consuming resources needed to encode competing emotionally neutral stimuli. However, it is not clear whether this detrimental effect is automatic or depends on the successful maintenance of the specific emotional object within working memory. Here, participants viewed everyday scenes including an emotional object among other neutral objects followed by a free-recollection task. Results showed that emotional objects—irrespective of their perceptual saliency—were recollected more often than neutral objects. The probability of being recollected increased as a function of the arousal of the emotional objects, specifically for negative objects. Successful recollection of emotional objects (positive or negative) from a scene reduced the overall number of recollected neutral objects from the same scene. This indicates that only emotional stimuli that are efficient in grabbing (and then consuming) available attentional resources play a crucial role during the encoding of competing information, with a subsequent bias in the recollection of neutral representations.     

The relationship between change detection and recognition of centrally attended objects in motion pictures

Observers typically detect changes to central objects more readily than changes to marginal objects, but they sometimes miss changes to central, attended objects as well. However, even if observers do not report such changes, they may be able to recognize the changed object. In three experiments we explored change detection and recognition memory for several types of changes to central objects in motion pictures. Observers who failed to detect a change still performed at above chance levels on a recognition task in almost all conditions. In addition, observers who detected the change were no more accurate in their recognition than those who did not detect the change. Despite large differences in the detectability of changes across conditions, those observers who missed the change did not vary in their ability to recognize the changing object.     

Cognitive Control of Attentional Guidance by Visual and Verbal Working Memory Representations

Both visual and verbal information in working memory guide visual attention toward a memory‐matching object. We tested whether: (a) visual and verbal representations have different effects on the deployment of attention; and (b) both types of representations can be used equally in a top‐down manner. We asked participants to maintain a visual cue or a verbal cue at the beginning of each trial, and ended with a memory task to ensure that each cue was represented actively in working memory. Before the memory task, a visual search task appeared where validity was manipulated as valid, neutral, or invalid. We also manipulated the probability of valid trials (20%, 50%, and 80%), which had been told to the participants prior to the task. Consistent with earlier findings, attentional guidance by visual representations was modulated by the probability. We also found that this was true for verbal representations, and that these effects did not differ between representation types. These results suggest that both visual and verbal representations in working memory can be used strategically to control attentional guidance.     

Interactions between visual working memory and selective attention

The relationship between working memory and selective attention has traditionally been discussed as operating in one direction: Attention filters incoming information, allowing only relevant information into short-term processing stores. This study tested the prediction that the contents of visual working memory also influence the guidance of selective attention. Participants held a sample object in working memory on each trial. Two objects, one matching the sample and the other novel, were then presented simultaneously. As measured by a probe task, attention shifted to the object matching the sample. This effect generalized across object type, attentional-probe task, and working memory task. In contrast, a matched task with no memory requirement showed the opposite pattern, demonstrating that this effect is not simply due to exposure to the sample. These results confirm a specific prediction about the influence of working memory contents on the guidance of attention.     

Representation of memory for order of mental operations in cognitive tasks

Recent research shows that people learning a cognitive task acquire a memory for the order of operations applied, independent of the data to which those operations were applied. We designed two experiments to show how this sequence memory is represented. Experiment 1 compared predictions based on 3 possible sequence representation methods: composition, dyad transition, and associative chain. Latency and error results from a simple sequential task supported the associative chain representation. The associative links between operations presumably enhance performance by priming subsequent operations but do not operate in an all-or-none fashion. Experiment 2 explored whether transfer items that matched the first 2 rules and first 3 elements of a training item could bias participants toward executing a composed production learned during training. Latency and undetected error results were consistent with an associative chain representation but not with additional predictions made by the composition representation. These two experiments support the representation of operation sequences in memory as an associative chain.     

Why don't we see changes?: The role of attentional bottlenecks and limited visual memory

Seven experiments explore the role of bottlenecks in selective attention and access to visual short-term memory in the failure of observers to identify clearly visible changes in otherwise stable visual displays. Experiment One shows that observers fail to register a color change in an object even if they are cued to the location of the object by a transient at that location as the change is occurring. Experiment Two shows the same for orientation change. In Experiments Three and Four, attention is directed to specific objects prior to making changes in those objects. Observers have only a very limited memory for the status of recently attended items. Experiment Five reveals that observers have no ability to detect changes that happen after attention has been directed to an object and before attention returns to that object. In Experiment Six, attention is cued at rates that more closely resemble natural rates and Experiment Seven uses natural images. Memory capacity remains very small (<4 items).     

How undistorted spatial memories can produce distorted responses

Reproducing the location of an object from the contents of spatial working memory requires the translation of a noisy representation into an action at a single location—for instance, a mouse click or a mark with a writing utensil. In many studies, these kinds of actions result in biased responses that suggest distortions in spatial working memory. We sought to investigate the possibility of one mechanism by which distortions could arise, involving an interaction between undistorted memories and nonuniformities in attention. Specifically, the resolution of attention is finer below than above fixation, which led us to predict that bias could arise if participants tend to respond in locations below as opposed to above fixation. In Experiment 1 we found such a bias to respond below the true position of an object. Experiment 2 demonstrated with eye-tracking that fixations during response were unbiased and centered on the remembered object’s true position. Experiment 3 further evidenced a dependency on attention relative to fixation, by shifting the effect horizontally when participants were required to tilt their heads. Together, these results highlight the complex pathway involved in translating probabilistic memories into discrete actions, and they present a new attentional mechanism by which undistorted spatial memories can lead to distorted reproduction responses.     

Parallels between remembering and predicting an object's location

Three experiments explore effects of rotational axis and velocity on observers' predictions regarding an object's future position, and begin to explore connections between this extrapolation task and representational momentum (RM). In general, observers accept as "correct" positions that are behind the correct extrapolated location, as shown in previous work (Cooper & Munger, 1993; Finke & Shyi, 1998). These prediction distortions are in the opposite direction of typical RM memory distortions, suggesting that these tasks are unrelated. However, new effects of axis for the extrapolation task are reported which parallel axis effects previously observed for RM and mental rotation tasks. Specifically, participants make larger negative distortion errors for axes of rotation that are not coincident with the viewer's coordinate system, as if these paths of rotation are harder to extrapolate. Effects of velocity and axis are examined for RM and extrapolation tasks, and the overall pattern of distortions supports a link. In particular, participants who misremember the location of an object as further along the implied path of motion also accept as "correct" positions relatively further along the extrapolated path of motion, suggesting that these apparently opposite types of errors are indeed related.     

Temporal buffering and visual capacity: The time course of object formation underlies capacity limits in visual cognition

Capacity limits are a hallmark of visual cognition. The upper boundary of our ability to individuate and remember objects is well known but—despite its central role in visual information processing—not well understood. Here, we investigated the role of temporal limits in the perceptual processes of forming “object files.” Specifically, we examined the two fundamental mechanisms of object file formation—individuation and identification—by selectively interfering with visual processing by using forward and backward masking with variable stimulus onset asynchronies. While target detection was almost unaffected by these two types of masking, they showed distinct effects on the two different stages of object formation. Forward “integration” masking selectively impaired object individuation, whereas backward “interruption” masking only affected identification and the consolidation of information into visual working memory. We therefore conclude that the inherent temporal dynamics of visual information processing are an essential component in creating the capacity limits in object individuation and visual working memory.