Temporal limits of selection and memory encoding: A comparison of whole versus partial report in rapid serial visual presentation

People often fail to recall the second of two visual targets presented within 500 ms in rapid serial visual presentation (RSVP). This effect is called the attentional blink. One explanation of the attentional blink is that processes involved in encoding the first target into memory are slow and capacity limited. Here, however, we show that the attentional blink should be ascribed to attentional selection, not consolidation of the first target. Rapid sequences of six letters were presented, and observers had to report either all the letters (whole-report condition) or a subset of the letters (partial-report condition). Selection in partial report was based on color (e.g., report the two red letters) or identity (i.e., report all letters from a particular letter onward). In both cases, recall of letters presented shortly after the first selected letter was impaired, whereas recall of the corresponding letters was relatively accurate with whole report.     

Attentional weights in vision as products of spatial and nonspatial components

The relationship between visual attentional selection of items in particular spatial locations and selection by nonspatial criteria was investigated in a partial report experiment with report of letters (as many as possible) from brief postmasked exposures of circular arrays of letters and digits. The data were fitted by mathematical models based on Bundesen’s (Psychological Review, 97, 523-547, 1990) theory of visual attention (TVA). Both attentional weights of targets (letters) and attentional weights of distractors (digits) showed strong variations across the eight possible target locations, but for each of the ten participants, the ratio of the weight of a distractor at a given location to the weight of a target at the same location was approximately constant. The results were accommodated by revising the weight equation of TVA such that the attentional weight of an object equals a product of a spatial weight component (weight due to being at a particular location) and a nonspatial weight component (weight due to having particular features other than locations), the two components scaling the effects of each other multiplicatively.     

The Word Superiority Effect in central and peripheral vision

The Word Superiority Effect (WSE) is a well-known phenomenon in reading research, where words are reported more accurately than single letters or non-words. We report two experiments that investigate the WSE in the central and peripheral visual field, as well as laterality differences in the perception of words and letters, using methods based on the Theory of Visual Attention. The results show a WSE in the central visual field, reflected in mean scores, perception thresholds, and processing speed, whereas the effect is eliminated or reversed in the periphery. This may be caused by crowding, which prevents lexical analysis of a word in the periphery. We conclude that perception of words and letters differs according to location in the visual field. Linking our results to previous studies of crowding effects in patients with reading impairments, we hypothesize that similar mechanisms may limit normal word peripheral processing.     

Selective attention and interhemispheric response competition in the split-brain

The interfering effect of an unattended stimulus on processing of an attended item was studied in a single split-brain participant (LB) and in normal controls. Pairs of letters were presented to the left visual field (LVF), right visual field (RVF), or bilaterally. Participants attended to the rightmost letter while attempting to ignore the leftmost letter. Responses associated with the attended and to-be-ignored letters could be compatible or incompatible. Manual response latencies were generally slower on Response Incompatible compared to Response Compatible trials. Notably, LB displayed this effect on Bilateral trials, where target and distractor were presented to opposite visual fields. LB was unable to perform a same-different matching task with bilateral letter stimuli, but was able to name bilateral letters accurately. Hence, in the bilateral condition, the ability to cross-compare letters was dissociated from attentional interference and from letter naming. Implications of these findings are discussed.     

The effect of repetitive saccade execution on the attention network test: Enhancing executive function with a flick of the eyes

The simple act of repeatedly looking left and right can enhance subsequent cognition, including divergent thinking, detection of matching letters from visual arrays, and memory retrieval. One hypothesis is that saccade execution enhances subsequent cognition by altering attentional control. To test this hypothesis, we compared performance following repetitive bilateral saccades or central fixation on the revised attention network test, which measures the operation of three distinct attentional networks: alerting, orienting, and executive function. The primary finding was that saccade execution increased the subsequent operation of the executive function network, which encompasses attentional control. Specifically, saccade execution decreased response time to target stimuli in the presence of response-incongruent flankers. A secondary finding was that saccade execution decreased response time to targets when an invalid location was cued prior to target onset. These findings suggest that saccades are an effective means of improving attentional control. Of greater theoretical importance, the study establishes attentional enhancement as a potential mechanism by which saccades enhance other aspects of cognition. Although some saccade execution effects have been found to depend on consistency of handedness (i.e., the consistency with which an individual uses one hand over the other), saccade-induced enhancement of attentional control occurred independently of handedness consistency.     

Implicit learning: A way to improve visual search in spatial neglect?

Studies have shown that neglect patients are able to use stimulus regularities to orient faster toward the neglected side, without necessarily being aware of that information, or at the very least without being able to verbalize their knowledge. In order to better control for the involvement of explicit processes, the present study sought to test neglect patients’ ability to detect more complex associations between stimuli using tasks similar to those used in implicit learning studies. Our results demonstrate that neglect patients had difficulties implicitly learning complex associations, contrary to what we found with controls. The possible influence of attentional and working memory impairments are discussed.     

Spatial analysis after perinatal stroke: patterns of neglect and exploration in extra-personal space

This study was conducted to determine whether school-aged children who had experienced a perinatal stroke demonstrate evidence of persistent spatial neglect, and if such neglect was specific to the visual domain or was more generalized. Two studies were carried out. In the first, 38 children with either left hemisphere (LH) or right hemisphere (RH) damage and 50 age-matched controls were given visual cancellation tasks varying in two factors: target stimuli and stimulus array. In the second study, tactile neglect was evaluated in 41 children with LH or RH damage and 72 age-matched controls using a blindfolded manual exploration task. On the visual cancellation task, LH subjects omitted more target stimuli on the right, but also on the left, compared with controls. Children with RH lesions also produced a larger number of omissions on both the left and right sides than controls, but with poorer performance on the left. On the manual exploration task, LH children required significantly longer times to locate the target on both sides of the board than did controls. RH children had significantly prolonged search times on the left side, but not on the right, compared with controls. In both tasks, LH subjects employed unsystematic search strategies more often than both control and RH children. The search strategy of RH children also tended to be erratic when compared to controls, but only in the random arrays of the visual cancellation tasks; structure of the target stimuli improved their organization. These results demonstrate that children with early LH brain damage display bilateral difficulties in visual and tactile modalities; a pattern that is in contrast to that seen in adults with LH damage. This may result from disorganized search strategies or other subtle spatial or attentional deficits. Results of performance of RH children suggests the presence of contralateral neglect in both the visual and tactile modalities; a finding that is similar to the neglect in adult stroke patients with RH lesions. The fact that deficits in spatial attention and organizational strategies are present after very early focal damage to either the LH or the RH broadens our understanding of the differences in functional lateralization between the immature and mature brain. These results also add to evidence for limitations to plasticity in the developing brain. Our findings may have therapeutic and rehabilitative implications for the management of children with early focal brain lesions.     

Allocation of visual attention to spatial locations: tradeoff functions for event-related brain potentials and detection performance

Event-related brain potentials (ERPs) were recorded in response to unilateral arrays of letters flashed in rapid, randomized sequences to left and right visual field locations. Subjects were required to focus attention exclusively on either left or right field stimuli, or to divide attention in different proportions between the two fields, with the aim of detecting infrequent target letters. Both d' and percent hits for target detections increased significantly as attentional allocation to a stimulus location increased. Attention operating characteristic (AOC) curves for the target detection scores were highly similar in form to those for the amplitudes of the long-latency, endogenous ERP components--N350-650 and P400-800 (P300). All of these measures showed gradual, nearly rectangular tradeoff functions. In contrast, the AOC curves for the early sensory-evoked components displayed steep, nearly linear amplitude tradeoffs as attention was increasingly allocated to one visual field at the expense of the other. The early and late ERP components were considered as indices of separate but interacting levels of attentional selection having different operating principles.     

Reaction time asymmetry through bilateral versus unilateral stimulus presentation

Previous research indicates that bilateral stimulation of the visual fields results in larger asymmetry than unilateral stimulation. However, the research has largely been limited to percentage correct studies. Here, three experiments employ reaction time (RT) measures, and show that the bilateral advantage generalizes to RT, and across spatial and verbal stimulus materials (bargraphs, letters, and words). Visual field differences average about six times larger with bilateral than with unilateral presentation. Beyond promising increased power to detect hemispheric differences, the results argue against structural and attentional models of behavioral asymmetry and support a dynamic (hemispheric interaction) model.     

The hare and the snail: Dissociating visual orienting from conscious perception

A method for investigating attentional effects of peripheral visual objects, independently of perceptual identification, is described. We report an experiment using this method which shows that visual processing of peripheral objects differs radically, depending on whether participants move attention in response to an object or consciously perceive that object. When luminance contrast was reduced, conscious perceptual discrimination of peripheral letters was massively slower and less accurate—but both low and high contrast letters elicited rapid attentional orienting effects and these rapid orienting effects were equal in magnitude across low and high contrast. This pattern is consistent with known differences in luminance sensitivity between the dorsal and ventral visual processing streams, and with rapid dorsal–ventral interaction mediated via re-entrant feedback. Our findings show that the control system responsible for rapid movements of attention is exquisitely sensitive to visual form information at low levels of contrast, and involves a different neurocognitive pathway to that which gives rise to conscious perception.     

Letter recognition: Effects of interitern similarity and report requirements

The effects. of auditory similarity, visual similarity, and position of letters within the Visual field upon letter recognition were investigated in two experiments. In Experiment 1, significant differences associated with visual, but not. auditory, similarity were found when Os were asked to report one, three, or all Items from five-item linear arrays. As report requirements increased left-right differences in report accuracy increased, although items in the center of the field were reported most accurately. In Experiment 2, either one or five items were requested from the arrays presented in Experiment 1 after a delay of 2 or 4 sec. Significant effects associated with both auditory and visual similarity were found, together with a tendency for items to the left of fixation to be reported most accurately. These results were discussed in terms of recent theories dealing with the encoding of visually presented material.     

Visual control of hand action

Recent investigations in normal and brain-damaged individuals have begun to identify the types of visual information used to plan and guide reaches. Binocular visual cues have been shown to be important for both movement planning and on-line guidance of hand movements, while emerging evidence suggests that dynamic visual analysis of the moving limb may provide a rich source of information for precise control of the hand in flight. Reaching movements appear to be planned to follow what is perceived to be a straight trajectory in peripersonal space. Furthermore, the process of selecting visual targets appears to influence hand trajectories, with hand movements curving away from non-target objects. This behaviour may be explained most effectively by a dynamic representation of space which is sculpted by attentional mechanisms into selected (target) and inhibited (non-target) regions. The role of attention in movement planning in individuals with attentional disorders is controversial. Patients with visual neglect have impairments of visuomotor control including reaches that, under certain conditions, are significantly more curved than those of normal individuals. The representations of space that neglect patients use to plan reaches may be distorted by impairments in the mechanisms that normally act to select target regions and inhibit non-target zones.     

Types and tokens in visual letter perception

Five experiments demonstrate that in briefly presented displays, subjects have difficulty distinguishing repeated instances of a letter or digit (multiple tokens of the same type). When subjects were asked to estimate the numerosity of a display, reports were lower for displays containing repeated letters, for example, DDDD, than for displays containing distinct letters, for example, NRVT. This homogeneity effect depends on the common visual form of adjacent letters. A distinct homogeneity effect, one that depends on the repetition of abstract letter identities, was also found: When subjects were asked to report the number of As and Es in a display, performance was poorer on displays containing two instances of a target letter, one appearing in uppercase and the other in lowercase, than on displays containing one of each target letter. This effect must be due to the repetition of identities, because visual form is not repeated in these mixed-case displays. Further experiments showed that this effect was not influenced by the context surrounding the target letters, and that it can be tied to limitations in attentional processing. The results are interpreted in terms of a model in which parallel encoding processes are capable of automatically analyzing information from several regions of the visual field simultaneously, but fail to accurately encode location information. The resulting representation is thus insufficient to distinguish one token from another because two tokens of a given type differ only in location. However, with serial attentional processing multiple tokens can be kept distinct, pointing to yet another limit on the ability to process visual information in parallel.     

Contingent capture for onsets and offsets: attentional set for perceptual transients

Four experiments were conducted to examine whether attentional set affects the ability of visual transients (onsets and offsets) to capture attention. In the experiments, visual search for an identity-defined target was conducted. In the first 3 experiments, the target display either onset entirely or was revealed by offsetting camouflaging line segments to reveal letters. Prior to the target display, there was a noninformative cue, either an onset or an offset, at one of the potential target locations. Cues that shared the same transient feature as the target display captured attention. The lack of predictable target transients led to attentional capture by all forms of transients. The final experiments with luminance changes without offsets or onsets showed attentional capture when the luminance changes were large. The results suggest that attentional set can be broadly or narrowly tuned to detect changes in luminance.     

Unique sudden onsets capture attention even when observers are in feature-search mode

Two sources of attentional capture have been proposed: stimulus-driven (exogenous) and goal-oriented (endogenous). A resolution between these modes of capture has not been straightforward. Even such a clearly exogenous event as the sudden onset of a stimulus can be said to capture attention endogenously if observers operate in singleton-detection mode rather than feature-search mode. In four experiments we show that a unique sudden onset captures attention even when observers are in feature-search mode. The displays were rapid serial visual presentation (RSVP) streams of differently coloured letters with the target letter defined by a specific colour. Distractors were four #s, one of the target colour, surrounding one of the non-target letters. Capture was substantially reduced when the onset of the distractor array was not unique because it was preceded by other sets of four grey # arrays in the RSVP stream. This provides unambiguous evidence that attention can be captured both exogenously and endogenously within a single task.     

Repetition blindness for locations: evidence for automatic spatial coding in an RSVP task

The authors report a new phenomenon called repetition blindness (RB) for locations: When 3 or 4 letters are presented rapidly and sequentially at random locations within a spatial array, experimental participants have difficulty reporting pairs of letters appearing in the same location within 250 ms of each other. This deficit occurs both during report of letter identities and during report of the locations in which the letters appear; it can also be found using a partial report task. During letter report, the deficit is found for 4-location arrays but not for 8-location arrays. In contrast, letter RB is not found during location report even when the letters are always chosen from a set of 4. These results indicate that a small number of locations--but not letters--can be encoded automatically even when they are not explicitly reported. The authors argue that RB for locations results from a difficulty individuating 2 tokens at the same spatial location.     

Rapid processing of letters,digits and symbols: what purely visual‐attentional deficit in developmental dyslexia?

Visual‐attentional theories of dyslexia predict deficits for dyslexic children not only for the perception of letter strings but also for non‐alphanumeric symbol strings. This prediction was tested in a two‐alternative forced‐choice paradigm with letters, digits, and symbols. Children with dyslexia showed significant deficits for letter and digit strings but not for symbol strings. This finding is difficult to explain for visual‐attentional theories of dyslexia which postulate identical deficits for letters, digits and symbols. Moreover, dyslexics showed normal W‐shaped serial position functions for letter and digit strings, which suggests that their deficit is not due to an abnormally small attentional window. Finally, the size of the deficit was identical for letters and digits, which suggests that poor letter perception is not just a consequence of the lack of reading. Together then, our results show that symbols that map onto phonological codes are impaired (i.e. letters and digits), whereas symbols that do not map onto phonological codes are not impaired. This dissociation suggests that impaired symbol‐sound mapping rather than impaired visual‐attentional processing is the key to understanding dyslexia.     

Time course of visual attention with emotional faces

When a briefly presented and then masked visual object is identified, it impairs the identification of the second target for several hundred milliseconds. This phenomenon is known as attentional blink or attentional dwell time. The present study is an attempt to investigate the role of salient emotional information in shifts of covert visual attention over time. Two experiments were conducted using the dwell time paradigm, in which two successive targets are presented at different locations with a variable stimulus onset asynchrony (SOA). In the first experiment, real emotional faces (happy/sad) were presented as the first target, and letters (L/T) were presented as the second target. The order of stimulus presentation was reversed in the second experiment. In the first experiment, identification of the letters preceded by happy faces showed better performance than did those preceded by sad faces at SOAs less than 200 msec. Similarly, happy faces were identified better than sad faces were at short SOAs in Experiment 2. The results show that the time course of visual attention is dependent on emotional content of the stimuli. The findings indicate that happy faces are associated with distributed attention or broad scope of attention and require fewer attentional resources than do sad faces.     

Attending to an object's color entails attending to its location: support for location-special views of visual attention

Van der Heijden, Kurvink, de Lange, de Leeuw, and van der Geest (1996) argued that the results supporting the location-special view obtained by Tsal and Lavie (1988) were due to uncontrollable shifts of fixation, rather than reflecting the properties of the attentional system. In the present study, we present an improved variation of the Tsal and Lavie (1988) paradigm and reassert our claim that location is a special dimension. Subjects were presented with circular arrays of six letters of different colors. Three of the letters were enclosed by (Experiment 1) or superimposed on (Experiments 2, 3, and 4) different colored shapes. The subjects were instructed to report the (target) shape with a given color (e.g., report whether the red shape was a square, a circle, or a triangle) and then either freely report letters from the array (Experiments 1, 2, and 4) or identify a prespecified target letter (Experiment 3). In all four experiments, performance was substantially better for the letter that appeared in the location of the to-be-reported shape (location letter) than for the letter that shared its color (color letter). We conclude that attending to the stimulus color entails directing attention to its location.     

Attending to an object’s color entails Attending to its location: Support for location-special views of visual attention

Van der Heijden, Kurvink, de Lange, de Leeuw, and van der Geest (1996) argued that the results supporting the location-special view obtained by Tsal and Lavie (1988) were due to uncontrollable shifts of fixation, rather than reflecting the properties of the attentional system. In the present study, we present an improved variation of the Tsal and Lavie (1988) paradigm and reassert our claim that location is a special dimension. Subjects were presented with circular arrays of six letters of different colors. Three of the letters were enclosed by (Experiment 1) or superimposed on (Experiments 2,3, and 4) different colored shapes. The subjects were instructed to report the (target) shape with a given color (e.g., report whether the red shape was a square, a circle, or a triangle) and then either freely report letters from the array (Experiments 1, 2, and 4) or identify a prespecified target letter (Experiment 3). In all four experiments, performance was substantially better for the letter that appeared in the location of the to-be-reported shape (location letter) than for the letter that shared its color (color letter). We conclude that attending to the stimulus color entails directing attention to its location.