Modeling visual attention

Quantitative modeling of psychological data is both technically and mathematically challenging. The present article introduces a user friendly and flexible program package that enables quantitative fits of Bundesen’s (1990) theory of visual attention to behavioral data from whole and partial report experiments. The program package is based on new computational formulas that are more general than previous ones and has already been used successfully in a number of neuropsychological investigations of attentional disorders, such as visual neglect and simultanagnosia. A clinical version of the program package is currently under development.     

Automatizing of visual attention

Perceptual automatizing was argued to occur as a consequence of repeated experience with a stimulus. Automatizing was hypothesized to entail a stereotyping in sampling of sensory information together with an attendant decrease in the rate of sampling of that information. An experiment was performed in which human Ss observed stimulus pictures for several trials, during which records were made of their visual fixations. It was found that fixation rate habituated and that this habituation was accompanied by a reduction in the uncertainty (entropy) of the spatial distributions of fixations. These results were interpreted as evidence for automatizing of visual fixation processes. Analysis of eye-movement distances suggested a possible mechanism for the reported loss of vividness of a stimulus which is perceived habitually.     

Spatial factors in visual attention: a reply to Crassini

Distances between stimuli and, derivatively, compactness of stimulus subsets are pervasive determiners of discrimination and classification performance. Contrary to Crassini (1986), these factors are sufficient to account for the major patterns in the chronometric data of Podgorny and Shepard (1978, 1983). Other factors, such as the dichotomous one distinguishing what Crassini terms unitary and nonunitary subsets, may exert some additional influence. But a convincing demonstration would require formulation of a quantitative model capable of being pitted against the distance-based model of Podgorny and Shepard within the context of their entire body of data.     

An investigation of visual responses to brief stereoscopic stimuli

An analytic model of the temporal properties of visual responses to brief stimuli is described. The model is based on the notion that visual responses persist for some time after the occurrence of brief stimuli. The model is quantified from data on stereopsis obtained with alternating brief monocular presentations of disparate stimuli. The relevance of the analysis for the data of experiments using tachistiscopic techniques is discussed.     

On the preattentive accessibility of stereoscopic disparity: Evidence from visual search

We examined the generality of the claim that stereoscopic disparity is detectable in parallel across the visual field. Using a search paradigm with random-dot stereograms, we varied the relative disparity of target and distractor items. When both target and distractors had crossed disparities, both search functions (i.e., target in front of distractors and target behind distractors) were linear with positive slopes. When both target and distractors had uncrossed disparities, the pattern of results depended upon whether the target was in front of or behind the distractors—specifically, when the target was in front of the distractors, search functions were similar to those seen for “crossed” search, but when the target was behind the distractors, a nonlinear search function was found. Finally, when the target and distractors straddled the plane of fixation, a nonlinear search function was found when the target was in front of the distractors; however, when the target was behind the distractors, a linear search function with a large positive slope was found. We show that the nonlinear search functions are consistent with the effects of an intervening global surface percept. We also show that the size of the stimulus display may be a factor in some relative depth cases. Additionally, we replicate Steinman’s (1987) finding that search is parallel when the distractors are located at the plane of fixation and the target disparity is crossed, eliminating monocular and spatial cues to target presence that may have been present in his original study. In a final control experiment, we showed that reaction times did not increase with set size when observers performed another kind of perceptual task on similar random-dot stereogram displays. This eliminates the possibility that some of the results obtained here can be explained by increases in the difficulty of perceiving/fusing the stimuli when the number of distractors is increased.     

Salience-based progression of visual attention: Time course

In a visual search task, visual attention progresses from the most to the least salient item until a target is found. The time course of such salience-based progression remains unclear although the temporal deployment seems as crucial as the spatial deployment. The present study investigated how the general hierarchical pattern takes place. Healthy volunteers were presented with a primed visual search paradigm in which the primes consisted of three items differing in salience for either 33, 50 or 100 ms. Subsequently one of them became the target and participants had to make a judgment about it. In order to progress on the basis of salience, attention seemed first to be captured by the most salient item. Secondly, the first two most salient items seemed both encompassed within the attentional spotlight. At that time, the least salient item seemed inhibited, completing the stepwise progression of attention. In summary, our data suggest that the hierarchical pattern is built up over time through orienting and expansion of the spotlight, and inhibition of the least salient signals. Furthermore, complementary analyses revealed a proximity effect influencing the selection of the next location to visit. As predicted by different computational models, items located closely to the first visited location were more prone to attract attention than distant items but interestingly enough, this effect only applied to the least salient item suggesting a balance between salience and proximity criteria. Critically also, salience and proximity effects seem to have different time courses. Results are only partially explained by current visual attention models and require further investigation.     

Abrupt visual onsets and selective attention: evidence from visual search

The effect of temporal discontinuity on visual search was assessed by presenting a display in which one item had an abrupt onset, while other items were introduced by gradually removing line segments that camouflaged them. We hypothesized that an abrupt onset in a visual display would capture visual attention, giving this item a processing advantage over items lacking an abrupt leading edge. This prediction was confirmed in Experiment 1. We designed a second experiment to ensure that this finding was due to attentional factors rather than to sensory or perceptual ones. Experiment 3 replicated Experiment 1 and demonstrated that the procedure used to avoid abrupt onset--camouflage removal--did not require a gradual waveform. Implications of these findings for theories of attention are discussed.     

SLAM: a connectionist model for attention in visual selection tasks

SLAM, the SeLective Attention Model, performs visual selective attention tasks, an analysis of which shows that two processes, object and attribute selection, are both necessary and sufficient. It is based upon the McClelland and Rumelhart (1981) model for visual word recognition, with the addition of a response selection and evaluation mechanism. The responses may be correct or incorrect and, in particular conditions, SLAM may not make a response at all. Moreover, it allows for the generation of specific responses in time. SLAM's main characteristics are parallelism restricted by competition within modules, heterarchical processing in a hierarchical structure, and generation of responses as a result of relaxation given the conjoint constraints of stimulation, object, and attribute selection. The model is considered to represent an individual subject performing filtering tasks and demonstrates appropriate selective behavior. It is also tested quantitatively using a single tentative set of model parameters. The study reports simulations of four different filtering experiments, modeling response latencies, and error proportions. Specifications are made to take account of instructions, previous trials, and the effect of a barmarker cue and of asynchronies in stimulus and cue onsets. The model is then extended in order to provide simulations of a number of Stroop experiments, which can be regarded as filtering tasks with nonequivalent stimuli. The extension required for Stroop simulations is the addition of direct connections between compatible stimulus and response aspects. The direct connections do not affect the simulation of simpler filtering tasks. A variety of different experiments carried out by different authors is simulated. The model is discussed in terms of how modular architecture and the interaction of excitation and inhibition generate facilitation or inhibition of response latencies.     

A theory of visual attention

A unified theory of visual recognition and attentional selection is developed by integrating the biased-choice model for single-stimulus recognition (Luce, 1963; Shepard, 1957) with a choice model for selection from multielement displays (Bundesen, Pedersen, & Larsen, 1984) in a race model framework. Mathematically, the theory is tractable, and it specifies the computations necessary for selection. The theory is applied to extant findings from a broad range of experimental paradigms. The findings include effects of object integrality in selective report, number and spatial position of targets in divided-attention paradigms, selection criterion and number of distracters in focused-attention paradigms, delay of selection cue in partial report, and consistent practice in search. On the whole, the quantitative fits are encouraging.     

Reallocation of visual attention.

Attentional movement time was investigated within and across hemifields in a discrimination task in which retinal acuity was controlled. Ss discriminated targets in a two-alternative, forced-choice latency paradigm. In Experiments 1-3, costs were mediated by distance, even though it was varied independently of acuity. In Experiments 4 and 7, with distance held constant, costs were equivalent for crossing the vertical and horizontal meridians and for crossing 1 and 2 meridians. However, crossing 1 meridian produced costs that were less than the costs for shifts to unexpected locations in the same quadrant, partially replicating the inhibitory aftereffect of Tassinari, Aglioti,Chelazzi,Marzi,and Berlucchi (1987). An explanation based on a combination of analog movement (Tsal, 1983) and attentional distribution (Downing & Pinker, 1985; Hughes & Zimba, 1987; Tassinari et al., 1987) models was discussed.     

Symbolic control of visual attention

The present study reports four pairs of experiments that examined the role of nonpredictive (i.e., task-irrelevant) symbolic stimuli on attentional orienting. The experiments involved a simple detection task, an inhibition of return (IOR) task, and choice decision tasks both with and without attentional bias. Each pair of experiments included one experiment in which nonpredictive arrows were presented at the central fixation location and another experiment in which nonpredictive direction words (e.g., "up,""down,""left,""right") were presented. The nonpredictive symbolic stimuli affected responses in all experiments, with the words producing greater effects in the detection task and the arrows producing greater effects in the IOR and choice decision tasks. Overall, the present findings indicate that there is a strong connection between the overlearned representations of the meaning of communicative symbols and the reflexive orienting of visual attention.     

The path of visual attention

Visual cuing is one paradigm often used to study object- and space-based visual selective attention. A primary finding is that shifts of attention within an object can be accomplished faster than equidistant shifts between objects. The present study used a visual cuing paradigm to examine how an object's size (i.e., internal distance) and shape, influences object- and space-based visual selective attention. The first two experiments manipulated object size and compared attentional shift performance with objects where the within-object distance between cued and uncued target locations was either equal to the between-object distance (1:1 ratio condition) or three times the between-object distance (3:1 ratio condition). Within-object shifts took longer for the larger objects, but an advantage over between-object shifts was still evident. Influences associated with the shapes of the larger objects suggested by the results of the first two experiments were tested and rejected in Experiment 3. Overall, the results indicate that within-object shifts of attention become slower as the within-object distance increases, but nevertheless are still accomplished faster than between-object shifts.     

Looking happy: the experimental manipulation of a positive visual attention bias

Individuals with a positive visual attention bias may use their gaze to regulate their emotions while under stress. The current study experimentally trained differential biases in participants' (N = 55) attention toward positive or neutral information. In each training trial, one positive and one neutral word were presented and then a visual target appeared consistently in the location of the positive or neutral words. Participants were instructed to make a simple perceptual discrimination response to the target. Immediately before and after attentional training, participants were exposed to a stress task consisting of viewing a series of extremely negative images while having their eyes tracked. Visual fixation time to negative images, assessed with an eye tracker, served as an indicator of using gaze to successfully regulate emotion. Those participants experimentally trained to selectively attend to affectively positive information looked significantly less at the negative images in the visual stress task following the attentional training, thus demonstrating a learned aversion to negative stimuli. Participants trained toward neutral information did not show this biased gaze pattern.     

Top-down selective visual attention: A neurodynamical approach

We propose a system of interconnected modules consisting of populations of neurons for modelling the underlying mechanisms involved in selective visual attention. We demonstrate that it is plausible to build a neural system for visual search, which works across the visual field in parallel, but, due to the intrinsic dynamics of the system, resembles apparent modes of visual attention, namely the serial focal and the parallel spread over the space mode. Thus, neither explicit serial focal search nor saliency maps need to be assumed. A focal attentional spotlight is not included in the system but rather focal attention emerges due to the convergence of the dynamic behaviour of the neural networks. The dynamics of the system can be interpreted as a mechanism for routing information from the sensory input.     

Feature-based memory-driven attentional capture: visual working memory content affects visual attention

In 7 experiments, the authors explored whether visual attention (the ability to select relevant visual information) and visual working memory (the ability to retain relevant visual information) share the same content representations. The presence of singleton distractors interfered more strongly with a visual search task when it was accompanied by an additional memory task. Singleton distractors interfered even more when they were identical or related to the object held in memory, but only when it was difficult to verbalize the memory content. Furthermore, this content-specific interaction occurred for features that were relevant to the memory task but not for irrelevant features of the same object or for once-remembered objects that could be forgotten. Finally, memory-related distractors attracted more eye movements but did not result in longer fixations. The results demonstrate memory-driven attentional capture on the basis of content-specific representations.     

The measurement of visual attention in infants: a comparison of two methodologies

Twenty-four infants were tested at 8 and 12 weeks of age—12 at each age—to determine fixation times to three checkerboard patterns of equal area, a 2 × 2, 8 × 8, and 24 × 24. Each infant was tested twice, once with a single stimulus method of presentation and once with a paired-comparisons. Both methods were similar in depicting age and sex differences. The older infants looked longer at the more complex patterns while the female infants fixated complex patterns longer, relative to simpler patterns, than than did the males. However, the paired-comparisons method was superior in distinguishing between what McCall (1970) has called “blank looking” from meaningful perceptual-cognitive interaction with a stimulus. The data were interpreted as showing that because females are more able to process information from static stimuli, as suggested by McCall, they are ahead of their male age peers in their perceptual-cognitive development within this age range.     

Symbolic control of visual attention: Semantic constraints on the spatial distribution of attention

Humans routinely use spatial language to control the spatial distribution of attention. In so doing, spatial information may be communicated from one individual to another across opposing frames of reference, which in turn can lead to inconsistent mappings between symbols and directions (or locations). These inconsistencies may have important implications for the symbolic control of attention because they can be translated into differences in cue validity, a manipulation that is known to influence the focus of attention. This differential validity hypothesis was tested in Experiment 1 by comparing spatial word cues that were predicted to have high learned spatial validity (“above/below”) and low learned spatial validity (“left/right”). Consistent with this prediction, when two measures of selective attention were used, the results indicated that attention was less focused in response to “left/right” cues than in response to “above/below” cues, even when the actual validity of each of the cues was equal. In addition, Experiment 2 predicted that spatial words such as “left/right” would have lower spatial validity than would other directional symbols that specify direction along the horizontal axis, such as “←/→” cues. The results were also consistent with this hypothesis. Altogether, the present findings demonstrate important semantic-based constraints on the spatial distribution of attention.     

Between-object binding and visual attention

Many previous studies have found that we can attend pairs of visual features (e.g., colour, orientation) more efficiently when they belong to the same “object” compared to when they belong to separate, neighbouring objects (e.g., Behrmann, Zemel, & Mozer, 1998; Egly, Rafal, & Driver, 1994). This advantage for attending features from the same object may reflect stronger binding between these features than arises for pairs of features belonging to separate objects. However, recent findings described by Davis, Welch, Holmes, and Shepherd (in press) suggest that under specific conditions this same-object advantage can be reversed, such that attention now spreads more readily between features belonging to separate neighbouring objects than between features of the same object. In such cases it would appear that features belonging to separate visual objects are more strongly bound than features of the same object. Here I review these findings and present the results of a new study. Together these data suggest that magnocellular processes in the human visual system bind together features from separate objects, whereas parvocellular processes bind together features from the same object.     

Object-based auditory and visual attention

Theories of visual attention argue that attention operates on perceptual objects, and thus that interactions between object formation and selective attention determine how competing sources interfere with perception. In auditory perception, theories of attention are less mature and no comprehensive framework exists to explain how attention influences perceptual abilities. However, the same principles that govern visual perception can explain many seemingly disparate auditory phenomena. In particular, many recent studies of 'informational masking' can be explained by failures of either auditory object formation or auditory object selection. This similarity suggests that the same neural mechanisms control attention and influence perception across different sensory modalities.