Spatial cueing and the relation between the accuracy of “where” and “what” decisions in visual search

To study the processes underlying selective attention in visual search, the relation between the accuracy of “where” (location) and “what” (same/different orientation matching) decisions was analysed under various display conditions. Target-non-target discriminability was varied by contrasting single and multiple element displays; further, attention was directly manipulated by spatial cueing. In Experiment 1, analyses for both single and multiple displays showed that localization accuracy remained above chance when same/different matching failed; the inverse also obtained. It seems that accurate matching is not a prerequisite for target localization, nor is accurate localization a prerequisite for same/different matching. However, localization is a prerequisite for the accurate recognition of target orientation (Experiment 2). In this case, it seems that features critical for localization “call” attention to a particular candidate location. This facilitates further (shape) analysis of the stimulus that is found there. This orienting process is by-passed if attention is cued to the location in advance.     

Temporal factors in pattern vision

A sequence of uncorrelated randomly patterned visual stimuli (“visual noise”) is normally seen as a field of particles in “Brownian motion.” When each frame of the sequence is followed by a blank flash superimposed on the same region of the visual field, the apparent structure of the noise field is strikingly altered, its form varying with the time interval between frame and flash. At a critical interval, many dots seem to cohere, to form maggot-like objects.

Some of the factors determining this critical interval have been studied. They include the brightness, repetition frequency and exposure duration of the noise field, and the distance of its retinal image from the fovea.

The critical interval for “perceptual blanking” is quite different from that for the “maggot effect,” but the two show a suggestively similar dependence upon the duty cycle of the noise display.

It is of some neurological interest that the phenomenon is not appreciably visible with dichoptic mixing of noise and blank stimuli.     

Moray revisited: High-priority affective stimuli and visual search

Previous research offers conflicting suggestions about whether “high-priority” verbal stimuli such as an individual's own name or emotionally charged words automatically grab attention and/or can be detected without the usual capacity limitations. Nine experiments investigated this issue, using visual search through displays of words. In speeded search tasks, the subject's own name was detected more quickly than other targets, but in no case were search slopes flat enough to suggest parallel search or “pop-out”. Further, names were not found to be unusually potent distractors. Emotionally charged words were neither more readily detected as targets nor more potent as distractors than neutral words. Acomparison of observers' accuracy in searching briefly exposed simultaneous vs. successive displays provided further evidence that search for “high-priority” word targets is subject to the same severe capacity limitations as those that are found with search for neutral words.     

A further study of the pendulum phenomenon

A first series of experiments had demonstrated certain conditions eliciting or inhibiting a “pendulum” phenomenon in the visual perception of apparent movement. The present study consists of five further variations designed to show more clearly conditions of occurrence and non-occurrence of this type of movement. The main findings are:

(i) Altering the axis of display to vertical significantly reduces the frequency of pendular-movement perception;

(2) Altering the position of metronome from behind to the side of the visual display, gives results almost identical with those where the metronome was inaudible, but, when the metronome is illuminated in this position, all forms of movement perception are reduced, and no pendular movement is reported.

The results for all the ten conditions, including the five of the first series are summarized, and the following possible factors are discussed: past experience, physiological nystagmus, and intervening adaptation. All three may be required to account for the perceptual phenomena under investigation and the dichotomizing of explanations into “experiential,” or “physiological,” appears to be arbitrary and inconsistent with the complexity of the observed facts.     

Visual imagery and verbalization with simple tachistoscopic displays

Two experiments, designed to compare the perception and retention of tachisto-scopic displays of four block capital letters and four simple “nonsense” figures are described. The results show that the letters were much better remembered and suggest that this was mainly due to the ease with which they were verbalized. The nonsense figures usually gave rise either to rapidly fading “iconic” images, or to an unstable kind of mixed imagery which was difficult to describe or remember, but in which inadequate verbalization was often a source of error. Subsidiary experiments illustrate the importance, not only of verbalization, but also of symmetry and simplicity in remembering visual display.     

Modelling visual detection: Luminance response non-linearity and internal noise

Two experiments that investigate the effect of various display factors on the detectability of a thin line signal in random visual noise are described. Three statistical decision models are described, together with their ability to account for the results. The first is an “ideal detector” model, the second an “energy integrator” model, and the third a model based upon the operation of retinal ganglion cells which incorporates a gain control mechanism. The ideal detector model fails to give a good account of human performance, whereas the other two models provide a good fit to the data. The digital Laplacian with gain control model has the slight advantage over the energy integrating model in being able to account for a small superiority in the detection of dark as opposed to bright signals. Finally, both models require the inclusion of an estimate of the internal noise of the human visual system to account for the pattern of performance observed under changing conditions of display contrast.     

Classification without identification in visual search

Six subjects scanned displays of random consonants for a single target which was (a) another consonant; (b) a given number; or (c) any number. A second group of six subjects took part in three comparable conditions with number displays, and letters or numbers as targets. Scanning time for a number in a letter display or a letter in a number display was more rapid than scanning for a target drawn from the same set as the background. Several unpractised subjects, and all the subjects who practised the task, were able to scan as fast through letters for “any number” as for a specific number, or conversely through digits. The finding of different scanning rates for two precisely physically specified targets, depending on which class they were drawn from, runs counter to an explanation of high-speed scanning in terms of the operation of visual feature analysers. It is suggested that familiar categorization responses may be immediate and may provide the basis for the discrimination of relevant from irrelevant items in rapid visual scanning.     

Interocular Delay Produces Depth in Subjectively Moving Noise Patterns

Brief apparent motion sequences were introduced into a dynamic visual dot display by spatially shifting selected dots between successive frames. This causes the display to look as if it is drifting continuously in one direction. When such a display is observed with an interocular delay the drifting dots appear to be displaced in depth, even though there is no conventional retinal disparity in the display. We found that the magnitude of this depth shift increased with the duration of the apparent motion sequences. With sequences of five or more frames duration the depth effect was very similar to that which would have been predicted with a continuously moving target. With briefer sequences the size of the depth effect decreased rapidly. We suggest that apparent motion cascades form the basis of Tyler's dynamic visual noise stereophenomenon, and we question his “random spatial disparity” hypothesis.     

Mechanisms of the associated nontargets effect: processes influenced by statistical learning in a simple visual environment

In three visual search experiments participants were asked to make a target response if either of two targets was present and to make a nontarget response if neither target was present. Some target-absent displays included only nontarget features that never occurred in the same displays as target features, whereas other target-absent displays included nontarget features that did sometimes occur with target features. Nontarget responses were reliably faster in the former case than in the latter. This “associated nontargets effect” appears to arise from participants' ability to learn and to use contingencies between the presence of certain nontargets and the absence of any target.     

On varying the span of visual attention: Evidence for two modes of spatial attention

Three experiments investigated whether subjects could selectively attend to a target item presented in close spatial proximity to a distractor element. Typically, the display consisted of two curved lines, one a target and the other a distractor. The task was to judge the direction of curvature of the target. When subjects attended to a target away from fixation, performance was affected by the presence of a distractor within an area of 1° around the target. In contrast, the distractor did not influence target processing when subjects fixated on the target location. Two modes of visual attention are proposed. When a target is located away from fixation, a “wide” attentional span is employed. With the present stimuli, this led to the detailed processing of items within 1° of the attended position. However, when targets are at fixation a “narrow” span can be adopted, with the result that there is differential processing of attended items even within the formerly critical area.     

The associated non-targets effect: evidence of nontarget processing at and beyond the level of letter recognition

In four visual search tasks participants were asked to make a target response if either of two targets was present and to make a nontarget response if neither target was present. Some target-absent displays included only nontarget stimuli or features that never occurred in the same displays as targets, whereas other target-absent displays included nontarget stimuli or features that did sometimes occur with targets. Nontarget responses were reliably faster in the former case than in the latter. This “associated nontargets effect” indicates that nontargets are not simply classified as nontargets but in addition are discriminated from one another. Current visual search models may underestimate the degree to which nontargets are processed during search.     

Young infants'' sensitivity to movement information specifying social causality

Adults and 3- to 6-month-old infants were tested for their visual preference for two different dynamic displays presented simultaneously on two side-by-side computer monitors. Each display consisted of a pair of colored discs moving either independently (the independent display) or in systematic interaction (the “chase” display), never actually contacting one another. Except for the relative spatio-temporal dependence of the discs' movements, all dynamic parameters on the two displays were controlled and maintained equal. Analysis of looking behavior showed that adults as well as infants looked differentially at the displays. Patterns of preference depended on age. For the infants who completed the experiment, there was a significant transition from more looking at the chase to more looking at the independent display as a function of age. Adults as well as the older, attentive infants, showed enhanced visual attention to the independent display. These results provide first evidence of young infants' sensitivity to movement information specifying social causality for adult observers.     

Early motion processes and the kinetic depth effect

It has been known for over 30 years that motion information alone is sufficient to yield a vivid impression of three-dimensional object structure. For example, a computer simulation of a transparent sphere, the surface of which is randomly speckled with dots, gives no impression of depth when presented as a stationary pattern on a visual display. As soon as the sphere is made to rotate in a series of discrete steps or frames, its 3-D structure becomes apparent. Three experiments are described which use this stimulus, and find that depth perception in these conditions depends crucially on the spatial and temporal properties of the display:

1. Depth is seen reliably only for between-frame rotations of less than 15°, using two-frame and four-frame sequences.

2. Parametric observations using a wide range of frame durations and inter-frame intervals reveal that depth is seen only for inter-frame intervals below 80 msec and is optimal when the stimulus can be sampled at intervals of about 40-60 msec.

3. Monoptic presentation of two frames of the stimulus is sufficient to yield depth, but the impression is destroyed by dichoptic presentation.

These data are in close agreement with the observed limits of direction perception in experiments using “short-range” stimuli. It is concluded that depth perception in the motion display used in these experiments depends on the outputs of low-level or “short-range” motion detectors.     

Effects of visual familiarity on “same” and “different” decision processes

An experiment was conducted in which subjects matched upper and lower case versions of well-known abbreviations, such as BBC and etc, and meaningless controls. “Same” RT showed a familiarity effect for upper case versions of abbreviations such as BBC and GPO, but not for the lower case versions bbc and gpo. The converse did not occur for abbreviations such as etc, which were thought to occur most frequently in lower case. The “different” RT was inhibited by familiarity, with pairs such as IBM GPO being classified less rapidly than their lower case versions or controls. These effects occurred for subjects instructed to report “No” for “same” displays and “Yes” for “different” displays as well as for subjects given a conventional decision-report assignment. Some implications of these results for an account of the manner in which familiarity affects graphemic comparison processes are considered.     

The perception of short phrases presented simultaneously for visual & auditory reception

Subjects were provided with outline maps that were incomplete in several details. Brief, simultaneous, visual and auditory instructions were given for completing some of the missing details. Certain items could be completed on the basis of direct information contained in one or other of the sensory modalities. Others, however, could be completed only because of their relation to details capable of location by direct instruction. Information important for the completion of map details was distributed randomly among short passages of unconnected words. All relevant visual and aural clues were presented simultaneously in every case. Opportunities for alternations of attention were curtailed.

Thirty-six subjects were randomly assigned to three experimental conditions, and to two groups that were given different instructions. One group was told that relevant information would always appear simultaneously, while the other group was not allowed this information.

The number of successfully located simultaneous pairs of items presented for direct location was found to be no greater than could be expected by chance. The total number of correctly located items was less than 50 per cent of the possible items. There was no difference in the number of correctly located simultaneous pairs of items between the “instructed” and the “uninstructed” groups. The “uninstructed” group did not learn in the course of the experiment that all relevant material was presented simultaneously. Significantly more correct completions were made with the visual material than with the auditory. It is concluded that successful division of attention did not occur.     

Visual pattern recognition: Size preprocessing re-examined

Template theories of visual pattern recognition assume the operation of preprocessing routines to deal with irrelevancies such as discrepancies in stimulus size. In three experiments where size was an irrelevant dimension, observers classified pairs of forms as either “same” or “different”. In Experiment I, the classification “different” was required when the stimuli shared the same form but a different orientation, and “same” when the stimuli shared the same form and orientation. Under these conditions RT was an increasing function of the magnitude of the size disparity between stimuli with equal slopes for “same” and “different” judgements. In Experiment II, “different” classifications were made to stimuli that had different forms, and “same” to figures with the same form. This stimulus set produced a size disparity function that interacted with response type; “different” responses had a shallower slope. Experiment III consisted of a mixed stimulus set drawn from both Experiment I and II. Stimuli that produced additive effects of size disparity and response type in Experiment I now produced an interaction between these two factors similar to the one observed in Experiment II. The results of these experiments are interpreted as evidence that previous contradictory results reported in the literature stem from differences in the way the stimulus set is constructed, and that size transformations can not be a necessary operation, at least when “different” judgements are made. The results are problematic for the view that size disparity effects in matching tasks are easily interpretable in terms of a primitive size normalization stage that precedes any comparison operations.     

The effect of an irrelevant dimension on “same-different” judgements of multi-dimensional stimuli

Subjects made “same”-“different” judgements of simultaneously presented pairs of visual stimuli which could vary either in shape and colour independently, or in shape alone. In both conditions only shape was relevant to the “same”-“different” judgement. In the former condition “same” and “different” reaction times (RTs) were shorter when the states (“same” or “different”) of the relevant and the irrelevant dimension, colour, were the same. This result is interpreted as support for either a perceptual or a response interference hypothesis. The presence of an irrelevant dimension did not appear to affect differentially “same” and “different” judgements. The need for a re-evaluation of the results from other studies of multi-dimensional stimulus discrimination is discussed.     

A study of the effect of structural information and familiarity in form perception

Two experiments were carried out to investigate the influence of structural information and familiarity on the processing of visual forms. Pairs of “well” structured and nameable and “poorly” structured and non-nameable fragmented forms were employed as stimuli. The effects of structure and familiarity were assessed by manipulating the visual hemifield of presentation and the task. In Experiment 1 stimuli were judged as being either in the same orientation or mirror-reversed, a task that does not require high-level semantic information to be processed. Experiment 2 required physically identical forms to be matched, which may use either physical or name information. In Experiment 1 “same” judgements were equivalent for both types of stimuli, and “different' judgements were longer for the “poorly” structured (non-nameable) forms. In Experiment 2 there was little overall difference between “well” and “poorly” structured forms, though response times to “well” structured (nameable) forms were slowed for right-visual-field presentations. It is suggested that familiarity may not be sufficient to provide a perceptual advantage for nameable forms, as the advantage for nameable stimuli was confined to “same” judgements in Experiment 1 and response times were shorter for non-nameable stimuli in Experiment 2. Rather, performance depends upon factors such as the computation of global shape (due to structural properties of collinearity and closure) and on the use of different kinds or representations (physical versus name) in matching.     

Recognition and attention

Sternberg has suggested that a possible way of achieving identification of degraded stimuli would be to execute “preprocessing” operations prior to recognition. Such operations would have some parallels with the “filtering” operations, suggested by Broadbent and others, for perceptual selection and attention. But when trying, in this paper, to consider how such operations could be implemented, some rather non-trivial problems emerge. Experimentally, these doubts find support in visual selection tasks of quite general character, in that filtering does not appear to take place. It seems, however, that these problems may be successfully overcome by some simple, though implicative, conceptual changes. The main implication is that effective focal attention is rather likely to be achieved through a process that is best described as “context-sensitive” selection.     

Orienting of attention

Bartlett viewed thinking as a high level skill exhibiting ballistic properties that he called its “point of no return”. This paper explores one aspect of cognition through the use of a simple model task in which human subjects are asked to commit attention to a position in visual space other than fixation. This instruction is executed by orienting a covert (attentional) mechanism that seems sufficiently time locked to external events that its trajectory can be traced across the visual field in terms of momentary changes in the efficiency of detecting stimuli. A comparison of results obtained with alert monkeys, brain injured and normal human subjects shows the relationship of this covert system to saccadic eye movements and to various brain systems controlling perception and motion. In accordance with Bartlett's insight, the possibility is explored that similar principles apply to orienting of attention toward sensory input and orienting to the semantic structures used in thinking.