Cognitive control of fixation duration in visual search: The role of extrafoveal processing

Participants' eye movements were monitored in two visual search experiments that manipulated target-distractor similarity (high vs. low) as well as the availability of distractors for extrafoveal processing (Free-Viewing vs. No-Preview). The influence of the target-distractor similarity by preview manipulation on the distributions of first fixation and second fixation duration was examined by using a survival analysis technique which provided precise estimates of the timing of the first discernible influence of target-distractor similarity on fixation duration. We found a significant influence of target-distractor similarity on first fixation duration in normal visual search (Free Viewing) as early as 26–28 ms from the start of fixation. In contrast, the influence of target-distractor similarity occurred much later (199–233 ms) in the No-Preview condition. The present study also documented robust and fast acting extrafoveal and foveal preview effects. Implications for models of eye-movement control and visual search are discussed.     

Finding a new target in an old display: Evidence for a memory recency effect in visual search

Visual search often involves searching the same environment, consecutively, for a number of different targets. Here we investigate the extent to which search benefits from such previous exposure. In the experiment participants searched the same display consecutively for two different targets. Manual responses were faster in the second search than the first search regardless of whether a target was present or absent in the second search. Eye movement recordings demonstrated that the time necessary to find a target letter in the second search depended on when that letter was last fixated in the previous search. This fixation recency effect lasted for about four fixations. In addition, when a target was absent during the second search, participants were less likely to refixate a distractor if it had been recently fixated in the previous search and refixations tended to also occur later on in the search. These results provide evidence for a limited capacity short-term memory store in this kind of visual search.     

The effect of prose context on visual search for letters

Subjects were given a simplified proofreading task in which they were instructed to circle every occurrence of a target letter in a prose passage or in a scrambled prose passage. It was found that the presence of a prose context enhanced the subjects ability to find a target letter when the target letter was in a content word, but impaired the subjects ability to find a target letter when it was in a function word. This interaction sheds light on a number of conflicting reports in the literature.     

The effect of visualization on visual search performance

Striking results recently demonstrated that visualizing search for a target can facilitate visual search for that target on subsequent trials (Reinhart et al. 2015). This visualization benefit was even greater than the benefit of actually repeating search for the target. We registered a close replication and generalization of the original experiment. Our results show clear benefits of repeatedly searching for the same target, but we found no benefit associated with visualization. The difficulty of the search task and the ability to monitor compliance with instructions to visualize are both possible explanations for the failure to replicate, and both should be carefully considered in future research exploring this interesting phenomenon.     

Linguistically mediated visual search: The critical role of speech rate

Recent studies have shown that the presentation of concurrent linguistic context can lead to highly efficient performance in a standard conjunction search task by the induction of an incremental search strategy (Spivey, Tyler, Eberhard, & Tanenhaus, 2001). However, these findings were obtained under anomalously slow speech rate conditions. Accordingly, in the present study, the effects of concurrent linguistic context on visual search performance were compared when speech was recorded at both a normal rate and a slow rate. The findings provided clear evidence that the visual search benefit afforded by concurrent linguistic context was contingent on speech rate, with normal speech producing a smaller benefit. Overall, these findings have important implications for understanding how linguistic and visual processes interact in real time and suggest a disparity in the temporal resolution of speech comprehension and visual search processes.     

The effect of set on categorization in visual search

Two experiments examine whether set for a categorial difference or set for a target category is necessary in order to obtain the category effect in visual search. Eliminating a set for categorial difference does not diminish the size of the effect. When subjects are prevented from developing a useful set for the target category, however, the category effect is eliminated.     

From parallel to serial processing: a computational study of visual search

A novel computational model of a preattentive system performing visual search is presented. The model processes displays of lines, reproduced from Wolfe, Friedman-Hill, Stewart, and O'Connell's (1992) and Treisman and Sato's (1990) visual-search experiments. The response times measured in these experiments suggest that some of the displays are searched serially, whereas others are scanned in parallel. Our neural network model operates in two phases. First, the visual displays are compressed via standard methods (principal component analysis), to overcome assumed biological capacity limitations. Second, the compressed representations are further processed to identify a target in the display. The model succeeds in fast detection of targets in experimentally labeled parallel displays, but fails with serial ones. Analysis of the compressed internal representations reveals that compressed parallel displays contain global information that enables instantaneous target detection. However, in representations of serial displays, this global information is obscure, and hence, a target detection system should resort to a serial, attentional scan of local features across the display. Our analysis provides a numerical criterion that is strongly correlated with the experimental response time slopes and enables us to reformulate Duncan and Humphreys's (1989) search surface, using precise quantitative measures. Our findings provide further insight into the important debate concerning the dichotomous versus continuous views of parallel/serial visual search.     

The control of fixation duration in visual search

A study is reported how fixation durations are affected as observers voluntarily use information in the visual environment to direct saccades in search of a target. In experiments with direction-coded displays, search fixation durations for correct and incorrectly directed saccades were comparable during image-driven/bottom-up search. In contrast, for knowledge-driven search, the relationship depended on peripheral preview. With ample access to peripheral preview, search fixation durations preceding correct saccades were shorter than those preceding incorrectly directed saccades. However, they were longer when preview was constrained by a gaze-contingent moving window. Fixation control was modeled as sigmoid functions.     

The generation effect with homographs: Evidence for postgeneration processing

The generation effect is the phenomenon in which words are remembered better when generated than when read. These experiments test the possibility that at least one consequence of generating is enhanced semantic processing. Homographs were used as targets, presented with rhymes in Experiment 1 so as not to bias meaning, and with synonyms in Experiment 2 to bias one meaning of each homograph. In beth experiments, extralist synonym cues were provided at recall. In Experiment 1 a generation effect was obtained when the retrieval cues biased the dominant meaning of the homograph (determined from free association norms), whereas in Experiment 2 a generation effect was found when the retrieval cues biased the same meaning that was biased during study. In neither experiment was a generation effect obtained with retrieval cues that biased the other meaning of each homograph. These results indicate that the generation effect is dependent upon the compatibility of the semantic processing conducted at study and test. Since it is impossible to process the meaning of a homograph when generating it from a rhyme cue, the meaning of the homograph could only have been processed after the word had been generated. The finding in Experiment 1 that a generation effect was obtained with rhymes when semantic retrieval cues were provided demonstrates that the enhancement properties associated with generation are not restricted to the information used to guide the generation process. This finding also indicates that one locus of the generation effect is in the processing that occurs after the word has been generated.     

The equivalence of target and nontarget processing in visual search

A comparison of a forced-choice visual search task with an item recognition task did not support Neisser’s (1967) hypothesis of a preattentive stage that processes targets and nontargets differentially. In the forced-choice condition, Ss indicated which of two items in a visual display was a target; in item recognition, Ss determined whether or not the single item in the visual display was a target. The size of the memorized set of possible targets was varied from one to six items for both tasks. Latencies increased linearly with memory set size in both conditions; the slopes for forced choice and item recognition were 41.8 and 27.9 msec per item, respectively. The ratio of 1.38 between the two slopes was well fit by Sternberg’s (1967) item recognition model, which predicts a ratio of 1.50.     

Serial processing of visual spatial patterns in a search paradigm

Previous experiments in this laboratory employing a search paradigm have found highly significant differences in the detectability of a briefly exposed target pattern as a function of the spatial location of the target when it is presented simultaneously with a number of discriminably different nontarget patterns. These detectability differences, at loci equidistant from the fovea, could not be accounted for by any known variation in retinal spatial resolution or by differential lateral masking effects of the target by nearby nontarget patterns. These observations led to the hypothesis that the target in these experiments was detected by a serial mechanism which "scanned" a persisting but rapidly degrading neural representation of the visual scene with increasing detection failures the later in time the scan processed the location occupied by the target. If this hypothesis is correct, then target detectability should vary inversely with the number of stimuli which must be examined. The present experiment confirmed this expectation. A mathematical model of such a serial scanning process also predicts other, less obvious, effects on target detectability which were observed when the number of nontarget patterns was changed.     

The effect of visual search efficiency on response preparation: neurophysiological evidence for discrete flow

Most models assume that response time (RT) comprises the time required for successive processing stages, but they disagree about whether information is transmitted continuously or discretely between stages. We tested these alternative hypotheses by measuring when movement-related activity began in the frontal eye field (FEF) of macaque monkeys performing visual search. Previous work showed that RT was longer when visual neurons in FEF took longer to select the target, a finding consistent with prolonged perceptual processing during less efficient search. We now report that the buildup of saccadic movement-related activity in FEF is delayed in inefficient visual search. Variability in the delay of movement-related activity accounted for the difference in RT between search conditions and for the variability of RT within conditions. These findings provide neurophysiological support for the hypothesis that information is transmitted discretely between perceptual and response stages of processing during visual search.     

In search of a strong visual recency effect

When a sequence of visual stimuli is presented in a fixed location, immediate serial recall of the sequence is characterized by only a small recency effect. According to Battacchi, Pelamatti, and Umiltà (1990), the distribution of visual stimuli over space, as well as time, greatly enhances the recency effect. After an initial failure to find a strong visual recency effect with distributed presentation (Experiment 1), in the remaining experiments an attempt was made to more closely approximate Battacchi et al.'s methodology by eliminating articulatory suppression (Experiments 2-7), using their stimuli (Experiments 3-7), blocking conditions (Experiments 4-7), requiring written rather than typed responses (Experiments 5-7), and using their list length (Experiments 6 and 7). Nevertheless, even when their method was followed as closely as possible (Experiment 7), distributed presentation did not produce a strong visual recency effect. The influence of distributed presentation on the visual recency effect would seem to be, at best, limited.     

Evidence for attentional capture by a surprising color singleton in visual search

Three experiments were conducted to investigate whether surprising color singletons capture attention. Participants performed a visual search task in which a target letter had to be detected among distractor letters. Experiments 1 and 2 assessed accuracy as the dependent variable. In Experiment 1, the unannounced presentation of a color singleton 500 ms prior to the letters (and in the same position as the target letter) resulted in better performance than in the preceding conjunction search segment, in which no singleton was presented, and performance was as good in this surprise–singleton trial as in the following feature search segment, in which the singleton always coincided with the target. In contrast, no improvement was observed when the color singleton was presented simultaneously with the letters in Experiment 2, indicating that attentional capture occurred later in the surprise trial than in the feature search segment. In Experiment 3, set size was varied, and reaction time was the dependent variable. Reaction time depended on set size in the conjunction search segment, but not in the surprise trial nor in the feature search segment. The results of the three experiments support the view that surprising color singletons capture attention independently of a corresponding attentional set.     

The effect of orthographic structure on word recognition in a visual search task

The effect of the orthographic structure of the stimulus field on the visual search performance of third graders (8-8 years), sixth graders (11-7 years) and adults was investigated in three experiments. In Experiment 1, where the predesignated target was one word, subjects of all ages searched equally fast through fields consisting of words, pseudowords, and nonwords. In contrast, subjects of all ages displayed effects of orthographic structure when searching for instances of a semantic category (Experiment 2) or for three words (Experiment 3). Subjects searched faster through nonwords than through pseudowords and faster through pseudowords than through words. The use of orthographic structure to facilitate search did not increase with age, suggesting that children of the youngest age group were already making maximal use of intraword redundancy.     

Prioritization in visual search: visual marking is not dependent on a mnemonic search

Visual marking (VM) refers to our ability to completely exclude old items from search when new stimuli are presented in our visual field. We examined whether this ability reflects an attentional scan of the old items, possibly allowing observers to apply inhibition of return or maintain a memory representation of already seen locations. In four experiments, we compared performance in two search conditions. In the double-search (DS) condition, we required participants to pay attention to a first set of items by having them search for a target within the set. Subsequently, they had to search a second set while the old items remained in the field. In the VM condition, the participants expected the target only to be in the second (new) set. Selection of new items in the DS condition was relatively poor and was always worse than would be expected if only the new stimuli had been searched. In contrast, selection of the new items in the VM condition was good and was equal to what would be expected if there had been an exclusive search of the new stimuli. These results were not altered when differences in Set 1 difficulty, task switching, and response generation were controlled for. We conclude that the mechanism of VM is distinct from mnemonic and/or serial inhibition-of-return processes as involved in search, although we also discuss possible links to more global and flexible inhibition-of-return processes not necessarily related to search.