Incidental visual memory for targets and distractors in visual search

We explored incidental retention of visual details of encountered objects during search. Participants searched for conjunction targets in 32 arrays of 12 pictures of real-world objects and then performed a token discrimination task that examined their memory for visual details of the targets and distractors from the search task. The results indicate that even though participants had not been instructed to memorize the objects, the visual details of search targets and distractor objects related to the targets were retained after the search. Distractor objects unrelated to the search target were remembered more poorly. Eye-movement measures indicated that the objects that were remembered were looked at more frequently during search than those that were not remembered. These results provide support that detailed visual information is included incidentally in the visual representation of an object after the object is no longer in view.     

Influence of single and multiple onset distractors on visual search for singleton targets

In three experiments, we examined attentional and oculomotor capture by single and multiple abrupt onsets in a singleton search paradigm. Subjects were instructed to move their eyes as quickly as possible to a color singleton target and to identify a small letter located inside of it. In Experiment 1, task-irrelevant sudden onsets appeared simultaneously on half the trials with the presentation of the color singleton target. Response times (RTs) were longer when onsets appeared in the display regardless of the number of onsets. Eye-scan strategies were also disrupted by the appearance of the onset distractors, although the proportion of trials on which the eyes were directed to the onsets was the same regardless of the number of onsets. In Experiment 2, we manipulated the time of presentation of two task-irrelevant onsets in order to further examine whether multiple onsets would be attended and fixated prior to attending a color singleton target. Again, subjects made a saccade to a task-irrelevant onset on a substantial proportion of trials prior to fixating the target. However, saccades to the second onset were rare. Experiment 3 served as a replication of Experiment 1 but without the requirement for subjects to move their eyes to detect and identify the singleton target. The RT results were consistent with those in Experiment 1; dual onsets had no larger an effect on response speed than single onset distractors. These data are discussed in terms of the interaction between top-down and bottom-up control of attention and the eyes.     

Influence of single and multiple onset distractors on visual search for singleton targets

In three experiments, we examined attentional and oculomotor capture by single and multiple abrupt onsets in a singleton search paradigm. Subjects were instructed to move their eyes as quickly as possible to a color singleton target and to identify a small letter located inside of it. In Experiment 1, taskirrelevant sudden onsets appeared simultaneously on half the trials with the presentation of the color singleton target. Response times (RTs) were longer when onsets appeared in the display regardless of the number of onsets. Eye-scan strategies were also disrupted by the appearance of the onset distractors, although the proportion of trials on which the eyes were directed to the onsets was the same regardless of the number of onsets. In Experiment 2, we manipulated the time of presentation of two taskirrelevant onsets in order to further examine whether multiple onsets would be attended and fixated prior to attending a color singleton target. Again, subjects made a saccade to a task-irrelevant onset on a substantial proportion of trials prior to fixating the target. However, saccades to the second onset were rare. Experiment 3 served as a replication of Experiment 1 but without the requirement for subjects to move their eyes to detect and identify the singleton target. The RT results were consistent with those in Experiment 1; dual onsets had no larger an effect on response speed than single onset distractors. These data are discussed in terms of the interaction between top-down and bottom-up control of attention and the eyes.     

False feedback increases detection of low-prevalence targets in visual search

Many critical search tasks, such as airport and medical screening, involve searching for targets that are rarely present. These low-prevalence targets are associated with extremely high miss rates Wolfe, Horowitz, & Kenner (Nature, 435, 439?C440, 2005). The inflated miss rates are caused by a criterion shift, likely due to observers attempting to equate the numbers of misses and false alarms. This equalizing strategy results in a neutral criterion at 50?% target prevalence, but leads to a higher proportion of misses for low-prevalence targets. In the present study, we manipulated participants?? perceived number of misses through explicit false feedback. As predicted, the participants in the false-feedback condition committed a higher number of false alarms due to a shifted criterion. Importantly, the participants in this condition were also more successful in detecting targets. These results highlight the importance of perceived prevalence in target search tasks.     

Asymmetry in visual search for targets defined by differences in movement speed.

Perception of motion speed was investigated with the visual search paradigm, using human Ss. When searching for a fast target among slow distractors, reaction time was minimally affected as the number of distractors was increased. In contrast, reaction time to detect a slow target among fast distractors was slow and linearly related to the number of distractors. The effect cannot be attributed to differences in temporal frequency, discriminability, or one type of representation that might result from spatiotemporal filtering. An alternative hypothesis that can account for the asymmetry is that speed detectors operate as high-pass filters in the velocity domain. This hypothesis is in agreement with results obtained in psychophysical studies on motion adaptation as well as data from single-cell recordings in nonhuman species.     

Object-based auditory facilitation of visual search for pictures and words with frequent and rare targets

Auditory and visual processes demonstrably enhance each other based on spatial and temporal coincidence. Our recent results on visual search have shown that auditory signals also enhance visual salience of specific objects based on multimodal experience. For example, we tend to see an object (e.g., a cat) and simultaneously hear its characteristic sound (e.g., “meow”), to name an object when we see it, and to vocalize a word when we read it, but we do not tend to see a word (e.g., cat) and simultaneously hear the characteristic sound (e.g., “meow”) of the named object. If auditory–visual enhancements occur based on this pattern of experiential associations, playing a characteristic sound (e.g., “meow”) should facilitate visual search for the corresponding object (e.g., an image of a cat), hearing a name should facilitate visual search for both the corresponding object and corresponding word, but playing a characteristic sound should not facilitate visual search for the name of the corresponding object. Our present and prior results together confirmed these experiential association predictions. We also recently showed that the underlying object-based auditory–visual interactions occur rapidly (within 220 ms) and guide initial saccades towards target objects. If object-based auditory–visual enhancements are automatic and persistent, an interesting application would be to use characteristic sounds to facilitate visual search when targets are rare, such as during baggage screening. Our participants searched for a gun among other objects when a gun was presented on only 10% of the trials. The search time was speeded when a gun sound was played on every trial (primarily on gun-absent trials); importantly, playing gun sounds facilitated both gun-present and gun-absent responses, suggesting that object-based auditory–visual enhancements persistently increase the detectability of guns rather than simply biasing gun-present responses. Thus, object-based auditory–visual interactions that derive from experiential associations rapidly and persistently increase visual salience of corresponding objects.     

On the relation between identifying and locating masked targets in visual search

Three experiments were designed to determine whether naming is contingent on locating in a visual search task. Subjects were required to identify a masked target whose location was known (I|L) or unknown (I) and to locate a masked target whose identity was known (L|I) or unknown (L). The location-contingent hypothesis predicts a relationship among the tasks such that P(L) P(I|L) = P(I), since P(I) and P(L) P(I|L) both estimate the joint probability of identifying and locating the target (i.e. P(IλL)). This relationship held in Experiment I where targets were presented alone, and in Experiment II where targets were presented with dots as noise elements, but not in Experiment III where Xs were noise elements. The results are discussed in terms of the generality of the location-contingent hypothesis.     

Dimensional weighting of primary and secondary target-defining dimensions in visual search for singleton conjunction targets

Two experiments investigated dimension-based attentional processing in a complex singleton conjunction search task. In Experiment 1, observers had to discern the presence of a singleton target defined by a conjunction of size (fixed primary dimension) with either color or motion direction (secondary dimension). Similar to findings in singleton feature search, changes (vs. repetitions) of the secondary dimension across trials resulted in reaction time (RT) costs—which were, however, increased by a factor of 3–5 compared to singleton feature search. In Experiment 2, the coding of search-critical, dimensional saliency signals was investigated by additionally presenting targets redundantly defined in both secondary dimensions, with redundant-target signals being either spatially coincident or separate (i.e., one vs. two target items). Redundant-target RTs significantly violated Miller’s (Cognit Psychol 14:247–279, 1982) race model inequality only when redundant signals were spatially coincident (i.e., bound to a single object), indicating coactive processing of target information in the two secondary dimensions. These findings suggest that the coding and combining of signals from different visual dimensions operates in parallel. Increased change costs in singleton conjunction search are likely to reflect a reduced amount of weight available for processing the secondary target-defining dimensions, due to a large amount of weight being bound by the primary dimension.

---

Searching for one versus two identical targets: when visual search has a memory

A recent study has suggested that observers' visual explorations of the external world can proceed unimpaired when the visual environment precludes the operation of memory processes (as, for instance, when the display elements change locations every 100 ms). One theoretical limitation of this study was that distractors were the only elements that had the potential to be tagged during visual search. The present study sought to clarify the amnesic-search hypothesis by investigating whether memory processes can guide search in other contexts in which targets also have the potential to be tagged. Accordingly, the experimental conditions of the previous study were repeated using a different search task in which observers had to decide whether one target or two were present among a variable number of similar distractors. Under these search conditions, the present findings provided strong evidence that memory processes can guide visual search.     

Two studies of visual search for word targets with controlled rates of presentation*

The two studies reported involve the visual search of word lists for a target item when the rate of presentation is controlled and the words are presented tachistoscopically. In the first study, the target is differentiated physically from the filler items by being capitalized. When the target is the last item in a list, it is readily identified at all presentation rates, but when it is the first word or is embedded in a list, recognition accuracy is inversely related to presentation rate. In the second study, the differentiation between target and filler items is in terms of the presence or absence of category membership. All Ss at all presentation rates do significantly better on lists with an animal word as a target and a set of unrelated words as filler items than on the converse arrangement.     

Fortune and reversals of fortune in visual search: Reward contingencies for pop-out targets affect search efficiency and target repetition effects

Rewards have long been known to modulate overt behavior. But their possible impact on attentional and perceptual processes is less well documented. Here, we study whether the (changeable) reward level associated with two different pop-out targets might affect visual search and trial-to-trial target repetition effects (see Maljkovic & Nakayama, 1994). Observers searched for a target diamond shape with a singleton color among distractor diamond shapes of another color (e.g., green among red or vice versa) and then judged whether the target had a notch at its top or bottom. Correct judgments led to reward, with symbolic feedback indicating this immediately; actual rewards accumulated for receipt at study end. One particular target color led to a higher (10:1) reward for 75% of its correct judgments, whereas the other singleton target color (counterbalanced over participants) yielded the higher reward on only 25% of the trials. We measured search performance in terms of inverse efficiency (response time/proportion correct). The reward schedules not only led to better performance overall for the more rewarding target color, but also increased trial-to-trial priming for successively repeated targets in that color. The actual level of reward received on the preceding trial affected this, as did (orthogonally) the likely level. When reward schedules were reversed within blocks, without explicit instruction, corresponding reversal of the impact on search performance emerged within around 6 trials, asymptoting at around 15 trials, apparently without the observers’ explicit knowledge of the contingency. These results establish that pop-out search and target repetition effects can be influenced by target reward levels, with search performance and repetition effects dynamically tracking changes in reward contingency.     

Sensitivity to object viewpoint and action instructions during search for targets in the lower visual field

We contrasted visual search for targets presented in prototypical views and targets presented in nonprototypical views, when targets were defined by their names and when they were defined by the action that would normally be performed on them. The likelihood of the first fixation falling on the target was increased for prototypical-view targets falling in the lower visual field. When targets were defined by actions, the durations of fixations were reduced for targets in the lower field. The results are consistent with eye movements in search being affected by representations within the dorsal visual stream, where there is strong representation of the lower visual field. These representations are sensitive to the familiarity or the affordance offered by objects in prototypical views, and they are influenced by action-based templates for targets.     

The effects of the binocular disparity differences between targets and maskers on visual search

A visual search for targets is facilitated when the target objects are on a different depth plane than other masking objects cluttering the scene. The ability of observers to determine whether one of four letters presented stereoscopically at four symmetrically located positions on the fixation plane differed from the other three was assessed when the target letters were masked by other randomly positioned and oriented letters appearing on the same depth plane as the target letters, or in front, or behind it. Three additional control maskers, derived from the letter maskers, were also presented on the same three depth planes: (1) random-phase maskers (same spectral amplitude composition as the letter masker but with the phase spectrum randomized); (2) random-pixel maskers (the locations of the letter maskers’ pixel amplitudes were randomized); (3) letter-fragment maskers (the same letters as in the letter masker but broken up into fragments). Performance improved with target duration when the target-letter plane was in front of the letter-masker plane, but not when the target letters were on the same plane as the masker, or behind it. A comparison of the results for the four different kinds of maskers indicated that maskers consisting of recognizable objects (letters or letter fragments) interfere more with search and comparison judgments than do visual noise maskers having the same spatial frequency profile and contrast. In addition, performance was poorer for letter maskers than for letter-masker fragments, suggesting that the letter maskers interfered more with performance than the letter-fragment maskers because of the lexical activity they elicit.     

Cross-trial priming in visual search for singleton conjunction targets: role of repeated target and distractor features

Kristjánsson, Wang, and Nakayama (2002) demonstrated that visual search for conjunctively defined targets can be substantially expedited ("primed") when target and distractor features are repeated on consecutive trials. Two experiments were conducted to examine whether the search response time (RT) facilitation on target-present trials results from repetition of target-defining features, distractor features, or both. The experiments used a multiple conjunctive search paradigm (adapted from Kristjánsson et al., 2002), in which the target and distractor features were varied (i.e., repeated) independently of each other across successive trials. The RT facilitation was numerically largest when both target and distractor features were repeated, but not significantly larger than that when only distractor features were repeated. This indicates that cross-trial priming effects in conjunctive visual search result mainly from the repetition of distractor, rather than target, features.