Rejecting salient distractors: Generalization from experience

Distraction impairs performance of many important, everyday tasks. Attentional control limits distraction by preferentially selecting important items for limited-capacity cognitive operations. Research in attentional control has typically investigated the degree to which selection of items is stimulus-driven versus goal-driven. Recent work finds that when observers initially learn a task, the selection is based on stimulus-driven factors, but through experience, goal-driven factors have an increasing influence. The modulation of selection by goals has been studied within the paradigm of learned distractor rejection, in which experience over a sequence of trials enables individuals eventually to ignore a perceptually salient distractor. The experiments presented examine whether observers can generalize learned distractor rejection to novel distractors. Observers searched for a target and ignored a salient color-singleton distractor that appeared in half of the trials. In Experiment 1, observers who learned distractor rejection in a variable environment rejected a novel distractor more effectively than observers who learned distractor rejection in a less variable, homogeneous environment, demonstrating that variable, heterogeneous stimulus environments encourage generalizable learned distractor rejection. Experiments 2 and 3 investigated the time course of learned distractor rejection across the experiment and found that after experiencing four color-singleton distractors in different blocks, observers could effectively reject subsequent novel color-singleton distractors. These results suggest that the optimization of attentional control to the task environment can be interpreted as a form of learning, demonstrating experience’s critical role in attentional control.     

Multiple attentional control settings at distinct locations without the confounding of repetition priming

An attentional control setting (ACS), which is based on the task goal, induces involuntary attentional capture by a stimulus possessing a target-defining feature. It is unclear whether ACSs are maintained for multiple targets defined as conjunctions of a color and location. In the present study we examined the possibility of local ACSs for dual targets defined as combinations of color and location, using different paradigms: visual search in Experiment 1, and spatial cueing in Experiment 2. In Experiment 1, a distractor captured attention only when its features matched the ACSs. Likewise, in Experiment 2, a significant attentional capture effect was found only with a matching cue, whose color and location were in line with the conjunction of the target definition. Importantly, the identical pattern of attentional capture was also obtained for a neutral-color target, which was unlikely to be primed by any color of the cue. Thus, these findings imply that the attentional bias depending on the match between the cue and target did not result from cue–target repetition priming. The present study highlights that top-down attentional control can be set flexibly to accomplish a complex task goal efficiently.     

Repetition blindness in priming in perceptual identification: Competitive effects of a word intervening between prime and target

University students named a 72-ms masked target word that was preceded by two 120-ms consecutively presented words, a prime word followed by a distractor. In Experiment 1, all words were in lowercase letters, whereas in Experiment 2, the target word was changed to uppercase letters. In both experiments there was an accuracy and latency cost (repetition blindness: RB) when the prime was the same word as the target, with the cost much less severe in Experiment 2 than in Experiment 1. A low-frequency distractor impaired target identification compared with a high-frequency distractor. Distractor frequency interacted with target frequency such that high-frequency targets preceded by low-frequency distractors had the lowest accuracy. The results are consistent with a frequency-dependent competition for access to working memory among briefly displayed words. However, there was no clear evidence that effects of target repetition on interword competition play a role in RB. The effects of a letter case change for the target are consistent with a contribution of token distinctiveness to word-order recovery in the intervening-word priming task.     

Pavlovian reward learning underlies value driven attentional capture

Recent evidence shows that distractors that signal high compared to low reward availability elicit stronger attentional capture, even when this is detrimental for task-performance. This suggests that simply correlating stimuli with reward administration, rather than their instrumental relationship with obtaining reward, produces value-driven attentional capture. However, in previous studies, reward delivery was never response independent, as only correct responses were rewarded, nor was it completely task-irrelevant, as the distractor signaled the magnitude of reward that could be earned on that trial. In two experiments, we ensured that associative reward learning was completely response independent by letting participants perform a task at fixation, while high and low rewards were automatically administered following the presentation of task-irrelevant colored stimuli in the periphery (Experiment 1) or at fixation (Experiment 2). In a following non-reward test phase, using the additional singleton paradigm, the previously reward signaling stimuli were presented as distractors to assess truly task-irrelevant value driven attentional capture. The results showed that high compared to low reward-value associated distractors impaired performance, and thus captured attention more strongly. This suggests that genuine Pavlovian conditioning of stimulus-reward contingencies is sufficient to obtain value-driven attentional capture. Furthermore, value-driven attentional capture can occur following associative reward learning of temporally and spatially task-irrelevant distractors that signal the magnitude of available reward (Experiment 1), and is independent of training spatial shifts of attention towards the reward signaling stimuli (Experiment 2). This confirms and strengthens the idea that Pavlovian reward learning underlies value driven attentional capture.     

Target objects defined by a conjunction of colour and shape can be selected independently and in parallel

It is generally assumed that during search for targets defined by a feature conjunction, attention is allocated sequentially to individual objects. We tested this hypothesis by tracking the time course of attentional processing biases with the N2pc component in tasks where observers searched for two targets defined by a colour/shape conjunction. In Experiment 1, two displays presented in rapid succession (100 ms or 10 ms SOA) each contained a target and a colour-matching or shape-matching distractor on opposite sides. Target objects in both displays elicited N2pc components of similar size that overlapped in time when the SOA was 10 ms, suggesting that attention was allocated in parallel to both targets. Analogous results were found in Experiment 2, where targets and partially matching distractors were both accompanied by an object without target-matching features. Colour-matching and shape-matching distractors also elicited N2pc components, and the target N2pc was initially identical to the sum of the two distractor N2pcs, suggesting that the initial phase of attentional object selection was guided independently by feature templates for target colour and shape. Beyond 230 ms after display onset, the target N2pc became superadditive, indicating that attentional selection processes now started to be sensitive to the presence of feature conjunctions. Results show that independent attentional selection processes can be activated in parallel by two target objects in situations where these objects are defined by a feature conjunction.     

Miss it and miss out: Counterproductive nonspatial attentional capture by task-irrelevant,value-related stimuli

Recent studies of visual search suggest that learning about valued outcomes (rewards and punishments) influences the likelihood that distractors will capture spatial attention and slow search for a target, even when those value-related distractors have never themselves been the targets of search. In the present study, we demonstrated a related effect in the context of temporal, rather than spatial, selection. Participants were presented with a temporal stream of pictures in a fixed central location and had to identify the orientation of a rotated target picture. Response accuracy was reduced if the rotated target was preceded by a “valued” distractor picture that signaled that a correct response to the target would be rewarded (and an incorrect response punished), relative to a distractor picture that did not signal reward or punishment. This effect of signal value on response accuracy was short-lived, being most prominent with a short lag between distractor and target. Impairment caused by a valued distractor was observed if participants were explicitly instructed regarding its relation to reward/punishment (Exps. 1, 3, and 4), or if they could learn this relationship only via trial-by-trial experience (Exp. 2). These findings show that the influence of signal value on attentional capture extends to temporal selection, and also demonstrate that value-related distractors can interfere with the conscious perception of subsequent target information.     

The fate of unattended stimuli and emotional habituation: Behavioral interference and cortical changes

The interference produced by the viewing of emotional distractors has been interpreted as evidence that emotional cues are processed in a fairly mandatory fashion, and that they divert attention from the primary ongoing task. However, few studies have examined how behavioral emotional interference varies with repeated presentation of the same emotional distractors. In two experiments, while participants were engaged in a parity judgment task, we investigated the effects of repetition of task-irrelevant emotional pictures, as reflected in both behavioral interference (Experiments 1 and 2) and neural activity (Experiment 2). Both experiments showed that the slowing of reaction times that was observed when viewing emotional, compared to neutral, scenes disappeared after only a few repetitions, suggesting diminished attention allocation to repeated emotional pictures. Conversely, in Experiment 2, neural correlates of picture processing revealed that the late positive potential (LPP) amplitude continued to be enhanced for emotional, compared to neutral, distractors despite picture repetition and the presence of a concurrent task. Altogether, these findings suggest that while evaluative processes are mandatory, and continue to engage cortico-limbic appetitive and defensive systems even after massive repetition, as suggested by the affective modulation of the LPP, attentional processes are not necessary after several repetitions of the same stimulus, as indicated by the rapid decline of behavioral emotional interference.     

Immunity to attentional capture at ignored locations

Certain stimuli have the power to rapidly and involuntarily capture spatial attention against our will. The present study investigated whether such stimuli capture spatial attention even when they appear in ignored regions of visual space. In other words, which force is more powerful: attentional capture or spatial filtering? Participants performed a spatial cuing task, searching for a letter target defined by color (e.g., green) and then reporting that letter’s identity. Two of the four search locations were always irrelevant. Unlike many previous experiments, participants were forced to ignore these locations because they always contained a target-colored distractor letter. Experiment 1 assessed capture by a salient-but-irrelevant abrupt onset cue appearing 150 ms before the search display. One might expect onset cues to capture attention even at ignored locations given that the main function of capture, presumably, is to rapidly alert observers to unexpected yet potentially important stimuli. However, they did not. Experiment 2 replicated this result with a different neutral baseline condition. Experiment 3 replicated the absence of capture effects at ignored locations with an even more potent stimulus: a relevant cue possessing the target color. We propose that people are effectively immune to attentional capture by objects in ignored locations – spatial filtering dominates attentional capture.     

The semantic category-based grouping in the Multiple Identity Tracking task

In the Multiple Identity Tracking (MIT) task, categorical distinctions between targets and distractors have been found to facilitate tracking (Wei, Zhang, Lyu, & Li in Frontiers in Psychology, 7, 589, 2016). The purpose of this study was to further investigate the reasons for the facilitation effect, through six experiments. The results of Experiments 1–3 excluded the potential explanations of visual distinctiveness, attentional distribution strategy, and a working memory mechanism, respectively. When objects’ visual information was preserved and categorical information was removed, the facilitation effect disappeared, suggesting that the visual distinctiveness between targets and distractors was not the main reason for the facilitation effect. Moreover, the facilitation effect was not the result of strategically shifting the attentional distribution, because the targets received more attention than the distractors in all conditions. Additionally, the facilitation effect did not come about because the identities of targets were encoded and stored in visual working memory to assist in the recovery from tracking errors; when working memory was disturbed by the object identities changing during tracking, the facilitation effect still existed. Experiments 4 and 5 showed that observers grouped targets together and segregated them from distractors on the basis of their categorical information. By doing this, observers could largely avoid distractor interference with tracking and improve tracking performance. Finally, Experiment 6 indicated that category-based grouping is not an automatic, but a goal-directed and effortful, strategy. In summary, the present findings show that a semantic category-based target-grouping mechanism exists in the MIT task, which is likely to be the major reason for the tracking facilitation effect.     

The different roles of category- and feature-specific attentional control settings on attentional enhancement and inhibition

Contingent attentional capture suggests that top-down attentional control settings (ACS) can enhance attentional processing of task-relevant properties and inhibit attentional processing of task-irrelevant properties. However, it remains unclear how ACS operates when a distractor has both task-relevant and task-irrelevant characteristics. In the present study, two lateralized ERP components, N2pc and distractor positivity (Pd), were employed as markers of attentional enhancement and inhibition, respectively. The degree of matching between a distractor and a conjunctively defined target was manipulated to illustrate attentional guidance by category-specific ACS (cACS) and feature-specific ACS (fACS), and the relative position between the distractor and the target was manipulated to isolate the processing of the distractor and the target. Experiment 1 showed that, with a long display duration for searching, a reliable N2pc component was elicited by a distractor that was feature-matched but category-mismatched (C-F+) relative to the target-defined properties, suggesting an enhancing effect of fACS. In contrast, Experiment 2 demonstrated that, with a short display duration, a Pd component was elicited by a distractor that was feature-mismatched but category-matched (C+F-) relative to the target-defined properties, suggesting an inhibitory effect of fACS. Moreover, both attentional enhancement and inhibition were only triggered by fACS but not by cACS. In summary, ACS can enhance target-relevant properties or inhibit target-irrelevant properties in response to the display duration, and fACS affects both enhancement and inhibition more than cACS.     

Filtering visual onsets via habituation: A context-specific long-term memory of irrelevant stimuli

The fact that we are often immediately attracted by sudden visual onsets provides a clear advantage for our survival. However, how can we resist from being continuously distracted by irrelevant repetitive onsets? Since the seminal work of Sokolov (1963), habituation of the orienting of attention has long been proposed to be a possible filtering mechanism. Here, in two experiments, we provide novel evidence showing that (a) habituation of capture of focused visual attention relies on a stored representation of the distractor onsets in relation to their context, and (b) that once formed such representation endures unchanged for weeks without any further exposure to the distractors. In agreement with the proposal of Wagner (1979) concerning the associative nature of habituation, the results of Experiment 1 suggest that habituation of attentional capture is context specific. Furthermore, the results of Experiment 2 show that to filter visual distractors our cognitive system uses long-lasting memories of the irrelevant information. Although distractor filtering can be implemented via top-down inhibitory control, neural and cognitive mechanisms underlying habituation provide a straightforward explanation for the reduced distraction obtained with training, thus working like an automatic filter that prevents irrelevant recurring stimuli from gaining access to higher stages of analysis.     

Numerosity estimates for attended and unattended items in visual search

The goal of this research was to examine memories created for the number of items during a visual search task. Participants performed a visual search task for a target defined by a single feature (Experiment 1A), by a conjunction of features (Experiment 1B), or by a specific spatial configuration of features (Experiment 1C). On some trials following the search task, subjects were asked to recall the total number of items in the previous display. In all search types, participants underestimated the total number of items, but the severity of the underestimation varied depending on the efficiency of the search. In three follow-up studies (Experiments 2A, 2B, and 2C) using the same visual stimuli, the participants’ only task was to estimate the number of items on each screen. Participants still underestimated the numerosity of the items, although the degree of underestimation was smaller than in the search tasks and did not depend on the type of visual stimuli. In Experiment 3, participants were asked to recall the number of items in a display only once. Subjects still displayed a tendency to underestimate, indicating that the underestimation effects seen in Experiments 1A-1C were not attributable to knowledge of the estimation task. The degree of underestimation depends on the efficiency of the search task, with more severe underestimation in efficient search tasks. This suggests that the lower attentional demands of very efficient searches leads to less encoding of numerosity of the distractor set.     

How to inhibit a distractor location? Statistical learning versus active,top-down suppression

Recently, Wang and Theeuwes (Journal of Experimental Psychology: Human Perception and Performance, 44(1), 13–17, 2018a) demonstrated the role of lingering selection biases in an additional singleton search task in which the distractor singleton appeared much more often in one location than in all other locations. For this location, there was less capture and selection efficiency was reduced. It was argued that statistical learning induces plasticity within the spatial priority map such that particular locations that are high likely to contain a distractor are suppressed relative to all other locations. The current study replicated these findings regarding statistical learning (Experiment 1) and investigated whether similar effects can be obtained by cueing the distractor location in a top-down way on a trial-by-trial basis. The results show that top-down cueing of the distractor location with long (1,500 ms; Experiment 2) and short stimulus-onset symmetries (SOAs) (600 ms; Experiment 3) does not result in suppression: The amount of capture nor the efficiency of selection was affected by the cue. If anything, we found an attentional benefit (instead of the suppression) for the short SOA. We argue that through statistical learning, weights within the attentional priority map are changed such that one location containing a salient distractor is suppressed relative to all other locations. Our cueing experiments show that this effect cannot be accomplished by active, top-down suppression. Consequences for recent theories of distractor suppression are discussed.     

T1 difficulty affects the AB: manipulating T1 word frequency and T1 orthographic neighbor frequency

Colored target words were presented with distractor nonwords in a rapid serial visual presentation (RSVP) task. In Experiment 1, the attentional blink (AB) effect on T2 accuracy was larger when T1 was a difficult (low-frequency) word than when it was a high-frequency word. In Experiment 2 the effect of T1 frequency on the AB was replicated in a between-participants design, and the frequency of T1’s one-letter different neighbors (e.g., case, bare, for care) interacted with T1 frequency in its effects on T2 accuracy. Experiment 3 confirmed the effect of T1 frequency over 6 T1-T2 lags. The effects of T1 characteristics were sensitively assessed in the AB and were more consistent with resource depletion theories than control-process accounts.     

Memory guidance in distractor suppression is governed by the availability of cognitive control

Information stored in the memory systems can affect visual search. Previous studies have shown that holding the to-be-ignored features of distractors in working memory (WM) could accelerate target selection. However, such facilitation effect was only observed when the cued to-be-ignored features remained unchanged within an experimental block (i.e., the fixed cue condition). No search benefit was obtained if the to-be-ignored features varied from trial to trial (i.e., the varied cue condition). In the present study, we conducted three behavioral experiments to investigate whether the WM and long-term memory (LTM) representations of the to-be-ignored features could facilitate visual search in the fixed cue (Experiment 1) and varied cue (Experiments 2 and 3) conditions. Given the importance of the processing time of cognitive control in distractor suppression, we divided visual search trials into five quintiles based on their reaction times (RTs) and examined the temporal characteristics of the suppression effect. Results showed that both the WM and LTM representations of the to-be-ignored features could facilitate distractor suppression in the fixed cue condition, and the facilitation effects were evident across the quintiles in the RT distribution. However, in the varied cue condition, the RT benefits of the WM-matched distractors occurred only in the trials with the longest RTs, whereas no advantage of the LTM-matched distractors was observed. These results suggest that the effective WM-guided distractor suppression depends on the availability of cognitive control and the LTM-guided suppression occurs only if sufficient WM resource is accessible by LTM reactivation.     

Comparing visual search and eye movements in bilinguals and monolinguals

Recent research has suggested that bilinguals show advantages over monolinguals in visual search tasks, although these findings have been derived from global behavioral measures of accuracy and response times. In the present study we sought to explore the bilingual advantage by using more sensitive eyetracking techniques across three visual search experiments. These spatially and temporally fine-grained measures allowed us to carefully investigate any nuanced attentional differences between bilinguals and monolinguals. Bilingual and monolingual participants completed visual search tasks that varied in difficulty. The experiments required participants to make careful discriminations in order to detect target Landolt Cs among similar distractors. In Experiment 1, participants performed both feature and conjunction search. In Experiments 2 and 3, participants performed visual search while making different types of speeded discriminations, after either locating the target or mentally updating a constantly changing target. The results across all experiments revealed that bilinguals and monolinguals were equally efficient at guiding attention and generating responses. These findings suggest that the bilingual advantage does not reflect a general benefit in attentional guidance, but could reflect more efficient guidance only under specific task demands.     

Prioritization to visual objects: Roles of sensory uncertainty

Two hypotheses, attentional prioritization and attentional spreading, have been proposed to account for object-based attention. The attentional-prioritization hypothesis posits that the positional uncertainty of targets is sufficient to resolve the controversy raised by the competing attentional-spreading hypothesis. Here we challenge the sufficiency of this explanation by showing that object-based attention is a function of sensory uncertainty in a task with consistent high positional uncertainty of the targets. In Experiment 1, object-based attention was modulated by sensory uncertainty induced by the noise from backward masking, showing an object-based effect under high as compared to low sensory uncertainty. This finding was replicated in Experiment 2 with increased task difficulty, to exclude that as a confounding factor, and in Experiment 3 with a psychophysical method, to obtain converging evidence using perceptual threshold measurement. Additionally, such a finding was not observed when sensory uncertainty was eliminated by replacing the backward-masking stimuli with perceptually dissimilar ones in Experiment 4. These results reveal that object-based attention is influenced by sensory uncertainty, even under high positional uncertainty of the targets. Our findings contradict the proposition of attentional spreading, proposing instead an automatic form of object-based attention due to enhancement of the perceptual representation. More importantly, the attentional-prioritization hypothesis based solely on positional uncertainty cannot sufficiently account for object-based attention, but needs to be developed by expanding the concept of uncertainty to include at least sensory uncertainty.     

Cue quality and criterion setting in recognition memory

Previous studies on how people set and modify decision criteria in old-new recognition tasks (in which they have to decide whether or not a stimulus was seen in a study phase) have almost exclusively focused on properties of the study items, such as presentation frequency or study list length. In contrast, in the three studies reported here, we manipulated the quality of the test cues in a scene-recognition task, either by degrading through Gaussian blurring (Experiment 1) or by limiting presentation duration (Experiment 2 and 3). In Experiments 1 and 2, degradation of the test cue led to worse old-new discrimination. Most importantly, however, participants were more liberal in their responses to degraded cues (i.e., more likely to call the cue “old”), demonstrating strong within-list, item-by-item, criterion shifts. This liberal response bias toward degraded stimuli came at the cost of increasing the false alarm rate while maintaining a constant hit rate. Experiment 3 replicated Experiment 2 with additional stimulus types (words and faces) but did not provide accuracy feedback to participants. The criterion shifts in Experiment 3 were smaller in magnitude than Experiments 1 and 2 and varied in consistency across stimulus type, suggesting, in line with previous studies, that feedback is important for participants to shift their criteria.     

Object width modulates object-based attentional selection

Visual input typically includes a myriad of objects, some of which are selected for further processing. While these objects vary in shape and size, most evidence supporting object-based guidance of attention is drawn from paradigms employing two identical objects. Importantly, object size is a readily perceived stimulus dimension, and whether it modulates the distribution of attention remains an open question. Across four experiments, the size of the objects in the display was manipulated in a modified version of the two-rectangle paradigm. In Experiment 1, two identical parallel rectangles of two sizes (thin or thick) were presented. Experiments 2–4 employed identical trapezoids (each having a thin and thick end), inverted in orientation. In the experiments, one end of an object was cued and participants performed either a T/L discrimination or a simple target-detection task. Combined results show that, in addition to the standard object-based attentional advantage, there was a further attentional benefit for processing information contained in the thick versus thin end of objects. Additionally, eye-tracking measures demonstrated increased saccade precision towards thick object ends, suggesting that Fitts’s Law may play a role in object-based attentional shifts. Taken together, these results suggest that object-based attentional selection is modulated by object width.     

The influence of attention on value integration

People often have to make decisions based on many pieces of information. Previous work has found that people are able to integrate values presented in a rapid serial visual presentation (RSVP) stream to make informed judgements on the overall stream value (Tsetsos et al. Proceedings of the National Academy of Sciences of the United States of America, 109(24), 9659–9664, 2012). It is also well known that attentional mechanisms influence how people process information. However, it is unknown how attentional factors impact value judgements of integrated material. The current study is the first of its kind to investigate whether value judgements are influenced by attentional processes when assimilating information. Experiments 1–3 examined whether the attentional salience of an item within an RSVP stream affected judgements of overall stream value. The results showed that the presence of an irrelevant high or low value salient item biased people to judge the stream as having a higher or lower overall mean value, respectively. Experiments 4–7 directly tested Tsetsos et al.’s (Proceedings of the National Academy of Sciences of the United States of America, 109(24), 9659–9664, 2012) theory examining whether extreme values in an RSVP stream become over-weighted, thereby capturing attention more than other values in the stream. The results showed that the presence of both a high (Experiments 4, 6 and 7) and a low (Experiment 5) value outlier captures attention leading to less accurate report of subsequent items in the stream. Taken together, the results showed that valuations can be influenced by attentional processes, and can lead to less accurate subjective judgements.