Numerosity estimates for attended and unattended items in visual search

The goal of this research was to examine memories created for the number of items during a visual search task. Participants performed a visual search task for a target defined by a single feature (Experiment 1A), by a conjunction of features (Experiment 1B), or by a specific spatial configuration of features (Experiment 1C). On some trials following the search task, subjects were asked to recall the total number of items in the previous display. In all search types, participants underestimated the total number of items, but the severity of the underestimation varied depending on the efficiency of the search. In three follow-up studies (Experiments 2A, 2B, and 2C) using the same visual stimuli, the participants’ only task was to estimate the number of items on each screen. Participants still underestimated the numerosity of the items, although the degree of underestimation was smaller than in the search tasks and did not depend on the type of visual stimuli. In Experiment 3, participants were asked to recall the number of items in a display only once. Subjects still displayed a tendency to underestimate, indicating that the underestimation effects seen in Experiments 1A-1C were not attributable to knowledge of the estimation task. The degree of underestimation depends on the efficiency of the search task, with more severe underestimation in efficient search tasks. This suggests that the lower attentional demands of very efficient searches leads to less encoding of numerosity of the distractor set.     

Bindings in working memory: The role of object-based attention

Over the past decade, it has been debated whether retaining bindings in working memory (WM) requires more attention than retaining constituent features, focusing on domain-general attention and space-based attention. Recently, we proposed that retaining bindings in WM needs more object-based attention than retaining constituent features (Shen, Huang, & Gao, 2015, Journal of Experimental Psychology: Human Perception and Performance, doi: 10.1037/xhp0000018). However, only unitized visual bindings were examined; to establish the role of object-based attention in retaining bindings in WM, more emperical evidence is required. We tested 4 new bindings that had been suggested requiring no more attention than the constituent features in the WM maintenance phase: The two constituent features of binding were stored in different WM modules (cross-module binding, Experiment 1), from auditory and visual modalities (cross-modal binding, Experiment 2), or temporally (cross-time binding, Experiments 3) or spatially (cross-space binding, Experiments 4–6) separated. In the critical condition, we added a secondary object feature-report task during the delay interval of the change-detection task, such that the secondary task competed for object-based attention with the to-be-memorized stimuli. If more object-based attention is required for retaining bindings than for retaining constituent features, the secondary task should impair the binding performance to a larger degree relative to the performance of constituent features. Indeed, Experiments 1–6 consistently revealed a significantly larger impairment for bindings than for the constituent features, suggesting that object-based attention plays a pivotal role in retaining bindings in WM.     

Cognitive load effects on early visual perceptual processing

Contrast-based early visual processing has largely been considered to involve autonomous processes that do not need the support of cognitive resources. However, as spatial attention is known to modulate early visual perceptual processing, we explored whether cognitive load could similarly impact contrast-based perception. We used a dual-task paradigm to assess the impact of a concurrent working memory task on the performance of three different early visual tasks. The results from Experiment 1 suggest that cognitive load can modulate early visual processing. No effects of cognitive load were seen in Experiments 2 or 3. Together, the findings provide evidence that under some circumstances cognitive load effects can penetrate the early stages of visual processing and that higher cognitive function and early perceptual processing may not be as independent as was once thought.     

Variation in the use of cues to guide visual working memory

Across two experiments we examined individual differences in the use of precues and retrocues to guide the selective encoding and maintenance of information in visual working memory (WM). In Experiment 1, we used spatial cues to indicate which item would be tested either before or after the presentation of a memory array. Regression analyses allowed us to separate variance due to visual WM capacity and attention control differences. In Experiment 2, we used categorical cues to indicate from which subset of items the tested item would be drawn, and we measured attention control with two independent tasks. Collectively, the results supported the idea that an element of individual differences in WM is the ability to flexibly allocate attention to encode only relevant information and subsequently select relevant information during maintenance stages.     

The semantic category-based grouping in the Multiple Identity Tracking task

In the Multiple Identity Tracking (MIT) task, categorical distinctions between targets and distractors have been found to facilitate tracking (Wei, Zhang, Lyu, & Li in Frontiers in Psychology, 7, 589, 2016). The purpose of this study was to further investigate the reasons for the facilitation effect, through six experiments. The results of Experiments 1–3 excluded the potential explanations of visual distinctiveness, attentional distribution strategy, and a working memory mechanism, respectively. When objects’ visual information was preserved and categorical information was removed, the facilitation effect disappeared, suggesting that the visual distinctiveness between targets and distractors was not the main reason for the facilitation effect. Moreover, the facilitation effect was not the result of strategically shifting the attentional distribution, because the targets received more attention than the distractors in all conditions. Additionally, the facilitation effect did not come about because the identities of targets were encoded and stored in visual working memory to assist in the recovery from tracking errors; when working memory was disturbed by the object identities changing during tracking, the facilitation effect still existed. Experiments 4 and 5 showed that observers grouped targets together and segregated them from distractors on the basis of their categorical information. By doing this, observers could largely avoid distractor interference with tracking and improve tracking performance. Finally, Experiment 6 indicated that category-based grouping is not an automatic, but a goal-directed and effortful, strategy. In summary, the present findings show that a semantic category-based target-grouping mechanism exists in the MIT task, which is likely to be the major reason for the tracking facilitation effect.     

Dissociations of the number and precision of visual short-term memory representations in change detection

The present study dissociated the number (i.e., quantity) and precision (i.e., quality) of visual short-term memory (STM) representations in change detection using receiver operating characteristic (ROC) and experimental manipulations. Across three experiments, participants performed both recognition and recall tests of visual STM using the change-detection task and the continuous color-wheel recall task, respectively. Experiment 1 demonstrated that the estimates of the number and precision of visual STM representations based on the ROC model of change-detection performance were robustly correlated with the corresponding estimates based on the mixture model of continuous-recall performance. Experiments 2 and 3 showed that the experimental manipulation of mnemonic precision using white-noise masking and the experimental manipulation of the number of encoded STM representations using consolidation masking produced selective effects on the corresponding measures of mnemonic precision and the number of encoded STM representations, respectively, in both change-detection and continuous-recall tasks. Altogether, using the individual-differences (Experiment 1) and experimental dissociation (Experiment 2 and 3) approaches, the present study demonstrated the some-or-none nature of visual STM representations across recall and recognition.     

The mere exposure effect for visual image

Mere exposure effect refers to a phenomenon in which repeated stimuli are evaluated more positively than novel stimuli. We investigated whether this effect occurs for internally generated visual representations (i.e., visual images). In an exposure phase, a 5 × 5 dot array was presented, and a pair of dots corresponding to the neighboring vertices of an invisible polygon was sequentially flashed (in red), creating an invisible polygon. In Experiments 1, 2, and 4, participants visualized and memorized the shapes of invisible polygons based on different sequences of flashed dots, whereas in Experiment 3, participants only memorized positions of these dots. In a subsequent rating phase, participants visualized the shape of the invisible polygon from allocations of numerical characters on its vertices, and then rated their preference for invisible polygons (Experiments 1, 2, and 3). In contrast, in Experiment 4, participants rated the preference for visible polygons. Results showed that the mere exposure effect appeared only when participants visualized the shape of invisible polygons in both the exposure and rating phases (Experiments 1 and 2), suggesting that the mere exposure effect occurred for internalized visual images. This implies that the sensory inputs from repeated stimuli play a minor role in the mere exposure effect. Absence of the mere exposure effect in Experiment 4 suggests that the consistency of processing between exposure and rating phases plays an important role in the mere exposure effect.     

Age of avatar modulates the altercentric bias in a visual perspective-taking task: ERP and behavioral evidence

Despite being able to rapidly and accurately infer their own and other peoples’ visual perspectives, healthy adults experience difficulty ignoring the irrelevant perspective when the two perspectives are in conflict; they experience egocentric and altercentric interference. We examine for the first time how the age of an observed person (adult vs. child avatar) influences adults’ visual perspective-taking, particularly the degree to which they experience interference from their own or the other person’s perspective. Participants completed the avatar visual perspective-taking task, in which they verified the number of discs in a visual scene according to either their own or an on-screen avatar’s perspective (Experiments 1 and 2) or only from their own perspective (Experiment 3), where the two perspectives could be consistent or in conflict. Age of avatar was manipulated between (Experiment 1) or within (Experiments 2 and 3) participants, and interference was assessed using behavioral (Experiments 1–3) and ERP (Experiment 1) measures. Results revealed that altercentric interference is reduced or eliminated when a child avatar was present, suggesting that adults do not automatically compute a child avatar’s perspective. We attribute this pattern to either enhanced visual processing for own-age others or an inference on reduced mental awareness in younger children. The findings argue against a purely attentional basis for the altercentric effect, and instead support an account where both mentalising and directional processes modulate automatic visual perspective-taking, and perspective-taking effects are strongly influenced by experimental context.     

Encouraging top-down attention in visual search:A developmental perspective

Four experiments are reported in which 60 younger children (7–8 years old), 60 older children (10–11 years old), and 60 young adults (18–25 years old) performed a conjunctive visual search task (15 per group in each experiment). The number of distractors of each feature type was unbalanced across displays to evaluate participants’ ability to restrict search to the smaller subset of features. The use of top-down attention processes to restrict search was encouraged by providing external aids for identifying and maintaining attention on the smaller set. In Experiment 1, no external assistance was provided. In Experiment 2, precues and instructions were provided to focus attention on that subset. In Experiment 3, trials in which the smaller subset was represented by the same feature were presented in alternating blocks to eliminate the need to switch attention between features from trial to trial. In Experiment 4, consecutive blocks of the same subset features were presented in the first or second half of the experiment, providing additional consistency. All groups benefited from external support of top-down attention, although the pattern of improvement varied across experiments. The younger children benefited most from precues and instruction, using the subset search strategy when instructed. Furthermore, younger children benefited from blocking trials only when blocks of the same features did not alternate. Older participants benefited from the blocking of trials in both Experiments 3 and 4, but not from precues and instructions. Hence, our results revealed both malleability and limits of children’s top-down control of attention.     

Memory guidance in distractor suppression is governed by the availability of cognitive control

Information stored in the memory systems can affect visual search. Previous studies have shown that holding the to-be-ignored features of distractors in working memory (WM) could accelerate target selection. However, such facilitation effect was only observed when the cued to-be-ignored features remained unchanged within an experimental block (i.e., the fixed cue condition). No search benefit was obtained if the to-be-ignored features varied from trial to trial (i.e., the varied cue condition). In the present study, we conducted three behavioral experiments to investigate whether the WM and long-term memory (LTM) representations of the to-be-ignored features could facilitate visual search in the fixed cue (Experiment 1) and varied cue (Experiments 2 and 3) conditions. Given the importance of the processing time of cognitive control in distractor suppression, we divided visual search trials into five quintiles based on their reaction times (RTs) and examined the temporal characteristics of the suppression effect. Results showed that both the WM and LTM representations of the to-be-ignored features could facilitate distractor suppression in the fixed cue condition, and the facilitation effects were evident across the quintiles in the RT distribution. However, in the varied cue condition, the RT benefits of the WM-matched distractors occurred only in the trials with the longest RTs, whereas no advantage of the LTM-matched distractors was observed. These results suggest that the effective WM-guided distractor suppression depends on the availability of cognitive control and the LTM-guided suppression occurs only if sufficient WM resource is accessible by LTM reactivation.     

Predictive visual search: Role of environmental regularities in the learning of context cues

Repeatedly searching through invariant spatial arrangements in visual search displays leads to the buildup of memory about these displays (contextual-cueing effect). In the present study, we investigate (1) whether contextual cueing is influenced by global statistical properties of the task and, if so, (2) whether these properties increase the overall strength (asymptotic level) or the temporal development (speed) of learning. Experiment 1a served as baseline against which we tested the effects of increased or decreased proportions of repeated relative to nonrepeated displays (Experiments 1b and 1c, respectively), thus manipulating the global statistical properties of search environments. Importantly, probability variations were achieved by manipulating the number of nonrepeated (baseline) displays so as to equate the total number of repeated displays across experiments. In Experiment 1d, repeated and nonrepeated displays were presented in longer streaks of trials, thus establishing a stable environment of sequences of repeated displays. Our results showed that the buildup of contextual cueing was expedited in the statistically rich Experiments 1b and 1d, relative to the baseline Experiment 1a. Further, contextual cueing was entirely absent when repeated displays occurred in the minority of trials (Experiment 1c). Together, these findings suggest that contextual cueing is modulated by observers’ assumptions about the reliability of search environments.     

Filtering visual onsets via habituation: A context-specific long-term memory of irrelevant stimuli

The fact that we are often immediately attracted by sudden visual onsets provides a clear advantage for our survival. However, how can we resist from being continuously distracted by irrelevant repetitive onsets? Since the seminal work of Sokolov (1963), habituation of the orienting of attention has long been proposed to be a possible filtering mechanism. Here, in two experiments, we provide novel evidence showing that (a) habituation of capture of focused visual attention relies on a stored representation of the distractor onsets in relation to their context, and (b) that once formed such representation endures unchanged for weeks without any further exposure to the distractors. In agreement with the proposal of Wagner (1979) concerning the associative nature of habituation, the results of Experiment 1 suggest that habituation of attentional capture is context specific. Furthermore, the results of Experiment 2 show that to filter visual distractors our cognitive system uses long-lasting memories of the irrelevant information. Although distractor filtering can be implemented via top-down inhibitory control, neural and cognitive mechanisms underlying habituation provide a straightforward explanation for the reduced distraction obtained with training, thus working like an automatic filter that prevents irrelevant recurring stimuli from gaining access to higher stages of analysis.     

The roles of order,distance, and interstitial items in temporal visual statistical learning

Humans are adept at learning regularities in a visual environment, even without explicit cues to structure and in the absence of instruction—this has been termed “visual statistical learning” (VSL). The nature of the representations resulting from VSL are still poorly understood. In five experiments, we examined the specificity of temporal VSL representations. In Experiments 1A, 1B, and 2, we compared recognition rates of triplets and all embedded pairs to chance. Robust learning of all structures was evident, and even pairs of non-adjacent items in a sequentially presented triplet (AC extracted from a triplet composed of ABC) were recognized at above-chance levels. In Experiment 3, we asked whether people could recognize rearranged pairs to examine the flexibility of learned representations. Recognition of all possible orders of target triplets and pairs was significantly higher than chance, and there were no differences between canonical orderings and their corresponding randomized orderings, suggesting that learners were not dependent upon originally experienced stimulus orderings to recognize co-occurrence. Experiment 4 demonstrates the essential role of an interstitial item in VSL representations. By comparing the learning of quadruplet sets (e.g., ABCD) and triplet sets (e.g., ABC), we found learning of AC and BD in ABCD (quadruplet) sets were better than the learning of AC in ABC (triplet) sets. This pattern of results might result from the critical role of interstitial items in statistical learning. In short, our work supports the idea of generalized representation in VSL and provides evidence about how this representation is structured.     

Multiple attentional control settings at distinct locations without the confounding of repetition priming

An attentional control setting (ACS), which is based on the task goal, induces involuntary attentional capture by a stimulus possessing a target-defining feature. It is unclear whether ACSs are maintained for multiple targets defined as conjunctions of a color and location. In the present study we examined the possibility of local ACSs for dual targets defined as combinations of color and location, using different paradigms: visual search in Experiment 1, and spatial cueing in Experiment 2. In Experiment 1, a distractor captured attention only when its features matched the ACSs. Likewise, in Experiment 2, a significant attentional capture effect was found only with a matching cue, whose color and location were in line with the conjunction of the target definition. Importantly, the identical pattern of attentional capture was also obtained for a neutral-color target, which was unlikely to be primed by any color of the cue. Thus, these findings imply that the attentional bias depending on the match between the cue and target did not result from cue–target repetition priming. The present study highlights that top-down attentional control can be set flexibly to accomplish a complex task goal efficiently.     

Miss it and miss out: Counterproductive nonspatial attentional capture by task-irrelevant,value-related stimuli

Recent studies of visual search suggest that learning about valued outcomes (rewards and punishments) influences the likelihood that distractors will capture spatial attention and slow search for a target, even when those value-related distractors have never themselves been the targets of search. In the present study, we demonstrated a related effect in the context of temporal, rather than spatial, selection. Participants were presented with a temporal stream of pictures in a fixed central location and had to identify the orientation of a rotated target picture. Response accuracy was reduced if the rotated target was preceded by a “valued” distractor picture that signaled that a correct response to the target would be rewarded (and an incorrect response punished), relative to a distractor picture that did not signal reward or punishment. This effect of signal value on response accuracy was short-lived, being most prominent with a short lag between distractor and target. Impairment caused by a valued distractor was observed if participants were explicitly instructed regarding its relation to reward/punishment (Exps. 1, 3, and 4), or if they could learn this relationship only via trial-by-trial experience (Exp. 2). These findings show that the influence of signal value on attentional capture extends to temporal selection, and also demonstrate that value-related distractors can interfere with the conscious perception of subsequent target information.     

Rejecting salient distractors: Generalization from experience

Distraction impairs performance of many important, everyday tasks. Attentional control limits distraction by preferentially selecting important items for limited-capacity cognitive operations. Research in attentional control has typically investigated the degree to which selection of items is stimulus-driven versus goal-driven. Recent work finds that when observers initially learn a task, the selection is based on stimulus-driven factors, but through experience, goal-driven factors have an increasing influence. The modulation of selection by goals has been studied within the paradigm of learned distractor rejection, in which experience over a sequence of trials enables individuals eventually to ignore a perceptually salient distractor. The experiments presented examine whether observers can generalize learned distractor rejection to novel distractors. Observers searched for a target and ignored a salient color-singleton distractor that appeared in half of the trials. In Experiment 1, observers who learned distractor rejection in a variable environment rejected a novel distractor more effectively than observers who learned distractor rejection in a less variable, homogeneous environment, demonstrating that variable, heterogeneous stimulus environments encourage generalizable learned distractor rejection. Experiments 2 and 3 investigated the time course of learned distractor rejection across the experiment and found that after experiencing four color-singleton distractors in different blocks, observers could effectively reject subsequent novel color-singleton distractors. These results suggest that the optimization of attentional control to the task environment can be interpreted as a form of learning, demonstrating experience’s critical role in attentional control.     

Repetition blindness in priming in perceptual identification: Competitive effects of a word intervening between prime and target

University students named a 72-ms masked target word that was preceded by two 120-ms consecutively presented words, a prime word followed by a distractor. In Experiment 1, all words were in lowercase letters, whereas in Experiment 2, the target word was changed to uppercase letters. In both experiments there was an accuracy and latency cost (repetition blindness: RB) when the prime was the same word as the target, with the cost much less severe in Experiment 2 than in Experiment 1. A low-frequency distractor impaired target identification compared with a high-frequency distractor. Distractor frequency interacted with target frequency such that high-frequency targets preceded by low-frequency distractors had the lowest accuracy. The results are consistent with a frequency-dependent competition for access to working memory among briefly displayed words. However, there was no clear evidence that effects of target repetition on interword competition play a role in RB. The effects of a letter case change for the target are consistent with a contribution of token distinctiveness to word-order recovery in the intervening-word priming task.     

The influence of attention on value integration

People often have to make decisions based on many pieces of information. Previous work has found that people are able to integrate values presented in a rapid serial visual presentation (RSVP) stream to make informed judgements on the overall stream value (Tsetsos et al. Proceedings of the National Academy of Sciences of the United States of America, 109(24), 9659–9664, 2012). It is also well known that attentional mechanisms influence how people process information. However, it is unknown how attentional factors impact value judgements of integrated material. The current study is the first of its kind to investigate whether value judgements are influenced by attentional processes when assimilating information. Experiments 1–3 examined whether the attentional salience of an item within an RSVP stream affected judgements of overall stream value. The results showed that the presence of an irrelevant high or low value salient item biased people to judge the stream as having a higher or lower overall mean value, respectively. Experiments 4–7 directly tested Tsetsos et al.’s (Proceedings of the National Academy of Sciences of the United States of America, 109(24), 9659–9664, 2012) theory examining whether extreme values in an RSVP stream become over-weighted, thereby capturing attention more than other values in the stream. The results showed that the presence of both a high (Experiments 4, 6 and 7) and a low (Experiment 5) value outlier captures attention leading to less accurate report of subsequent items in the stream. Taken together, the results showed that valuations can be influenced by attentional processes, and can lead to less accurate subjective judgements.     

Comparing visual search and eye movements in bilinguals and monolinguals

Recent research has suggested that bilinguals show advantages over monolinguals in visual search tasks, although these findings have been derived from global behavioral measures of accuracy and response times. In the present study we sought to explore the bilingual advantage by using more sensitive eyetracking techniques across three visual search experiments. These spatially and temporally fine-grained measures allowed us to carefully investigate any nuanced attentional differences between bilinguals and monolinguals. Bilingual and monolingual participants completed visual search tasks that varied in difficulty. The experiments required participants to make careful discriminations in order to detect target Landolt Cs among similar distractors. In Experiment 1, participants performed both feature and conjunction search. In Experiments 2 and 3, participants performed visual search while making different types of speeded discriminations, after either locating the target or mentally updating a constantly changing target. The results across all experiments revealed that bilinguals and monolinguals were equally efficient at guiding attention and generating responses. These findings suggest that the bilingual advantage does not reflect a general benefit in attentional guidance, but could reflect more efficient guidance only under specific task demands.     

Prioritization to visual objects: Roles of sensory uncertainty

Two hypotheses, attentional prioritization and attentional spreading, have been proposed to account for object-based attention. The attentional-prioritization hypothesis posits that the positional uncertainty of targets is sufficient to resolve the controversy raised by the competing attentional-spreading hypothesis. Here we challenge the sufficiency of this explanation by showing that object-based attention is a function of sensory uncertainty in a task with consistent high positional uncertainty of the targets. In Experiment 1, object-based attention was modulated by sensory uncertainty induced by the noise from backward masking, showing an object-based effect under high as compared to low sensory uncertainty. This finding was replicated in Experiment 2 with increased task difficulty, to exclude that as a confounding factor, and in Experiment 3 with a psychophysical method, to obtain converging evidence using perceptual threshold measurement. Additionally, such a finding was not observed when sensory uncertainty was eliminated by replacing the backward-masking stimuli with perceptually dissimilar ones in Experiment 4. These results reveal that object-based attention is influenced by sensory uncertainty, even under high positional uncertainty of the targets. Our findings contradict the proposition of attentional spreading, proposing instead an automatic form of object-based attention due to enhancement of the perceptual representation. More importantly, the attentional-prioritization hypothesis based solely on positional uncertainty cannot sufficiently account for object-based attention, but needs to be developed by expanding the concept of uncertainty to include at least sensory uncertainty.