The eyes have it: visual pop-out in infants and adults

Visual search studies with adults have shown that stimuli that contain a unique perceptual feature pop out from dissimilar distractors and are unaffected by the number of distractors. Studies with very young infants have suggested that they too might exhibit pop-out. However, infant studies have used paradigms in which pop-out is measured in seconds or minutes, whereas in adults pop-out occurs in milliseconds. In addition, with the previous infant paradigms the effects from higher cognitive processes such as memory cannot be separated from pop-out and selective attention. Consequently, whether infants exhibit the phenomenon of pop-out and have selective attention mechanisms as found in adults is not clear. This study was an initial attempt to design a paradigm that would provide a comparable measure between infants and adults, thereby allowing a more accurate determination of the developmental course of pop-out and selective attention mechanisms. To this end, we measured 3-month-olds' and adults' saccade latencies to visual arrays that contained either a + among Ls (target-present) or all Ls (target-absent) with set sizes of 1, 3, 5 or 8 items. In Experiment 1, infants' saccade latencies remained unchanged in the target-present conditions as set size increased, whereas their saccade latencies increased linearly in the target-absent conditions as set size increased. In Experiment 2, adults' saccade latencies in the target-present and target-absent conditions showed the same pattern as the infants. The only difference between the infants and adults was that the infants' saccade latencies were slower in every condition. These results indicate that infants do exhibit pop-out on a millisecond scale, that it is unaffected by the number of distractors, and likely have similar functioning selective attention mechanisms. Moreover, the results indicate that eye movement latencies are a more comparable and accurate measure for assessing the phenomenon of pop-out and underlying attentional mechanisms in infants.     

Asymmetries in Infants' Attention to the Presence or Absence of Features

Three experiments were performed to test whether infants show a bias for detecting the presence of a feature in a stimulus rather than its absence. In the 1st experiment, 24 16-week-old infants were given 3 paired-comparison problems, each of which included a 25-s familiarization phase followed by 2 test trials. Infants were familiarized to 1 member of a set of capital alphabetical letters (E-F; Q-O; B-R). Then they were given a paired-comparison recognition test under 1 of 2 conditions. In the feature-present condition, the familiar letter (e.g., F) was paired with a novel letter containing the addition of a distinguishing element (e.g., E). In the feature-absent condition, infants were presented with a familiar letter (e.g., E) paired with a novel letter in which 1 element was removed (e.g., F). Infants showed a novelty preference to the letter in which the distinguishing feature was present, but there was no preference for novelty in the feature-absent condition. The 2nd experiment showed that infants' fixation to the letter containing the presence of the feature was not due to a simple preference for the letter with the greater number of elements. Finally, to test whether infants' failure to discriminate the absence was due to insufficient encoding time, 36 infants were tested in a 3rd experiment in which familiarization time was varied. After 20 s of familiarization, no evidence of discrimination was observed in either the feature-present or feature-absent condition. After 30 s, however, infants could discriminate the novel letter in the feature-present condition but not in the feature-absent condition. The significance of these results is discussed in terms of theoretical explanations for the development of the feature-presence bias.     

Asymmetries in infants' attention to the presence or absence of features

Three experiments were performed to test whether infants show a bias for detecting the presence of a feature in a stimulus rather than its absence. In the 1st experiment, 24 16-week-old infants were given 3 paired-comparison problems, each of which included a 25-s familiarization phase followed by 2 test trials. Infants were familiarized to 1 member of a set of capital alphabetical letters (E-F; Q-O; B-R). Then they were given a paired-comparison recognition test under 1 of 2 conditions. In the feature-present condition, the familiar letter (e.g., F) was paired with a novel letter containing the addition of a distinguishing element (e.g., E). In the feature-absent condition, infants were presented with a familiar letter (e.g., E) paired with a novel letter in which 1 element was removed (e.g., F). Infants showed a novelty preference to the letter in which the distinguishing feature was present, but there was no preference for novelty in the feature-absent condition. The 2nd experiment showed that infants' fixation to the letter containing the presence of the feature was not due to a simple preference for the letter with the greater number of elements. Finally, to test whether infants' failure to discriminate the absence was due to insufficient encoding time, 36 infants were tested in a 3rd experiment in which familiarization time was varied. After 20 s of familiarization, no evidence of discrimination was observed in either the feature-present or feature-absent condition. After 30 s, however, infants could discriminate the novel letter in the feature-present condition but not in the feature-absent condition. The significance of these results is discussed in terms of theoretical explanations for the development of the feature-presence bias.     

Visual search and foraging compared in a large-scale search task

It has been argued that visual search is a valid model for human foraging. However, the two tasks differ greatly in terms of the coding of space and the effort required to search. Here we describe a direct comparison between visually guided searches (as studied in visual search tasks) and foraging that is not based upon a visually distinct target, within the same context. The experiment was conducted in a novel apparatus, where search locations were indicated by an array of lights embedded in the floor. In visually guided conditions participants searched for a target defined by the presence of a feature (red target amongst green distractors) or the absence of a feature (green target amongst red and green distractors). Despite the expanded search scale and the different response requirements, these conditions followed the pattern found in conventional visual search paradigms: feature-present search latencies were not linearly related to display size, whereas feature-absent searches were longer as the number of distractors increased. In a non-visually guided foraging condition, participants searched for a target that was only visible once the switch was activated. This resulted in far longer latencies that rose markedly with display size. Compared to eye-movements in previous visual search studies, there were few revisit errors to previously inspected locations in this condition. This demonstrates the important distinction between visually guided and non-visually guided foraging processes, and shows that the visual search paradigm is an equivocal model for general search in any context. We suggest a comprehensive model of human spatial search behaviour needs to include search at a small and large scale as well as visually guided and non-visually guided search.     

Influence of Task-Irrelevant Onset Distractors on the Visual Search Performance of Young and Old Adults

We examined potential age-related differences in attentional and oculomotor capture by single and multiple abrupt onsets in a singleton search paradigm. Participants were instructed to move their eyes as quickly as possible to a color singleton target and to identify a small letter located inside it. Either single or dual onset task-irrelevant distractors were presented simultaneously with the color change that defined the target, or one onset distractor was presented prior to and another onset distractor was presented during the participant's initial eye movement away from fixation. Young and old adults misdirected their eyes to the single and dual onset task-irrelevant distractors, on an equivalent proportion of trials, relative to control trials. However, older adults' saccade latencies and RTs were influenced to a greater extent by onsets compared to younger adults'. These data are discussed in terms of age-related differences in attentional control and oculomotor capture.     

Electrophysiological evidence for parallel and serial processing during visual search

Event-related potentials were recorded from young adults during a visual search task in order to evaluate parallel and serial models of visual processing in the context of Treisman's feature integration theory. Parallel and serial search strategies were produced by the use of feature-present and feature-absent targets, respectively. In the feature-absent condition, the slopes of the functions relating reaction time and latency of the P3 component to set size were essentially identical, indicating that the longer reaction times observed for larger set sizes can be accounted for solely by changes in stimulus identification and classification time, rather than changes in post-perceptual processing stages. In addition, the amplitude of the P3 wave on target-present trials in this condition increased with set size and was greater when the preceding trial contained a target, whereas P3 activity was minimal on target-absent trials. These effects are consistent with the serial self-terminating search model and appear to contradict parallel processing accounts of attention-demanding visual search performance, at least for a subset of search paradigms. Differences in ERP scalp distributions further suggested that different physiological processes are utilized for the detection of feature presence and absence.     

Feature overlap slows lexical selection: Evidence from the picture–word interference paradigm

How does the presence of a categorically related word influence picture naming latencies? In order to test competitive and noncompetitive accounts of lexical selection in spoken word production, we employed the picture–word interference (PWI) paradigm to investigate how conceptual feature overlap influences naming latencies when distractors are category coordinates of the target picture. Mahon et al. (2007. Lexical selection is not by competition: A reinterpretation of semantic interference and facilitation effects in the picture-word interference paradigm. Journal of Experimental Psychology. Learning, Memory, and Cognition, 33(3), 503–535. doi:10.1037/0278-7393.33.3.503) reported that semantically close distractors (e.g., zebra) facilitated target picture naming latencies (e.g., HORSE) compared to far distractors (e.g., whale). We failed to replicate a facilitation effect for within-category close versus far target–distractor pairings using near-identical materials based on feature production norms, instead obtaining reliably larger interference effects (Experiments 1 and 2). The interference effect did not show a monotonic increase across multiple levels of within-category semantic distance, although there was evidence of a linear trend when unrelated distractors were included in analyses (Experiment 2). Our results show that semantic interference in PWI is greater for semantically close than for far category coordinate relations, reflecting the extent of conceptual feature overlap between target and distractor. These findings are consistent with the assumptions of prominent competitive lexical selection models of speech production.     

A clash of bottom-up and top-down processes in visual search: the reversed letter effect revisited

It is harder to find the letter "N" among its mirror reversals than vice versa, an inconvenient finding for bottom-up saliency accounts based on primary visual cortex (V1) mechanisms. However, in line with this account, we found that in dense search arrays, gaze first landed on either target equally fast. Remarkably, after first landing, gaze often strayed away again and target report was delayed. This delay was longer for target "N" We suggest that the delay arose because bottom-up saliency clashed with top-down shape recognition. Thus, although gaze landed accurately and quickly to the distinctive feature in the target shape (the orientation of the diagonal bar in "N" or "И"), the identical zigzag shape of target and distractors was registered, leading to temporary confusion. In sparser search arrays with smaller set sizes, top-down target shape recognition occurs earlier and bottom-up saliency is weaker. The clash in this case causes search asymmetry even before target location at first gaze landing. Our findings rule out previous suggestions that search asymmetry stems from stronger preattentive salience for the reversed target and/or faster rejection of familiar distractors.     

Presaccadic target competition attenuates distraction

Although it is well known that salient nontargets can capture attention despite being task irrelevant, several studies have reported short fixation dwell times, suggesting the presence of an attentional mechanism to “rapidly reject” dissimilar distractors. Rapid rejection has been hypothesized to depend on the strong mismatch between distractor features and the target template, but it is unknown whether the presence of strong feature mismatch is sufficient, or if the presence of a target at a competing location is also necessary. Here, we investigated this question by first replicating the finding of rapid rejection for dissimilar distractors in the presence of a concurrent target (Experiment 1); manipulating the onset of the target stimulus relative to the distractor (Experiment 2); and using a saccade-contingent display to delay the target onset until after the first saccade was initiated. The results demonstrate that the speed of distractor rejection depends on the presence of target competition prior to the initiation of the first saccade, and not after the saccade. This suggests that stimulus competition for covert attention sets a “saccade priority map” that unfolds over time, resulting in faster corrective saccades to an anticipated object with higher top-down attentional priority.     

The control of saccade trajectories: direction of curvature depends on prior knowledge of target location and saccade latency

Recent reports have shown that saccades can deviate either toward or away from distractors. However, the specific conditions responsible for the change in initial saccade direction are not known. One possibility, examined here, is that the direction of curvature (toward or away from distractors) reflects preparatory tuning of the oculomotor system when the location of the target and distractor are known in advance. This was investigated by examining saccade trajectories under predictable and unpredictable target conditions. In Experiment 1, the targets and the distractors appeared unpredictably, whereas in Experiment 2 an arrow cue presented at fixation indicated the location of the forthcoming target prior to stimulus onset. Saccades were made to targets on the horizontal, vertical, and principal oblique axis, and distractors appeared simultaneously at an adjacent location (a separation of +/- 45 degrees of visual angle). On average, saccade trajectories curved toward distractors when target locations were unpredictable and curved away from distractors when target locations were known in advance. There was no overall difference in mean saccade latencies between the two experiments. The magnitude of the distractor modulation of saccade trajectory (either toward or away from) was comparable across the different saccade directions (horizontal, vertical, and oblique). These results are interpreted in terms of the time course of competitive interactions operating in the neural structures involved in the suppression of distractors and the selection of a saccade target. A relatively slow mechanism that inhibits movements to distractors produces curvature away from the distractor. This mechanism has more time to operate when target location is predictable, increasing the likelihood that the saccade trajectory will deviate away from the distractor.     

Setting semantics: conceptual set can determine the physical properties that capture attention

The ability of a stimulus to capture visuospatial attention depends on the interplay between its bottom-up saliency and its relationship to an observer’s top-down control set, such that stimuli capture attention if they match the predefined properties that distinguish a searched-for target from distractors (Folk, Remington, & Johnston, Journal of Experimental Psychology: Human Perception & Performance, 18, 1030–1044 1992). Despite decades of research on this phenomenon, however, the vast majority has focused exclusively on matches based on low-level physical properties. Yet if contingent capture is indeed a “top-down” influence on attention, then semantic content should be accessible and able to determine which physical features capture attention. Here we tested this prediction by examining whether a semantically defined target could create a control set for particular features. To do this, we had participants search to identify a target that was differentiated from distractors by its meaning (e.g., the word “red” among color words all written in black). Before the target array, a cue was presented, and it was varied whether the cue appeared in the physical color implied by the target word. Across three experiments, we found that cues that embodied the meaning of the word produced greater cuing than cues that did not. This suggests that top-down control sets activate content that is semantically associated with the target-defining property, and this content in turn has the ability to exogenously orient attention.     

Developmental changes in the control of saccadic eye movements in response to directional eye gaze and arrows

We investigated developmental differences in oculomotor control between 10-year-old children and adults using a central interference task. In this task, the colour of a fixation point instructed participants to saccade either to the left or to the right. These saccade directions were either congruent or incongruent with two types of distractor cue: either the direction of eye gaze of a centrally presented schematic face, or the direction of arrows. Children had greater difficulties inhibiting the distractor cues than did adults, which revealed itself in longer saccade latencies for saccades that were incongruent with the distractor cues as well as more errors on these incongruent trials than on congruent trials. Counter to our prediction, in terms of saccade latencies, both children and adults had greater difficulties inhibiting the arrow than the eye gaze distractors.     

Developmental changes in the control of saccadic eye movements in response to directional eye gaze and arrows

We investigated developmental differences in oculomotor control between 10-year-old children and adults using a central interference task. In this task, the colour of a fixation point instructed participants to saccade either to the left or to the right. These saccade directions were either congruent or incongruent with two types of distractor cue: either the direction of eye gaze of a centrally presented schematic face, or the direction of arrows. Children had greater difficulties inhibiting the distractor cues than did adults, which revealed itself in longer saccade latencies for saccades that were incongruent with the distractor cues as well as more errors on these incongruent trials than on congruent trials. Counter to our prediction, in terms of saccade latencies, both children and adults had greater difficulties inhibiting the arrow than the eye gaze distractors.     

Colavita dominance effect revisited: the effect of semantic congruity

To investigate the effect of semantic congruity on audiovisual target responses, participants detected a semantic concept that was embedded in a series of rapidly presented stimuli. The target concept appeared as a picture, an environmental sound, or both; and in bimodal trials, the audiovisual events were either consistent or inconsistent in their representation of a semantic concept. The results showed faster detection latencies to bimodal than to unimodal targets and a higher rate of missed targets when visual distractors were presented together with auditory targets, in comparison to auditory targets presented alone. The findings of Experiment 2 showed a cross-modal asymmetry, such that visual distractors were found to interfere with the accuracy of auditory target detection, but auditory distractors had no effect on either the speed or the accuracy of visual target detection. The biased-competition theory of attention (Desimone & Duncan Annual Review of Neuroscience 18: 1995; Duncan, Humphreys, & Ward Current Opinion in Neurobiology 7: 255–261 1997) was used to explain the findings because, when the saliency of the visual stimuli was reduced by the addition of a noise filter in Experiment 4, visual interference on auditory target detection was diminished. Additionally, the results showed faster and more accurate target detection when semantic concepts were represented in a visual rather than an auditory format.     

Visual and semantic effects in a serial word classification task

Subjects were asked to decide as quickly as possible whether each of a series of items was one of the four target words, ‘dog’, ‘rat’, ‘boar’ and ‘mole’. The relationship of distractors to the targets was varied. Distractors which were of high visual similarity to the targets took longer to reject than those which were of lower visual similarity, and distractors which were semantically related to the targets took longer to reject than those which were unrelated. These effects were independent. There was no effect of familiarity, with non-animal distractors and pronounceable non-words rejected equally quickly. These results are qualitatively the same as those earlier found with faces (Bruce, 1979).     

Saccade latency in children and adults: Effects of warning interval and target eccentricity

Saccadic response latency to the onset of an eccentric target was studied in children (mean age = 8.7) and adults. The independent variables investigated were fixation-light offset to target-light onset warning interval (0, 100, 300, and 600 msec) and target eccentricity (5° or 15°). Both children and adults showed shorter saccade latencies under warning-interval conditions. Children were found to have longer latencies than adults with 0 or 100 msec warning intervals but to respond with as short or shorter latencies with 300 or 600 msec warning intervals. Target eccentricity effects did not interact with age, and occurred only with a lower target intensity. Children defined as poor readers could initiate a response as quickly as good readers but were less able to maintain fixation-light fixation prior to target onset.     

Feature-based search asymmetries in pigeons and humans

Pigeon and human subjects searched for one target item amidst a number of identical distractors. Simple line forms were used. The target differed from the distractors only in terms of the presence or absence of a feature (a line or a gap); in some experimental series, the feature was present in the target; in others, the feature was in the distractors. The pigeons pecked at the target; the human subjects either reported the presence of the target or pointed to it with a light pen. The time between display onset and this response was recorded. Varied across experimental conditions were the number of distractors in the display, the nature of the stimulus forms, and certain procedural parameters; five conditions were run with pigeons and three with humans. Under all test conditions, the results from the human subjects replicated the previously reported search-asymmetry effect. That is, search speed was greater and decreased less with display size when the target bore the feature (line or gap) than when the distractors bore the feature; both yes/no and localization-response conditions yielded this effect. However, pigeons failed to show search asymmetry; neither line nor gap in a target facilitated search. The results suggest that early visual processing differs for pigeons and humans, that pigeon features differ from human features, or that search asymmetry was eliminated by the long practice given the pigeons.     

What we remember affects how we see: Spatial working memory steers saccade programming

Relationships between visual attention, saccade programming, and visual working memory have been hypothesized for over a decade. Awh, Jonides, and Reuter-Lorenz (Journal of Experimental Psychology: Human Perception and Performance 24(3):780–90, 1998) and Awh et al. (Psychological Science 10(5):433–437, 1999) proposed that rehearsing a location in memory also leads to enhanced attentional processing at that location. In regard to eye movements, Belopolsky and Theeuwes (Attention, Perception & Psychophysics 71(3):620–631, 2009) found that holding a location in working memory affects saccade programming, albeit negatively. In three experiments, we attempted to replicate the findings of Belopolsky and Theeuwes (Attention, Perception & Psychophysics 71(3):620–631, 2009) and determine whether the spatial memory effect can occur in other saccade-cuing paradigms, including endogenous central arrow cues and exogenous irrelevant singletons. In the first experiment, our results were the opposite of those in Belopolsky and Theeuwes (Attention, Perception & Psychophysics 71(3):620–631, 2009), in that we found facilitation (shorter saccade latencies) instead of inhibition when the saccade target matched the region in spatial working memory. In Experiment 2, we sought to determine whether the spatial working memory effect would generalize to other endogenous cuing tasks, such as a central arrow that pointed to one of six possible peripheral locations. As in Experiment 1, we found that saccade programming was facilitated when the cued location coincided with the saccade target. In Experiment 3, we explored how spatial memory interacts with other types of cues, such as a peripheral color singleton target or irrelevant onset. In both cases, the eyes were more likely to go to either singleton when it coincided with the location held in spatial working memory. On the basis of these results, we conclude that spatial working memory and saccade programming are likely to share common overlapping circuitry.     

Saccade latency reveals episodic representation of object color

While previous studies suggest that identity, but not color, plays a role in episodic object representation, such studies have typically used tasks in which only identity is relevant, raising the possibility that the results reflect task demands, rather than the general principles that underlie object representation. In the present study, participants viewed a preview display containing one (Experiments 1 and 2) or two (Experiment 3) letters, then viewed a target display containing a single letter, in either the same or a different location. Participants executed an immediate saccade to fixate the target; saccade latency served as the dependent variable. In all experiments, saccade latencies were longer to fixate a target appearing in its previewed location, consistent with a bias to attend to new objects rather than to objects for which episodic representations are being maintained in visual working memory. The results of Experiment 3 further demonstrate, however, that changing target color eliminates these latency differences. The results suggest that color and identity are part of episodic representation even when not task relevant and that examining biases in saccade execution may be a useful approach to studying episodic representation.     

Distracted by relatives: Effects of frontal lobe damage on semantic distraction

When young adults carry out visual search, distractors that are semantically related, rather than unrelated, to targets can disrupt target selection (see 2 and 22). This effect is apparent on the first eye movements in search, suggesting that attention is sometimes captured by related distractors. Here we assessed effects of semantically related distractors on search in patients with frontal-lobe lesions and compared them to the effects in age-matched controls. Compared with the controls, the patients were less likely to make a first saccade to the target and they were more likely to saccade to distractors (whether related or unrelated to the target). This suggests a deficit in a first stage of selecting a potential target for attention. In addition, the patients made more errors by responding to semantically related distractors on target-absent trials. This indicates a problem at a second stage of target verification, after items have been attended. The data suggest that frontal lobe damage disrupts both the ability to use peripheral information to guide attention, and the ability to keep separate the target of search from the related items, on occasions when related items achieve selection.