Does color synesthesia pose a paradox for early-selection theories of attention?

Abstract— P.M. is a synesthete who experiences colors when viewing alphanumeric symbols. Her search for a target differing from distractors by a synesthetic color feature takes the form of a pop-out search. Thus, it would seem that synesthesia can occur preattentively. However, discrepancies between the regression functions of response times observed in target-present trials and target-absent trials, and the fact that fast response times occur only when the target is within a few degrees of visual angle from fixation, indicate that P.M.'s synesthesia does not occur preattentively, but rather is within the focus of attention. We conclude that synesthesia is a genuine perceptual phenomenon that can have substantial influence on visual processing.     

Pop-out without awareness: unseen feature singletons capture attention only when top-down attention is available

Visual pop-out occurs when a unique visual target (e.g., a feature singleton) is present in a set of homogeneous distractors. However, the role of visual awareness in this process remains unclear. In the experiments reported here, we showed that even though subjects were not aware of a suppressed pop-out display, their subsequent performance on an orientation-discrimination task was significantly better at the pop-out location than at a control location. These results indicate that conscious visual awareness of a feature singleton is not necessary for it to attract attention. Furthermore, the subliminal pop-out effect disappeared when subjects diverted their attention toward a rapid sequential visual presentation task while presented with the same subliminal pop-out display. These results suggest that top-down attention is necessary for the subliminal pop-out effect and that the cognitive processes underlying attention and awareness are somewhat independent.     

Interactions between search mechanisms in conjunction search.

We report the results of a technique designed to measure interactions between different visual search processes. We interrupted pop-out search before it produced a detection response, by adding extra distractors to the display so that a target initially defined by a single feature difference (e.g., a yellow horizontal line among yellow vertical lines) could then only be found on the basis of the conjunction of two features (a yellow horizontal line among yellow vertical lines and pink horizontal lines; difficult search). This technique has been used to measure the duration of the perceptual components of pop-out search, independent of over-all response time, for targets presented among different sets of distractors. In addition, when pop-out failed because it was interrupted, past work has shown that it nevertheless provided useful information to the processes responsible for difficult search. That is, partial pop-out assisted difficult search, when extra distractors made search difficult because the target was between the two types of distractors in the relevant feature space (Olds, Cowan, & Jolicoeur, 2000a,b,c). The present results demonstrate that partial pop-out also assists difficult search when difficult search is a conjunction search, and therefore these interactions may occur at a stage where information from different feature dimensions is combined.     

Partial orientation pop-out helps difficult search for orientation

We interrupted pop-out search before it produced a detection response by adding extra distractors to the search display. We show that when pop-out for an orientation target fails because of this interruption, it nevertheless provides useful information to the processes responsible for difficult search. That is, partial pop-out assists difficult search. This interaction has also been found for color stimuli (Olds, Cowan, & Jolicoeur, 2000a, 2000b). These results indicate that interactions and/or overlap between the mechanisms responsible for pop-out and the mechanisms responsible for difficult search may be quite general in early visual selection.     

Age-related increase in top-down activation of visual features

Previous research suggests that, during visual search and discrimination tasks, older adults place greater emphasis than younger adults on top-down attention. This experiment investigated the relative contribution of target activation and distractor inhibition to this age difference. Younger and older adults performed a singleton discrimination task in which either an E or an R target (colour singleton) was present among distractor letters. Relative to a baseline condition in which the colours of the targets and distractors remained constant, an age-related slowing of performance was evident when either the colour of the target or that of the distractors varied across trials. The age-related slowing was more pronounced in response to target colour variation, suggesting that older adults place relatively greater emphasis on the top-down activation of target features.     

Age-related increase in top-down activation of visual features

Previous research suggests that, during visual search and discrimination tasks, older adults place greater emphasis than younger adults on top-down attention. This experiment investigated the relative contribution of target activation and distractor inhibition to this age difference. Younger and older adults performed a singleton discrimination task in which either an E or an R target (colour singleton) was present among distractor letters. Relative to a baseline condition in which the colours of the targets and distractors remained constant, an age-related slowing of performance was evident when either the colour of the target or that of the distractors varied across trials. The age-related slowing was more pronounced in response to target colour variation, suggesting that older adults place relatively greater emphasis on the top-down activation of target features.     

Reinforcement of inhibitory positional priming by spatial working memory contents

This study examined whether positional priming of pop-out is modulated by spatial working memory (WM). In Experiments 1A and 1B, observers were presented with a to-be-memorized item (Experiment 1A: triangle; Experiment 1B: circle) prior to performing a block of search trials, with triangular stimulus configurations (one target, two distractors) on an underlying elliptical frame. Each search block was followed by a memory test (i.e., memory conditions). In Experiment 1C, the presentation of the memory item (triangle) was immediately followed by the memory test, and the search block was performed after this test (i.e., no-memory condition). It was found that targets presented at a previous target were detected faster and targets presented at a previous distractor location slower, relative to a previous empty (‘neutral’) stimulus location, respectively. While facilitatory position priming was uninfluenced by the memory manipulation, inhibitory positional priming was larger in the memory than no-memory condition, but only when the memory stimulus (triangle) matched the (triangle) configuration formed by the three search items. This finding of larger inhibitory priming under memory conditions provides further evidence that positional priming, rather than being purely bottom-up determined, is open to top-down influences.     

Deciding where to attend: priming of pop-out drives target selection

With attention and eye-movements humans orient to targets of interest. This orienting occurs faster when the same target repeats: priming of pop-out (PoP). While reaction times (RTs) can be important, PoP's real function could be to steer where to orient, a possibility underexposed in many current paradigms, as these predesignate a target to which to orient. In a novel procedure we intermixed pop-out trials (one oddball target, two identical distractors) with choice trials (one item of each kind) where observers freely chose an item to attend to. Pop-out trials strongly drove subsequent choice: observers typically chose the preceding target. Conversely, choice trials affected subsequent pop-out RTs. Conventional PoP measures correlated positively with our choice measures among observers, suggesting common mechanisms. Our results support PoP accounts centered on altered target priority, and underscore PoP's importance for visual exploration.     

Attentional control settings prevent abrupt onsets from capturing visual spatial attention

When a visual distractor appears earlier than a visual target in a target-detection task, response time is faster if the distractor appears at the same location as the target. When a visual distractor appears concurrently with a visual target in a target-detection task, response time is slowed relative to when no distractor is presented. Both effects have been taken as evidence of the capture of visual spatial attention, yet capture by early distractors is contingent on top-down attentional control settings (ACSs), and capture by concurrent distractors is not. The present study evaluated whether this incongruity is attributable to the timing of distractors (earlier than vs. concurrently with the target), or to the employed comparisons (same location/different location vs. distractor/no distractor). Using a task that presented both early and concurrent distractors, we observed that, regardless of timing, capture was contingent on ACSs when assessed by the same-location/different-location comparison. This result suggests that, although irrelevant stimuli cause nonspatial purely stimulus-driven effects, the capture of visual spatial attention is contingent on ACSs.     

A unique visual rhythm does not pop out

We investigated attentional demands in visual rhythm perception of periodically moving stimuli using a visual search paradigm. A dynamic search display consisted of vertically “bouncing dots” with regular rhythms. The search target was defined by a unique visual rhythm (i.e., a shorter or longer period) among rhythmic distractors with identical periods. We found that search efficiency for a faster or a slower periodically moving target decreased as the number of distractors increased, although searching for a faster target was about one second faster than searching for a slower target. We conclude that perception of a visual rhythm defined by a unique period is not a “pop-out” process, but a serial one that demands considerable attention.     

Spatial cueing in time–space synesthetes: An event-related brain potential study

Some people report that they consistently and involuntarily associate time events, such as months of the year, with specific spatial locations; a condition referred to as time–space synesthesia. The present study investigated the manner in which such synesthetic time–space associations affect visuo-spatial attention via an endogenous cuing paradigm. Reaction times and ERPs were recorded as 12 time–space synesthetes and 12 control participants did a peripheral target detection task, cued by three different types of centrally presented cues: arrows pointing left or right, direction words “left” or “right”, and month names associated with either the left or the right side of the synesthete’s mental calendar (e.g., “October” or “May”). Cues were followed by probes on the left or right side of the screen, and participants responded to the probes with button presses. Behavioral and ERP data suggested that for synesthetes, month words functioned more effectively as cues to direct attention in space. In synesthetes but not controls, a comparison of ERPs to probes cued by months revealed effects of cue validity on the P3b component peaking 370 ms post-onset and on the subsequent positive slow wave (pSW) observed 600–900 ms post-onset (both larger for invalid probes). No effects of cue validity were observed on early visual potentials (N1) for probes cued by months. The findings suggest that in these time–space synesthetes cue validity influenced post-perceptual processes, such as stimulus evaluation and categorization, with no evidence for enhanced visual processing.     

Word meaning and the control of eye fixation: semantic competitor effects and the visual world paradigm

When participants are presented simultaneously with spoken language and a visual display depicting objects to which that language refers, participants spontaneously fixate the visual referents of the words being heard [Cooper, R. M. (1974). The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology, 6(1), 84-107; Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268(5217), 1632-1634]. We demonstrate here that such spontaneous fixation can be driven by partial semantic overlap between a word and a visual object. Participants heard the word ‘piano’ when (a) a piano was depicted amongst unrelated distractors; (b) a trumpet was depicted amongst those same distractors; and (c), both the piano and trumpet were depicted. The probability of fixating the piano and the trumpet in the first two conditions rose as the word ‘piano’ unfolded. In the final condition, only fixations to the piano rose, although the trumpet was fixated more than the distractors. We conclude that eye movements are driven by the degree of match, along various dimensions that go beyond simple visual form, between a word and the mental representations of objects in the concurrent visual field.     

The eyes have it: visual pop-out in infants and adults

Visual search studies with adults have shown that stimuli that contain a unique perceptual feature pop out from dissimilar distractors and are unaffected by the number of distractors. Studies with very young infants have suggested that they too might exhibit pop-out. However, infant studies have used paradigms in which pop-out is measured in seconds or minutes, whereas in adults pop-out occurs in milliseconds. In addition, with the previous infant paradigms the effects from higher cognitive processes such as memory cannot be separated from pop-out and selective attention. Consequently, whether infants exhibit the phenomenon of pop-out and have selective attention mechanisms as found in adults is not clear. This study was an initial attempt to design a paradigm that would provide a comparable measure between infants and adults, thereby allowing a more accurate determination of the developmental course of pop-out and selective attention mechanisms. To this end, we measured 3-month-olds' and adults' saccade latencies to visual arrays that contained either a + among Ls (target-present) or all Ls (target-absent) with set sizes of 1, 3, 5 or 8 items. In Experiment 1, infants' saccade latencies remained unchanged in the target-present conditions as set size increased, whereas their saccade latencies increased linearly in the target-absent conditions as set size increased. In Experiment 2, adults' saccade latencies in the target-present and target-absent conditions showed the same pattern as the infants. The only difference between the infants and adults was that the infants' saccade latencies were slower in every condition. These results indicate that infants do exhibit pop-out on a millisecond scale, that it is unaffected by the number of distractors, and likely have similar functioning selective attention mechanisms. Moreover, the results indicate that eye movement latencies are a more comparable and accurate measure for assessing the phenomenon of pop-out and underlying attentional mechanisms in infants.     

Consistency of synesthetic association varies with grapheme familiarity: A longitudinal study of grapheme-color synesthesia

Grapheme-color synesthesia is a condition in which the visual perception of letters or numbers induces a specific color sensation. The consistency of grapheme-color association has been considered as a fundamental characteristic of synesthesia. However, recent studies have indicated that this association can change across the adult lifespan, and it has become necessary to investigate the factors behind the changes within each synesthete. We conducted a longitudinal study of Japanese adult synesthetes to investigate long-term (5–8 years) changes in color responses to 300 graphemes (alphanumeric and Japanese characters). Graphemes with lower long-term consistency of synesthetic association also tended to have lower short-term consistency, indicating that grapheme-color association's consistency is determined for each grapheme. Further, less familiar graphemes had less consistent associations with their synesthetic colors. These findings suggest that a stronger grapheme-color association is formed for more familiar graphemes, leading to the consolidation of synesthetic color for such graphemes.     

Searching through synaesthetic colors

Synaesthesia can be characterized by illusory colors being elicited automatically when one reads an alphanumeric symbol. These colors can affect attention; synaesthetes can show advantages in visual search of achromatic symbols that normally cause slow searches. However, some studies have failed to find these advantages, challenging the conclusion that synaesthetic colors influence attention in a manner similar to the influence of perceptual colors. In the present study, we investigated 2 synaesthetes who reported colors localized in space over alphanumeric symbols’ shapes. The Euclidian distance in CIE xyY color space between two synaesthetic colors was computed for each specific visual search, so that the relationship between color distance (CD) and efficiency of search could be explored with simple regression analyses. Target-to-distractors color salience systematically predicted the speed of search, but the CD between a target or distractors and the physically presented achromatic color did not. When the synaesthetic colors of a target and distractors were nearly complementary, searches resembled popout performance with real colors. Control participants who performed searches for the same symbols (which were colored according to the synaesthetic colors) showed search functions very similar to those shown by the synaesthetes for the physically achromatic symbols.     

Is “Σ” purple or green? Bistable grapheme-color synesthesia induced by ambiguous characters

People with grapheme-color synesthesia perceive specific colors when viewing different letters or numbers. Previous studies have suggested that synesthetic color experience can be bistable when induced by an ambiguous character. However, the exact relationship between processes underlying the identity of an alphanumeric character and the experience of the induced synesthetic color has not been examined. In the present study, we explored this by focusing on the temporal relation of inducer identification and color emergence using inducers whose identity could be rendered ambiguous upon rotation of the characters. Specifically, achromatic alphabetic letters (W/M) and digits (6/9) were presented at varying angles to 9 grapheme-color synesthetes. Results showed that grapheme identification and synesthetically perceived grapheme color covary with the orientation of the test stimulus and that synesthetes were slower naming the experienced color than identifying the character, particularly at intermediate angles where ambiguity was greatest.     

Extinction-like effects in normals: independence of localization and response selection

An extinction-like effect in normal subjects was previously elicited when a low-salience target in the left was simultaneously presented with a highly salient distractor in the right visual hemifield, but not vice versa (Pollmann, 1996). We investigated in four experiments whether this extinction-like effect depends on (a) explicit localization and (b) response competition. It was found that the extinction-like effect could be replicated in the absence of both. In contradistinction to our previous results, low-salience distractors had no effect on pop-out target search. This showed that explicit spatial localization demands lead to low-salience distractor interference on pop-out search.     

Perceptual organization and focused attention: The role of objects and proximity in visual processing

The influence of the Gestalt grouping principles of similarity, closure, and proximity on the size of the response-compatibility effect was examined in a focused attention task. In three studies, subjects responded to a centrally located target and attempted to ignore adjacent distractors. The distractors, which served as targets on other trials, could be compatible, incompatible, or neutral with respect to the response of the target. In addition, the distractors and the target could be embedded in the same object, presented in the same color, presented on different objects, or presented in different colors. The typical response-compatibility effect (B. A. Eriksen & C. W. Eriksen, 1974) was found when the target and distractors were embedded in the same object or presented in the same color. Performance was poorer when the target was surrounded by response-incompatible distractors than when it was surrounded by response-compatible distractors. However, the response-compatibility effect was eliminated-w-hen. the target and distractors were embedded in different objects, even when the distance between the items was less than.25° of visual angle. Furthermore, the response-compatibility effect was of intermediate size when the distractors were not grouped strongly with the target or with neutral flankers. The results are discussed in terms of space- and object-based models of visual attention.     

Perceptual organization and focused attention: the role of objects and proximity in visual processing.

The influence of the Gestalt grouping principles of similarity, closure, and proximity on the size of the response-compatibility effect was examined in a focused attention task. In three studies, subjects responded to a centrally located target and attempted to ignore adjacent distractors. The distractors, which served as targets on other trials, could be compatible, incompatible, or neutral with respect to the response of the target. In addition, the distractors and the target could be embedded in the same object, presented in the same color, presented on different objects, or presented in different colors. The typical response-compatibility effect (B. A. Eriksen & C. W. Eriksen, 1974) was found when the target and distractors were embedded in the same object or presented in the same color. Performance was poorer when the target was surrounded by response-incompatible distractors than when it was surrounded by response-compatible distractors. However, the response-compatibility effect was eliminated when the target and distractors were embedded in different objects, even when the distance between the items was less than .25 degrees of visual angle. Furthermore, the response-compatibility effect was of intermediate size when the distractors were not grouped strongly with the target or with neutral flankers. The results are discussed in terms of space- and object-based models of visual attention.     

When is search for a static target among dynamic distractors efficient?

Intuitively, dynamic visual stimuli, such as moving objects or flashing lights, attract attention. Visual search tasks have revealed that dynamic targets among static distractors can indeed efficiently guide attention. The present study shows that the reverse case, a static target among dynamic distractors, allows for relatively efficient selection in certain but not all cases. A static target was relatively efficiently found among distractors that featured apparent motion, corroborating earlier findings. The important new finding was that static targets were equally easily found among distractors that blinked on and off continuously, even when each individual item blinked at a random rate. However, search for a static target was less efficient when distractors abruptly varied in luminance but did not completely disappear. The authors suggest that the division into the parvocellular pathway dealing with static visual information, on the one hand, and the magnocellular pathway common to motion and new object onset detection, on the other hand, allows for efficient filtering of dynamic and static information.