Does color synesthesia pose a paradox for early-selection theories of attention?

Abstract— P.M. is a synesthete who experiences colors when viewing alphanumeric symbols. Her search for a target differing from distractors by a synesthetic color feature takes the form of a pop-out search. Thus, it would seem that synesthesia can occur preattentively. However, discrepancies between the regression functions of response times observed in target-present trials and target-absent trials, and the fact that fast response times occur only when the target is within a few degrees of visual angle from fixation, indicate that P.M.'s synesthesia does not occur preattentively, but rather is within the focus of attention. We conclude that synesthesia is a genuine perceptual phenomenon that can have substantial influence on visual processing.     

Limitations on the parallel guidance of visual search: color x color and orientation x orientation conjunctions

In visual search for a conjunction it is much more difficult to search for the conjunction of 2 colors or 2 orientations than for Color x Orientation or Color x Shape conjunctions. The result is not limited to particular colors or shapes. Two colors cannot occupy the same spatial location in Color x Color searches. However, Experiments 6 and 7 show that Color x Shape searches remain efficient even if the color and shape are spatially separated. Our guided search model suggests that in searches for Color x Shape, a parallel color module can guide attention toward the correct color, whereas the shape module guides attention toward the correct shape. Together these 2 sources of guidance lead attention to the target. However, if a target is red and green among red-blue and green-blue distractors, it is not possible to guide search independently toward red items and green items or away from all blue items.     

Stimulus-determined discrimination mechanisms for color search.

Visual attention can be goal driven, stimulus driven, or a combination of the two. Here we report evidence for an unexpectedly stimulus-driven component of visual search for a target defined by color. Observers demonstrated a surprisingly cost-free ability to incorporate multiple classifiers in search for a target of one color from among distractors of other colors. A target color was presented among distractors that could change from trial to trial (intermixed presentation) or that remained constant across all trials in a block (blocked presentation). For blocked presentation, a single search classifier (a mechanism that segregates the target from distractors in color space) could be adopted, whereas for intermixed presentation different classifiers had to be used when the distractor colors changed. The benefit of blocked presentation was very small, suggesting that the appropriate classifier was determined very quickly in trials for which the classifier changed. The results suggest that the stimulus-driven activation of an appropriate stimulus classifier can be very efficient.     

Stimulus-determined discrimination mechanisms for color search

Visual attention can be goal driven, stimulus driven, or a combination of the two. Here we report evidence for an unexpectedly stimulus-driven component of visual search for a target defined by color. Observers demonstrated a surprisingly cost-free ability to incorporate multiple classifiers in search for a target of one color from among distractors of other colors. A target color was presented among distractors that could change from trial to trial (intermixed presentation) or that remained constant across all trials in a block (blocked presentation). For blocked presentation, a single search classifier (a mechanism that segregates the target from distractors in color space) could be adopted, whereas for intermixed presentation different classifiers had to be used when the distractor colors changed. The benefit of blocked presentation was very small, suggesting that the appropriate classifier was determined very quickly in trials for which the classifier changed. The results suggest that the stimulus-driven activation of an appropriate stimulus classifier can be very efficient.     

Segregation by color and stereoscopic depth in three-dimensional visual space

Two experiments were conducted to investigate how color and stereoscopic depth information are used to segregate objects for visual search in three-dimensional (3-D) visual space. Eight observers were asked to indicate the alphanumeric category (letter or digit) of the target which had its unique color and unique depth plane. In Experiment 1, distractors sharing a common depth plane or a common color appeared in spatial contiguity in thexy plane. The results suggest that visual search for the target involves examination of kernels formed by homogeneous items sharing the same color and depth. In Experiment 2, thexy contiguity of distractors sharing a common color or a common depth plane was varied. The results showed that when target-distractor distinction becomes more difficult on one dimension, the other dimension becomes more important in performing visual search, as indicated by a larger effect on search time. This suggests that observers can make optimal use of the information available. Finally, color had a larger effect on search time than did stereoscopic depth. Overall, the results support models of visual processing which maintain that perceptual segregation and selective attention are determined by similarity among objects in 3-D visual space on both spatial and nonspatial stimulus dimensions.     

Perceptual organization and focused attention: The role of objects and proximity in visual processing

The influence of the Gestalt grouping principles of similarity, closure, and proximity on the size of the response-compatibility effect was examined in a focused attention task. In three studies, subjects responded to a centrally located target and attempted to ignore adjacent distractors. The distractors, which served as targets on other trials, could be compatible, incompatible, or neutral with respect to the response of the target. In addition, the distractors and the target could be embedded in the same object, presented in the same color, presented on different objects, or presented in different colors. The typical response-compatibility effect (B. A. Eriksen & C. W. Eriksen, 1974) was found when the target and distractors were embedded in the same object or presented in the same color. Performance was poorer when the target was surrounded by response-incompatible distractors than when it was surrounded by response-compatible distractors. However, the response-compatibility effect was eliminated-w-hen. the target and distractors were embedded in different objects, even when the distance between the items was less than.25° of visual angle. Furthermore, the response-compatibility effect was of intermediate size when the distractors were not grouped strongly with the target or with neutral flankers. The results are discussed in terms of space- and object-based models of visual attention.     

Perceptual organization and focused attention: the role of objects and proximity in visual processing.

The influence of the Gestalt grouping principles of similarity, closure, and proximity on the size of the response-compatibility effect was examined in a focused attention task. In three studies, subjects responded to a centrally located target and attempted to ignore adjacent distractors. The distractors, which served as targets on other trials, could be compatible, incompatible, or neutral with respect to the response of the target. In addition, the distractors and the target could be embedded in the same object, presented in the same color, presented on different objects, or presented in different colors. The typical response-compatibility effect (B. A. Eriksen & C. W. Eriksen, 1974) was found when the target and distractors were embedded in the same object or presented in the same color. Performance was poorer when the target was surrounded by response-incompatible distractors than when it was surrounded by response-compatible distractors. However, the response-compatibility effect was eliminated when the target and distractors were embedded in different objects, even when the distance between the items was less than .25 degrees of visual angle. Furthermore, the response-compatibility effect was of intermediate size when the distractors were not grouped strongly with the target or with neutral flankers. The results are discussed in terms of space- and object-based models of visual attention.     

The inability to ignore auditory distractors as a function of visual task perceptual load

Using a response competition paradigm, we investigated the ability to ignore target response-compatible, target response-incompatible, and neutral visual and auditory distractors presented during a visual search task. The perceptual load model of attention (e.g., Lavie & Tsal, 1994) states that task-relevant processing load determines irrelevant distractor processing in such a way that increasing processing load prevents distractor processing. In three experiments, participants searched sets of one (easy search) or six (hard search) similar items. In Experiment 1, visual distractors influenced reaction time (RT) and accuracy only for easy searches, following the perceptual load model. Surprisingly, auditory distractors yielded larger distractor compatibility effects (median RT for incompatible trials minus median RT for compatible trials) for hard searches than for easy searches. In Experiments 2 and 3, during hard searches, consistent RT benefits with response-compatible and RT costs with response-incompatible auditory distractors occurred only for hard searches. We suggest that auditory distractors are processed regardless of visual perceptual load but that the ability to inhibit cross-modal influence from auditory distractors is reduced under high visual load.     

Contingent capture in cueing: the role of color search templates and cue-target color relations

Visual search studies have shown that attention can be top-down biased to a specific target color, so that only items with this color or a similar color can capture attention. According to some theories of attention, colors from different categories (i.e., red, green, blue, yellow) are represented independently. However, other accounts have proposed that these are related—either because color is filtered through broad overlapping channels (4-channel view), or because colors are represented in one continuous feature space (e.g., CIE space) and search is governed by specific principles (e.g., linear separability between colors, or top-down tuning to relative colors). The present study tested these different views using a cueing experiment in which observers had to select one target color (e.g., red) and ignore two or four differently colored distractors that were presented prior to the target (cues). The results showed clear evidence for top-down contingent capture by colors, as a target-colored cue captured attention more strongly than differently colored cues. However, the results failed to support any of the proposed views that different color categories are related to one another by overlapping channels, linear separability, or relational guidance (N = 96).     

Part—whole information is useful in visual search for size × size but not orientation × orientation conjunctions

In visual search tasks, subjects look for a target among a variable number of distractor items. If the target is defined by a conjunction of two different features (e.g., color × orientation), efficient search is possible when parallel processing of information about color and about orientation is used to “guid” the deployment of attention to the target. Another type of conjunction search has targets defined by two instances of one type of feature (e.g., a conjunction of two colors). In this case, search is inefficient when the target is an item defined by parts of two different colors but much more efficient if the target can be described as a whole item of one color with a part of another color (Wolfe, Friedman-Hill, & Bilsky, 1994). In this paper, we show that the same distinction holds for size. “Part— whole” size × size conjunction searches are efficient; “part-part” searches are not (Experiments 1–3). In contrast, all orientation × orientation searches are inefficient (Experiments 4–6). This difference between preattentive processing of color and size, on the one hand, and orientation, on the other, may reflect structural relationships between features in real-world objects.     

Frequency correlates in grapheme-color synaesthesia

Individuals with synaesthesia experience certain stimuli in more than one sensory modality. Most common is the linkage of letters and digits (graphemes) to colors. Whereas synaesthesia might be partly genetically determined, the linkages to specific colors are assumed to be learned. We present a systematic statistical analysis of synaesthetic color perception based on subjects' reproduction of individual colors for each grapheme, instead of simple verbal categorizations. The statistical analysis revealed that the color perceptions, measured with the HSL (hue, saturation, and luminance) scale, varied systematically among the different digits and letters. The frequencies of the digits and letters (in the German language) partly explained these systematic variations. However, digit frequency was more strongly related to color perception in the synaesthetes than was letter frequency. The results for digit and letter frequency indicate that experience with graphemes may shape synaesthetic color perception.     

Perceptual grouping and visual selective attention

The present study demonstrates that incongruent distractor letters at a constant distance from a target letter produce more response competition and negative priming when they share a target’s color than when they have a different color. Moreover, perceptual grouping by means of color, attenuated the effects of spatial proximity. For example, when all items were presented in the same color, near distractors produced more response competition and negative priming than far distractors (Experiment 3A). However, when near distractors were presented in a different color and far distractors were presented in the same color as the target, the response competition × distractor proximity interaction was eliminated and the proximity × negative priming interaction was reversed (Experiment 3B). A final experiment demonstrated that distractors appearing on the same object as a selected target produced comparable amounts of response competition and negative priming whether they were near or far from the target. This suggests that the inhibitory mechanisms of visual attention can be directed to perceptual groups/objects in the environment and not only to unsegmented regions of visual space.     

Automatic priming of attentional control by relevant colors

We tested whether color word cues automatically primed attentional control settings during visual search, or whether color words were used in a strategic manner for the control of attention. In Experiment 1, we used color words as cues that were informative or uninformative with respect to the target color. Regardless of the cue's informativeness, distractors similar to the color cue captured more attention. In Experiment 2, the participants either indicated their expectation about the target color or recalled the last target color, which was uncorrelated with the present target color. We observed more attentional capture by distractors that were similar to the participants' predictions and recollections, but no difference between effects of the recollected and predicted colors. In Experiment 3, we used 100%-informative word cues that were congruent with the predicted target color (e.g., the word "red" informed that the target would be red) or incongruent with the predicted target color (e.g., the word "green" informed that the target would be red) and found that informative incongruent word cues primed attention capture by a word-similar distractor. Together, the results suggest that word cues (Exps. 1 and 3) and color representations (Exp. 2) primed attention capture in an automatic manner. This indicates that color cues automatically primed temporary adjustments in attention control settings.     

Short-term and long-term attentional biases to frequently encountered target features

It has long been known that frequently occurring targets are attended better than infrequent ones in visual search. But does this frequency-based attentional prioritization reflect momentary or durable changes in attention? Here we observed both short-term and long-term attentional biases for visual features as a function of different types of statistical associations between the targets, distractors, and features. Participants searched for a target, a line oriented horizontally or vertically among diagonal distractors, and reported its length. In one set of experiments we manipulated the target’s color probability: Targets were more often in Color 1 than in Color 2. The distractors were in other colors. Participants found Color 1 targets more quickly than Color 2 targets, but this preference disappeared immediately when the target’s color became random in the subsequent testing phase. In the other set of experiments, we manipulated the diagnostic values of the two colors: Color 1 was more often a target than a distractor; Color 2 was more often a distractor than a target. Participants found Color 1 targets more quickly than Color 2 targets. Importantly, and in contrast to the first set of experiments, the featural preference was sustained in the testing phase. These results suggest that short-term and long-term attentional biases are products of different statistical information. Finding a target momentarily activates its features, inducing short-term repetition priming. Long-term changes in attention, on the other hand, may rely on learning diagnostic features of the targets.     

工作记忆表征精度加工需求对注意引导的影响

采用注意捕获范式, 通过行为和事件相关脑电位(ERP)实验, 探讨工作记忆表征精度加工需求对注意引导的影响, 行为结果发现, 在低精度加工需求条件下, 只有一个工作记忆表征引导注意, 且处于高激活状态的工作记忆表征产生的注意捕获大于低激活状态; 而在高精度加工需求条件下, 有两个工作记忆表征引导注意, 且处于高、低激活状态的工作记忆表征产生的注意捕获没有差异。ERP结果显示, 高精度加工需求条件下诱发的NSW和LPC大于低精度加工需求条件; 在高精度加工需求条件下, 干扰项与记忆项匹配比不匹配时, 诱发更大的N2和更小的N2pc, 而在低精度加工需求条件下, 干扰项与记忆项匹配和不匹配时诱发的N2、N2pc没有差异。研究表明, 工作记忆表征精度加工需求影响注意引导的机制可能是高精度加工需求下, 工作记忆表征消耗的认知资源增加, 搜索目标获得的资源减少, 干扰项捕获的注意增加。     

Grapheme-color synaesthesia benefits rule-based Category learning

Researchers have long suspected that grapheme-color synaesthesia is useful, but research on its utility has so far focused primarily on episodic memory and perceptual discrimination. Here we ask whether it can be harnessed during rule-based Category learning. Participants learned through trial and error to classify grapheme pairs that were organized into categories on the basis of their associated synaesthetic colors. The performance of synaesthetes was similar to non-synaesthetes viewing graphemes that were physically colored in the same way. Specifically, synaesthetes learned to categorize stimuli effectively, they were able to transfer this learning to novel stimuli, and they falsely recognized grapheme-pair foils, all like non-synaesthetes viewing colored graphemes. These findings demonstrate that synaesthesia can be exploited when learning the kind of material taught in many classroom settings.     

Color opponency in synaesthetic experiences

Grapheme-color synaesthesia is a rare condition in which perception of a letter or a digit is associated with concurrent perception of a color. Synaesthetes report that these color experiences are vivid and realistic. We used a Stroop task to show that synaesthetically induced color, like real color, is processed in color-opponent channels (red-green or blue-yellow). Synaesthetic color produced maximal interference with the perception and naming of the real color of a grapheme if the real color was opponent to the synaesthetic color. Interference was reduced considerably if the synaesthetic and real colors engaged different color channels (e.g., synaesthetic blue and real red). No dependence on color opponency was found for semantic conflicts between shape and color (e.g., a blue lemon). Thus, the neural representation of synaesthetic colors closely resembles that of real colors. This suggests involvement of early stages of visual processing in color synaesthesia and explains the vivid and realistic nature of synaesthetic experiences.     

The influence of synesthesia on eye movements: no synesthetic pop-out in an oculomotor target selection task

Recent research on grapheme-colour synesthesia has focused on whether visual attention is necessary to induce a synesthetic percept. The current study investigated the influence of synesthesia on overt visual attention during an oculomotor target selection task. Chromatic and achromatic stimuli were presented with one target among distractors (e.g. a ‘2’ (target) among multiple ‘5’s (distractors)). Participants executed an eye movement to the target. Synesthetes and controls showed a comparable target selection performance across conditions and a ‘pop-out effect’ was only seen in the chromatic condition. As a pop-out effect was absent for the synesthetes in the achromatic condition, a synesthetic element appears not to elicit a synesthetic colour, even when it is the target. The synesthetic percepts are not pre-attentively available to distinguish the synesthetic target from synesthetic distractors when elements are presented in the periphery. Synesthesia appears to require full recognition to bind form and colour.     

Visual search and foraging compared in a large-scale search task

It has been argued that visual search is a valid model for human foraging. However, the two tasks differ greatly in terms of the coding of space and the effort required to search. Here we describe a direct comparison between visually guided searches (as studied in visual search tasks) and foraging that is not based upon a visually distinct target, within the same context. The experiment was conducted in a novel apparatus, where search locations were indicated by an array of lights embedded in the floor. In visually guided conditions participants searched for a target defined by the presence of a feature (red target amongst green distractors) or the absence of a feature (green target amongst red and green distractors). Despite the expanded search scale and the different response requirements, these conditions followed the pattern found in conventional visual search paradigms: feature-present search latencies were not linearly related to display size, whereas feature-absent searches were longer as the number of distractors increased. In a non-visually guided foraging condition, participants searched for a target that was only visible once the switch was activated. This resulted in far longer latencies that rose markedly with display size. Compared to eye-movements in previous visual search studies, there were few revisit errors to previously inspected locations in this condition. This demonstrates the important distinction between visually guided and non-visually guided foraging processes, and shows that the visual search paradigm is an equivocal model for general search in any context. We suggest a comprehensive model of human spatial search behaviour needs to include search at a small and large scale as well as visually guided and non-visually guided search.     

颜色凸显条件下基于工作记忆内容的视觉注意

采用记忆任务与视觉搜索任务相结合的实验范式,通过操纵背景颜色与刺激颜色,考察了工作记忆内容对视觉注意的引导是否存在强自动性。实验一通过操作背景颜色以突显记忆项目,结果发现即使工作记忆内容在匹配分心物的情况下仍然自动地捕获视觉注意。实验二通过操作背景颜色以突显目标项目,结果发现工作记忆内容对视觉注意的自动引导作用消失。说明了与工作记忆内容匹配的刺激能够自动地引导视觉注意,但是这种引导并非完全自动化,具有一定的条件性。