Precision of synesthetic color matching resembles that for recollected colors rather than physical colors

Grapheme-color synesthesia is an atypical condition in which individuals experience sensations of color when reading printed graphemes such as letters and digits. For some grapheme-color synesthetes, seeing a printed grapheme triggers a sensation of color, but hearing the name of a grapheme does not. This dissociation allowed us to compare the precision with which synesthetes are able to match their color experiences triggered by visible graphemes, with the precision of their matches for recalled colors based on the same graphemes spoken aloud. In six synesthetes, color matching for printed graphemes was equally variable relative to recalled experiences. In a control experiment, synesthetes and age-matched controls either matched the color of a circular patch while it was visible on a screen, or they judged its color from memory after it had disappeared. Both synesthetes and controls were more variable when matching from memory, and the variance of synesthetes' recalled color judgments matched that associated with their synesthetic judgments for visible graphemes in the first experiment. Results suggest that synesthetic experiences of color triggered by achromatic graphemes are analogous to recollections of color. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

Consistency and strength of grapheme-color associations are separable aspects of synesthetic experience

Consistency of synesthetic associations over time is a widely used test of synesthesia. Since many studies suggest that consistency is not a completely reliable feature, we compared the consistency and strength of synesthetes’ grapheme-color associations. Consistency was measured by scores on the Synesthesia Battery and by the Euclidean distance in color space for the specific graphemes tested for each participant. Strength was measured by congruency magnitudes on the Implicit Association Test. The strength of associations was substantially greater for synesthetes than non-synesthetes, suggesting that this is a novel, objective marker of synesthesia. Although, intuitively, strong associations should also be consistent, consistency and strength were uncorrelated, indicating that they are likely independent, at least for grapheme-color synesthesia. These findings have implications for our understanding of synesthesia and for estimates of its prevalence since synesthetes who experience strong, but inconsistent, associations may not be identified by tests that focus solely on consistency.     

Synesthesia and memory: color congruency, von Restorff, and false memory effects

In the current study, we explored the influence of synesthesia on memory for word lists. We tested 10 grapheme-color synesthetes who reported an experience of color when reading letters or words. We replicated a previous finding that memory is compromised when synesthetic color is incongruent with perceptual color. Beyond this, we found that, although their memory for word lists was superior overall, synesthetes did not exhibit typical color- or semantic-defined von Restorff isolation effects (von Restorff, 1933) compared with control participants. Moreover, our synesthetes exhibited a reduced Deese-Roediger-McDermott false memory effect (Deese, 1959; Roediger & McDermott, 1995). Taken as a whole, these findings are consistent with the idea that color-grapheme synesthesia can lead people to place a greater emphasis on item-specific processing and surface form characteristics of words in a list (e.g., the letters that make them up) relative to relational processing and more meaning-based processes. (PsycINFO Database Record (c) 2010 APA, all rights reserved).     

Executive functions in synesthesia

In grapheme-color synesthesia, a number or letter can evoke two different and possibly conflicting (real and synesthetic) color sensations at the same time. In this study, we investigate the relationship between synesthesia and executive control functions. First, no general skill differences were obtained between synesthetes and non-synesthetes in classic executive control paradigms. Furthermore, classic executive control effects did not interact with synesthetic behavioral effects. Third, we found support for our hypothesis that inhibition of a synesthetic color takes effort and time. Finally, individual differences analyses showed no relationship between the two skills; performance on a ‘normal’ Stroop task does not predict performance on a synesthetic Stroop task. Across four studies, the current results consistently show no clear relationship between executive control functions and synesthetic behavioral effects. This raises the question of which mechanisms are at play in synesthetic ‘management’ during the presence of two conflicting (real and synesthetic) sensations.     

Metacontrast masking is processed before grapheme–color synesthesia

We investigated the physiological mechanism of grapheme–color synesthesia using metacontrast masking. A metacontrast target is rendered invisible by a mask that is delayed by about 60 ms; the target and mask do not overlap in space or time. Little masking occurs, however, if the target and mask are simultaneous. This effect must be cortical, because it can be obtained dichoptically. To compare the data for synesthetes and controls, we developed a metacontrast design in which nonsynesthete controls showed weaker dichromatic masking (i.e., the target and mask were in different colors) than monochromatic masking. We accomplished this with an equiluminant target, mask, and background for each observer. If synesthetic color affected metacontrast, synesthetes should show monochromatic masking more similar to the weak dichromatic masking among controls, because synesthetes could add their synesthetic color to the monochromatic condition. The target–mask pairs used for each synesthete were graphemes that elicited strong synesthetic colors. We found stronger monochromatic than dichromatic U-shaped metacontrast for both synesthetes and controls, with optimal masking at an asynchrony of 66 ms. The difference in performance between the monochromatic and dichromatic conditions in the synesthetes indicates that synesthesia occurs at a later processing stage than does metacontrast masking.     

Grapheme–color synesthesia can enhance immediate memory without disrupting the encoding of relational cues

Previous evidence has suggested that grapheme–color synesthesia can enhance memory for words, but little is known about how these photisms cue retrieval. Often, the encoding of specific features of individual words can disrupt the encoding of ordered relations between words, resulting in an overall decrease in recall accuracy. Here we show that the photisms arising from grapheme–color synesthesia do not function like these item-specific cues. The influences of high and low word frequency on the encoding of ordered relations and the accuracy of immediate free recall were compared across a group of 10 synesthetes and 48 nonsynesthetes. The main findings of Experiment 1 showed that the experience of synesthesia had no adverse effect on the encoding of ordered relations (as measured by input–output correspondence); furthermore, it enhanced recall accuracy in a strictly additive fashion across the two word frequency conditions. Experiment 2 corroborated these findings by showing that the synesthetes only outperformed the nonsynesthetes when the materials involved words and letters, not when they involved digits and spatial locations. Altogether, the present findings suggest that synesthesia can boost immediate memory performance without disrupting the encoding of ordered relations.     

Enhanced mental rotation ability in time-space synesthesia

Time-space synesthesia is a variant of sequence–space synesthesia and involves the involuntary association of months of the year with 2D and 3D spatial forms, such as arcs, circles, and ellipses. Previous studies have revealed conflicting results regarding the association between time-space synesthesia and enhanced spatial processing ability. Here, we tested 15 time-space synesthetes, and 15 non-synesthetic controls matched for age, education, and gender on standard tests of mental rotation ability, spatial working memory, and verbal working memory. Synesthetes performed better than controls on our test of mental rotation, but similarly to controls on tests of spatial and verbal working memory. Results support a dissociation between visuo-spatial imagery and spatial working memory capacity, and suggest time-space synesthesia is associated only with enhanced visuo-spatial imagery. These data are consistent with the time-space connectivity thesis that time-space synesthesia results from enhanced connectivity in the parietal lobe between regions supporting the representation of temporal sequences and those underlying visuo-spatial imagery.     

Synesthetic colors are elicited by sound quality in Japanese synesthetes

Determinants of synesthetic color choice for Japanese phonetic characters were studied in six Japanese synesthetes. The study used Hiragana and Katakana characters, which represent the same set of syllables although their visual forms are dissimilar. From a palette of 138 colors, synesthetes selected a color corresponding to each character. Results revealed that synesthetic color choices for Hiragana characters and those for their Katakana counterparts were remarkably consistent, indicating that color selection depended on character-related sounds and not visual form. This Hiragana–Katakana invariance cannot be regarded as the same phenomenon as letter case invariance, usually reported for English grapheme-color synesthesia, because Hiragana and Katakana characters have different identities whereas upper and lower case letters have the same identity. This involvement of phonology suggests that cross-activation between an inducer (i.e., letter/character) brain region and that of the concurrent (i.e., color) area in grapheme-color synesthesia is mediated by higher order cortical processing areas.     

Database of synesthetic color associations for Japanese kanji

Synesthesia is a neurological phenomenon in which certain types of stimuli elicit involuntary perceptions in an unrelated pathway. A common type of synesthesia is grapheme–color synesthesia, in which the visual perception of letters and numbers stimulates the perception of a specific color. Previous studies have often collected relatively small numbers of grapheme–color associations per synesthete, but the accumulation of a large quantity of data has greater promise for uncovering the mechanisms underlying synesthetic association. In this study, we therefore collected large samples of data from a total of eight synesthetes. All told, we obtained over 1000 synesthetic colors associated with Japanese kanji characters from each of two synesthetes, over 100 synesthetic colors form each of three synesthetes, and about 80 synesthetic colors associated with Japanese hiragana, Latin letters, and Arabic numerals from each of three synesthetes. We then compiled the data into a database, called the KANJI-Synesthetic Colors Database (K-SCD), which has a total of 5122 colors for 483, 46, and 46 Japanese kanji, hiragana, and katakana characters, respectively, as well as for 26 Latin letters and ten Arabic numerals. In addition to introducing the K-SCD, this article demonstrates the database’s merits by using two examples, in which two new rules for synesthetic association, “shape similarity” and “synesthetic color clustering,” were found. The K-SCD is publicly accessible (www.cv.jinkan.kyoto-u.ac.jp/site/uploads/K-SCD.xlsm) and will be a valuable resource for those who wish to conduct statistical analyses using a rich dataset in order to uncover the rules governing synesthetic association and to understand its mechanisms.     

Enhanced semantic priming in synesthetes independent of sensory binding

Synesthesia is the phenomenon in which individuals experience unusual involuntary cross-modal pairings. The evidence to date suggests that synesthetes have access to advantageous item-specific memory cues linked to their synesthetic experience, but whether this emphasis on item-specific memory cues comes at the expense of semantic-level processing has not been unambiguously demonstrated. Here we found that synesthetes produce substantially greater semantic priming magnitudes, unrelated to their specific synesthetic experience. This effect, however, was moderated by whether the synesthetes were projectors (their synesthetic experience occurs in their representation of external space), or associators (their synesthetic experience occurs in their ‘mind’s eye’). That is, the greater a synesthetes’s tendency to project their experience, the weaker their semantic priming when the task did not require them to semantically categorize the stimuli, whereas this trade-off was absent when the task did have that requirement.     

Consistency of synesthetic association varies with grapheme familiarity: A longitudinal study of grapheme-color synesthesia

Grapheme-color synesthesia is a condition in which the visual perception of letters or numbers induces a specific color sensation. The consistency of grapheme-color association has been considered as a fundamental characteristic of synesthesia. However, recent studies have indicated that this association can change across the adult lifespan, and it has become necessary to investigate the factors behind the changes within each synesthete. We conducted a longitudinal study of Japanese adult synesthetes to investigate long-term (5–8 years) changes in color responses to 300 graphemes (alphanumeric and Japanese characters). Graphemes with lower long-term consistency of synesthetic association also tended to have lower short-term consistency, indicating that grapheme-color association's consistency is determined for each grapheme. Further, less familiar graphemes had less consistent associations with their synesthetic colors. These findings suggest that a stronger grapheme-color association is formed for more familiar graphemes, leading to the consolidation of synesthetic color for such graphemes.     

Reduced audiovisual integration in synesthesia – evidence from bimodal speech perception

Recent research suggests synesthesia as a result of a hypersensitive multimodal binding mechanism. To address the question whether multimodal integration is altered in synesthetes in general, grapheme‐colour and auditory‐visual synesthetes were investigated using speech‐related stimulation in two behavioural experiments. First, we used the McGurk illusion to test the strength and number of illusory perceptions in synesthesia. In a second step, we analysed the gain in speech perception coming from seen articulatory movements under acoustically noisy conditions. We used disyllabic nouns as stimulation and varied signal‐to‐noise ratio of the auditory stream presented concurrently to a matching video of the speaker. We hypothesized that if synesthesia is due to a general hyperbinding mechanism this group of subjects should be more susceptible to McGurk illusions and profit more from the visual information during audiovisual speech perception. The results indicate that there are differences between synesthetes and controls concerning multisensory integration – but in the opposite direction as hypothesized. Synesthetes showed a reduced number of illusions and had a reduced gain in comprehension by viewing matching articulatory movements in comparison to control subjects. Our results indicate that rather than having a hypersensitive binding mechanism, synesthetes show weaker integration of vision and audition.     

The influence of synesthesia on eye movements: no synesthetic pop-out in an oculomotor target selection task

Recent research on grapheme-colour synesthesia has focused on whether visual attention is necessary to induce a synesthetic percept. The current study investigated the influence of synesthesia on overt visual attention during an oculomotor target selection task. Chromatic and achromatic stimuli were presented with one target among distractors (e.g. a ‘2’ (target) among multiple ‘5’s (distractors)). Participants executed an eye movement to the target. Synesthetes and controls showed a comparable target selection performance across conditions and a ‘pop-out effect’ was only seen in the chromatic condition. As a pop-out effect was absent for the synesthetes in the achromatic condition, a synesthetic element appears not to elicit a synesthetic colour, even when it is the target. The synesthetic percepts are not pre-attentively available to distinguish the synesthetic target from synesthetic distractors when elements are presented in the periphery. Synesthesia appears to require full recognition to bind form and colour.     

Why Saturday could be both green and red in synesthesia

It has long been observed that certain words induce multiple synesthetic colors, a phenomenon that has remained largely unexplored. We report here on the distinct synesthetic colors two synesthetes experienced with closed sets of concepts (digits, weekdays, months). For example, Saturday was associated with green, like other word starting with s; however, Saturday also had its specific color (red). Auditory priming and Visual Color Stroop tasks were used to understand the cognitive mechanisms supporting the distinct synesthetic colors. Results revealed that processing of word segments and whole words was specifically involved in each type of synesthetic colors. However, these mechanisms differed between participants, as they could relate either to orthography (and written words) or phonology (and spoken words). Further differences concerned the word representations, which varied as to whether or not they encoded serial positions. In addition to clarifying the cognitive mechanisms underlying the distinct synesthetic colors, our results offer some clues for understanding the neurocognitive underpinnings of a rather common form of synesthesia.     

Is “Σ” purple or green? Bistable grapheme-color synesthesia induced by ambiguous characters

People with grapheme-color synesthesia perceive specific colors when viewing different letters or numbers. Previous studies have suggested that synesthetic color experience can be bistable when induced by an ambiguous character. However, the exact relationship between processes underlying the identity of an alphanumeric character and the experience of the induced synesthetic color has not been examined. In the present study, we explored this by focusing on the temporal relation of inducer identification and color emergence using inducers whose identity could be rendered ambiguous upon rotation of the characters. Specifically, achromatic alphabetic letters (W/M) and digits (6/9) were presented at varying angles to 9 grapheme-color synesthetes. Results showed that grapheme identification and synesthetically perceived grapheme color covary with the orientation of the test stimulus and that synesthetes were slower naming the experienced color than identifying the character, particularly at intermediate angles where ambiguity was greatest.     

Temporal sequences,synesthetic mappings,and cultural biases: The geography of time

Time–space synesthetes report that they experience the months of the year as having a spatial layout. In Study 1, we characterize the phenomenology of calendar sequences produced by synesthetes and non-synesthetes, and show a conservative estimate of time–space synesthesia at 2.2% of the population. We demonstrate that synesthetes most commonly experience the months in a circular path, while non-synesthetes default to linear rows or rectangles. Study 2 compared synesthetes’ and non-synesthetes’ ability to memorize a novel spatial calendar, and revealed better performance in synesthetes. The capacity to learn mappings between arbitrary spatial forms and temporal sequences is present in all individuals, and time–space synesthetes’ enhanced visuo-spatial memory abilities may underlie their creation of idiosyncratic spatial calendar forms.     

Musical space synesthesia: Automatic,explicit and conceptual connections between musical stimuli and space

In musical–space synesthesia, musical pitches are perceived as having a spatially defined array. Previous studies showed that symbolic inducers (e.g., numbers, months) can modulate response according to the inducer’s relative position on the synesthetic spatial form. In the current study we tested two musical–space synesthetes and a group of matched controls on three different tasks: musical–space mapping, spatial cue detection and a spatial Stroop-like task. In the free mapping task, both synesthetes exhibited a diagonal organization of musical pitch tones rising from bottom left to the top right. This organization was found to be consistent over time. In the subsequent tasks, synesthetes were asked to ignore an auditory or visually presented musical pitch (irrelevant information) and respond to a visual target (i.e., an asterisk) on the screen (relevant information). Compatibility between musical pitch and the target’s spatial location was manipulated to be compatible or incompatible with the synesthetes’ spatial representations. In the spatial cue detection task participants had to press the space key immediately upon detecting the target. In the Stroop-like task, they had to reach the target by using a mouse cursor. In both tasks, synesthetes’ performance was modulated by the compatibility between irrelevant and relevant spatial information. Specifically, the target’s spatial location conflicted with the spatial information triggered by the irrelevant musical stimulus. These results reveal that for musical–space synesthetes, musical information automatically orients attention according to their specific spatial musical-forms. The present study demonstrates the genuineness of musical–space synesthesia by revealing its two hallmarks—automaticity and consistency. In addition, our results challenge previous findings regarding an implicit vertical representation for pitch tones in non-synesthete musicians.     

Spatial cueing in time–space synesthetes: An event-related brain potential study

Some people report that they consistently and involuntarily associate time events, such as months of the year, with specific spatial locations; a condition referred to as time–space synesthesia. The present study investigated the manner in which such synesthetic time–space associations affect visuo-spatial attention via an endogenous cuing paradigm. Reaction times and ERPs were recorded as 12 time–space synesthetes and 12 control participants did a peripheral target detection task, cued by three different types of centrally presented cues: arrows pointing left or right, direction words “left” or “right”, and month names associated with either the left or the right side of the synesthete’s mental calendar (e.g., “October” or “May”). Cues were followed by probes on the left or right side of the screen, and participants responded to the probes with button presses. Behavioral and ERP data suggested that for synesthetes, month words functioned more effectively as cues to direct attention in space. In synesthetes but not controls, a comparison of ERPs to probes cued by months revealed effects of cue validity on the P3b component peaking 370 ms post-onset and on the subsequent positive slow wave (pSW) observed 600–900 ms post-onset (both larger for invalid probes). No effects of cue validity were observed on early visual potentials (N1) for probes cued by months. The findings suggest that in these time–space synesthetes cue validity influenced post-perceptual processes, such as stimulus evaluation and categorization, with no evidence for enhanced visual processing.     

The interaction of synesthetic and print color and its relation to visual imagery

Synesthetic color induced by graphemes is well understood to be an automatic perceptual phenomenon paralleling print color in some ways, but also differing in others. We addressed this juxtaposition by asking how synesthetes are affected by synesthetic and print colors that are the same. We tested two groups of grapheme–color synesthetes using a basic color-priming method in which a grapheme prime was presented, followed by a color patch (probe), the color of which was to be named as quickly and accurately as possible. The primes induced either no color, print color only, synesthetic color only, or both forms of color (e.g., a letter “A” printed in red that also triggered synesthetic red). As expected, responses to name the probe color were faster if it was congruent with the prime color than if it was incongruent. The new finding (Exp. 1) was that a prime that induced the same print and synesthetic colors led to substantially larger priming effects than did either type of color individually, an effect that could not be attributed to semantic priming (Exp. 2). In addition, the synesthesia effects correlated with a standard measure of visual imagery. These findings are discussed as being consistent with the hypothesis that print and synesthetic color converge on similar color mechanisms.     

Multilevel analysis of individual differences in regularities of grapheme–color associations in synesthesia

Grapheme–color synesthesia is a neurological phenomenon where visual perception of letters and numbers stimulates perception of a specific color. Grapheme–color correspondences have been shown to be systematically associated with grapheme properties, including visual shape difference, ordinality, and frequency. However, the contributions of grapheme factors differ across individuals. In this study, we applied multilevel analysis to test whether individual differences in regularities of grapheme–color associations could be explained by individual styles of processing grapheme properties. These processing styles are reflected by the type of synesthetic experience. Specifically, we hypothesized that processing focusing on shape differences would be associated with projector synesthetes, while processing focusing on ordinality or familiarity would be associated with associator synesthetes. The analysis revealed that ordinality and familiarity factors were expressed more strongly among associators than among projectors. This finding suggests that grapheme–color associations are partly determined by the type of synesthetic experience.