An exploratory study of linguistic–colour associations across languages in multilingual synaesthetes

In one of the most common forms of synaesthesia, linguistic–colour synaesthesia, colour is induced by stimuli such as numbers, letters, days of the week, and months of the year. It is not clear, however, whether linguistic–colour synaesthesia is determined more by higher level semantic information—that is, word meaning—or by lower level grapheme or phoneme structure. To explore this issue, we tested whether colour is consistently induced by grapheme or phoneme form or word meaning in bilingual and trilingual linguistic–colour synaesthetes. We reasoned that if the induced colour was related to word meaning, rather than to the acoustic or visual properties of the words, then the induced colours would remain consistent across languages. We found that colours were not consistently related to word meaning across languages. Instead, induced colours were more related to form properties of the word across languages, particularly visual structure. However, the type of inducing stimulus influenced specific colour associations. For example, colours to months of the year were more consistent across languages than were colours to numbers or days of the week. Furthermore, the effect of inducing stimuli was also associated with the age of acquisition of additional languages. Our findings are discussed with reference to a critical period in language acquisition on synaesthesia.     

Searching for Shereshevskii: what is superior about the memory of synaesthetes?

Some individuals with superior memory, such as the mnemonist Shereshevskii (Luria, 1968), are known to have synaesthesia. However, the extent to which superior memory is a general characteristic of synaesthesia is unknown, as is the precise cognitive mechanism by which synaesthesia affects memory. This study demonstrates that synaesthetes tend to report subjectively better than average memory and that these reports are borne out with objective testing. Synaesthetes experiencing colours for words show better memory than matched controls for stimuli that induce synaesthesia (word lists) relative to stimuli that do not (an abstract figure). However, memory advantages are not limited to material that elicits synaesthesia because synaesthetes demonstrate enhanced memory for colour per se (which does not induce a synaesthetic response). Our results suggest that the memory enhancement found in synaesthetes is related to an enhanced retention of colour in both synaesthetic and nonsynaesthetic situations. Furthermore, this may account for the fact that synaesthetic associations, once formed, remain highly consistent.     

Searching for Shereshevskii: What is superior about the memory of synaesthetes?

Some individuals with superior memory, such as the mnemonist Shereshevskii (Luria, 1968), are known to have synaesthesia. However, the extent to which superior memory is a general characteristic of synaesthesia is unknown, as is the precise cognitive mechanism by which synaesthesia affects memory. This study demonstrates that synaesthetes tend to report subjectively better than average memory and that these reports are borne out with objective testing. Synaesthetes experiencing colours for words show better memory than matched controls for stimuli that induce synaesthesia (word lists) relative to stimuli that do not (an abstract figure). However, memory advantages are not limited to material that elicits synaesthesia because synaesthetes demonstrate enhanced memory for colour per se (which does not induce a synaesthetic response). Our results suggest that the memory enhancement found in synaesthetes is related to an enhanced retention of colour in both synaesthetic and nonsynaesthetic situations. Furthermore, this may account for the fact that synaesthetic associations, once formed, remain highly consistent.     

A systematic, large-scale study of synaesthesia: implications for the role of early experience in lexical-colour associations

For individuals with synaesthesia, stimuli in one sensory modality elicit anomalous experiences in another modality. For example, the sound of a particular piano note may be 'seen' as a unique colour, or the taste of a familiar food may be 'felt' as a distinct bodily sensation. We report a study of 192 adult synaesthetes, in which we administered a structured questionnaire to determine the relative frequency and characteristics of different types of synaesthetic experience. Our data suggest the prevalence of synaesthesia in the adult population is approximately 1 in 1150 females and 1 in 7150 males. The incidence of left-handedness in our sample was within the normal range, contrary to previous claims. We did, however, find that synaesthetes are more likely to be involved in artistic pursuits, consistent with anecdotal reports. We also examined responses from a subset of 150 synaesthetes for whom letters, digits and words induce colour experiences ('lexical-colour' synaesthesia). There was a striking consistency in the colours induced by certain letters and digits in these individuals. For example, 'R' elicited red for 36% of the sample, 'Y' elicited yellow for 45%, and 'D' elicited brown for 47%. Similar trends were apparent for a group of non-synaesthetic controls who were asked to associate colours with letters and digits. Based on these findings, we suggest that the development of lexical-colour synaesthesia in many cases incorporates early learning experiences common to all individuals. Moreover, many of our synaesthetes experienced colours only for days of the week, letters or digits, suggesting that inducers that are part of a conventional sequence (e.g. Monday, Tuesday, Wednesday...; A, B, C...; 1, 2, 3...) may be particularly important in the development of synaesthetic inducer-colour pairs. We speculate that the learning of such sequences during an early critical period determines the particular pattern of lexical-colour links, and that this pattern then generalises to other words.     

Colours sometimes count: awareness and bidirectionality in grapheme-colour synaesthesia

Three experiments were conducted with 10 grapheme-colour synaesthetes and 10 matched controls to investigate (a) whether awareness of the inducer grapheme is necessary for synaesthetic colour induction and (b) whether grapheme-colour synaesthesia may be bidirectional in the sense that not only do graphemes induce colours, but that colours influence the processing of graphemes. Using attentional blink and Stroop paradigms with digit targets, we found that some synaesthetes did report “seeing” synaesthetic colours even when they were not able to report the inducing digit. Moreover, congruency effects (effects of matching the colour of digit presentation with the synaesthetic colour associated with that digit) suggested that grapheme-colour synaesthesia can be bidirectional, at least for some synaesthetes.     

Development of synaesthetic consistency: Repeated autonomous engagement with graphemes and colours leads to consistent associations

Synaesthetic consistency is the hallmark of synaesthesia and plays an important role in the definition and validation of synaesthesia. It has been hypothesised that the acquisition of initially unspecified synaesthetic associations is based on consolidation processes. Thus, we investigated in non-synaesthetes whether repeatedly engaging with grapheme-colour associations mimics the developmental trajectory of synaesthetic consistency in genuine grapheme-colour synaesthesia. This was the case for the two tested experimental groups, irrespective of whether they were instructed to memorize their chosen associations, but not for the passive control group. Moreover, consolidated associations of the experimental groups resembled those frequently found in genuine synaesthesia. Furthermore, the acquisition of consistent grapheme-colour associations resulted in a transfer of benefits to performance in recognition memory for abstract stimuli, as also found in genuine synaesthesia. Our findings suggest that consistent synaesthetic associations are based on consolidation processes due to repeated engagement with graphemes and colours.     

Colours sometimes count: Awareness and bidirectionality in grapheme–colour synaesthesia

Three experiments were conducted with 10 grapheme–colour synaesthetes and 10 matched controls to investigate (a) whether awareness of the inducer grapheme is necessary for synaesthetic colour induction and (b) whether grapheme–colour synaesthesia may be bidirectional in the sense that not only do graphemes induce colours, but that colours influence the processing of graphemes. Using attentional blink and Stroop paradigms with digit targets, we found that some synaesthetes did report “seeing” synaesthetic colours even when they were not able to report the inducing digit. Moreover, congruency effects (effects of matching the colour of digit presentation with the synaesthetic colour associated with that digit) suggested that grapheme–colour synaesthesia can be bidirectional, at least for some synaesthetes.     

Varieties of grapheme-colour synaesthesia: a new theory of phenomenological and behavioural differences

Recent research has suggested that not all grapheme-colour synaesthetes are alike. One suggestion is that they can be divided, phenomenologically, in terms of whether the colours are experienced in external or internal space (projector–associator distinction). Another suggestion is that they can be divided according to whether it is the perceptual or conceptual attributes of a stimulus that is critical (higher–lower distinction). This study compares the behavioural performance of 7 projector and 7 associator synaesthetes. We demonstrate that this distinction does not map on to behavioural traits expected from the higher–lower distinction. We replicate previous research showing that projectors are faster at naming their synaesthetic colours than veridical colours, and that associators show the reverse profile. Synaesthetes who project colours into external space but not on to the surface of the grapheme behave like associators on this task. In a second task, graphemes presented briefly in the periphery are more likely to elicit reports of colour in projectors than associators, but the colours only tend to be accurate when the grapheme itself is also accurately identified. We propose an alternative model of individual differences in grapheme-colour synaesthesia that emphasises the role of different spatial reference frames in synaesthetic perception. In doing so, we attempt to bring the synaesthesia literature closer to current models of non-synaesthetic perception, attention and binding.     

The neural basis of illusory gustatory sensations: two rare cases of lexical-gustatory synaesthesia

Lexical-gustatory synaesthesia is a rare phenomenon in which the individual experiences flavour sensations when they read, hear, or imagine words. In this study, we provide insight into the neural basis of this form of synaesthesia using functional neuroimaging. Words known to evoke pleasant, neutral, and unpleasant synaesthetic tastes and synaesthetically tasteless words were presented to two lexical-gustatory synaesthetes, during fMRI scanning. Ten non-synaesthetic participants were also scanned on the same list of words. The synaesthetic brain displayed a different pattern of activity to words when compared to the non-synaesthetes, with insula activation related to viewing words that elicited tastes that have an associated emotional valence (i.e., pleasant or unpleasant tastes). The subjective intensity of the synaesthesia was correlated with activity in the medial parietal lobes (precuneus/retrosplenial cortex), which are implicated in polymodal imagery and self-directed thought. This region has also previously been activated in studies of lexical-colour synaesthesia, suggesting its role may not be limited to the type of synaesthesia explored here.     

Out of sight,out of mind: The attentional blink can eliminate synaesthetic colours

Mechanisms of selective attention exert a powerful influence on visual perception. We examined whether attentional selection is necessary for generation of the vivid colours experienced by individuals with grapheme-colour synaesthesia. Twelve synaesthetes and matched controls viewed rapid serial displays of nonsense characters within which were embedded an oriented grating (T1) and a letter-prime (T2), forming a modified attentional blink (AB) task. At the end of the stream a coloured probe appeared that was either congruent or incongruent with the synaesthetic colour elicited by the letter-prime. When the prime was attended, synaesthetes showed a reliable effect of prime-probe congruency. In contrast, when the prime appeared at 350 ms following T1 (during the AB), the congruency effect was eliminated. Our findings suggest that focused attention is crucial for inducing letters to elicit colours in synaesthesia.     

Isolating automatic photism generation from strategic photism use in grapheme-colour synaesthesia

Grapheme-colour synaesthesia is a phenomenon in which ordinary black numbers and letters (graphemes) trigger the experience of highly specific colours (photisms). The Synaesthetic Stroop task has been used to demonstrate that graphemes trigger photisms automatically. In the standard Stroop task, congruent trial probability (CTP) has been manipulated to isolate effects of automaticity from higher-order strategic effects, with larger Stroop effects at high CTP attributed to participants strategically attending to the stimulus word to facilitate responding, and smaller Stroop effects at low CTP reflecting automatic word processing. Here we apply this logic for the first time to the Synaesthetic Stroop task. At high CTP we showed larger Stroop effects due to synaesthetes using their synaesthetic colours strategically. At low CTP Stroop effects were reduced but were still significant. We directly isolate automatic processing of graphemes from strategic effects and conclusively show that, in synaesthesia, viewing black graphemes automatically triggers colour experiences.     

Context-dependent effects of background colour in free recall with spatially grouped words

Three experiments investigated context-dependent effects of background colour in free recall with groups of items. Undergraduates (N=113) intentionally studied 24 words presented in blocks of 6 on a computer screen with two different background colours. The two background colours were changed screen-by-screen randomly (random condition) or alternately (alternation condition) during the study period. A 30-second filled retention interval was imposed before an oral free-recall test. A signal for free recall was presented throughout the test on one of the colour background screens presented at study. Recalled words were classified as same- or different-context words according to whether the background colours at study and test were the same or different. The random condition produced significant context-dependent effects, whereas the alternation condition showed no context-dependent effects, regardless of whether the words were presented once or twice. Furthermore, the words presented on the same screen were clustered in recall, whereas the words presented against the same background colour but on different screens were not clustered. The present results imply: (1) background colours can cue spatially massed words; (2) background colours act as temporally local context; and (3) predictability of the next background colour modulates the context-dependent effect.     

Psychophysiological evidence for the genuineness of swimming-style colour synaesthesia

Recently, swimming-style colour synaesthesia was introduced as a new form of synaesthesia. A synaesthetic Stroop test was used to establish its genuineness. Since Stroop interference can occur for any type of overlearned association, in the present study we used a modified Stroop test and psychophysiological synaesthetic conditioning to further establish the genuineness of this form of synaesthesia. We compared the performance of a swimming-style colour synaesthete and a control who was trained on swimming-style colour associations. Our results showed that behavioural aspects of swimming-style colour synaesthesia can be mimicked in a trained control. Importantly, however, our results showed a psychophysiological conditioning effect for the synaesthete only. We discuss the theoretical relevance of swimming-style colour synaesthesia according to different models of synaesthesia. We conclude that swimming-style colour synaesthesia is a genuine form of synaesthesia, can be mimicked behaviourally in non-synaesthetes, and is best explained by a re-entrant feedback model.     

Contingency learning without awareness: evidence for implicit control

The results of four experiments provide evidence for controlled processing in the absence of awareness. Participants identified the colour of a neutral distracter word. Each of four words (e.g., MOVE) was presented in one of the four colours 75% of the time (Experiments 1 and 4) or 50% of the time (Experiments 2 and 3). Colour identification was faster when the words appeared in the colour they were most often presented in relative to when they appeared in another colour, even for participants who were subjectively unaware of any contingencies between the words and the colours. An analysis of sequence effects showed that participants who were unaware of the relation between distracter words and colours nonetheless controlled the impact of the word on performance depending on the nature of the previous trial. A block analysis of contingency-unaware participants revealed that contingencies were learned rapidly in the first block of trials. Experiment 3 showed that the contingency effect does not depend on the level of awareness, thus ruling out explicit strategy accounts. Finally, Experiment 4 showed that the contingency effect results from behavioural control and not from semantic association or stimulus familiarity. These results thus provide evidence for implicit control.     

Biases and regularities of grapheme–colour associations in Japanese nonsynaesthetic population

Associations between graphemes and colours in a nonsynaesthetic Japanese population were investigated. Participants chose the most suitable colour from 11 basic colour terms for each of 40 graphemes from the four categories of graphemes used in the Japanese language (kana characters, English alphabet letters, and Arabic and kanji numerals). This test was repeated after a three-week interval. In their responses, which were not as temporally consistent as those of grapheme–colour synaesthetes, participants showed biases and regularities that were comparable to those of synaesthetes reported in past studies. Although it has been believed that only synaesthetes, and not nonsynaesthetes, tended to associate graphemes with colours based on grapheme frequency, Berlin and Kay's colour typology, and colour word frequency, participants in this study tended in part to associate graphemes with colours based on the above factors. Moreover, participants that were nonsynaesthetes tended to associate different graphemes that shared sounds and/or meanings (e.g., Arabic and kanji numerals representing the same number) with the same colours, which was analogous to the findings in Japanese synaesthetes. These results support the view that grapheme–colour synaesthesia might have its origins in cross-modal association processes that are shared with the general population.     

Flexibility over automaticity: Separable representations for colours and words

This study demonstrates that associations between colour words and the colours they denote are not mandatory. Experiments 1–3 used a go/no-go task in which participants responded to one print colour and one word and withheld response from another print colour and another word. In Experiment 1, the content of the words denoted noncolour entities. In Experiment 2 the two words denoted two colours that were different from the target print colours. In Experiment 3, the words denoted the same colours as the target print colours but each response set included incompatible print colour and word (e.g., one response to the print colour blue and the word “green” and another response to the print colour green and the word “blue”). Participants performed equally well in all the experiments. Experiment 4a used Arabic digits and words denoting numbers, two formats that are known to have shared representations. Here, participants had difficulties separating their responses to the digits and words. These results suggest that representations of words are distinct from the content that they represent, supporting the existence of distinct verbal and colour modules.     

Colored-Speech Synaesthesia Is Triggered by Multisensory, Not Unisensory, Perception

ABSTRACT— Although it is estimated that as many as 4% of people experience some form of enhanced cross talk between (or within) the senses, known as synaesthesia, very little is understood about the level of information processing required to induce a synaesthetic experience. In work presented here, we used a well-known multisensory illusion called the McGurk effect to show that synaesthesia is driven by late, perceptual processing, rather than early, unisensory processing. Specifically, we tested 9 linguistic-color synaesthetes and found that the colors induced by spoken words are related to what is perceived (i.e., the illusory combination of audio and visual inputs) and not to the auditory component alone. Our findings indicate that color-speech synaesthesia is triggered only when a significant amount of information processing has occurred and that early sensory activation is not directly linked to the synaesthetic experience.     

Grapheme–colour synaesthesia yields an ordinary rather than extraordinary memory advantage: Evidence from a group study

In synaesthesia, the input of one sensory modality automatically triggers an additional experience, not normally triggered by the input of that modality. Therefore, compared to non-synaesthetes, additional experiences exist and these may be used as retrieval cues when memory is tested. Previous case studies have suggested that synaesthesia may yield even extraordinary memory abilities. However, group studies found either a task-specific memory advantage or no performance advantage at all. The aim of the present study was to test whether grapheme–colour synaesthesia gives rise to a general memory benefit using a standardised memory test (Wechsler Memory Scale). The synaesthetes showed a performance advantage in episodic memory tests, but not in short-term memory tests. However, performance was still within the ordinary range. The results support the hypothesis that synaesthesia provides for a richer world of experience and as a consequence additional retrieval cues may be available and beneficial but not to the point of extraordinary memory ability.