Mental imagery and synaesthesia: Is synaesthesia from internally-generated stimuli possible?

Previous studies provide empirical support for the reported colour experience in grapheme-colour synaesthesia by measuring the synaesthetic experience from an externally presented grapheme. The current study explored the synaesthetic experience resulting from a visual mental image of a grapheme. Grapheme-colour synaesthetes (N=6) and matched controls (N=10 per synaesthete) completed a visual mental imagery task that involved visualising a letter and making a size-based decision about it. The background colour that the grapheme was visualised against was manipulated so that it was congruent or incongruent with the synaesthetic colour for the grapheme being visualised. Compared to matched controls, an effect of colour condition was found for four of the six synaesthetes, although importantly the direction of the effect varied between synaesthetes. In addition, a significant effect of group was found, as the synaesthetes were all faster than the matched controls at the imagery task, regardless of background colour. We conclude that there is some support for subjective reports of imagery-induced synaesthesia, but there are important individual differences. These findings are discussed in relation to both the visual imagery and synaesthesia literature.     

Synaesthetic perception of colour and visual space in a blind subject: an fMRI case study

In spatial sequence synaesthesia (SSS) ordinal stimuli are perceived as arranged in peripersonal space. Using fMRI, we examined the neural bases of SSS and colour synaesthesia for spoken words in a late-blind synaesthete, JF. He reported days of the week and months of the year as both coloured and spatially ordered in peripersonal space; parts of the days and festivities of the year were spatially ordered but uncoloured. Words that denote time-units and triggered no concurrents were used in a control condition. Both conditions inducing SSS activated the occipito-parietal, infero-frontal and insular cortex. The colour area hOC4v was engaged when the synaesthetic experience included colour. These results confirm the continued recruitment of visual colour cortex in this late-blind synaesthetes. Synaesthesia also involved activation in inferior frontal cortex, which may be related to spatial memory and detection, and in the insula, which might contribute to audiovisual integration related to the processing of inducers and concurrents.     

Congruence or coherence? Emotional and physiological responses to colours in synaesthesia

Lexical–chromatic synaesthesia is a condition in which letters and/or words elicit percepts of synaesthetic colours, termed photisms. Anecdotal data suggest that synaesthetes are particularly sensitive to inconsistencies between their synaesthetic percepts and the real world, e.g., it can be annoying and unpleasant for them to see a letter printed in a colour different than the respective photism colour. For R, a synaesthete subject who participated in the present study, the photisms possess specific emotional values (a red photism is pleasing and attractive, green is repulsive and unpleasant, etc.). In contrast to the anecdotal data, R does not always find the colour–photism incongruence to be disturbing. More importantly, he states that it is the emotional coherence between the stimulus and the corresponding photism that matters. In a series of experiments, we studied this new concept of emotional coherence on three levels—subjective (self-report), behavioural, and physiological, corroborating R's introspective statements. Besides the implications of the concept of coherence itself, the results presented here suggest that even highly subjective cognitive constructs can be approached and measured experimentally, uncovering the workings of the underlying psychophysiological mechanisms.     

Colours sometimes count: Awareness and bidirectionality in grapheme–colour synaesthesia

Three experiments were conducted with 10 grapheme–colour synaesthetes and 10 matched controls to investigate (a) whether awareness of the inducer grapheme is necessary for synaesthetic colour induction and (b) whether grapheme–colour synaesthesia may be bidirectional in the sense that not only do graphemes induce colours, but that colours influence the processing of graphemes. Using attentional blink and Stroop paradigms with digit targets, we found that some synaesthetes did report “seeing” synaesthetic colours even when they were not able to report the inducing digit. Moreover, congruency effects (effects of matching the colour of digit presentation with the synaesthetic colour associated with that digit) suggested that grapheme–colour synaesthesia can be bidirectional, at least for some synaesthetes.     

Colours sometimes count: awareness and bidirectionality in grapheme-colour synaesthesia

Three experiments were conducted with 10 grapheme-colour synaesthetes and 10 matched controls to investigate (a) whether awareness of the inducer grapheme is necessary for synaesthetic colour induction and (b) whether grapheme-colour synaesthesia may be bidirectional in the sense that not only do graphemes induce colours, but that colours influence the processing of graphemes. Using attentional blink and Stroop paradigms with digit targets, we found that some synaesthetes did report “seeing” synaesthetic colours even when they were not able to report the inducing digit. Moreover, congruency effects (effects of matching the colour of digit presentation with the synaesthetic colour associated with that digit) suggested that grapheme-colour synaesthesia can be bidirectional, at least for some synaesthetes.     

Isolating automatic photism generation from strategic photism use in grapheme-colour synaesthesia

Grapheme-colour synaesthesia is a phenomenon in which ordinary black numbers and letters (graphemes) trigger the experience of highly specific colours (photisms). The Synaesthetic Stroop task has been used to demonstrate that graphemes trigger photisms automatically. In the standard Stroop task, congruent trial probability (CTP) has been manipulated to isolate effects of automaticity from higher-order strategic effects, with larger Stroop effects at high CTP attributed to participants strategically attending to the stimulus word to facilitate responding, and smaller Stroop effects at low CTP reflecting automatic word processing. Here we apply this logic for the first time to the Synaesthetic Stroop task. At high CTP we showed larger Stroop effects due to synaesthetes using their synaesthetic colours strategically. At low CTP Stroop effects were reduced but were still significant. We directly isolate automatic processing of graphemes from strategic effects and conclusively show that, in synaesthesia, viewing black graphemes automatically triggers colour experiences.     

Color opponency in synaesthetic experiences

Grapheme-color synaesthesia is a rare condition in which perception of a letter or a digit is associated with concurrent perception of a color. Synaesthetes report that these color experiences are vivid and realistic. We used a Stroop task to show that synaesthetically induced color, like real color, is processed in color-opponent channels (red-green or blue-yellow). Synaesthetic color produced maximal interference with the perception and naming of the real color of a grapheme if the real color was opponent to the synaesthetic color. Interference was reduced considerably if the synaesthetic and real colors engaged different color channels (e.g., synaesthetic blue and real red). No dependence on color opponency was found for semantic conflicts between shape and color (e.g., a blue lemon). Thus, the neural representation of synaesthetic colors closely resembles that of real colors. This suggests involvement of early stages of visual processing in color synaesthesia and explains the vivid and realistic nature of synaesthetic experiences.     

Brain areas involved in synaesthesia: a review

Despite a recent upsurge of research, much remains unknown about the neurobiological mechanisms underlying synaesthesia. By integrating results obtained so far in Magnetic Resonance Imaging (MRI) studies, this contribution sheds light on the role of particular brain regions in synaesthetic experiences. First, in accordance with its sensory nature, it seems that the sensory brain areas corresponding to the type of synaesthetic experience are activated. Synaesthetic colour experiences can activate colour regions in occipito-temporal cortex, but this is not necessarily restricted to V4. Furthermore, sensory and motor brain regions have been obtained that extend beyond the particular type of synaesthesia studied. Second, differences in experimental setup, number and type of synaesthetes tested, and method to delineate regions of interest may help explain inconsistent results obtained in the BOLD-MRI (Blood Oxygen Level Dependent functional MRI) studies. Third, an overview of obtained results shows that a network of brain areas rather than a single brain region underlies synaesthesia. Six brain regions of overlapping results emerge, these regions are in sensory and motor regions as well as 'higher level' regions in parietal and frontal lobe. We propose that these regions are related to three different cognitive processes inherently part of synaesthesia; the sensory processes, the (attentional) 'binding' processes, and cognitive control processes. Finally, we discuss how these functional and structural brain properties might relate to the development of synaesthesia. In particular, we believe this relationship is better understood by separating the question what underlies the presence of synaesthesia ('trait') from what determines particular synaesthetic associations ('type').     

Searching for Shereshevskii: what is superior about the memory of synaesthetes?

Some individuals with superior memory, such as the mnemonist Shereshevskii (Luria, 1968), are known to have synaesthesia. However, the extent to which superior memory is a general characteristic of synaesthesia is unknown, as is the precise cognitive mechanism by which synaesthesia affects memory. This study demonstrates that synaesthetes tend to report subjectively better than average memory and that these reports are borne out with objective testing. Synaesthetes experiencing colours for words show better memory than matched controls for stimuli that induce synaesthesia (word lists) relative to stimuli that do not (an abstract figure). However, memory advantages are not limited to material that elicits synaesthesia because synaesthetes demonstrate enhanced memory for colour per se (which does not induce a synaesthetic response). Our results suggest that the memory enhancement found in synaesthetes is related to an enhanced retention of colour in both synaesthetic and nonsynaesthetic situations. Furthermore, this may account for the fact that synaesthetic associations, once formed, remain highly consistent.     

Searching for Shereshevskii: What is superior about the memory of synaesthetes?

Some individuals with superior memory, such as the mnemonist Shereshevskii (Luria, 1968), are known to have synaesthesia. However, the extent to which superior memory is a general characteristic of synaesthesia is unknown, as is the precise cognitive mechanism by which synaesthesia affects memory. This study demonstrates that synaesthetes tend to report subjectively better than average memory and that these reports are borne out with objective testing. Synaesthetes experiencing colours for words show better memory than matched controls for stimuli that induce synaesthesia (word lists) relative to stimuli that do not (an abstract figure). However, memory advantages are not limited to material that elicits synaesthesia because synaesthetes demonstrate enhanced memory for colour per se (which does not induce a synaesthetic response). Our results suggest that the memory enhancement found in synaesthetes is related to an enhanced retention of colour in both synaesthetic and nonsynaesthetic situations. Furthermore, this may account for the fact that synaesthetic associations, once formed, remain highly consistent.     

What is the relationship between synaesthesia and visuo-spatial number forms?

This study compares the tendency for numerals to elicit spontaneous perceptions of colour or taste (synaesthesia) with the tendency to visualise numbers as occupying particular visuo-spatial configurations (number forms). The prevalence of number forms was found to be significantly higher in synaesthetes experiencing colour compared both to synaesthetes experiencing taste and to control participants lacking any synaesthetic experience. This suggests that the presence of synaesthetic colour sensations enhances the tendency to explicitly represent numbers in a visuo-spatial format although the two symptoms may nevertheless be logically independent (i.e. it is possible to have number forms without colour, and coloured numbers without forms). Number forms are equally common in men and women, unlike previous reports of synaesthesia that have suggested a strong female bias. Individuals who possess a number form are also likely to possess visuo-spatial forms for other ordinal sequences (e.g. days, months, letters) which suggests that it is the ordinal nature of numbers rather than numerical quantity that gives rise to this particular mode of representation. Finally, we also describe some consequences of number forms for performance in a number comparison task.     

The cross-activation theory at 10

In 2001, Ramachandran and Hubbard introduced the cross-activation model of grapheme-colour synaesthesia. On the occasion of its 10-year anniversary, we review the evidence from experiments that have been conducted to test the model to assess how it has fared. We examine data from behavioural, functional magnetic resonance imaging (fMRI), anatomical studies (diffusion tensor imaging and voxel-based morphometry), and electroencephalography (EEG) and magnetoencephalography (MEG) studies of grapheme-colour synaesthesia. Although much of this evidence has supported the basic cross-activation hypothesis, our growing knowledge of the neural basis of synaesthesia, grapheme, and colour processing has necessitated two specific updates and modifications to the basic model: (1) our original model assumed that binding and parietal cortex functions were normal in synaesthesia; we now recognize that parietal cortex plays a key role in synaesthetic binding, as part of a two-stage model. (2) Based on MEG data we have recently collected demonstrating that synaesthetic responses begin within 140 ms of stimulus presentation, and an updated understanding of the neural mechanisms of reading as hierarchical feature extraction, we present a revised and updated version of the cross-activation model, the cascaded cross-tuning model. We then summarize data demonstrating that the cross-activation model may be extended to account for other forms of synaesthesia and discuss open questions about how learning, development, and cortical plasticity interact with genetic factors to lead to the full range of synaesthetic experiences. Finally, we outline a number of future directions needed to further test the cross-activation theory and to compare it with alternative theories.     

Synaesthetic photisms guide attention

We evaluated whether synaesthetic colour experiences (i.e., photisms) guide or attract attention. An alphanumeric-colour synaesthete, J, and seven non-synaesthetes searched for target digits presented against backgrounds that were either congruent or incongruent with the colours of J's photisms for the target digits. For J, the slope of the search function for detecting the target digits on incongruent trials was shallower than the slope of the search function for detecting the target digits on congruent trials. In contrast, for the seven non-synaesthetes, the slopes of the search functions for detecting the target digits on congruent and incongruent trials were equivalent. These findings suggest that synaesthetic colour experiences influence the efficiency of visual search by guiding or attracting attention.     

Colour fluctuations in grapheme‐colour synaesthesia: The effect of clinical and non‐clinical mood changes

Synaesthesia is a condition that gives rise to unusual secondary sensations (e.g., colours are perceived when listening to music). These unusual sensations tend to be reported as being stable throughout adulthood (e.g., Simner & Logie, 2007, Neurocase, 13, 358) and the consistency of these experiences over time is taken as the behavioural hallmark of genuineness. Our study looked at the influence of mood states on synaesthetic colours. In Experiment 1, we recruited grapheme‐colour synaesthetes (who experience colours from letters/digits) and elicited their synaesthetic colours, as well as their mood and depression states, in two different testing sessions. In each session, participants completed the PANAS‐X (Watson & Clark, 1999) and the BDI‐II (Beck, Steer, & Brown, 1996, Manual for Beck Depression Inventory‐II), and chose their synaesthetic colours for letters A‐Z from an interactive colour palette. We found that negative mood significantly decreased the luminance of synaesthetic colours. In Experiment 2, we showed that synaesthetic colours were also less luminant for synaesthetes with anxiety disorder, versus those without. Additional evidence suggests that colour saturation, too, may inversely correlate with depressive symptoms. These results show that fluctuations in mood within both a normal and clinical range influence synaesthetic colours over time. This has implications for our understanding about the longitudinal stability of synaesthetic experiences, and of how mood may interact with the visual (imagery) systems.     

Development of synaesthetic consistency: Repeated autonomous engagement with graphemes and colours leads to consistent associations

Synaesthetic consistency is the hallmark of synaesthesia and plays an important role in the definition and validation of synaesthesia. It has been hypothesised that the acquisition of initially unspecified synaesthetic associations is based on consolidation processes. Thus, we investigated in non-synaesthetes whether repeatedly engaging with grapheme-colour associations mimics the developmental trajectory of synaesthetic consistency in genuine grapheme-colour synaesthesia. This was the case for the two tested experimental groups, irrespective of whether they were instructed to memorize their chosen associations, but not for the passive control group. Moreover, consolidated associations of the experimental groups resembled those frequently found in genuine synaesthesia. Furthermore, the acquisition of consistent grapheme-colour associations resulted in a transfer of benefits to performance in recognition memory for abstract stimuli, as also found in genuine synaesthesia. Our findings suggest that consistent synaesthetic associations are based on consolidation processes due to repeated engagement with graphemes and colours.     

Not all synaesthetes are created equal: Projector versus associator synaesthetes

In synaesthesia, ordinary stimuli elicit extraordinary experiences. When grapheme-color synaesthetes view black text, each grapheme elicits a photism-a highly specific experience of color. Importantly, some synaesthetes (projectors) report experiencing their photisms in external space, whereas other synaesthetes (associators) report experiencing their photisms "in the mind's eye." We showed that projectors and associators can be differentiated not only by their subjective reports, but also by their performance on Stroop tasks. Digits were presented in colors that were either congruent or incongruent with the synaesthetes' photisms. The synaesthetes named either the video colors of the digits or the colors of the photisms elicited by the digits. The results revealed systematic differences in the patterns of Stroop interference between projectors and associators. Converging evidence from first-person reports and third-person objective measures of Stroop interference establish the projector/ associator distinction as an important individual difference in grapheme-color synaesthesia.     

Seeing double: the role of meaning in alphanumeric-colour synaesthesia

When PD, an alphanumeric-colour synaesthete, is shown black digits or letters, each grapheme elicits a highly specific colour, called a "photism" (e.g., a 2 induces green, a Z induces brown). Previous experiments showed that photisms interfere with video-colour naming when the photism colour and the video colour are incongruent. Here we used coloured ambiguous graphemes that could be interpreted as either digits or letters depending on context (e.g., an ambiguous grapheme was interpreted as a 2 if presented within a block of digit trials, but as a Z if presented within a block of letter trials). Ambiguous graphemes were presented in video colours that were either congruent or incongruent with PD's photisms. Crucially, what was a congruent trial in one context was an incongruent trial in the other context. PD's pattern of response times indicated that identical graphemes could induce differently coloured photisms depending on their interpretation. This suggests that the meaning of graphemes ultimately determines their synaesthetic colour.     

Familial patterns and the origins of individual differences in synaesthesia

The term synaesthesia has been applied to a range of different sensory-perceptual and cognitive experiences, yet how these experiences are related to each other is not well understood. Not only are there disparate types of synaesthesia, but even within types there are vast individual differences in the way that stimuli induce synaesthesia and in the subjective synaesthetic experience. An investigation of the inheritance patterns of different types of synaesthesia is likely to elucidate whether a single underlying mechanism can explain all types. This study is the first to systematically survey all types of synaesthesia within a familial framework. We recruited 53 synaesthetes and 42% of these probands reported a first-degree relative with synaesthesia. We then directly contacted as many first-degree relatives as possible and collected complete data on synaesthetic status for all family members for 17 families. We found that different types of synaesthesia can occur within the same family and that the qualitative nature of the experience can differ between family members. Our findings strongly indicate that various types of synaesthesia are fundamentally related at the genetic level, but that the explicit associations and the individual differences between synaesthetes are influenced by other factors. Synaesthesia thus provides a good model to explore the interplay of all these factors in the development of cognitive traits in general.     

What is the relationship between Aphantasia,Synaesthesia and Autism?

For people with aphantasia, visual imagery is absent or markedly impaired. Here, we investigated the relationship between aphantasia and two other neurodevelopmental conditions also linked to imagery differences: synaesthesia, and autism. In Experiment 1a and 1b, we asked whether aphantasia and synaesthesia can co-occur, an important question given that synaesthesia is linked to strong imagery. Taking grapheme-colour synaesthesia as a test case, we found that synaesthesia can be objectively diagnosed in aphantasics, suggesting visual imagery is not necessary for synaesthesia to occur. However, aphantasia influenced the type of synaesthesia experienced (favouring ‘associator’ over ‘projector’ synaesthesia - a distinction tied to the phenomenology of the synaesthetic experience). In Experiment 2, we asked whether aphantasics have traits associated with autism, an important question given that autism – like aphantasia – is linked to weak imagery. We found that aphantasics reported more autistic traits than controls, with weaknesses in imagination and social skills.