Visuo-spatial representations of the alphabet in synaesthetes and non-synaesthetes

Visuo-spatial representations of the alphabet (so-called 'alphabet forms') may be as common as other types of sequence-space synaesthesia, but little is known about them or the way they relate to implicit spatial associations in the general population. In the first study, we describe the characteristics of a large sample of alphabet forms visualized by synaesthetes. They most often run from left to right and have salient features (e.g., bends, breaks) at particular points in the sequence that correspond to chunks in the 'Alphabet Song' and at the alphabet mid-point. The Alphabet Song chunking suggests that the visuo-spatial characteristics are derived, at least in part, from those of the verbal sequence learned earlier in life. However, these synaesthetes are no faster at locating points in the sequence (e.g., what comes before/after letter X?) than controls. They tend to be more spatially consistent (measured by eye tracking) and letters can act as attentional cues to left/right space in synaesthetes with alphabet forms (measured by saccades), but not in non-synaesthetes. This attentional cueing suggests dissociation between numbers (which reliably act as attentional cues in synaesthetes and non-synaesthetes) and letters (which act as attentional cues in synaesthetes only).     

Type-based associations in grapheme-color synaesthesia revealed by response time distribution analyses

Determining the nature of binding in grapheme-color synaesthesia has consequences for understanding the neural basis of synaesthesia and visual awareness in general. We evaluated type- and token-based letter-color binding using a synaesthetic version of the object-reviewing paradigm. Although mean response times failed to reveal any significant differences between synaesthetes and control participants, RT analyses with ex-Gaussian distributions revealed that the response facilitation in the synaesthesia group reflected type representations exclusively, while response facilitation in the control group, who learned letter-color associations, was dominated by token representations. Thus, letter-color associations in associator synaesthetes are type-based, and do not involve binding to object tokens, consistent with their subjective reports. Contrary to recent studies that failed to find differences between synaesthetes and non-synaesthetes with behavioral measures, response time distribution analyses indicate that color sensations in synaesthetes are not simply the extreme form of normal letter-color associations, and cannot be attributed to demand characteristics.     

Do children with grapheme-colour synaesthesia show cognitive benefits?

Grapheme-colour synaesthesia is characterized by conscious and consistent associations between letters and colours, or between numbers and colours (e.g., synaesthetes might see A as red, 7 as green). Our study explored the development of this condition in a group of randomly sampled child synaesthetes. Two previous studies (Simner & Bain, 2013, Frontiers in Human Neuroscience, 7, 603; Simner, Harrold, Creed, Monro, & Foulkes, 2009, Brain, 132, 57) had screened over 600 primary school children to find the first randomly sampled cohort of child synaesthetes. In this study, we evaluate this cohort to ask whether their synaesthesia is associated with a particular cognitive profile of strengths and/or weaknesses. We tested our child synaesthetes at age 10–11 years in a series of cognitive tests, in comparison with matched controls and baseline norms. One previous study (Green & Goswami, 2008, Cognition, 106, 463) had suggested that child synaesthetes might perform differently to non-synaesthetes in such tasks, although those participants may have been a special type of population independent of their synaesthesia. In our own study of randomly sampled child synaesthetes, we found no significant advantages or disadvantages in a receptive vocabulary test and a memory matrix task. However, we found that synaesthetes demonstrated above-average performance in a processing-speed task and a near-significant advantage in a letter-span task (i.e., memory/recall task of letters). Our findings point to advantages for synaesthetes that go beyond those expected from enhanced coding accounts and we present the first picture of the broader cognitive profile of a randomly sampled population of child synaesthetes.     

Handedness and calendar orientations in time-space synaesthesia

In one common variant of time-space synaesthesia, individuals report the consistent experience of months bound to a spatial arrangement, commonly described as a circle extending outside of the body. Whereas the layout of these calendars has previously been thought to be relatively random and to differ greatly between synaesthetes, Study 1 provides the first evidence suggesting one critical aspect of these calendars is mediated by handedness: clockwise versus counter-clockwise orientation. A study of 34 time-space synaesthetes revealed a strong association between handedness and the orientation of circular calendars. That is, left-handed time-space synaesthetes tended to report counter-clockwise arrangements and right-handed synaesthetes clockwise. Study 2 tested whether a similar bias was present in non-synaesthetes whose task was to memorize and recall the spatial configuration of a clockwise and counter-clockwise calendar. Non-synaesthetes' relative performance on these two sorts of calendars was significantly correlated with their handedness scores in a pattern similar to synaesthetes. Specifically, left-handed controls performed better on counter-clockwise calendars compared to clockwise, and right-handed controls on clockwise over counter-clockwise. We suggest that the implicit biases seen in controls are mediated by similar mechanisms as in synaesthesia, highlighting the graded nature of synaesthetic associations.     

Grapheme-color synaesthesia benefits rule-based Category learning

Researchers have long suspected that grapheme-color synaesthesia is useful, but research on its utility has so far focused primarily on episodic memory and perceptual discrimination. Here we ask whether it can be harnessed during rule-based Category learning. Participants learned through trial and error to classify grapheme pairs that were organized into categories on the basis of their associated synaesthetic colors. The performance of synaesthetes was similar to non-synaesthetes viewing graphemes that were physically colored in the same way. Specifically, synaesthetes learned to categorize stimuli effectively, they were able to transfer this learning to novel stimuli, and they falsely recognized grapheme-pair foils, all like non-synaesthetes viewing colored graphemes. These findings demonstrate that synaesthesia can be exploited when learning the kind of material taught in many classroom settings.     

Training synaesthesia

Synaesthetic inducers such as graphemes are typically cultural artifacts. Thus, a learning component seems evident in synaesthesia (Simner et al, 2009 Brain 132 57-64). Normally, synaesthetes report to have their experiences since they can remember. Nevertheless, a recent training study suggests that synaesthesia can be mimicked in non-synaesthetes. To date, the role of learning during the development of synaesthesia is still debated. It is not clear whether synaesthesia can be learned or trained at all. To address this question, we compared a non-adaptive and an adaptive training for their effectiveness. We assessed their impact on two types of priming tasks, before and after the training. We found stronger priming in the adaptive training group suggesting that adaptive training is more efficient to mimic synaesthesia.     

Searching for Shereshevskii: What is superior about the memory of synaesthetes?

Some individuals with superior memory, such as the mnemonist Shereshevskii (Luria, 1968), are known to have synaesthesia. However, the extent to which superior memory is a general characteristic of synaesthesia is unknown, as is the precise cognitive mechanism by which synaesthesia affects memory. This study demonstrates that synaesthetes tend to report subjectively better than average memory and that these reports are borne out with objective testing. Synaesthetes experiencing colours for words show better memory than matched controls for stimuli that induce synaesthesia (word lists) relative to stimuli that do not (an abstract figure). However, memory advantages are not limited to material that elicits synaesthesia because synaesthetes demonstrate enhanced memory for colour per se (which does not induce a synaesthetic response). Our results suggest that the memory enhancement found in synaesthetes is related to an enhanced retention of colour in both synaesthetic and nonsynaesthetic situations. Furthermore, this may account for the fact that synaesthetic associations, once formed, remain highly consistent.     

Searching for Shereshevskii: what is superior about the memory of synaesthetes?

Some individuals with superior memory, such as the mnemonist Shereshevskii (Luria, 1968), are known to have synaesthesia. However, the extent to which superior memory is a general characteristic of synaesthesia is unknown, as is the precise cognitive mechanism by which synaesthesia affects memory. This study demonstrates that synaesthetes tend to report subjectively better than average memory and that these reports are borne out with objective testing. Synaesthetes experiencing colours for words show better memory than matched controls for stimuli that induce synaesthesia (word lists) relative to stimuli that do not (an abstract figure). However, memory advantages are not limited to material that elicits synaesthesia because synaesthetes demonstrate enhanced memory for colour per se (which does not induce a synaesthetic response). Our results suggest that the memory enhancement found in synaesthetes is related to an enhanced retention of colour in both synaesthetic and nonsynaesthetic situations. Furthermore, this may account for the fact that synaesthetic associations, once formed, remain highly consistent.     

A systematic, large-scale study of synaesthesia: implications for the role of early experience in lexical-colour associations

For individuals with synaesthesia, stimuli in one sensory modality elicit anomalous experiences in another modality. For example, the sound of a particular piano note may be 'seen' as a unique colour, or the taste of a familiar food may be 'felt' as a distinct bodily sensation. We report a study of 192 adult synaesthetes, in which we administered a structured questionnaire to determine the relative frequency and characteristics of different types of synaesthetic experience. Our data suggest the prevalence of synaesthesia in the adult population is approximately 1 in 1150 females and 1 in 7150 males. The incidence of left-handedness in our sample was within the normal range, contrary to previous claims. We did, however, find that synaesthetes are more likely to be involved in artistic pursuits, consistent with anecdotal reports. We also examined responses from a subset of 150 synaesthetes for whom letters, digits and words induce colour experiences ('lexical-colour' synaesthesia). There was a striking consistency in the colours induced by certain letters and digits in these individuals. For example, 'R' elicited red for 36% of the sample, 'Y' elicited yellow for 45%, and 'D' elicited brown for 47%. Similar trends were apparent for a group of non-synaesthetic controls who were asked to associate colours with letters and digits. Based on these findings, we suggest that the development of lexical-colour synaesthesia in many cases incorporates early learning experiences common to all individuals. Moreover, many of our synaesthetes experienced colours only for days of the week, letters or digits, suggesting that inducers that are part of a conventional sequence (e.g. Monday, Tuesday, Wednesday...; A, B, C...; 1, 2, 3...) may be particularly important in the development of synaesthetic inducer-colour pairs. We speculate that the learning of such sequences during an early critical period determines the particular pattern of lexical-colour links, and that this pattern then generalises to other words.     

A strong parietal hub in the small-world network of coloured-hearing synaesthetes during resting state EEG

We investigated whether functional brain networks are different in coloured-hearing synaesthetes compared with non-synaesthetes. Based on resting state electroencephalographic (EEG) activity, graph-theoretical analysis was applied to functional connectivity data obtained from different frequency bands (theta, alpha1, alpha2, and beta) of 12 coloured-hearing synaesthetes and 13 non-synaesthetes. The analysis of functional connectivity was based on estimated intra-cerebral sources of brain activation using standardized low-resolution electrical tomography. These intra-cerebral sources of brain activity were subjected to graph-theoretical analysis yielding measures representing small-world network characteristics (cluster coefficients and path length). In addition, brain regions with strong interconnections were identified (so-called hubs), and the interconnectedness of these hubs were quantified using degree as a measure of connectedness. Our analysis was guided by the two-stage model proposed by Hubbard and Ramachandran (2005). In this model, the parietal lobe is thought to play a pivotal role in binding together the synaesthetic perceptions (hyperbinding). In addition, we hypothesized that the auditory cortex and the fusiform gyrus would qualify as strong hubs in synaesthetes. Although synaesthetes and non-synaesthetes demonstrated a similar small-world network topology, the parietal lobe turned out to be a stronger hub in synaesthetes than in non-synaesthetes supporting the two-stage model. The auditory cortex was also identified as a strong hub in these coloured-hearing synaesthetes (for the alpha2 band). Thus, our a priori hypotheses receive strong support. Several additional hubs (for which no a priori hypothesis has been formulated) were found to be different in terms of the degree measure in synaesthetes, with synaesthetes demonstrating stronger degree measures indicating stronger interconnectedness. These hubs were found in brain areas known to be involved in controlling memory processes (alpha1: hippocampus and retrosplenial area), executive functions (alpha1 and alpha2: ventrolateral prefrontal cortex; theta: inferior frontal cortex), and the generation of perceptions (theta: extrastriate cortex; beta: subcentral area). Taken together this graph-theoretical analysis of the resting state EEG supports the two-stage model in demonstrating that the left-sided parietal lobe is a strong hub region, which is stronger functionally interconnected in synaesthetes than in non-synaesthetes. The right-sided auditory cortex is also a strong hub supporting the idea that coloured-hearing synaesthetes demonstrate a specific auditory cortex. A further important point is that these hub regions are even differently operating at rest supporting the idea that these hub characteristics are predetermining factors of coloured-hearing synaesthesia.     

Familial patterns and the origins of individual differences in synaesthesia

The term synaesthesia has been applied to a range of different sensory-perceptual and cognitive experiences, yet how these experiences are related to each other is not well understood. Not only are there disparate types of synaesthesia, but even within types there are vast individual differences in the way that stimuli induce synaesthesia and in the subjective synaesthetic experience. An investigation of the inheritance patterns of different types of synaesthesia is likely to elucidate whether a single underlying mechanism can explain all types. This study is the first to systematically survey all types of synaesthesia within a familial framework. We recruited 53 synaesthetes and 42% of these probands reported a first-degree relative with synaesthesia. We then directly contacted as many first-degree relatives as possible and collected complete data on synaesthetic status for all family members for 17 families. We found that different types of synaesthesia can occur within the same family and that the qualitative nature of the experience can differ between family members. Our findings strongly indicate that various types of synaesthesia are fundamentally related at the genetic level, but that the explicit associations and the individual differences between synaesthetes are influenced by other factors. Synaesthesia thus provides a good model to explore the interplay of all these factors in the development of cognitive traits in general.     

The aesthetic appeal of auditory-visual synaesthetic perceptions in people without synaesthesia

The term 'visual music' refers to works of art in which both hearing and vision are directly or indirectly stimulated. Our ability to create, perceive, and appreciate visual music is hypothesised to rely on the same multisensory processes that support auditory visual (AV) integration in other contexts. Whilst these mechanisms have been extensively studied, there has been little research on how these processes affect aesthetic judgments (of liking or preference). Studies of synaesthesia in which sound evokes vision and studies of cross-modal biases in non-synaesthetes have revealed non-arbitrary mappings between visual and auditory properties (eg high-pitch sounds being smaller and brighter). In three experiments, we presented members of the general population with animated AV clips derived from synaesthetic experiences and contrasted them with a number of control conditions. The control conditions consisted of the same clips rotated or with the colour changed, random AV pairings, or animated clips generated by non-synaesthetes. Synaesthetic AV animations were generally preferred over the control conditions. The results suggest that non-arbitrary AV mappings, present in the experiences of synaesthetes, can be readily appreciated by others and may underpin our tendency to engage with certain forms of art.     

Grapheme–colour synaesthesia yields an ordinary rather than extraordinary memory advantage: Evidence from a group study

In synaesthesia, the input of one sensory modality automatically triggers an additional experience, not normally triggered by the input of that modality. Therefore, compared to non-synaesthetes, additional experiences exist and these may be used as retrieval cues when memory is tested. Previous case studies have suggested that synaesthesia may yield even extraordinary memory abilities. However, group studies found either a task-specific memory advantage or no performance advantage at all. The aim of the present study was to test whether grapheme–colour synaesthesia gives rise to a general memory benefit using a standardised memory test (Wechsler Memory Scale). The synaesthetes showed a performance advantage in episodic memory tests, but not in short-term memory tests. However, performance was still within the ordinary range. The results support the hypothesis that synaesthesia provides for a richer world of experience and as a consequence additional retrieval cues may be available and beneficial but not to the point of extraordinary memory ability.     

Is there a burden attached to synaesthesia? Health screening of synaesthetes in the general population

Synaesthesia has long been considered a benign alternative form of perception most often associated with positive rather than negative outcomes. The condition has been associated with a variety of cognitive and perceptual advantages, including benefits in memory, processing speed, and creativity. It is not currently recognized in the DSM‐IV. Recently, however, several studies have raised the question of a possible link between synaesthesia and clinical conditions. Here, we present the first large‐scale screening of the general population in which we (1) objectively identified grapheme‐colour synaesthetes and (2) elicited information from our participants about a range of clinical conditions. We compared the prevalence rates of these conditions in synaesthetes versus non‐synaesthetes to establish whether any conditions were found at a higher rate among synaesthetes. In our initial study, screening 3,742 people (95 synaesthetes and 3,647 controls), we found initially that grapheme‐colour was significantly comorbid with two conditions (anxiety disorder and obsessive compulsive disorder). In our second study, screening a new population of 120 synaesthetes and 166 non‐synaesthetes, we replicated our finding that grapheme‐colour synaesthesia is comorbid with anxiety disorder. At the same time, we also addressed a methodological concern that likely elevated rates of OCD in Study 1. We consider the aetiology of synaesthesia to determine whether there may be a shared genetic or neurological basis with anxiety disorder, and we question the status of synaesthesia within a mental health framework.     

Synaesthesia,creativity and art: What is the link?

It has been suggested that individuals with synaesthesia may show heightened creativity as a result of being able to form meaningful associations between disparate stimuli (e.g. colour, sound). In this study, a large sample (N=82) of people with various kinds of synaesthesia were given two psychometric tests of creativity (Remote Associates Test, Alternate Uses Test) and were also asked about the amount of time engaged in creative arts (visual art, music). There was a significant tendency for synaesthetes to spend more time engaged in creative arts and this was, at least in part, dependent upon the type of synaesthesia experienced. For example, synaesthetes experiencing vision from music were far more likely to play an instrument than their other synaesthetic counterparts. There was no relationship between this tendency and the psychometric measures of creativity, but synaesthetes did outperform controls on one of the two psychometric measures (Remote Associates). We conclude that the tendency for synaesthetes to be more engaged in art is likely to have a different mechanism to psychometric measures of creativity, and that there is no direct link between them. Although synaesthetes may well perform better on some measures of creativity, we suggest that synaesthetes have better bottom‐up access to certain associations, but are not necessarily better able to use them flexibly (in divergent thinking).     

Development of synaesthetic consistency: Repeated autonomous engagement with graphemes and colours leads to consistent associations

Synaesthetic consistency is the hallmark of synaesthesia and plays an important role in the definition and validation of synaesthesia. It has been hypothesised that the acquisition of initially unspecified synaesthetic associations is based on consolidation processes. Thus, we investigated in non-synaesthetes whether repeatedly engaging with grapheme-colour associations mimics the developmental trajectory of synaesthetic consistency in genuine grapheme-colour synaesthesia. This was the case for the two tested experimental groups, irrespective of whether they were instructed to memorize their chosen associations, but not for the passive control group. Moreover, consolidated associations of the experimental groups resembled those frequently found in genuine synaesthesia. Furthermore, the acquisition of consistent grapheme-colour associations resulted in a transfer of benefits to performance in recognition memory for abstract stimuli, as also found in genuine synaesthesia. Our findings suggest that consistent synaesthetic associations are based on consolidation processes due to repeated engagement with graphemes and colours.     

Do sequence-space synaesthetes have better spatial imagery skills? Maybe not

Sequence-space synaesthesia is a type of visuo-spatial imagery in which numbers or calendar units are experienced to occupy locations in space. Previous studies have claimed that these synaesthetes (1) have stronger self-reported visual (but not spatial) imagery and (2) perform unusually well on mental rotation tasks that are usually taken to reflect spatial (but not visual) imagery. To further investigate whether this form of synaesthesia is related to spatial imagery, we compared synaesthetes to controls on the Object Spatial Imagery Questionnaire, a paper folding test and a mental rotation task. The synaesthetes did not differ from controls in self-reported spatial imagery, but showed a strong trend to report better visual imagery, replicating previously reported data patterns. Consistent with this, their paper folding and mental rotation performance was no better than controls. We also confirmed that, in our pooled sample, performance on both these tasks was positively correlated with self-reported spatial imagery. We suggest our data are more consistent with the view that sequence-space synaesthesia is related to visual than to spatial imagery, and we suggest reasons why previous studies may have found superior mental rotation performance.     

The neural basis of illusory gustatory sensations: two rare cases of lexical-gustatory synaesthesia

Lexical-gustatory synaesthesia is a rare phenomenon in which the individual experiences flavour sensations when they read, hear, or imagine words. In this study, we provide insight into the neural basis of this form of synaesthesia using functional neuroimaging. Words known to evoke pleasant, neutral, and unpleasant synaesthetic tastes and synaesthetically tasteless words were presented to two lexical-gustatory synaesthetes, during fMRI scanning. Ten non-synaesthetic participants were also scanned on the same list of words. The synaesthetic brain displayed a different pattern of activity to words when compared to the non-synaesthetes, with insula activation related to viewing words that elicited tastes that have an associated emotional valence (i.e., pleasant or unpleasant tastes). The subjective intensity of the synaesthesia was correlated with activity in the medial parietal lobes (precuneus/retrosplenial cortex), which are implicated in polymodal imagery and self-directed thought. This region has also previously been activated in studies of lexical-colour synaesthesia, suggesting its role may not be limited to the type of synaesthesia explored here.     

An exploratory study of linguistic–colour associations across languages in multilingual synaesthetes

In one of the most common forms of synaesthesia, linguistic–colour synaesthesia, colour is induced by stimuli such as numbers, letters, days of the week, and months of the year. It is not clear, however, whether linguistic–colour synaesthesia is determined more by higher level semantic information—that is, word meaning—or by lower level grapheme or phoneme structure. To explore this issue, we tested whether colour is consistently induced by grapheme or phoneme form or word meaning in bilingual and trilingual linguistic–colour synaesthetes. We reasoned that if the induced colour was related to word meaning, rather than to the acoustic or visual properties of the words, then the induced colours would remain consistent across languages. We found that colours were not consistently related to word meaning across languages. Instead, induced colours were more related to form properties of the word across languages, particularly visual structure. However, the type of inducing stimulus influenced specific colour associations. For example, colours to months of the year were more consistent across languages than were colours to numbers or days of the week. Furthermore, the effect of inducing stimuli was also associated with the age of acquisition of additional languages. Our findings are discussed with reference to a critical period in language acquisition on synaesthesia.     

Biases and regularities of grapheme–colour associations in Japanese nonsynaesthetic population

Associations between graphemes and colours in a nonsynaesthetic Japanese population were investigated. Participants chose the most suitable colour from 11 basic colour terms for each of 40 graphemes from the four categories of graphemes used in the Japanese language (kana characters, English alphabet letters, and Arabic and kanji numerals). This test was repeated after a three-week interval. In their responses, which were not as temporally consistent as those of grapheme–colour synaesthetes, participants showed biases and regularities that were comparable to those of synaesthetes reported in past studies. Although it has been believed that only synaesthetes, and not nonsynaesthetes, tended to associate graphemes with colours based on grapheme frequency, Berlin and Kay's colour typology, and colour word frequency, participants in this study tended in part to associate graphemes with colours based on the above factors. Moreover, participants that were nonsynaesthetes tended to associate different graphemes that shared sounds and/or meanings (e.g., Arabic and kanji numerals representing the same number) with the same colours, which was analogous to the findings in Japanese synaesthetes. These results support the view that grapheme–colour synaesthesia might have its origins in cross-modal association processes that are shared with the general population.