Musical space synesthesia: Automatic,explicit and conceptual connections between musical stimuli and space

In musical–space synesthesia, musical pitches are perceived as having a spatially defined array. Previous studies showed that symbolic inducers (e.g., numbers, months) can modulate response according to the inducer’s relative position on the synesthetic spatial form. In the current study we tested two musical–space synesthetes and a group of matched controls on three different tasks: musical–space mapping, spatial cue detection and a spatial Stroop-like task. In the free mapping task, both synesthetes exhibited a diagonal organization of musical pitch tones rising from bottom left to the top right. This organization was found to be consistent over time. In the subsequent tasks, synesthetes were asked to ignore an auditory or visually presented musical pitch (irrelevant information) and respond to a visual target (i.e., an asterisk) on the screen (relevant information). Compatibility between musical pitch and the target’s spatial location was manipulated to be compatible or incompatible with the synesthetes’ spatial representations. In the spatial cue detection task participants had to press the space key immediately upon detecting the target. In the Stroop-like task, they had to reach the target by using a mouse cursor. In both tasks, synesthetes’ performance was modulated by the compatibility between irrelevant and relevant spatial information. Specifically, the target’s spatial location conflicted with the spatial information triggered by the irrelevant musical stimulus. These results reveal that for musical–space synesthetes, musical information automatically orients attention according to their specific spatial musical-forms. The present study demonstrates the genuineness of musical–space synesthesia by revealing its two hallmarks—automaticity and consistency. In addition, our results challenge previous findings regarding an implicit vertical representation for pitch tones in non-synesthete musicians.     

Consistency and strength of grapheme-color associations are separable aspects of synesthetic experience

Consistency of synesthetic associations over time is a widely used test of synesthesia. Since many studies suggest that consistency is not a completely reliable feature, we compared the consistency and strength of synesthetes’ grapheme-color associations. Consistency was measured by scores on the Synesthesia Battery and by the Euclidean distance in color space for the specific graphemes tested for each participant. Strength was measured by congruency magnitudes on the Implicit Association Test. The strength of associations was substantially greater for synesthetes than non-synesthetes, suggesting that this is a novel, objective marker of synesthesia. Although, intuitively, strong associations should also be consistent, consistency and strength were uncorrelated, indicating that they are likely independent, at least for grapheme-color synesthesia. These findings have implications for our understanding of synesthesia and for estimates of its prevalence since synesthetes who experience strong, but inconsistent, associations may not be identified by tests that focus solely on consistency.     

Spatial cueing in time–space synesthetes: An event-related brain potential study

Some people report that they consistently and involuntarily associate time events, such as months of the year, with specific spatial locations; a condition referred to as time–space synesthesia. The present study investigated the manner in which such synesthetic time–space associations affect visuo-spatial attention via an endogenous cuing paradigm. Reaction times and ERPs were recorded as 12 time–space synesthetes and 12 control participants did a peripheral target detection task, cued by three different types of centrally presented cues: arrows pointing left or right, direction words “left” or “right”, and month names associated with either the left or the right side of the synesthete’s mental calendar (e.g., “October” or “May”). Cues were followed by probes on the left or right side of the screen, and participants responded to the probes with button presses. Behavioral and ERP data suggested that for synesthetes, month words functioned more effectively as cues to direct attention in space. In synesthetes but not controls, a comparison of ERPs to probes cued by months revealed effects of cue validity on the P3b component peaking 370 ms post-onset and on the subsequent positive slow wave (pSW) observed 600–900 ms post-onset (both larger for invalid probes). No effects of cue validity were observed on early visual potentials (N1) for probes cued by months. The findings suggest that in these time–space synesthetes cue validity influenced post-perceptual processes, such as stimulus evaluation and categorization, with no evidence for enhanced visual processing.     

Enhanced mental rotation ability in time-space synesthesia

Time-space synesthesia is a variant of sequence–space synesthesia and involves the involuntary association of months of the year with 2D and 3D spatial forms, such as arcs, circles, and ellipses. Previous studies have revealed conflicting results regarding the association between time-space synesthesia and enhanced spatial processing ability. Here, we tested 15 time-space synesthetes, and 15 non-synesthetic controls matched for age, education, and gender on standard tests of mental rotation ability, spatial working memory, and verbal working memory. Synesthetes performed better than controls on our test of mental rotation, but similarly to controls on tests of spatial and verbal working memory. Results support a dissociation between visuo-spatial imagery and spatial working memory capacity, and suggest time-space synesthesia is associated only with enhanced visuo-spatial imagery. These data are consistent with the time-space connectivity thesis that time-space synesthesia results from enhanced connectivity in the parietal lobe between regions supporting the representation of temporal sequences and those underlying visuo-spatial imagery.     

Enhanced semantic priming in synesthetes independent of sensory binding

Synesthesia is the phenomenon in which individuals experience unusual involuntary cross-modal pairings. The evidence to date suggests that synesthetes have access to advantageous item-specific memory cues linked to their synesthetic experience, but whether this emphasis on item-specific memory cues comes at the expense of semantic-level processing has not been unambiguously demonstrated. Here we found that synesthetes produce substantially greater semantic priming magnitudes, unrelated to their specific synesthetic experience. This effect, however, was moderated by whether the synesthetes were projectors (their synesthetic experience occurs in their representation of external space), or associators (their synesthetic experience occurs in their ‘mind’s eye’). That is, the greater a synesthetes’s tendency to project their experience, the weaker their semantic priming when the task did not require them to semantically categorize the stimuli, whereas this trade-off was absent when the task did have that requirement.     

Time–space synaesthesia – A cognitive advantage?

Is synaesthesia cognitively useful? Individuals with time–space synaesthesia experience time units (such as months of the year) as idiosyncratic spatial forms, and report that these forms aid them in mentally organising their time. In the present study, we hypothesised that time–space synaesthesia would facilitate performance on a time-related cognitive task. Synaesthetes were not specifically recruited for participation; instead, likelihood of time–space synaesthesia was assessed on a continuous scale based on participants’ responses during a semi-structured interview. Participants performed a month-manipulation task, which involved naming every second month or every third month in reverse-chronological order, beginning and ending with a target month. Using hierarchical multiple regression, we found that time–space synaesthesia corresponded with faster performance on both versions of the task. We propose that time–space synaesthesia may expedite the cognitive manipulation of time-based information. Our results also indicate that synaesthesia is far less unusual than widely believed.     

联觉的发展与习得

联觉具有基因遗传性, 基因遗传在决定联觉中起到重要作用, 但并不意味着基因遗传就是决定联觉的唯一因素, 联觉具有在后期发展的可能, 并且这种发展呈现倒U形曲线。既然联觉是发展的, 那么联觉可否通过训练习得呢？目前不少研究对非联觉者进行了配对关联训练, 发现训练后的非联觉者具有类似于联觉者的表现, 也发现训练后的非联觉者与真正的联觉者具有一定的差异。但目前研究还没有直接或强有力的证据表明训练所致的配对关联就是一种联觉, 训练后的非联觉者就能变成联觉者。相反地, 越来越多的证据显示非联觉者经过配对关联训练后可能无法成为真正的联觉者。     

Consistency in synesthetic experience to vowels and consonants: Five case studies

The present study attempted to specify the actual degree of consistency in synesthetic experience in two synesthetes and three non-synesthetes. By comparing colour chip selections, and size and density ratings, to the same set of stimulus letters on separate occasions, it was found that the synesthetic subjects showed a high consistency in responding over a short (24 hours) as well as a long (one year) time span. In comparison, the non-synesthetic subjects demonstrated less consistent responding when retested after 24 hours. However, the differences between the two groups were smaller than expected. Consistency to vowels and consonants was compared, and it was found that consistency to consonants was comparable to, or even higher than, vowel consistency in all subjects.     

Inducing synesthesia in non-synesthetes: Short-term visual deprivation facilitates auditory-evoked visual percepts

Sounds can modulate activity in visual cortex, facilitating the detection of visual targets. However, these sound-driven modulations are not thought to evoke conscious visual percepts in the general population. In individuals with synesthesia, however, multisensory interactions do lead to qualitatively different experiences such as sounds evoking flashes of light. Why, if multisensory interactions are present in all individuals, do only synesthetes experience abnormal qualia? Competing models differ in the time required for synesthetic experiences to emerge. The cross-activation model suggests synesthesia arises over months or years from the development of abnormal neural connections. Here we demonstrate that after ∼5 min of visual deprivation, sounds can evoke synesthesia-like percepts (vivid colors and Klüver form-constants) in ∼50% of non-synesthetes. These results challenge aspects of the cross-activation model and suggest that synesthesia exists as a latent feature in all individuals, manifesting when the balance of activity across the senses has been altered.     

Association between synesthetic colors and sensitivity to physical colors changed by type of synesthetic experience in grapheme-color synesthesia

Grapheme-color synesthesia is a condition in which visual perception of letters induces simultaneous perception of a specific color. Previous studies indicate that grapheme-color synesthetes are more sensitive to physical colors than non-synesthetes. Synesthetic colors are found to be concentrated in multiple regions of the color space, forming “synesthetic color clusters”. The present study investigated whether color sensitivity corresponding to synesthetic color clusters (clustered colors) is higher than color sensitivity that does not correspond to synesthetic color clusters (non-clustered colors). However, we found no difference in the color sensitivity for clustered and non-clustered colors. We also investigated whether the color sensitivity is dependent on the synesthetic experience (associators and projectors). We found that the greater the tendency toward associator characteristics, the greater the sensitivity for clustered colors compared to that for non-clustered colors. Our findings suggest an association between synesthetic colors and physical color sensitivity that is modulated by synesthetic experience.     

The Role of Sensory Perception,Emotionality and <Emphasis Type="BoldItalic">Lifeworld</Emphasis> in Auditory Word Processing: Evidence from Congenital Blindness and Synesthesia

Although it has been established that human beings process concrete and abstract words differently, it is still a matter of debate what factors contribute to this difference. Since concrete concepts are closely tied to sensory perception, perceptual experience seems to play an important role in their processing. The present study investigated the processing of nouns during an auditory lexical decision task. Participants came from three populations differing in their visual-perceptual experience: congenitally blind persons, word-color synesthetes, and sighted non-synesthetes. Specifically, three features with potential relevance to concreteness were manipulated: sensory perception, emotionality, and Husserlian lifeworld, a concept related to the inner versus the outer world of the self. In addition to a classical concreteness effect, our results revealed a significant effect of lifeworld: words that are closely linked to the internal states of humans were processed faster than words referring to the outside world. When lifeworld was introduced as predictor, there was no effect of emotionality. Concerning participants’ perceptual experience, an interaction between participant group and item characteristics was found: the effects of both concreteness and lifeworld were more pronounced for blind compared to sighted participants. We will discuss the results in the context of embodied semantics, and we will propose an approach to concreteness based on the individual’s bodily experience and the relatedness of a given concept to the self.     

Executive functions in synesthesia

In grapheme-color synesthesia, a number or letter can evoke two different and possibly conflicting (real and synesthetic) color sensations at the same time. In this study, we investigate the relationship between synesthesia and executive control functions. First, no general skill differences were obtained between synesthetes and non-synesthetes in classic executive control paradigms. Furthermore, classic executive control effects did not interact with synesthetic behavioral effects. Third, we found support for our hypothesis that inhibition of a synesthetic color takes effort and time. Finally, individual differences analyses showed no relationship between the two skills; performance on a ‘normal’ Stroop task does not predict performance on a synesthetic Stroop task. Across four studies, the current results consistently show no clear relationship between executive control functions and synesthetic behavioral effects. This raises the question of which mechanisms are at play in synesthetic ‘management’ during the presence of two conflicting (real and synesthetic) sensations.     

Metacontrast masking is processed before grapheme–color synesthesia

We investigated the physiological mechanism of grapheme–color synesthesia using metacontrast masking. A metacontrast target is rendered invisible by a mask that is delayed by about 60 ms; the target and mask do not overlap in space or time. Little masking occurs, however, if the target and mask are simultaneous. This effect must be cortical, because it can be obtained dichoptically. To compare the data for synesthetes and controls, we developed a metacontrast design in which nonsynesthete controls showed weaker dichromatic masking (i.e., the target and mask were in different colors) than monochromatic masking. We accomplished this with an equiluminant target, mask, and background for each observer. If synesthetic color affected metacontrast, synesthetes should show monochromatic masking more similar to the weak dichromatic masking among controls, because synesthetes could add their synesthetic color to the monochromatic condition. The target–mask pairs used for each synesthete were graphemes that elicited strong synesthetic colors. We found stronger monochromatic than dichromatic U-shaped metacontrast for both synesthetes and controls, with optimal masking at an asynchrony of 66 ms. The difference in performance between the monochromatic and dichromatic conditions in the synesthetes indicates that synesthesia occurs at a later processing stage than does metacontrast masking.     

Handedness and calendar orientations in time-space synaesthesia

In one common variant of time-space synaesthesia, individuals report the consistent experience of months bound to a spatial arrangement, commonly described as a circle extending outside of the body. Whereas the layout of these calendars has previously been thought to be relatively random and to differ greatly between synaesthetes, Study 1 provides the first evidence suggesting one critical aspect of these calendars is mediated by handedness: clockwise versus counter-clockwise orientation. A study of 34 time-space synaesthetes revealed a strong association between handedness and the orientation of circular calendars. That is, left-handed time-space synaesthetes tended to report counter-clockwise arrangements and right-handed synaesthetes clockwise. Study 2 tested whether a similar bias was present in non-synaesthetes whose task was to memorize and recall the spatial configuration of a clockwise and counter-clockwise calendar. Non-synaesthetes' relative performance on these two sorts of calendars was significantly correlated with their handedness scores in a pattern similar to synaesthetes. Specifically, left-handed controls performed better on counter-clockwise calendars compared to clockwise, and right-handed controls on clockwise over counter-clockwise. We suggest that the implicit biases seen in controls are mediated by similar mechanisms as in synaesthesia, highlighting the graded nature of synaesthetic associations.     

When 9 is not on the right: Implications from number-form synesthesia

Number-form synesthetes consciously experience numbers in spatially-defined locations. For non-synesthete individuals, a similar association of numbers and space appears in the form of an implicit mental number line as signified by the distance effect–reaction time decreases as the numerical distance between compared numbers increases. In the current experiment, three number-form synesthetes and two different non-synesthete control groups (Hebrew speaking and English speaking) performed a number comparison task. Synesthete participants exhibited a sizeable distance effect only when presented numbers were congruent with their number-form. In contrast, the controls exhibited a distance effect regardless of congruency or presentation type. The findings suggest that: (a) number-form synesthesia impairs the ability to represent numbers in a flexible manner according to task demands; (b) number-form synesthesia is a genuine tangible experience, triggered involuntarily; and (c) the classic mental number line can be more pliable than previously thought and appears to be independent of cultural-lingo direction.     

Is it for real? Evaluating authenticity of musical pitch-space synesthesia

In spatial-sequence synesthesia, ordinal sequences are visualized in explicit spatial locations. We examined a recently documented subtype in which musical notes are represented in spatial configurations, to verify consistency and automaticity of musical pitch-space (M-S) synesthesia. An M-S synesthete performed a mapping pre-task (Exp. 1) used to indicate the locations of 7 auditory or visually presented notes, in 2 sessions a month apart. Results revealed strong correlations between sessions, suggesting the synesthete's musical forms were consistent over time. Experiment 2 assessed automaticity of M-S synesthesia. The same synesthete and matched controls preformed a spatial Stroop-like task. Participants were presented with an auditory or visual musical note and then had to reach for an asterisk (target) with a mouse cursor. The target appeared in a compatible or incompatible location (according to the synesthete's spatial representation). A compatibility effect was found for the synesthete but not for controls. The synesthete was significantly faster when the target appeared in compatible locations than in incompatible ones. Our findings show that for synesthetes, auditory and visually presented notes automatically trigger attention to specific spatial locations according to their specific M-S associations.     

Synesthetic grapheme-color percepts exist for newly encountered Hebrew,Devanagari, Armenian and Cyrillic graphemes

Grapheme-color synesthetes experience color, not physically present, when viewing symbols. Synesthetes cannot remember learning these associations. Must synesthetic percepts be formed during a sensitive period? Can they form later and be consistent? What determines their nature? We tested grapheme-color synesthete, MC2, before, during and after she studied Hindi abroad. We investigated whether novel graphemes elicited synesthetic percepts, changed with familiarity, and/or benefited from phonemic information. MC2 reported color percepts to novel Devanagari and Hebrew graphemes. MC2 monitored these percepts over 6 months in a Hindi-speaking environment. MC2 and synesthete DN, reported synesthetic percepts for Armenian graphemes, or Cyrillic graphemes + phonemes over time. Synesthetes, not controls, reported color percepts for novel graphemes that gained consistency over time. Phonemic information did not enhance consistency. Thus, synesthetes can form and consolidate percepts to novel graphemes as adults. These percepts may depend on pre-existing grapheme-color relationships but they can flexibly shift with familiarity.     

Multilevel analysis of individual differences in regularities of grapheme–color associations in synesthesia

Grapheme–color synesthesia is a neurological phenomenon where visual perception of letters and numbers stimulates perception of a specific color. Grapheme–color correspondences have been shown to be systematically associated with grapheme properties, including visual shape difference, ordinality, and frequency. However, the contributions of grapheme factors differ across individuals. In this study, we applied multilevel analysis to test whether individual differences in regularities of grapheme–color associations could be explained by individual styles of processing grapheme properties. These processing styles are reflected by the type of synesthetic experience. Specifically, we hypothesized that processing focusing on shape differences would be associated with projector synesthetes, while processing focusing on ordinality or familiarity would be associated with associator synesthetes. The analysis revealed that ordinality and familiarity factors were expressed more strongly among associators than among projectors. This finding suggests that grapheme–color associations are partly determined by the type of synesthetic experience.     

Grapheme–color synesthesia can enhance immediate memory without disrupting the encoding of relational cues

Previous evidence has suggested that grapheme–color synesthesia can enhance memory for words, but little is known about how these photisms cue retrieval. Often, the encoding of specific features of individual words can disrupt the encoding of ordered relations between words, resulting in an overall decrease in recall accuracy. Here we show that the photisms arising from grapheme–color synesthesia do not function like these item-specific cues. The influences of high and low word frequency on the encoding of ordered relations and the accuracy of immediate free recall were compared across a group of 10 synesthetes and 48 nonsynesthetes. The main findings of Experiment 1 showed that the experience of synesthesia had no adverse effect on the encoding of ordered relations (as measured by input–output correspondence); furthermore, it enhanced recall accuracy in a strictly additive fashion across the two word frequency conditions. Experiment 2 corroborated these findings by showing that the synesthetes only outperformed the nonsynesthetes when the materials involved words and letters, not when they involved digits and spatial locations. Altogether, the present findings suggest that synesthesia can boost immediate memory performance without disrupting the encoding of ordered relations.     

How to rapidly construct a spatial–numerical representation in preliterate children (at least temporarily)

Spatial processing of numbers has emerged as one of the basic properties of humans’ mathematical thinking. However, how and when number–space relations develop is a highly contested issue. One dominant view has been that a link between numbers and left/right spatial directions is constructed based on directional experience associated with reading and writing. However, some early forms of a number–space link have been observed in preschool children who cannot yet read and write. As literacy experience is evidently not necessary for number–space effects, we are searching for other potential sources of this association. Here we propose and test a hypothesis that the number–space link can be quickly constructed in preschool children's cognition on the basis of spatially oriented visuo‐motor activities. We trained 3‐ and 4‐year‐old children with a non‐numerical spatial movement task (left‐to‐right or right‐to‐left), where via touch screen children had to move a frog across a pond. After the training, children had to perform a numerosity comparison task. After left‐to‐right training, we observed a SNARC‐like effect (reactions to smaller numbers were faster on the left side, and reactions to larger numbers on the right side), and after right‐to‐left training a reverse effect. These results are the first to show a causal link between visuo‐motor activities and number–space associations in children before they learn to read and write. We argue that simple activities, such as manual games, dominant in a given society, might shape number–space associations in children in a way similar to lifelong reading training.