The ventriloquist effect does not depend on the direction of automatic visual attention

Previously, we showed that the visual bias of auditory sound location, or ventriloquism, does not depend on the direction of deliberate, orendogenous, attention (Bertelson, Vroomen, de Gelder, & Driver, 2000). In the present study, a similar question concerning automatic, orexogenous, attention was examined. The experimental manipulation was based on the fact that exogenous visual attention can be attracted toward asingleton—that is, an item different on some dimension from all other items presented simultaneously. A display was used that consisted of a row of four bright squares with one square, in either the left- or the rightmost position,smaller than the others, serving as the singleton. In Experiment 1, subjects made dichotomous left-right judgments concerning sound bursts, whose successivelocations were controlled by a psychophysical staircase procedure and which were presented in synchrony with a display with the singleton either left or right. Results showed that the apparent location of the sound was attractednot toward the singleton, but instead toward the big squares at the opposite end of the display. Experiment 2 was run to check that the singleton effectively attracted exogenous attention. The task was to discriminate target letters presented either on the singleton or on the opposite big square. Performance deteriorated when the target was on the big square opposite the singleton, in comparison with control trials with no singleton, thus showing that the singleton attracted attention away from the target location. In Experiment 3, localization and discrimination trials were mixed randomly so as to control for potential differences in subjects’ strategies in the two preceding experiments. Results were as before, showing that the singleton attracted attention, whereas sound localization was shifted away from the singleton. Ventriloquism can thus be dissociated from exogenous visual attention and appears to reflect sensory interactions with little role for the direction of visual spatial attention.     

The ventriloquist effect does not depend on the direction of deliberate visual attention

It is well known that discrepancies in the location of synchronized auditory and visual events can lead to mislocalizations of the auditory source, so-called ventriloquism. In two experiments, we tested whether such cross-modal influences on auditory localization depend on deliberate visual attention to the biasing visual event. In Experiment 1, subjects pointed to the apparent source of sounds in the presence or absence of a synchronous peripheral flash. They also monitored for target visual events, either at the location of the peripheral flash or in a central location. Auditory localization was attracted toward the synchronous peripheral flash, but this was unaffected by where deliberate visual attention was directed in the monitoring task. In Experiment 2, bilateral flashes were presented in synchrony with each sound, to provide competing visual attractors. When these visual events were equally salient on the two sides, auditory localization was unaffected by which side subjects monitored for visual targets. When one flash was larger than the other, auditory localization was slightly but reliably attracted toward it, but again regardless of where visual monitoring was required. We conclude that ventriloquism largely reflects automatic sensory interactions, with little or no role for deliberate spatial attention.     

The recognition of phonologically assimilated words does not depend on specific language experience

In a series of 5 experiments, we investigated whether the processing of phonologically assimilated utterances is influenced by language learning. Previous experiments had shown that phonological assimilations, such as /lean#bacon/ → [leam bacon], are compensated for in perception. In this article, we investigated whether compensation for assimilation can occur without experience with an assimilation rule using automatic event-related potentials. Our first experiment indicated that Dutch listeners compensate for a Hungarian assimilation rule. Two subsequent experiments, however, failed to show compensation for assimilation by both Dutch and Hungarian listeners. Two additional experiments showed that this was due to the acoustic properties of the assimilated utterance, confirming earlier reports that phonetic detail is important in compensation for assimilation. Our data indicate that compensation for assimilation can occur without experience with an assimilation rule, in line with phonetic-phonological theories that assume that speech production is influenced by speech-perception abilities.     

The ventriloquist effect does not depend on the direction of automatic visual attention.

Previously, we showed that the visual bias of auditory sound location, or ventriloquism, does not depend on the direction of deliberate, or endogenous, attention (Bertelson, Vroomen, de Gelder, & Driver, 2000). In the present study, a similar question concerning automatic, or exogenous, attention was examined. The experimental manipulation was based on the fact that exogenous visual attention can be attracted toward a singleton--that is, an item different on some dimension from all other items presented simultaneously. A display was used that consisted of a row of four bright squares with one square, in either the left- or the rightmost position, smaller than the others, serving as the singleton. In Experiment 1, subjects made dichotomous left-right judgments concerning sound bursts, whose successive locations were controlled by a psychophysical staircase procedure and which were presented in synchrony with a display with the singleton either left or right. Results showed that the apparent location of the sound was attracted not toward the singleton, but instead toward the big squares at the opposite end of the display. Experiment 2 was run to check that the singleton effectively attracted exogenous attention. The task was to discriminate target letters presented either on the singleton or on the opposite big square. Performance deteriorated when the target was on the big square opposite the singleton, in comparison with control trials with no singleton, thus showing that the singleton attracted attention away from the target location. In Experiment 3, localization and discrimination trials were mixed randomly so as to control for potential differences in subjects' strategies in the two preceding experiments. Results were as before, showing that the singleton attracted attention, whereas sound localization was shifted away from the singleton. Ventriloquism can thus be dissociated from exogenous visual attention and appears to reflect sensory interactions with little role for the direction of visual spatial attention.     

When speech enhances Spatial Musical Association of Response Codes: Joint spatial associations of pitch and timbre in nonmusicians

Previous studies have shown that the effect of the Spatial Musical Association of Response Codes (SMARC) depends on various features, such as task conditions (whether pitch height is implicit or explicit), response dimension (horizontal vs. vertical), presence or absence of a reference tone, and former musical training of the participants. In the present study, we investigated the effects of pitch range and timbre: in particular, how timbre (piano vs. vocal) contributes to the horizontal and vertical SMARC effect in nonmusicians under varied pitch range conditions. Nonmusicians performed a timbre judgement task in which the pitch range was either small (6 or 8 semitone steps) or large (9 or 12 semitone steps) in a horizontal and a vertical response setting. For piano sounds, SMARC effects were observed in all conditions. For the vocal sounds, in contrast, SMARC effects depended on pitch range. We concluded that the occurrence of the SMARC effect, especially in horizontal response settings, depends on the interaction of the timbre (vocal and piano) and pitch range if vocal and instrumental sounds are combined in one experiment: the human voice enhances the attention, both to the vocal and the instrumental sounds.     

计数单位的空间联合编码效应

采用Dehaene等人的研究范式,以计数单位中的“千”为基线,要求被试快速作大于“千”还是小于“千”的分类判断,考察计数单位在心理数字线上的空间表征方式.结果表明:(1)计数单位和数字有着相同的加工机制,小计数单位表征在心理数字线的左侧,大计数单位表征在心理数字线的右侧,存在显著的SNARC效应. (2) SNARC效应不仅仅出现在数量的空间表征上,同样能够出现在顺序信息的空间表征上.     

Visual mental image generation does not overlap with visual short-term memory: A dual-task interference study

Visual mental imagery and working memory are often assumed to play similar roles in high-order functions, but little is known of their functional relationship. In this study, we investigated whether similar cognitive processes are involved in the generation of visual mental images, in short-term retention of those mental images, and in short-term retention of visual information. Participants encoded and recalled visually or aurally presented sequences of letters under two interference conditions: spatial tapping or irrelevant visual input (IVI). In Experiment 1, spatial tapping selectively interfered with the retention of sequences of letters when participants generated visual mental images from aural presentation of the letter names and when the letters were presented visually. In Experiment 2, encoding of the sequences was disrupted by both interference tasks. However, in Experiment 3, IVI interfered with the generation of the mental images, but not with their retention, whereas spatial tapping was more disruptive during retention than during encoding. Results suggest that the temporary retention of visual mental images and of visual information may be supported by the same visual short-term memory store but that this store is not involved in image generation.     

亮度对空间-数字反应编码联合效应的影响

本研究探讨亮度对空间-数字反应编码联合效应（Spatial-Numerical Association of Response Codes,简称SNARC效应）的影响及其机制。通过三个实验设计不同的亮度对比水平,要求被试对阿拉伯数字1~9（5除外）进行奇偶判断。实验一将数字亮度设为最高值255时,结果出现了数字的SNARC效应。实验二将数字的亮度值分别设为255和213时,结果仍存在SNARC效应。实验三将亮度值分别设置为213和42时,数字的SNARC效应却消失了。这些结果表明亮度会激活或抑制数字的空间表征,可能与亮度对比值的高低及所消耗认知资源的多少有关。     

The size of the cross-lingual masked phonological priming effect does not depend on second language proficiency

Using a masked phonological priming paradigm, Brysbaert, Van Dyck, and Van de Poel (1999) showed that Dutch-French bilinguals perform better at identifying tachistoscopically presented L2 words (e.g., oui [yes]) when those words are primed by L1 words or nonwords that are homophonic to the L2 target word according to the L1 grapheme-phoneme conversion rules (e.g., wie [who]). They noted that this priming effect was smaller for balanced bilinguals than for less proficient bilinguals, although the interaction failed to reach significance. Findings of Gollan, Forster, and Frost (1997) suggest that this could be attributed to a greater reliance on phonology in L2 reading, caused by a smaller proficiency in this language. However, in this study we show that the Dutch-French cross-lingual phonological priming effect is equally large for perfectly balanced and less proficient bilinguals. Our findings are in line with more recent work of Van Wijnendaele and Brysbaert (2002).     

The control of appetitive instrumental responding does not depend on classical conditioning to the discriminative stimulus

In Experiment I, rats were exposed to a classical relationship between a clicker-light compound and response-independent food. Conditioning to the light was blocked if the clicker had previously served as a classical signal for food, but not if it had been established as a discriminative stimulus for food-reinforced lever pressing. In Experiment II, a tone-light compound served as a discriminative stimulus for lever pressing. Control by the light was blocked if the tone was independently trained as a discriminative stimulus, but not if it was trained as a classical signal for response-independent food. These results suggest that discriminative stimuli do not come to control appetitive instrumental responding by virtue of their implicit classical relationship to the instrumental reinforcer.     

The role of visual experience in the production of emotional facial expressions by blind people: a review

Facial expressions of emotion are nonverbal behaviors that allow us to interact efficiently in social life and respond to events affecting our welfare. This article reviews 21 studies, published between 1932 and 2015, examining the production of facial expressions of emotion by blind people. It particularly discusses the impact of visual experience on the development of this behavior from birth to adulthood. After a discussion of three methodological considerations, the review of studies reveals that blind subjects demonstrate differing capacities for producing spontaneous expressions and voluntarily posed expressions. Seventeen studies provided evidence that blind and sighted spontaneously produce the same pattern of facial expressions, even if some variations can be found, reflecting facial and body movements specific to blindness or differences in intensity and control of emotions in some specific contexts. This suggests that lack of visual experience seems to not have a major impact when this behavior is generated spontaneously in real emotional contexts. In contrast, eight studies examining voluntary expressions indicate that blind individuals have difficulty posing emotional expressions. The opportunity for prior visual observation seems to affect performance in this case. Finally, we discuss three new directions for research to provide additional and strong evidence for the debate regarding the innate or the culture-constant learning character of the production of emotional facial expressions by blind individuals: the link between perception and production of facial expressions, the impact of display rules in the absence of vision, and the role of other channels in expression of emotions in the context of blindness.     

Microaggressions: The experience of individuals with mental illness

The main objective of the study was to investigate the types of microaggressions experienced by individuals with mental illness (MI) based on this marginalized group status. This study included 4 focus groups, comprised of 18 individuals diagnosed with MI(es). The researchers qualitatively identified four themes (a) conveying stereotypes against individuals with MI (i.e. assumptions of inferiority, seeking attention or being dramatic, assumptions of coldness, bringing MI upon themselves, and using MI as an excuse), (b) invalidating the experience of having a MI (i.e. doubting existence, doubting severity, and avoiding acknowledgment of the MI), (c) defining a person by their disorder, and (d) misuse of terminology. Participants revealed the main perpetrators (i.e. family, friends, and professionals) of the microaggressions. The researchers discuss: how the identified themes compare to the three categories of microaggressions (i.e. microinsults, microinvalidations, and microassaults); similarities and differences between the current results and previously identified racial, gender, and sexual orientation microaggressions perpetrated in daily interactions and in therapeutic settings; and the perpetrators of microaggressions as they relate to prejudicial attitudes and social distance. Finally, the authors make recommendations for practitioners and researchers.     

Sub-optimal choice in pigeons does not depend on avoidance of the stimulus associated with the absence of reinforcement

When pigeons are given a choice between two alternatives, one leading to a stimulus 20% of the time that always signals reinforcement (S+) or another stimulus 80% of the time that signals no reinforcement (S−), and the other alternative leading to one of two stimuli each signaling reinforcement 50% of the time, they show a strong preference for the first alternative. This preference occurs in spite of the fact that, overall, the second alternative provides two and a half times more reinforcement than the first. In the present experiment we tested the hypothesis that the S− is a less effective conditioned inhibitor because as soon as it is recognized, the pigeon may orient away from it, whereas it does not orient away from the other signals. To test this hypothesis, for Group HLS−, we made the S− more salient and less avoidable by using a ceiling mounted houselight. To control for a possible aversion to the houselight we included Group HLS+, a group for which the houselight served as the S+. And the preferences of both groups were compared to those of a standard no houselight group. The pigeons in all three groups showed a strong preference for the lower probability of reinforcement alternative. Thus, reduced peripheral orienting during presentation of the S− stimulus was not likely responsible for pigeons’ sub-optimal choice.     

The recognition of emotional prosody in students with blindness: Effects of early visual experience and age development

This study examined the role of early visual experience and age in the recognition of emotional prosody among students with visual impairments in China. A total of 75 primary and junior high school students participated in the study. The ability of participants to recognize the prosody of four basic emotions (sadness, anger, happiness, and neutrality) was explored. The findings were as follows. (1) Early visual experience had a significant effect on the recognition of emotional prosody. The accuracy rate of students with congenital blindness was lower than that of students with adventitious blindness, and the performance of students with congenital blindness was lower than that of sighted students. The students with congenital blindness exhibited the slowest recognition speeds. (2) Age had a significant effect on the emotional prosody recognition accuracy of the sighted students, but it had no effect on the students with blindness.     

Synaesthetic perception of colour and visual space in a blind subject: an fMRI case study

In spatial sequence synaesthesia (SSS) ordinal stimuli are perceived as arranged in peripersonal space. Using fMRI, we examined the neural bases of SSS and colour synaesthesia for spoken words in a late-blind synaesthete, JF. He reported days of the week and months of the year as both coloured and spatially ordered in peripersonal space; parts of the days and festivities of the year were spatially ordered but uncoloured. Words that denote time-units and triggered no concurrents were used in a control condition. Both conditions inducing SSS activated the occipito-parietal, infero-frontal and insular cortex. The colour area hOC4v was engaged when the synaesthetic experience included colour. These results confirm the continued recruitment of visual colour cortex in this late-blind synaesthetes. Synaesthesia also involved activation in inferior frontal cortex, which may be related to spatial memory and detection, and in the insula, which might contribute to audiovisual integration related to the processing of inducers and concurrents.     

Effect of visual experience on face processing: a developmental study of inversion and non-native effects

In adults, three phenomena are taken to demonstrate an experience effect on face recognition: an inversion effect, a non-native face effect (so-called 'other-race' effect) and their interaction. It is crucial for our understanding of the developmental perception mechanisms of object processing to discover when these effects are present in childhood. Three- to 5-year-old Caucasian children (N = 64) were asked to recognize upright and inverted Caucasian and Asian faces. Recognition was tested with a forced-choice procedure. Overall performance improved with age. However, there was an interaction between the inversion and non-native effects that did not change with age between ages 3 and 5: (a) the inversion effect with native (Caucasian) faces was larger than with non-native (Asian) faces, and (b) upright native faces were recognized better than upright non-native faces. These results show that face orientation and morphology constrain face processing in 3- to 5-year-olds. The first 3 years of life during which the brain and the environment interact are sufficient to build a face-processing system that constrains recognition.