Adaptation to auditory-visual discordance and ventriloquism in semirealistic situations

While “recalibration by pairing” is now generally held to be the main process responsible for adaptation to intermodal discordance, the conditions under which pairing of heteromodal data occur in spite of a discordance have not been studied systematically. The question has been explored in the case of auditory-visual discordance. Subjects pointed at auditory targets before and after exposure to auditory and visual data from sources 20° apart in azimuth, in conditions varying by (a) the degree of realism of the context, and (b) the synchronization be-tween auditory and visual data. In Experiment 1, the exposure conditions combined the sound of a percussion instrument (bongos) with either the image on a video monitor of the hands of the player (semirealistic situation) or diffuse light modulated by the sound (nonrealistic situation). Experiment 2 featured a voice and either the image of the face of the speaker or light modulated by the voice, and in both situations either sound and image were exactly syn-chronous or the sound was made to lag by 0.35 sec. Desynchronization was found to reduce adaptation significantly, while degree of realism failed to produce an effect. Answers to a question asked at the end of the testing regarding the location of the sound source suggested that the apparent fusion of the auditory and visual data—the phenomenon called “ventriloquism”— was not affected by the conditions in the same way as adaptation. In Experiment 3, subjects were exposed to the experimental conditions of Experiment 2 and were asked to report their impressions of fusion by pressing a key. The results contribute to the suggestion that pairing of registered auditory and visual locations, the hypothetical process at the basis of recalibration, may be a different phenomenon from conscious fusion.     

Rapid adaptation to auditory-visual spatial disparity

The so-called ventriloquism aftereffect is a remarkable example of rapid adaptative changes in spatial localization caused by visual stimuli. After exposure to a consistent spatial disparity of auditory and visual stimuli, localization of sound sources is systematically shifted to correct for the deviation of the sound from visual positions during the previous adaptation period. In the present study, this aftereffect was induced by presenting, within 17 min, 1800 repetitive noise or pure-tone bursts in combination with synchronized, and 20° disparate flashing light spots, in total darkness. Post-adaptive sound localization, measured by a method of manual pointing, was significantly shifted 2.4° (noise), 3.1° (1 kHz tones), or 5.8° (4 kHz tones) compared with the pre-adaptation condition. There was no transfer across frequencies; that is, shifts in localization were insignificant when the frequencies used for adaptation and the post-adaptation localization test were different. It is hypothesized that these aftereffects may rely on shifts in neural representations of auditory space with respect to those of visual space, induced by intersensory spatial disparity, and may thus reflect a phenomenon of neural short-term plasticity.     

Cross-modal bias and perceptual fusion with auditory-visual spatial discordance

Investigations of situations involving spatial discordance between auditory and visual data which can otherwise be attributed to a common origin have revealed two main phenomena:cross-modal bias andperceptual fusion (or ventriloquism). The focus of the present study is the relationship between these two. The question asked was whether bias occurred only with fusion, as is predicted by some accounts of reactions to discordance, among them those based on cuesubstitution. The approach consisted of having subjects, on each trial, both point to signals in one modality in the presence of conflicting signals in the other modality and produce same-different origin judgments. To avoid the confounding of immediate effects with cumulative adaptation, which was allowed in most previous studies, the direction and amplitude of discordance was varied randomly from trial to trial. Experiment 1, which was a pilot study, showed that both visual bias of auditory localization and auditory bias of visual localization can be observed under such conditions. Experiment 2, which addressed the main question, used a method which controls for the selection involved in separating fusion from no-fusion trials and showed that the attraction of auditory localization by conflicting visual inputs occurs even when fusion is not reported. This result is inconsistent with purely postperceptual views of cross-modal interactions. The question could not be answered for auditory bias of visual localization, which, although significant, was very small in Experiment 1 and fell below significance under the conditions of Experiment 2.     

Cognitive adaptation to the experience of social and cultural diversity

Diversity is a defining characteristic of modern society, yet there remains considerable debate over the benefits that it brings. The authors argue that positive psychological and behavioral outcomes will be observed only when social and cultural diversity is experienced in a way that challenges stereotypical expectations and that when this precondition is met, the experience has cognitive consequences that resonate across multiple domains. A model, rooted in social categorization theory and research, outlines the preconditions and processes through which people cognitively adapt to the experience of social and cultural diversity and the resulting cross-domain benefits that this brings. Evidence is drawn from a range of literatures to support this model, including work on biculturalism, minority influence, cognitive development, stereotype threat, work group productivity, creativity, and political ideology. The authors bring together a range of differing diversity experiences and explicitly draw parallels between programs of research that have focused on both perceiving others who are multicultural and being multicultural oneself. The findings from this integrative review suggest that experiencing diversity that challenges expectations may not only encourage greater tolerance but also have benefits beyond intergroup relations to varied aspects of psychological functioning.     

Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements

In this paper, we show that human saccadic eye movements toward a visual target are generated with a reduced latency when this target is spatially and temporally aligned with an irrelevant auditory nontarget. This effect gradually disappears if the temporal and/or spatial alignment of the visual and auditory stimuli are changed. When subjects are able to accurately localize the auditory stimulus in two dimensions, the spatial dependence of the reduction in latency depends on the actual radial distance between the auditory and the visual stimulus. If, however, only the azimuth of the sound source can be determined by the subjects, the horizontal target separation determines the strength of the interaction. Neither saccade accuracy nor saccade kinematics were affected in these paradigms. We propose that, in addition to an aspecific warning signal, the reduction of saccadic latency is due to interactions that take place at a multimodal stage of saccade programming, where theperceived positions of visual and auditory stimuli are represented in a common frame of reference. This hypothesis is in agreement with our finding that the saccades often are initially directed to the average position of the visual and the auditory target, provided that their spatial separation is not too large. Striking similarities with electrophysiological findings on multisensory interactions in the deep layers of the midbrain superior colliculus are discussed.     

Movement and illumination factors in adaptation to prismatic viewing

While wearing laterally displacing prisms, Ss were required to align a spot of light to the phenomenal straightahead. These measurements were obtained at the beginning and at the end of an exposure to prismatic displacement. In addition, Ss either actively controlled movement of the spot of light, or movement was manipulated by E under the direction of the S. Aftereffects were determined by having S position the spot of light with normal vision at the beginning of the experiment and after each measurement obtained under prism viewing. Ss in the darkened room condition who were required to align the spot of light actively showed a significant aftereffect in the direction of prismatic displacement both at the beginning and at the end of the exposure period. No difference in the degree of adaptation was found between those measurements at the beginning and at the end of the exposure period. No significant aftereffects were found when the room was illuminated during prism exposure or when E controlled movement of the light source.     

Cognitive processes in psychological adaptation to miscarriage: A preliminary report

Abstract

Twenty-two women who wished to continue their pregnancies were interviewed several months after their first miscarriage. Levels of anxiety and depression showed an extremely high degree of variability. Cognitive processes in the form of a search for meaning, mastery and self-enhancement hypothesised to be important in adaptation to negative events were assessed. Having an explanation for the miscarriage and the experience leading to a general reappraisal of values were associated with lower levels of intrusive thoughts. A belief in a medical cause was linked to lower anxiety. Women believed that neither they themselves nor their doctors could exert much influence over the outcome of future pregnancies. Stronger belief in personal control was associated with higher anxiety levels. There is a need to consider not only the emotional consequences of miscarriage but also the cognitive mediators influencing such responses and although based upon a small sample this study initiates that process.     

Cognitive and marital factors in depression

The current investigation examines three groups of wives: (1) a group of nondepressed, nondiscordant community wives; (2) a group of nondepressed, discordant clinic wives; and (3) a group of depressed, discordant clinic wives. Groups were formed on the basis of structured interview responses and responses to a self-report inventory of depressive symptomatology. To be classified as depressed, wives were required to meet DSM III criteria for depression according to interview data and to exceed a Beck Depression Inventory score of 14. Both clinic groups showed equal levels of marital discord. Both nondepressed groups showed equally few cognitive errors. Accordingly, comparisons of these three groups allow us to test current interpersonal and cognitive theories of depression. The level of closeness in the marriage differentiated the depressed, discordant from the nondepressed, discordant wives despite their equal levels of overall marital discord. The level of depressive symptomatology was greater for the nondepressed clinic wives than it was for the community wives despite their equal levels of cognitive errors. Both closeness in the marriage and cognitive errors accounted for the unique variance in level of depression. Implications for current interpersonal and cognitive accounts of depression are discussed.Support for this research came in part from NIMH Grant 38390-02. Portions of this paper were presented at the 25th Annual Convention of the American Association for the Advancement of Behavior Therapy.     

Modifying an underlying component of perceived arm length: adaptation of tactile location induced by spatial discordance

In four experiments we examined the adaptation and aftereffect that resulted from a treatment yielding tactile/kinesthetic length discordance between the arms. Perceived discordance diminished with trials and tended to zero. Subsequent visual/tactile cross-modal judgments of distance showed the aftereffect to be a change in the perceived location of an unseen probed spot on each hand with respect to the location of a truly coincident visual marker. This occurred toward the body for the probed spot on one arm and away from the body on the other. There were three other main findings: (a) Arm movement was not a necessary condition for adaptation or aftereffect; (b) with intrinsic length information about the right arm present, but touch information from the right index finger absent during treatment, adaptation and aftereffect were abolished; (c) aftereffects of tactile location that were manifest at the hand and wrist tended to zero when a point close to the elbow was tested with a cross-modal procedure. The experiments provide evidence that the mapping of the tactile sheet onto an internal length domain had been modified by the treatment. The sensory consequences of the treatment led many subjects to report spontaneously that their arms felt to be of different lengths.     

Spatial co-location and infants'' learning of auditory-visual associations

The role of spatial co-location between sight and sound in infants' cross-modal learning was examined in three experiments. Four-and 6-month-old infants were familiarized with a toy and an accompanying soundtrack. Across conditions, spatial congruity between sight and sound was varied. Following familiarization, infants were tested to determine under which conditions they learned to associate the toy with the sound. Results indicated age-related differences in how discrepant in location a sight and sound could be for infants to form a cross-modal association based on the amodal invariant of co-location. Specifically, 4-month-olds formed cross-modal associations under conditions of less precise co-location than did 6-month-olds. Parallel improvements in infants' sound localization abilities across this age span are likely a contributing factor to the observed developmental trend in cross-modal learning.     

Cognitive and linguistic factors affect visual feature integration

Five experiments investigated the influence of cognitive and linguistic factors on the integration of color and letter-shape information. Subjects were briefly presented strings of colored letters that varied in pronounceability and familiarity. Detection and search tasks required subjects to identify the color of predesignated target letters. It was proposed that errors in integrating color and shape would be less likely with items from different perceptual units than from items within the same perceptual unit. If words, at some level of perceptual analysis, are processed as units whereas nonwords are processed by individual letters, then there should be more letter-shape and color feature integration errors with words than with nonwords. The first two experiments tested this prediction by comparing feature integration errors with words and nonwords. The remaining experiments manipulated letter-string pronounceability, familiarity, and the presence of vowels to isolate the factors that may influence feature integration. The results demonstrate that cognitive and linguistic factors, such as familiarity and pronounceability, can influence the combination of colors and shapes in perception.     

Cognitive discernible factors between schizophrenia and schizoaffective disorder

BACKGROUND: Schizophrenia (SZ) and schizoaffective disorders (SA) are associated with cognitive deficits. Generally, a schizoaffective diagnosis is associated with better prognosis on the level of social integration. It is also well established that cognition is an important factor for good social outcome in schizophrenia. We hypothesized that, although patients suffering from SA share symptoms with SZ, they can be differentiated on the basis of neurocognitive function and that SA perform better in several domains. METHOD: Performances of two groups SA (N = 13) and SZ (N = 44) were compared on several visual-motor tasks using CANTAB [Motor Screening (MOT), Reaction Time (RTI), Paired Associates Learning Task (PAL), and Stockings of Cambridge items (SOC)]. The two groups were matched for symptom severity. ANOVA with repeated measures was employed to determine whether any difference in cognitive scores during a 2-year period was significantly related to the diagnostic status. RESULTS: A significant and durable difference was observed between SZ and SA on motor screening and explicit memory tests where SA performed better. CONCLUSION: Neurocognitive tests may be relevant for distinguishing schizoaffective from schizophrenia, chiefly via tests tapping into visuo-spatial and visuo-motor coordination abilities (e.g., paired associated learning and motor screening).     

Four triggering factors in loudness adaptation.

A factor analysis was used to determine whether induced loudness adaptation (Botte, Canevet, & Scharf, 1982; Scharf, 1983) and adaptation measured by Hood's (1950) classic Simultaneous Dichotic Loudness Balance technique (SDLB) would cluster on the same factors. The two phenomena did not cluster on the same factors; thus, induced adaptation cannot replace SDLB adaptation. Four independent factors that trigger auditory adaptation were identified in the factor analysis.     

Social and linguistic factors influencing adaptation in children's speech

The ability to appropriately reciprocate or compensate a partner's communicative response represents an essential element of communicative competence. Previous research indicates that as children grow older, their speech levels reflect greater adaptation relative to their partner's speech. In this study, we argue that patterns of adaptation are related to specific linguistic and pragmatic abilities, such as verbal responsiveness, involvement in the interaction, and the production of relatively complex syntactic structures. Thirty-seven children (3–6 years of age) individually interacted with an adult for 20 to 30 minutes. Adaptation between child and adult was examined among conversational floortime, response latency, and speech rate. Three conclusions were drawn from the results of this investigation. First, by applying time-series analysis to the interactants' speech behaviors within each dyad, individual measures of the child's adaptations to the adult's speech can be generated. Second, consistent with findings in the adult domain, these children generally reciprocated changes in the adult's speech rate and response latency. Third, there were differences in degree and type of adaptation within specific dyads. Chronological age was not useful in accounting for this individual variation, but specific linguistic and social abilities were. Implications of these findings for the development of communicative competence and for the study of normal versus language-delayed speech were discussed.     

Adaptation to visual rearrangement: Role of sensory discordance

The relative contributions of proprioceptive and efferent information in eliciting adaptation to visual rearrangement were studied under two conditions of visual stimulation. Subjects permitted sight of their forearm under normal room illumination showed significant adaptation when the forearm was (a) moved up and down under the action of tonic vibration reflexes, (b) voluntarily moved through the same trajectory at the same pace, (c) viewed while still, and (d) viewed while the margins of the elbow were vibrated. The reflex movement condition elicited significantly greater adaptation than the other conditions. Subjects allowed only sight of a point source of light attached to their hand showed significant adaptation when the forearm was (a) reflexly moved, (b) voluntarily moved through the same trajectory at the same rate, (c) passively moved, (d) still, and (e) vibrated while still. Less adaptation occurred as the amount of proprioceptive information about limb position was decreased. The adaptation elicited by voluntary movements of the forearm and by reflex movements did not differ significantly. It is concluded that corollary-discharge signals may not be crucial in adaptation to visual rearrangement; a more important factor appears to be discordance between proprioceptive and visual information.     

Cognitive development following early brain injury: evidence for neural adaptation

Over the past few decades a large body of work from developmental neurobiology has shown that mammalian brain development is the product of dynamic and adaptive processes operating within highly constrained, but continually changing, biological and environmental contexts. The recent study of children with prenatal focal brain injury supports this dynamic view of development for humans. Children's injuries often affect substantial portions of one cerebral hemisphere, resulting in damage that would compromise cognitive ability in adults. However, longitudinal behavioral studies of this population have revealed only mild deficits. It is suggested here that children's capacity for adaptation reflects normal developmental processes operating against a backdrop of serious neural perturbation. Data from three behavioral domains--linguistics, spatial cognition and affective development--illustrate this complex profile of change.     

Cross-modal, auditory-visual Stroop interference: a reply to Cowan and Barron (1987)

This series of experiments was performed to verify Cowan and Barron's (1987) reported effect of auditory color-word interference on a visual Stroop task. Extant theory predicts effects of irrelevant speech on visual memory tasks involving immediate, ordered recall of the items. Interference between the two sources of information (visual and auditory) is assumed to be located at the phonological store component of the articulatory loop. Perceptual tasks such as the Stroop task, which do not require use of the articulatory loop for rehearsal purposes, should not be similarly susceptible. The present data fail to replicate Cowan and Barron's findings, and are thus consistent with contemporary theory.