Intersensory redundancy guides attentional selectivity and perceptual learning in infancy

This study assessed an intersensory redundancy hypothesis, which holds that in early infancy information presented redundantly and in temporal synchrony across two sense modalities selectively recruits attention and facilitates perceptual differentiation more effectively than does the same information presented unimodally. Five-month-old infants' sensitivity to the amodal property of rhythm was examined in 3 experiments. Results revealed that habituation to a bimodal (auditory and visual) rhythm resulted in discrimination of a novel rhythm, whereas habituation to the same rhythm presented unimodally (auditory or visual) resulted in no evidence of discrimination. Also, temporal synchrony between the bimodal auditory and visual information was necessary for rhythm discrimination. These findings support an intersensory redundancy hypothesis and provide further evidence for the importance of redundancy for guiding and constraining early perceptual learning.     

The development of infant discrimination of affect in multimodal and unimodal stimulation: The role of intersensory redundancy

This research examined the developmental course of infants' ability to perceive affect in bimodal (audiovisual) and unimodal (auditory and visual) displays of a woman speaking. According to the intersensory redundancy hypothesis (L. E. Bahrick, R. Lickliter, & R. Flom, 2004), detection of amodal properties is facilitated in multimodal stimulation and attenuated in unimodal stimulation. Later in development, however, attention becomes more flexible, and amodal properties can be perceived in both multimodal and unimodal stimulation. The authors tested these predictions by assessing 3-, 4-, 5-, and 7-month-olds' discrimination of affect. Results demonstrated that in bimodal stimulation, discrimination of affect emerged by 4 months and remained stable across age. However, in unimodal stimulation, detection of affect emerged gradually, with sensitivity to auditory stimulation emerging at 5 months and visual stimulation at 7 months. Further temporal synchrony between faces and voices was necessary for younger infants' discrimination of affect. Across development, infants first perceive affect in multimodal stimulation through detecting amodal properties, and later their perception of affect is extended to unimodal auditory and visual stimulation. Implications for social development, including joint attention and social referencing, are considered.     

Perceptual and academic patterns of learning-disabled/gifted students.

This research explored ways gifted children with learning disabilities perceive and recall auditory and visual input and apply this information to reading, mathematics, and spelling. 24 learning-disabled/gifted children and a matched control group of normally achieving gifted students were tested for oral reading, word recognition and analysis, listening comprehension, and spelling. In mathematics, they were tested for numeration, mental and written computation, word problems, and numerical reasoning. To explore perception and memory skills, students were administered formal tests of visual and auditory memory as well as auditory discrimination of sounds. Their responses to reading and to mathematical computations were further considered for evidence of problems in visual discrimination, visual sequencing, and visual spatial areas. Analyses indicated that these learning-disabled/gifted students were significantly weaker than controls in their decoding skills, in spelling, and in most areas of mathematics. They were also significantly weaker in auditory discrimination and memory, and in visual discrimination, sequencing, and spatial abilities. Conclusions are that these underlying perceptual and memory deficits may be related to students' academic problems.     

儿童视听觉通道现实监控的发展

采用视觉图片和动画,听觉声音和词语任务,分别要求5岁（平均年龄66.5个月）、7岁（平均年龄80.8个月）和9岁（平均年龄117.2个月）共233名儿童在知觉和想象材料中作出来源判断,比较现实监控任务中视听觉通道之间和通道内部的发展差异。结果发现,在通道内部,不同实验材料对现实监控的影响不尽相同。在视觉通道内部：较小年龄儿童对图片的现实监控好于动画,较大年龄儿童对动画的现实监控好于图片;在听觉通道内部：儿童对声音的现实监控好于词。随着年龄的增长,对记忆现实监控的通道差异从视觉的图片刺激优势到图片和动画优势,到视觉刺激和声音对词的优势。文章还讨论了这些发展差异的可能原因,对我们理解个体记忆发展的规律和特点以及对实践的指导意义     

New methodology in infant operant kicking procedures: computerized stimulus control and computerized measurement of kicking

Numerous developmental issues have been assessed using a mobile reinforcement procedure (leg kicks=operant response, movement of a 3D mobile=reinforcer). The current study addressed issues of stimulus control in the mobile procedure through implementation of computerized measurement of leg kicks and computerized control over auditory/visual reinforcers. Experiment 1 demonstrated that the computerized apparatus provides a sensitive measure of learning and memory. Experiment 2 examined the efficacy of single and multiple modality reinforcement in learning/retention of operant kicking and revealed successful acquisition with single modality reinforcement. These results suggest that the mobile procedure could be expanded to address other types of developmental questions (i.e. perception, cognition, intersensory integration) and could be modified to allow replacement of the 3D mobile with images displayed on a computer monitor, thereby extending the utility of the procedure to studies requiring precise psychophysical control over visual stimuli (i.e. object identification and categorization).     

Prolonged development of auditory skills: A role for perceptual anchoring?

Many auditory skills continue to develop beyond infancy and even into adolescence, but the factors underlying this prolonged development remain poorly understood. Of interest here is the contribution of on-line statistical learning of stimulus repetitions (anchoring) to the development of auditory spectral and temporal discrimination, as well as the potential contributions of auditory attention and working memory. Children, aged 6–13 years, as well as adults (age range: 21–33 years) were tested on auditory frequency and duration discrimination. Each type of discrimination was measured in two conditions (XAB and XXXAB) designed to afford different levels of anchoring by varying the number of repetitions of a standard stimulus (X) prior to the presentation of the test tone (A or B) in each trial. Auditory attention and working memory were also assessed. Whereas duration and frequency discrimination in either condition did not reach adult level prior to 11 years of age, the magnitude of the anchoring effect was similar across ages. These data suggest that perceptual anchoring matures prior to the attainment of adult-like discrimination thresholds. Likewise, neither attention nor working memory could account for the observed developmental trajectories. That auditory discrimination and anchoring follow dissociable developmental trajectories suggests that different factors might contribute to the development of each. We therefore conclude that although anchoring might be necessary for attaining good auditory discrimination, it does not account for the prolonged development of auditory frequency and duration discrimination in school-aged children.     

阅读障碍儿童汉字认知特点研究

运用多重评估法从760名小学3年级学生中选取了30名阅读与记字困难学生和30名正常学生为被试,分别研究了儿童视觉能力、听知觉能力和字形-音及字形义通道联结能力的识字认知特点。研究结果表明,阅读障碍儿童基本语音辩别能力不存在落后,而在视觉辨别、字形长时记忆、语音短时记忆以及形音和形义联结长时记忆上都存在程度不同的落后。研究还发现,阅读障碍儿童具有对汉字做浅层次机械加工和视觉加工的倾向。     

Development of motion processing in children with autism

Recent findings suggest that children with autism may be impaired in the perception of biological motion from moving point-light displays. Some children with autism also have abnormally high motion coherence thresholds. In the current study we tested a group of children with autism and a group of typically developing children aged 5 to 12 years of age on several motion perception tasks, in order to establish the specificity of the biological motion deficit in relation to other visual discrimination skills. The first task required the recognition of biological from scrambled motion. Three quasi-psychophysical tasks then established individual thresholds for the detection of biological motion in dynamic noise, of motion coherence and of form-from-motion. Lastly, individual thresholds for a task of static perception--contour integration (Gabor displays)--were also obtained. Compared to controls, children with autism were particularly impaired in processing biological motion in relation to any developmental measure (chronological or mental age). In contrast, there was some developmental overlap in ability to process other types of visual motion between typically developing children and the children with autism, and evidence of developmental change in both groups. Finally, Gabor display thresholds appeared to develop typically in children with autism.     

Elicitation and Inhibition of Competitive Fighting in Food Deprived Mice

Habituation as an index of the intrasensory and intersensory integration of form was investigated in nine-year-old children. In Habituation Period One, Ss were habituated to either a visual or a haptic 14″-perimeter standard stimulus. During Habituation Period Two, groups were subdivided and presented with one of the following stimuli: (a) 14″ visual, (b) 16″ visual, (c) 14″ haptic, or (d) 16″ haptic. The dependent variables were GSR frequency and amplitude, visual fixation time, and touching time. Subjects required more trials to habituate to the different stimulus presented in Habituation Period Two than Ss who received repeated presentations of the same stimulus. GSR frequency and amplitude habituated more consistently than did fixation and touching response measures. The results supported the use of the habituation paradigm for the study of intersensory and intrasensory integration, as well as providing support for extending Sokolov's theory to intersensory functions.     

A factorial study of auditory function

Tests of auditory function in the fields of pitch, loudness, quality (timbre), and time, auditory analysis, synthesis, and memory, together with age, intelligence, and four tests of visual memory, were studied factorially. The subjects were 200 high-school students. The intercorrelations were factored to nine factors by a modification of the centroid technique and rotated to an oblique simple structure. No general auditory factor appeared. Instead there appeared group factors tentatively identified as pitch-quality discrimination, loudness discrimination, auditory integral for perceptual mass, auditory resistance (synthesis and analysis), speed of closure, auditory span formation, memory span (auditory and visual), memory or incidental closure and an unidentifiable residual plane. The average intercorrelation among the primary vectors was low, only one intercorrelation being greater than .34. A number of queries are answered by the interpretation of the results.     

A two-stage model for visual-auditory interaction in saccadic latencies

In two experiments, saccadic response time (SRT) for eye movements toward visual target stimuli at different horizontal positions was measured under simultaneous or near-simultaneous presentation of an auditory nontarget (distractor). The horizontal position of the auditory signal was varied, using a virtual auditory environment setup. Mean SRT to a visual target increased with distance to the auditory nontarget and with delay of the onset of the auditory signal relative to the onset of the visual stimulus. A stochastic model is presented that distinguishes a peripheral processing stage with separate parallel activation by visual and auditory information from a central processing stage at which intersensory integration takes place. Two model versions differing with respect to the role of the auditory distractors are tested against the SRT data.     

Duration discrimination in the context of age,sex, and cognition

It has been proposed that the perception of very short duration is governed by sensory mechanisms, whereas the perception of longer duration depends on cognitive capacities. Four duration discrimination tasks (modalities: visual, auditory; base duration: 100 ms, 1000 ms) were used to study the relation between time perception, age, sex, and cognitive abilities (alertness, visual and verbal working memory, general fluid reasoning) in 100 subjects aged between 21 and 84 years. Temporal acuity was higher (Weber fractions are lower) for longer stimuli and for the auditory modality. Age was related to the visual 100 ms condition only, with lower temporal acuity in elder participants. Alertness was significantly related to auditory and visual Weber fractions for shorter stimuli only. Additionally, visual working memory was a significant predictor for shorter visual stimuli. These results indicate that alertness, but also working memory, are associated with temporal discrimination of very brief duration.     

A family study of memory processes and their relations to cognitive test scores

Members of 118 families (456 individuals) who had been tested on several measures of cognitive ability were retested on the same battery in order to determine test-retest reliability. They then were administered the Wechsler Adult Intelligence Scale and tests of visual memory, auditory memory, and figure memory, as well as other measures not discussed herein. Intercorrelations of memory tasks were low to moderate. Factor analysis resulted in a four factor solution. The different factors appeared to represent auditory sequential memory (Factor I); visual memory, as measured psychometrically (Factor II); visual memory, as measured experimentally (Factor III); and figure memory (Factor IV). A second order factor analysis yielded two factors, one consisting of basically psychometric measures of memory and the other of measures of memory obtained in the experimental psychological tradition. Memory measures generally showed low to moderate positive correlations with scores on the cognitive test battery. Significant spouse correlations were found for 3 of the 11 measures of memory. Significant midparent-midchild regressions were found for 9 of the 11 memory measures.     

Intermodal enhancement of stimulus localisation in infants born prematurely

The interaction of auditory and visual modalities in the enhancement of orientation was examined in premature and near-term infants by presenting them auditory or visual stimuli or auditory-visual stimulus combinations at various positions in sensory space. In 4.5--15-mo-olds, brisk orienting responses could be elicited to very peripheral stimulus positions but only when the stimulus consisted of a spatially coherent auditory-visual combination (i.e., where a sound and a light occurred at the same point in space). This occurred for all infants, irrespective of age or gestational age at birth. First, the result shows that infants can respond to visual stimuli at eccentric positions, beyond the supposed limits of their effective visual fields as measured by standard perimetry. Second, the result extends earlier studies showing that intersensory integration and stimulus localisation develop relatively normally in prematurely born infants. The auditory-visual enhancement test as used here may have a number of further uses and applications in the clinic and laboratory.     

Auditory and visual differences in time perception? An investigation from a developmental perspective with neuropsychological tests

Adults and children (5- and 8-year-olds) performed a temporal bisection task with either auditory or visual signals and either a short (0.5-1.0s) or long (4.0-8.0s) duration range. Their working memory and attentional capacities were assessed by a series of neuropsychological tests administered in both the auditory and visual modalities. Results showed an age-related improvement in the ability to discriminate time regardless of the sensory modality and duration. However, this improvement was seen to occur more quickly for auditory signals than for visual signals and for short durations rather than for long durations. The younger children exhibited the poorest ability to discriminate time for long durations presented in the visual modality. Statistical analyses of the neuropsychological scores revealed that an increase in working memory and attentional capacities in the visuospatial modality was the best predictor of age-related changes in temporal bisection performance for both visual and auditory stimuli. In addition, the poorer time sensitivity for visual stimuli than for auditory stimuli, especially in the younger children, was explained by the fact that the temporal processing of visual stimuli requires more executive attention than that of auditory stimuli.     

Intersensory conflict between vision and touch: the response modality dominates when precise, attention-riveting judgments are required

In four experiments, reducing lenses were used to minify vision and generate intersensory size conflicts between vision and touch. Subjects made size judgments, using either visual matching or haptic matching. In visual matching, the subjects chose from a set of visible squares that progressively increased in size. In haptic matching, the subjects selected matches from an array of tangible wooden squares. In Experiment 1, it was found that neither sense dominated when subjects exposed to an intersensory discrepancy made their size estimates by using either visual matching or haptic matching. Size judgments were nearly indentical for conflict subjects making visual or haptic matches. Thus, matching modality did not matter in Experiment 1. In Experiment 2, it was found that subjects were influenced by the sight of their hands, which led to increases in the magnitude of their size judgments. Sight of the hands produced more accurate judgments, with subjects being better able to compensate for the illusory effects of the reducing lens. In two additional experiments, it was found that when more precise judgments were required and subjects had to generate their own size estimates, the response modality dominated. Thus, vision dominated in Experiment 3, where size judgments derived from viewing a metric ruler, whereas touch dominated in Experiment 4, where subjects made size estimates with a pincers posture of their hands. It is suggested that matching procedures are inadequate for assessing intersensory dominance relations. These results qualify the position (Hershberger & Misceo, 1996) that the modality of size estimates influences the resolution of intersensory conflicts. Only when required to self-generate more precise judgments did subjects rely on one sense, either vision or touch. Thus, task and attentional requirements influence dominance relations, and vision does not invariably prevail over touch.     

Visuospatial working memory,auditory discrimination,and attention

ABSTRACT

The present study examined the degree to which tests of visuospatial storage capacity tap into domain-general storage and attention processes. This was done by comparing performance of visuospatial memory tasks with performance on sound-based sensory discrimination tasks. We found that memory task- and discrimination task performance both tapped into a cross-modality factor (visual and auditory). We further examined the degree to which this common variance could be explained by attention control and sustained attention. These attention factors accounted for roughly 60% of the variance in memory. This indicates that tests of visuospatial memory capacity reflect more than modality-specific memory.     

Working memory deficits in boys with attention deficit/hyperactivity disorder (ADHD): An examination of orthographic coding and episodic buffer processes

The episodic buffer component of working memory was examined in children with attention deficit/hyperactivity disorder (ADHD) and typically developing peers (TD). Thirty-two children (ADHD = 16, TD = 16) completed three versions of a phonological working memory task that varied with regard to stimulus presentation modality (auditory, visual, or dual auditory and visual), as well as a visuospatial task. Children with ADHD experienced the largest magnitude working memory deficits when phonological stimuli were presented via a unimodal, auditory format. Their performance improved during visual and dual modality conditions but remained significantly below the performance of children in the TD group. In contrast, the TD group did not exhibit performance differences between the auditory- and visual-phonological conditions but recalled significantly more stimuli during the dual-phonological condition. Furthermore, relative to TD children, children with ADHD recalled disproportionately fewer phonological stimuli as set sizes increased, regardless of presentation modality. Finally, an examination of working memory components indicated that the largest magnitude between-group difference was associated with the central executive. Collectively, these findings suggest that ADHD-related working memory deficits reflect a combination of impaired central executive and phonological storage/rehearsal processes, as well as an impaired ability to benefit from bound multimodal information processed by the episodic buffer.