Developmental changes in associations between auditory-visual events

The goal of the present study was twofold: to examine the influence of two amodal properties, co-location and temporal synchrony, on infants' associating a sight with a sound, and to determine if the relative influence of these properties on crossmodal learning changes with age. During familiarization 2-, 4-, 6- and 8-month-olds were presented two toys and a sound, with sights and sounds varying with respect to co-location and temporal synchrony. Following each familiarization phase infants were given a paired preference test to assess their learning of sight-sound associations. Measures of preferential looking revealed age-related changes in the influence of co-location and temporal synchrony on infants' learning sight-sound associations. At all ages, infants could use temporal synchrony and co-location as a basis for associating an auditory with a visual event and, in the absence of temporal synchrony, co-location was sufficient to support crossmodal learning. However, when these cues conflicted there were developmental changes in the influence of these cues on infants' learning auditory-visual associations. At 2 and 4 months infants associated the sounds with the toy that moved in synchrony with the sound's rhythm despite extreme violation of co-location of this sight and sound. In contrast, 6- and 8-month-olds did not associate a specific toy with the sound when co-location and synchrony information conflicted. The findings highlight the unique and interactive effects of distinct amodal properties on infants' learning arbitrary crossmodal relations. Possible explanations for the age shift in performance are discussed.     

Developmental changes in visual scanning of face and nonface patterns by infants

The eye movements of infants, aged 4–5, 7–8, and 10–11 weeks, were recorded while they viewed either a representation of a face or a nonface stimulus. Presentation of the visual stimulus was paired with the presentation of an auditory stimulus (either voice or tone) or silence. Attention to the visual stimulus was greater for the older two groups than for the youngest group. The effect of the addition of sound was to increase attention to the visual stimulus. In general, the face was looked at more than the nonface stimulus. The difference in visual attention between the face and the nonface stimulus did not appear to be based solely on the physical characteristics of the stimuli. A sharp increase in the amount of looking at the eyes of the face stimulus at 7–8 weeks of age seemed to be related to a developing appreciation of the meaning of the face as a pattern.     

Novelty and frequency as determinants of newborn preference

The debate over whether infants prefer a familiar stimulus over a novel stimulus has persisted for over 30 years, and there is evidence which supports both sides of the question. However, the research which supports the preference for the familiar uses different measures than that which supports the preference for novelty. In the first experiment, the preference for the familiar was tested by making one stimulus more familiar than the others presented. A target of a ‘familiar’ face was presented eight times more frequently than the other faces. During the experiment, the infants could choose at which face they looked and for how long. It was found that the infants significantly preferred the familiar face over any one of the novel faces, especially when the familiar face was presented first. Substituting auditory for visual stimuli, the second experiment was a replication of the first experiment. Consonant–vowel syllables were used instead of faces. Overall, 17 stimuli were used: one repeating ‘familiar’ sound, and 16 novel sounds. It was found that the infants significantly preferred the familiar sound over any of the novel sounds. As found in Experiment 1, the infants also had a greater preference for the familiar sound when it was presented first.     

Intermodal matching of vision and audition in infancy: A proposal for a new taxonomy

The aim of this review paper is first to devise a common framework for the various procedures used in experimental investigations of intermodal auditory – visual matching by human infants, and second to propose a new taxonomy of intermodal tasks in order to gain a better understanding of the perceptual-cognitive processing underlying these tasks and their relationships to other cognitive achievements such as the development of language. Based on an examination of the tasks used in the developmental literature, we suggest analysing them in terms of (a) their mode of presentation (simultaneous or sequential) for accessing the information in the two modalities (auditory and visual) and (b) the type of relation (amodal or arbitrary) between these two stimulus sources. A review of the literature in the light of this classification shows that most experimental studies employ parallel intermodal presentation (PIP) using both amodal and arbitrary relations between stimuli. Very few investigations have used sequential intermodal presentation (SIP) with amodal relations, and none have used SIP procedures with arbitrary relations. It is claimed here that this last approach might be the most appropriate one for furthering our understanding of (a) the categorical and semantic processing involved in intermodal matching and (b) how the developing infant learns to process words.     

Crossmodal spatial attention shift produced by centrally presented gaze cues1

Abstract: Despite previous failures to identify visual‐upon‐auditory spatial‐cuing effects, recent studies have demonstrated that the abrupt onset of a lateralized visual stimulus triggers a shift of spatial attention in response to auditory judgment. Nevertheless, whether a centrally presented visual stimulus orients auditory attention remained unclear. The present study investigated whether centrally presented gaze cues trigger a reflexive shift of attention in response to auditory judgment. Participants fixated on a schematic face in which the eyes looked left or right (the cue). A target sound was then presented to the left or right of the cue. Participants judged the direction of the target as quickly as possible. Even though participants were told that the gaze direction did not predict the direction of the target, the response time was significantly faster when the gaze was in the target direction than when it was in the non‐target direction. These findings provide initial evidence for visual‐upon‐auditory spatial‐cuing effects produced by centrally presented cues, suggesting that a reflexive crossmodal shift of attention does occur with a centrally presented visual stimulus.     

Development of selective attention in young infants: Enhancement and attenuation of startle reflex by attention

This study examined the effect of level of attention engagement on the modification of the blink reflex in young infants. Infants at 8, 14, 20, or 26 weeks of age were presented with interesting visual or auditory stimuli. At delays defined by changes in heart rate known to be associated with sustained attention or attention disengagement, blink reflexes were elicited by visual or auditory blink reflex stimuli. Blink amplitude varied according to the level of attention, and the match between the foreground and blink reflex stimulus. If the infant was attending to the foreground stimulus, a blink reflex stimulus in the same modality resulted in enhanced blink reflex magnitude. A blink reflex stimulus in the other modality resulted in an attenuated blink reflex magnitude. If attention was not engaged with the foreground stimulus, this modulation of the blink reflex did not occur. This ‘selective modality effect’ showed an increasing tendency to occur between 8 and 26 weeks of age. These results show that selective attention to modalities increases over this age range.     

Evidence of amodal representation of small numbers across visuo-tactile modalities in 5-month-old infants

Two experiments investigated 5-month-old infants’ amodal sensitivity to numerical correspondences between sets of objects presented in the tactile and visual modes. A classical cross-modal transfer task from touch to vision was adopted. Infants were first tactually familiarized with two or three different objects presented one by one in their right hand. Then, they were presented with visual displays containing two or three objects. Visual displays were presented successively (Experiment 1) or simultaneously (Experiment 2). In both experiments, results showed that infants looked longer at the visual display which contained a different number of objects from the tactile familiarization phase. Taken together, the results revealed that infants can detect numerical correspondences between a sequence of tactile and visual stimulation, and they strengthen the hypothesis of amodal and abstract representation of small numbers of objects (two or three) across sensory modalities in 5-month-old infants.     

Effects of adults’ contingent responding on infants’ behavior in ambiguous situations

We examined the effect of adults’ contingency in responding to infants’ behavior in an ambiguous situation in two experiments. In Experiment 1, forty-four 12-month-old infants were exposed to an ambiguous toy. An unfamiliar adult responded either contingently or non-contingently to the infant’s bids and then presented the toy and provided positive information. During toy presentation, infants in the non-contingent condition looked less at the experimenter than infants in the contingent condition. In a concluding free-play situation infants in the non-contingent condition played less and tended to touch the toy less. In Experiment 2 (forty-four 12-month-old infants), the parent either responded promptly or with a delay each time the infant made contact initiatives and then presented an ambiguous toy and delivered the positive information. The infants in the non-contingent condition tended to look less at the parent during toy presentation and also tended to play less with the toy during the concluding free-play situation. The findings show that adults’ contingency in responding influences infants’ behavior in ambiguous situations.     

Emerging self-exploration by 2-month-old infants

Two-month-olds and newborns were tested in a situation where they had the opportunity to experience different auditory consequences of their own oral activity on a dummy pacifier. Modulation of oral activity was scored and analyzed relative to two types of contingent auditory feedback, either analog or non-analog to the effort exerted by the infant on the pacifier. The dummy pacifier was connected to an air pressure transducer for recording of oral action. In two different experimental conditions, each time the infant sucked above a certain pressure threshold they heard a perfectly contingent sound of varying pitch. In one condition, the pitch variation was analog to the pressure applied by the infant on the pacifier (analog condition). In another, the pitch variation was random (non-analog condition). As rationale, a differential modulation of oral activity in these two conditions was construed as indexing some voluntary control and the sense of a causal link between sucking and its auditory consequences, beyond mere temporal contingency detection and response–stimulus association. Results indicated that 2-month-olds showed clear signs of modulation of their oral activity on the pacifier as a function of analog versus non-analog condition. In contrast, newborns did not show any signs of such modulation either between experimental conditions (analog versus non-analog contingent sounds) or between baseline (no contingent sounds condition) and experimental conditions. These observations are interpreted as evidence of self-exploration and the emergence of a sense of self-agency by 2 months of age.     

Visual motion influences the contingent auditory motion aftereffect

In this study, we show that the contingent auditory motion aftereffect is strongly influenced by visual motion information. During an induction phase, participants listened to rightward-moving sounds with falling pitch alternated with leftward-moving sounds with rising pitch (or vice versa). Auditory aftereffects (i.e., a shift in the psychometric function for unimodal auditory motion perception) were bigger when a visual stimulus moved in the same direction as the sound than when no visual stimulus was presented. When the visual stimulus moved in the opposite direction, aftereffects were reversed and thus became contingent upon visual motion. When visual motion was combined with a stationary sound, no aftereffect was observed. These findings indicate that there are strong perceptual links between the visual and auditory motion-processing systems.     

偏差声音干扰刺激对视觉注意网络系统的影响

结合注意网络测量工具和听视ODDBALL干扰范式,考察偏差声音干扰刺激的出现对注意网络系统不同功能的影响。结果发现,声音刺激序列下,视觉线索唤醒效应均消失; 标准声音刺激下,不存在线索的脱离和转移效应; 偏差声音刺激下,出现线索脱离和转移效应。研究表明,注意网络中的警觉功能具有超通道加工机制,偏差刺激下视觉注意系统中注意定向和线索转移效应的出现表明偏差干扰效应主要由偏差刺激引起的注意脱离和注意转移损耗部分引起。     

Electromyographic responses in infants after auditory stimulation.

49 of 50 newborn infants, when presented with a strong auditory stimulus, showed significant increases in EMG potential. The infant who failed initially responded when rechecked in 1 mo. The results suggest it may be possible to develop an EMG-Audiometric process which could be employed in screening hearing of newborn infants.     

Development of infant reaching in the dark to luminous objects and 'invisible sounds'

Two studies were conducted to investigate the existence of an unusual U-shaped developmental function described by Wishart et al (1978) for human infants reaching towards invisible sounds. In study 1, 2-7 month olds were presented with four conditions: (i) an invisible auditory stimulus alone, (ii) a glowing visual stimulus alone, (iii) auditory and visual stimuli on the same side (ie combined), and (iv) auditory and visual stimuli on opposite sides (ie in conflict). Study 2 was designed to examine the effects of practice and possible associations made when using the 'combined conflict' paradigm. Infants of 5 and 7 months of age were given five trials with the auditory stimulus, with or without prior visual experience, and five trials with the visual stimulus, with the position of the stimulus varied on each trial. Stimuli were presented individually at the midline, and +/- 30 and +/- 60 degrees from the midline. In both studies testing was conducted in complete darkness. Results indicated that the auditory-alone condition was slower to elicit a reach from the infants, relative to the visual-alone one, and reaches were least frequent to the auditory target. No U-shaped function was obtained, and reaching for auditory targets occurred later in age than for visual targets, but even at 7 months of age did not occur as often and was achieved by fewer infants. In both studies the quality of the reach was significantly poorer to auditory than to visual targets, but there were some accurate reaches. This research adds to our understanding of the development of auditory-manual coordination in sighted infants and is relevant to theories of auditory localization, visually guided reaching, and programming for the blind.     

Effects of multimodal presentation and stimulus familiarity on auditory and visual processing

Two experiments examined the effects of multimodal presentation and stimulus familiarity on auditory and visual processing. In Experiment 1, 10-month-olds were habituated to either an auditory stimulus, a visual stimulus, or an auditory-visual multimodal stimulus. Processing time was assessed during the habituation phase, and discrimination of auditory and visual stimuli was assessed during a subsequent testing phase. In Experiment 2, the familiarity of the auditory or visual stimulus was systematically manipulated by prefamiliarizing infants to either the auditory or visual stimulus prior to the experiment proper. With the exception of the prefamiliarized auditory condition in Experiment 2, infants in the multimodal conditions failed to increase looking when the visual component changed at test. This finding is noteworthy given that infants discriminated the same visual stimuli when presented unimodally, and there was no evidence that multimodal presentation attenuated auditory processing. Possible factors underlying these effects are discussed.     

Joint attention and object learning in 5‐ and 7‐month‐old infants

We examined the effects of joint attention for object learning in 5‐ and 7‐month‐old infants. Infants interacted with an adult social partner who taught them about a novel toy in two conditions. In the Joint Attention condition, the adult spoke about the toy while alternating gaze between the infant and the toy, while in the Object Only condition, the adult looked to the toy and to a spot on the ceiling, but never at the infant. In the test trials following each social interaction, we presented infants with the ‘familiarization’ toy and a novel toy, and monitored looking times to each object. We found that 7‐month‐olds looked significantly longer to the novel toy following the Joint Attention relative to the Object Only condition, while 5‐month‐old infants did not show a significant difference across conditions. We interpret these results to suggest that joint attention facilitated 7‐month‐old infants' encoding of information about the familiarization object. Implications for the ontogeny of infant learning in joint attention contexts are discussed. Copyright © 2007 John Wiley & Sons, Ltd.     

Attention to eye contact opportunity and facial motion by three-month-old infants

Thirty-two 3-month-old infants participated in two experiments showing color videotapes of facial stimuli in a paired comparison format. In Experiment 1, the experimenter, serving as the stimulus, looked either directly at the infant or averted his gaze to the side; the face was presented either still or in motion. Eye contact opportunity had no effect while motion of the head was an effective attractor of visual fixation. In Experiment 2, the amount of available eye contact opportunity was parametrically varied by occluding the eyes with different patterns of blinking, each at the same rate. The no-motion 100% eye contact available condition received less attention than the three blinking stimuli, which were all equally attended to, though they varied with respect to the amount of eye contact opportunity they afforded. The contrast in effect of eye contact availability and rather subtle stimulus motion would imply that 3-month-old infants are comparatively insensitive to being the object of another's visual regard.     

Redundant amodal properties facilitate operant learning in 3-month-old infants

The current study examined the role redundant amodal properties play in an operant learning task in 3-month-old human infants. Prior studies have suggested that the presence of redundant amodal information facilitates detection and discrimination of amodal properties and potentially functions to influence general learning processes such as associative conditioning. The current study examined how human infants use redundant amodal information (visual and haptic) about the shape of an object to influence learning of an operant response. Infants learned to kick to move a mobile of cylinders while either holding a cylinder, a rectangular cube, or no object. Kick rate served as the dependent measure. The results showed that infants given matching redundant amodal properties (e.g., viewed cylinders while holding a cylinder) showed facilitated operant learning whereas infants given mismatching redundant amodal properties showed inhibited operant learning. These results support and extend the Intersensory Redundancy Hypothesis by demonstrating that amodal redundancy influences complex learning processes such as operant conditioning.     

Constrained motor-perceptual task in infancy: effects of sensory modality

The authors examined the relative success of varying sensory stimulation modalities that they presented via a mobile reinforcement procedure for promoting left-knee extensions in 3-month-old infants. They separated 53 infants into 5 groups. Four groups received contingent unimodal auditory, enhanced auditory, or visual reinforcement or contingent bimodal auditory plus visual (aud + vis) reinforcement. One group (controls) received aud + vis noncontingent reinforcement. The group that received aud + vis contingent reinforcement was most successful in learning the motor task and maintained the highest attention levels. The authors observed few differences in learning and attention within the unimodal groups. The present findings confirm the effectiveness of contingent multisensory stimulation for promoting perception-action coupling in infancy.     

Intersensory redundancy educates selective attention in bobwhite quail embryos

We assessed whether exposure to amodal properties in bimodal stimulation (e.g. rhythm, rate, duration) could educate attention to amodal properties in subsequent unimodal stimulation during prenatal development. Bobwhite quail embryos were exposed to an individual bobwhite maternal call under several experimental and control conditions during the day prior to hatching. Experimental groups received redundant auditory and visual exposure to the temporal features of an individual maternal call followed by unimodal auditory exposure to the same call immediately or after a 2-hr or 4-hr delay. Control groups received (1) the same exposure but in the reverse sequence (unimodal --> redundant bimodal), (2) asynchronous bimodal --> unimodal, (3) only unimodal exposure, or (4) only bimodal exposure. All experimental groups showed a significant preference for the familiar maternal call over a novel maternal call when tested 2 days after hatching, whereas none of the control groups showed a significant preference for the familiar call. These results indicate that intersensory redundancy can direct attention to amodal properties in bimodal stimulation and educate attention to the same amodal properties in subsequent unimodal stimulation where no intersensory redundancy is available.     

Infants' responsiveness to the auditory and visual attributes of a sounding/moving stimulus.

Responses to unimodal and multimodal attributes of a compound auditory/visual stimulus were investigated in 4-, 6-, 8-, and 10-month-old infants. First, infants were habituated to a compound stimulus consisting of a visual stimulus that moved up and down on a video monitor and a sound that occurred each time the visual stimulus reversed direction at the bottom. Once each infant met a habituation criterion, a series of test trials was administered to assess responsiveness to the components of the compound stimulus. Response was defined as the total duration of visual fixation in each trial. In the two unimodal test trials, the rate at which the component was presented was changed while the rate of the other component remained the same, whereas in the bimodal test trial the rate of both components was changed simultaneously. Results indicated that infants at each age successfully discriminated the bimodal and the two unimodal changes and that regression to the mean did not account for the results. Results also showed that disruption of the temporal relationship that accompanied the change in rate in the two unimodal test trials was also discriminable, but rate changes appeared to play a greater role in responsiveness than did synchrony changes. Considered together with results from similar prior studies, the current results are consistent with the modality appropriateness hypothesis in showing that discrimination of temporal changes in the auditory and visual modalities is dependent on the specialization of the sensory modalities.