Relative effectiveness of three stimulus variables for locating a moving sound source

A study is reported in which it is shown that observers can use at least three types of acoustic variables that indicate reliably when a moving sound source is passing: interaural temporal differences, the Doppler effect, and amplitude change. Each of these variables was presented in isolation and each was successful in indicating when a (stimulated) moving sound source passed an observer. These three variables were put into competition (with each indicating that closest passage occurred at a different time) in an effort to determine their relative importance. It was found that amplitude change dominated interaural temporal differences which, in turn, dominated the Doppler effect stimulus variable. The results are discussed in terms of two interpretations. First, it is possible that subjects based their judgements on the potential discriminability of each stimulus variable. However, because the stimuli used involved easily discriminable changes, subjects may instead have based their judgements on the independence of a stimulus variable from different environmental situation conditions. The dominance ordering obtained supports the second interpretation.     

Static depiction of movement

A number of pictorial devices were compared in order to assess their relative effectiveness in depicting events. Effectiveness, as measured by a rating task, did not seem to be a function of the classification of a device as natural or metaphorical. Rather, it depended on whether a given device highlighted a distinctive aspect of a particular event (running, jumping, or moving), or simply modified the event. This observation was buttressed by the existence in a forced-choice task of a category boundary for depictions of running (pictures with a certain device were seen as running, those without it were not) but not for moving or jumping. Even preschool children displayed some understanding of metaphorical devices. They chose figures with those devices as running faster than the experimental standard. Results are discussed in the context of Kennedy's characterization of pictorial metaphors and Gibson's framework for understanding the relationship between pictorial and environmental information.     

Visual influences on auditory pluck and bow judgments

In the McGurk effect, visual information specifying a speaker’s articulatory movements can influence auditory judgments of speech. In the present study, we attempted to find an analogue of the McGurk effect by using nonspeech stimuli—the discrepant audiovisual tokens of plucks and bows on a cello. The results of an initial experiment revealed that subjects’ auditory judgments were influenced significantly by the visual pluck and bow stimuli. However, a second experiment in which speech syllables were used demonstrated that the visual influence on consonants was significantly greater than the visual influence observed for pluck-bow stimuli. This result could be interpreted to suggest that the nonspeech visual influence was not a true McGurk effect. In a third experiment, visual stimuli consisting of the wordspluck andbow were found to have no influence over auditory pluck and bow judgments. This result could suggest that the nonspeech effects found in Experiment 1 were based on the audio and visual information’s having an ostensive lawful relation to the specified event. These results are discussed in terms of motor-theory, ecological, and FLMP approaches to speech perception.     

The McGurk effect in infants

In the McGurk effect, perceptual identification of auditory speech syllables is influenced by simultaneous presentation of discrepant visible speech syllables. This effect has been found in subjects of different ages and with various native language backgrounds. But no McGurk tests have been conducted with prelinguistic infants. In the present series of experiments, 5-month-old English-exposed infants were tested for the McGurk effect. Infants were first gaze-habituated to an audiovisual /va/. Two different dishabituation stimuli were then presented: audio /ba/-visual /va/ (perceived by adults as /va/), and audio /da/-visual /va/ (perceived by adults as /da/). The infants showed generalization from the audiovisual /va/ to the audio /ba/-visual /va/ stimulus but not to the audio /da/-visual /va/ stimulus. Follow-up experiments revealed that these generalization differences were not due to a general preference for the audio /da/-visual /va/ stimulus or to the auditory similarity of /ba/ to /va/ relative to /da/. These results suggest that the infants were visually influenced in the same way as Englishspeaking adults are visually influenced.     

Duplex perception with musical stimuli

Duplex perception, a phenomenon previously demonstrated for speech stimuli, is demonstrated here for musical stimuli. In the first experiment, major and minor chords are produced by dichotic fusion of two simultaneous piano notes presented to one ear (perfect fifth) with a “natural” or “flat” single note presented to the opposite ear. Musically trained subjects perceive simultaneously both the single tone and a fused (major or minor) chord. The chords are labeled more consistently than the single notes, even though the fused chords differ solely in terms of the contralateral notes. In a second experiment, using pure tones in place of piano notes, other musically trained subjects individually exhibited categorical perception for either the fused chord or the single tones, but never for both types of stimuli. The duplex phenomenon is discussed in terms of its implications for its specific component modes of perception.     

Task dynamics and resource dynamics in the assembly of a coordinated rhythmic activity.

Task dynamics corresponding to rhythmic movements emerge from interactions among dynamical resources composed of the musculature, the link segments, and the nervous and circulatory systems. This article investigated whether perturbations of interlimb coordination might be effect over circulatory and nervous elements. Stiffness of wrist-pendulums oscillated at a common tempo and at 180 degrees relative phase was perturbed through the use of tonic activity about an ankle. Left and right stiffnesses, the common period, and the phase relation all changed. Stiffnesses increased with ankle torque in proportion to the wrist's inertial load. Despite different changes in stiffness at the two wrists, isochrony was preserved. The stability was shown to be consistent with the proportionality of changes in stiffness to the inertial loads. The phase departed from antiphase in proportion to the asymmetry of inertial loads. The size of departures decreased with increasing ankle torque. An account was developed in terms of muscular, circulatory, and nervous functions.     

Visual speech information for face recognition

Two experiments test whether isolated visible speech movements can be used for face matching. Visible speech information was isolated with a point-light methodology. Participants were asked to match articulating point-light faces to a fully illuminated articulating face in an XAB task. The first experiment tested single-frame static face stimuli as a control. The results revealed that the participants were significantly better at matching the dynamic face stimuli than the static ones. Experiment 2 tested whether the observed dynamic advantage was based on the movement itself or on the fact that the dynamic stimuli consisted of many more static and ordered frames. For this purpose, frame rate was reduced, and the frames were shown in a random order, a correct order with incorrect relative timing, or a correct order with correct relative timing. The results revealed better matching performance with the correctly ordered and timed frame stimuli, suggesting that matches were based on the actual movement itself. These findings suggest that speaker-specific visible articulatory style can provide information for face matching.     

Effects of talker variability on speechreading

The effects of talker variability on visual speech perception were tested by having subjects speechread sentences from either single-talker or mixed-talker sentence lists. Results revealed that changes in talker from trial to trial decreased speechreading performance. To help determine whether this decrement was due to talker change--and not a change in superficial characteristics of the stimuli--Experiment 2 tested speechreading from visual stimuli whose images were tinted by a single color, or mixed colors. Results revealed that the mixed-color lists did not inhibit speechreading performance relative to the single-color lists. These results are analogous to findings in the auditory speech literature and suggest that, like auditory speech, visual speech operations include a resource-demanding component that is influenced by talker variability.     

Environmental influences on perceptual and motor skills of children from immigrant Ethiopian families

The purpose of this study was to examine environmental influences on perceptual and motor skills of children from immigrant Ethiopian families in Israel in comparison with those of Israeli-born children. The subjects were divided into groups based on age (6- to 8-yr.-olds and 10- to 12-yr.-olds) and length of time in Israel. The results of this study show that the perceptual and motor performance of 6- to 8-yr.-old, less recent Ethiopian immigrants is similar to that of the recent Ethiopian immigrants of the same age. A difference exists between those two groups and the Israeli-born children of the same age. In the 10- to 12-yr.-old age group, there is a marked difference between the performance of the two groups of Ethiopian immigrants. The difference between the less recent immigrants and the Israeli-born children is smaller for most tasks; however, the less recent immigrants' performance is still poorer than that of the Israeli children. These results are compatible with those of other studies describing the difficulties encountered by children who had not studied in formal educational settings and those who have had that experience.