Seeing to hear better: evidence for early audio-visual interactions in speech identification

Lip reading is the ability to partially understand speech by looking at the speaker's lips. It improves the intelligibility of speech in noise when audio-visual perception is compared with audio-only perception. A recent set of experiments showed that seeing the speaker's lips also enhances sensitivity to acoustic information, decreasing the auditory detection threshold of speech embedded in noise [J. Acoust. Soc. Am. 109 (2001) 2272; J. Acoust. Soc. Am. 108 (2000) 1197]. However, detection is different from comprehension, and it remains to be seen whether improved sensitivity also results in an intelligibility gain in audio-visual speech perception. In this work, we use an original paradigm to show that seeing the speaker's lips enables the listener to hear better and hence to understand better. The audio-visual stimuli used here could not be differentiated by lip reading per se since they contained exactly the same lip gesture matched with different compatible speech sounds. Nevertheless, the noise-masked stimuli were more intelligible in the audio-visual condition than in the audio-only condition due to the contribution of visual information to the extraction of acoustic cues. Replacing the lip gesture by a non-speech visual input with exactly the same time course, providing the same temporal cues for extraction, removed the intelligibility benefit. This early contribution to audio-visual speech identification is discussed in relationships with recent neurophysiological data on audio-visual perception.     

DINING OUT WITH CHILDREN: EFFECTIVENESS OF A PARENT ADVICE PACKAGE ON PRE-MEAL INAPPROPRIATE BEHAVIOR

The effectiveness of an advice package designed to restructure the restaurant environment and encourage parent praise was examined. Experiment 1 assessed the usefulness of the package when used with experimenter assistance. Videotapes were used to record the target child's behavior. Pre-meal inappropriate behavior decreased an average of 51% across target children. Mealtime inappropriate behavior and parent praise and disapproval were also measured. Experiment 2 was designed to determine whether families could implement the package without experimenter assistance and whether effects obtained would generalize to a different restaurant. Data were taken in vivo. Nine families were randomly assigned to one of three groups. Group assignment determined the order in which families went to two restaurants, the number of dinners each family participated in, and the point at which parents received the advice package. The order in which the families went to the two restaurants as well as the number of baseline meals was counterbalanced. Results of Experiment 2 showed that, when using the advice package, parents in all sequences were able to decrease pre-meal inappropriate behavior of their children, and that these effects generalized to a second restaurant.     

On the lateralization of emotional prosody: an event-related functional MR investigation

In order to investigate the lateralization of emotional speech we recorded the brain responses to three emotional intonations in two conditions, i.e., "normal" speech and "prosodic" speech (i.e., speech with no linguistic meaning, but retaining the 'slow prosodic modulations' of speech). Participants listened to semantically neutral sentences spoken with a positive, neutral, or negative intonation in both conditions and judged how positive, negative, or neutral the intonation was on a five-point scale. Core peri-sylvian language areas, as well as some frontal and subcortical areas were activated bilaterally in the normal speech condition. In contrast, a bilateral fronto-opercular region was active when participants listened to prosodic speech. Positive and negative intonations elicited a bilateral fronto-temporal and subcortical pattern in the normal speech condition, and more frontal activation in the prosodic speech condition. The current results call into question an exclusive right hemisphere lateralization of emotional prosody and expand patient data on the functional role of the basal ganglia during the perception of emotional prosody.     

EFFECTS OF REINFORCEMENT HISTORY AND INSTRUCTIONS ON THE PERSISTENCE OF STUDENT ENGAGEMENT

We examined the effects of three reinforcement histories on the persistence of task engagement by 2 fourth-grade students using a partially counterbalanced ABCDBCD design. In each condition, an experimenter made four student contacts during the first 2 min of each session (reinforcement baseline), followed by an 8-min extinction period. The reinforcement history that contained an instructional control component produced the greatest persistence in student engagement. The applied relevance of instructional control is discussed.     

Comparison of simultaneous prompting and constant time delay procedures in teaching sight words to elementary students with moderate mental retardation

Simultaneous prompting (a type of antecedent prompt and test procedure) and constant time delay were compared with four students with moderate mental retardation learning expressive sight words. A parallel treatments design across word sets and replicated across students was used. For acquisition, the simultaneous prompting procedures required fewer trials, sessions, and training time to criterion and resulted in fewer student errors during daily probe and training sessions. However, maintenance data indicated mixed results across the two procedures. Reliability data (both dependent and independent variables) revealed no differences between the two procedures in terms of the teacher's accuracy in recording student responses and implementing each procedure. Future research issues are discussed.     

Time-place learning by pigeons, Columba livia

In each of two experiments, 2 pigeons received discrimination training in which food reinforcement for key pecking was conditional upon both spatial and temporal cues. In Experiment 1, food was available for periods of 30 s at each of three locations (pecking keys) during trials that lasted 90 s. In Experiment 2, food was available for periods of 15 min at each of four locations (pecking keys) during a 60-min trial. In both experiments, pigeons' key pecking was jointly controlled by the spatial and temporal cues. These data, and other recent experiments, suggest that animals learn relationships between temporal and spatial cues that predict stable patterns of food availability.     

Bringing out the agreeableness in everyone: Using a cognitive self-regulation model to reduce aggression

Research has shown that those individuals high in agreeableness recruit helpful thoughts in hostile contexts, presumably in the service of controlling aggressive behavior. The present experiment follows from such work, but importantly does so in a manner seeking to support causal conclusions. Participants were randomly assigned to an experimental training condition, in which hostile prime words were followed by helpful target words, or to a control condition that did not involve such pairings. Those assigned to the experimental condition subsequently exhibited lower levels of aggression in a laboratory task. Additional considerations and findings support the potential involvement of self-regulation processes. In general terms, the experiment reveals that a brief cognitive manipulation targeting processes thought to underlie aggression control was in fact causally effective in reducing subsequent levels of aggressive behavior.     

The vision heuristic: Judging music ensembles by sight alone

Team effectiveness and group performance are often defined by standards set by domain experts. Professional musicians consistently report that sound output is the most important standard for evaluating the quality of group performance in the domain of music. However, across six studies, visual information dominated rapid judgments of group performance. Participants (1062 experts and novices) were able to select the actual winners of live ensemble competitions and distinguish top-ranked orchestras from non-ranked orchestras based on 6-s silent video recordings yet were unable to do so from sound recordings or recordings with both video and sound. These findings suggest that judgments of group performance in the domain of music are driven at least in part by visual cues about group dynamics and leadership.     

Can I borrow your alibi? The applicability of the verifiability approach to the case of an alibi witness

The present experiment tested the applicability of the verifiability approach to the case of an alibi witness. Pairs of truth tellers carried out non-criminal activities. Pairs of liars were separated whereby Member 1 carried out the same non-criminal activities as the pairs of truth tellers while Member 2 committed a mock crime. Participants were asked to provide statements about their whereabouts, whereby pairs of liars were requested to pretend that they carried out Member 1's activities together. Participants were informed that their statements would be assessed in terms of providing verifiable evidence that they had carried out the activities together. Results showed that 88% of the pairs were correctly classified by the verifiability approach. Groups differed in their strategies: Truth-tellers focused mainly on “staying with the truth”, and provided evidence that they were together, whereas liars attempted to make it difficult to refute their claims that they were together.