Further investigation on the mnemonic effect of gestures: Their meaning matters

Three experiments are reported that examine the nature of knowledge underlying performance in the invariant learning task. Previous research (Bright & Burton, 1994; McGeorge & Burton, 1990) has supported an account of performance based on the implicit abstraction and application of a rule pertaining to the invariant feature. In contrast, we found effects in both the digit and clock invariant tasks that are difficult to explain solely in terms of subjects acquiring the experimenters' rule. In all three experiments, manipulation of test item properties that are independent of the invariant feature led to a detriment in performance that is not predicted by an account based on the experimenters' rules. Furthermore, the use of an on-line measure of awareness (confidence ratings) provided some evidence that performance is mediated by low confidence explicit knowledge.     

The mnemonic effect of choice

Psychonomic Bulletin & Review - Making choices during encoding leads to superior memory compared with having the same choices made for you. Evidence also suggests that chosen items might be...     

The role of gestures in spatial working memory and speech

Co-speech gestures traditionally have been considered communicative, but they may also serve other functions. For example, hand-arm movements seem to facilitate both spatial working memory and speech production. It has been proposed that gestures facilitate speech indirectly by sustaining spatial representations in working memory. Alternatively, gestures may affect speech production directly by activating embodied semantic representations involved in lexical search. Consistent with the first hypothesis, we found participants gestured more when describing visual objects from memory and when describing objects that were difficult to remember and encode verbally. However, they also gestured when describing a visually accessible object, and gesture restriction produced dysfluent speech even when spatial memory was untaxed, suggesting that gestures can directly affect both spatial memory and lexical retrieval.     

Children learn when their teacher's gestures and speech differ

Teachers gesture when they teach, and those gestures do not always convey the same information as their speech. Gesture thus offers learners a second message. To determine whether learners take advantage of this offer, we gave 160 children in the third and fourth grades instruction in mathematical equivalence. Children were taught either one or two problem-solving strategies in speech accompanied by no gesture, gesture conveying the same strategy, or gesture conveying a different strategy. The children were likely to profit from instruction with gesture, but only when it conveyed a different strategy than speech did. Moreover, two strategies were effective in promoting learning only when the second strategy was taught in gesture, not speech. Gesture thus has an active hand in learning.     

The effects of elimination of hand gestures and of verbal codability on speech performance

Subjects were required to describe line drawings of two-dimensional shapes at two levels of verbal codability, with and without using hand gestures. Elimination of gesture affected speech performance by changing the semantic content of utterances and the proportion of speaking time spent pausing; numbers of words, numbers of pauses, mean pause length and semantic content were found to be related to the verbal codability of the stimulus material; and the number of hesitations was related to both gesture and level of codability.     

Evaluation and integration of speech and pointing gestures during referential understanding

Two experiments investigated the relative influence of speech and pointing gesture information in the interpretation of referential acts. Children averaging 3 and 5 years of age and adults viewed a videotape containing the independent manipulation of speech and gestural forms of reference. A man instructed the subjects to choose a ball or a doll by vocally labeling the referent and/or pointing to it. A synthetic speech continuum between two alternatives was crossed with the pointing gesture in a factorial design. Based on research in other domains, it was predicted that all age groups would utilize gestural information, although both speech and gestures were predicted to influence children less than adults. The main effects and interactions of speech and gesture in combination with quantitative models of performance showed the following similarities in information processing between preschoolers and adults: (1) referential evaluation of gestures occurs independently of the evaluation of linguistic reference; (2) speech and gesture are continuous, rather than discrete, sources of information; (3) 5-year-olds and adults combine the two types of information in such a way that the least ambiguous source has the most impact on the judgment. Greater discriminability of both speech and gesture information for adults compared to preschoolers indicated small quantitative progressions with development in the ability to extract and utilize referential signals.     

The ‘circumstances’ of gestures: Proto-interrogatives and private gestures

The later Wittgenstein's emphasis on the social usage of language has been very influential in psychology, particularly in language acquisition research. This move toward a pragmatic position should also be applied to gestures in pre-linguistic children and to objects in the everyday contexts of use. The shared ‘forms of life’ presupposed by language involve pre-linguistic gestures and material ‘things’.Research on early communication has focused on proto-declarative and proto-imperative gestures. I extend this focus and propose further types of gestures: ‘proto-interrogatives’ - in which children “ask” for help or regulation from adults, and three types of ‘private gestures’ - ostensive, indexical and symbolic - in which children regulate their own behaviour. This diversity of gestures becomes apparent when objects are taken seriously. Wittgenstein's ‘language-games’ necessarily apply to games with objects and gestures as well: social meaning in all cases is emergent within the context of these ‘sign games’ and ‘circumstances.’     

The bizarre mnemonic

Summary Five experiments measured effects of bizarre contexts on the free recall of noun triplets after brief retention intervals. More triplets were remembered from bizarre than from common contexts in short mixed lists (12 sentences) when the sentences were presented at a controlled (10 seconds/sentence) rate, regardless of incidental task (rating images for bizarreness, vividness, or memorability). The average number of words/sentence recalled, however, tended to be higher for common than for bizarre contexts. No memory benefit from bizarreness was found for pure lists nor for lists containing more than six triplets in bizarre contexts. The bizarreness effect was less when the subject controlled the rate of presentation. A sixth experiment, which tested recall after immediate and two-day retention intervals, found that the Bizarre/Common Context by Pure/Mixed List interaction increased over longer retention intervals.     

Embodying gestures: The Social Orienting Model and the study of early gestures in autism

Autistic spectrum disorders impair the ability to interact socially. Detecting and understanding their onset is not only an empirical enterprise, but also a theoretical one, often linked to studies on intersubjectivity. Different theoretical perspectives have been elaborated in the past to account for the deficit. The main purpose of this paper is to reinforce and offer empirical grounding to a recent approach, termed Social Orienting Model, by presenting the main theoretical approaches to autism and contrasting them to this view, as well as considering its possible effect on empirical research, focusing on current literature analyzing gestures in children with autism.

The effect of subject-generated and experimentersupplied code words on the phonetic mnemonic system

The hypothesis tested proposed that subjects using the phonetic mnemonic system who were supplied code words by the experimenter would recall more numbers than either subjects generating their own code words or a control group. In Experiment 1,36 undergraduate subjects serving in a 3 × (3) mixed-factorial design confirmed the hypothesis, but the possibility existed that the superiority of the experimenter-supplied group was attributable to the failure of the subject-generated group to devise a complete set of code words. In Experiment 2 a new group of 12 self-generated subjects was tested with a modified procedure designed to maximize number of correct code words. However, the experimenter-supplied group recalled significantly more numbers than this group, too. In Experiment 3 the possibility was tested that the superiority of the experimenter-supplied subjects was an artifact based on insufficient training in the phonetic method of subjects creating code words. Accordingly, all 28 subjects received extended training before recall of a subject-generated group was tested against that of an experimenter-supplied group in a 2 × (2) factorial design. Once again the experimentersupplied group recalled significantly more numbers, confirming the hypothesis. These results represent an exception to the general finding that subject-generated mnemonics are superior to those supplied by the experimenter. The data suggest that the relative efficacy of the two sources interacts with the difficulty of the mnemonic.     

Semantics of primate gestures: intentional meanings of orangutan gestures

Great ape gesture has become a research topic of intense interest, because its intentionality and flexibility suggest strong parallels to human communication. Yet the fundamental question of whether an animal species’ gestures carry specific meanings has hardly been addressed. We set out a systematic approach to studying intentional meaning in the gestural communication of non-humans and apply it to a sample of orangutan gestures. We propose that analysis of meaning should be limited to gestures for which (1) there is strong evidence for intentional production and (2) the recipient’s final reaction matches the presumed goal of the signaller, as determined independently. This produces a set of “successful” instances of gesture use, which we describe as having goal–outcome matches. In this study, 28 orangutans in three European zoos were observed for 9 months. We distinguished 64 gestures on structural grounds, 40 of which had frequent goal–outcome matches and could therefore be analysed for meaning. These 40 gestures were used predictably to achieve one of 6 social goals: to initiate an affiliative interaction (contact, grooming, or play), request objects, share objects, instigate co-locomotion, cause the partner to move back, or stop an action. Twenty-nine of these gestures were used consistently with a single meaning. We tested our analysis of gesture meaning by examining what gesturers did when the response to their gesture did not match the gesture’s meaning. Subsequent actions of the gesturer were consistent with our assignments of meaning to gestures. We suggest that, despite their contextual flexibility, orangutan gestures are made with the expectation of specific behavioural responses and thus have intentional meanings as well as functional consequences.     

Neuropsychological functions of hand movements and gestures change in the presence or absence of speech

In order to address previous controversies whether hand movements and gestures are linked to mental concepts or solely to the process of speaking, in the present study we investigate the neuropsychological functions of the entire spectrum of unimanual and bimanual hand movements and gestures when they either accompany speaking or when they act as the only means to communicate in the absence of speech. The results showed that the hand movement activity regarding all types of hand movements and gestures stayed constant with and without speaking. The analysis of the Structure of hand movements showed that executions shifted from in space hand movements with a phase structure during the condition without speech to more irregular on body hand movements without a phase structure during the co-speech condition. The gestural analysis revealed that pantomime gestures increase under conditions without speech whereas emotional motions and subject-oriented actions primarily occur when speaking. The present results provide evidence that the overall hand movement activity does not differ between co-speech conditions and conditions without speech, but that the hands adopt different neuropsychological functions. We conclude that the hands primarily externalise mental concepts in conditions without speaking but that their use shifts to more self-regulation and to endorsing verbal output with emotional connotations when they accompany speech.     

Giving cognition a helping hand: The effect of congruent gestures on object name retrieval

The gestures that accompany speech are more than just arbitrary hand movements or communicative devices. They are simulated actions that can both prime and facilitate speech and cognition. This study measured participants’ reaction times for naming degraded images of objects when simultaneously adopting a gesture that was either congruent with the target object, incongruent with it, and when not making any hand gesture. A within‐subjects design was used, with participants (N= 122) naming 10 objects under each condition. Participants named the objects significantly faster when adopting a congruent gesture than when not gesturing at all. Adopting an incongruent gesture resulted in significantly slower naming times. The findings are discussed in the context of the intrapersonal cognitive and facilitatory effects of gestures and underline the relatedness between language, action, and cognition.     

The effect of variations of emotional expressions on mnemonic discrimination and traditional recognition memory

Face recognition occurs when a face is recognised despite changes between learning and test exposures. Yet there has been relatively little research on how variations in emotional expressions influence people’s ability to recognise these changes. We evaluated the ability to discriminate old and similar expressions of emotions (i.e. mnemonic discrimination) of the same face, as well as the discrimination ability between old and dissimilar (new) expressions of the same face, reflecting traditional discrimination. An emotional mnemonic discrimination task with morphed faces that were similar but not identical to the original face was used. Results showed greater mnemonic discrimination for learned neutral expressions that at test became slightly more fearful rather than happy. For traditional discrimination, there was greater accuracy for learned happy faces becoming fearful, rather than those changing from fearful-to-happy. These findings indicate that emotional expressions may have asymmetrical influences on mnemonic and traditional discrimination of the same face.     

The executive control of mnemonic activity

The present study focused on the executive monitoring of a rehearsal strategy by sixth (11 years 5 months), tenth (15 years 8 months), and twelfth (17 years 9 months) graders and adults (27 years 4 months). The results showed that all of the adults spontaneously adopted an “optimal” strategy and generalized it to a second task. However, none of the sixth graders and only two tenth and three twelfth graders did so. All of the school subjects subsequently trained to rehearse, maintained the strategy without prompting, and showed evidence of transfer. In comparison to adults, the trained subjects' generalized routines became more similar to the adults' as grade increased. This study supports the notion that efficient executive functioning includes the case where continued use of a mnemonic routine is a reasonable response to an objective change in an information-processing task.     

The mnemonic value of perceptual identification

In four experiments, subjects were required to name words presented on a CRT screen. On generate trials, the words were presented quickly, at a point where roughly half could be identified correctly; on read trials, the items were presented for a full second, allowing for rapid and easy naming. A surprise recognition test for the presented items then revealed a substantial retention advantage for the briefly presented items, but no similar advantage was produced in a recall. It is argued that under rapid viewing conditions subjects may fail to extract enough visual features to allow for immediate resolution, requiring the initiation of a kind of data-driven generation process. This latter process then produces a generation effect for the briefly presented items compared with the read items, but only on a retention test that shows sensitivity to data-driven processing. These results are discussed from the standpoint of current theoretical views on the generation effect.     

Exploring a mnemonic debiasing account of the underconfidence-with-practice effect

Judgments of learning (JOLs) underestimate the increase in recall that occurs with repeated study (the underconfidence-with-practice effect; UWP). The authors explore an account in terms of a foresight bias in which JOLs are inflated when the to-be-recalled target highlights aspects of the cue that are not transparent when the cue appears alone and the tendency of practice to alleviate bias by providing learners with cues pertinent to recall. In 3 experiments the UWP effect was strongest for items that induce a foresight bias, but delaying JOLs reduced the debiasing effects of practice, thereby moderating the UWP effect. This occurred when delayed JOLs were prompted by the cue alone (like during testing), not when prompted by the cue-target pair (like during study).     

The effect of SpeechEasy on stuttering frequency, speech rate, and speech naturalness

The effects of SpeechEasy on stuttering frequency, stuttering severity self-ratings, speech rate, and speech naturalness for 31 adults who stutter were examined. Speech measures were compared for samples obtained with and without the device in place in a dispensing setting. Mean stuttering frequencies were reduced by 79% and 61% for the device compared to the control conditions on reading and monologue tasks, respectively. Mean severity self-ratings decreased by 3.5 points for oral reading and 2.7 for monologue on a 9-point scale. Despite dramatic reductions in stuttering frequency, mean global speech rates in the device condition increased by only 8% in the reading task and 15% for the monologue task, and were well below normal. Further, complete elimination of stuttering was not associated with normalized speech rates. Nevertheless, mean ratings of speech naturalness improved markedly in the device compared to the control condition and, at 3.3 and 3.2 for reading and monologue, respectively, were only slightly outside the normal range. These results show that SpeechEasy produced improved speech outcomes in an assessment setting. However, findings raise the issue of a possible contribution of slowed speech rate to the stuttering reduction effect, especially given participants' instructions to speak chorally with the delayed signal as part of the active listening instructions of the device protocol. Study of device effects in situations of daily living over the long term is necessary to fully explore its treatment potential, especially with respect to long-term stability. Educational objectives: The reader will be able to discuss and evaluate: (1) issues pertinent to evaluating treatment benefits of fluency aids and (2) the effects of SpeechEasy on stuttering frequency, speech rate, and speech naturalness during testing in a dispensing setting for a relatively large sample of adults who stutter.     

Facial speech gestures: the relation between visual speech processing,phonological awareness,and developmental dyslexia in 10‐year‐olds

Successful communication in everyday life crucially involves the processing of auditory and visual components of speech. Viewing our interlocutor and processing visual components of speech facilitates speech processing by triggering auditory processing. Auditory phoneme processing, analyzed by event‐related brain potentials (ERP), has been shown to be associated with impairments in reading and spelling (i.e. developmental dyslexia), but visual aspects of phoneme processing have not been investigated in individuals with such deficits. The present study analyzed the passive visual Mismatch Response (vMMR) in school children with and without developmental dyslexia in response to video‐recorded mouth movements pronouncing syllables silently. Our results reveal that both groups of children showed processing of visual speech stimuli, but with different scalp distribution. Children without developmental dyslexia showed a vMMR with typical posterior distribution. In contrast, children with developmental dyslexia showed a vMMR with anterior distribution, which was even more pronounced in children with severe phonological deficits and very low spelling abilities. As anterior scalp distributions are typically reported for auditory speech processing, the anterior vMMR of children with developmental dyslexia might suggest an attempt to anticipate potentially upcoming auditory speech information in order to support phonological processing, which has been shown to be deficient in children with developmental dyslexia.     

Pre-schoolers use head gestures rather than prosodic cues to highlight important information in speech

Previous evidence suggests that children's mastery of prosodic modulations to signal the informational status of discourse referents emerges quite late in development. In the present study, we investigate the children's use of head gestures as it compares to prosodic cues to signal a referent as being contrastive relative to a set of possible alternatives. A group of French-speaking pre-schoolers were audio-visually recorded while playing in a semi-spontaneous but controlled production task, to elicit target words in the context of broad focus, contrastive focus, or corrective focus utterances. We analysed the acoustic features of the target words (syllable duration and word-level pitch range), as well as the head gesture features accompanying these target words (head gesture type, alignment patterns with speech). We found that children's production of head gestures, but not their use of either syllable duration or word-level pitch range, was affected by focus condition. Children mostly aligned head gestures with relevant speech units, especially when the target word was in phrase-final position. Moreover, the presence of a head gesture was linked to greater syllable duration patterns in all focus conditions. Our results show that (a) 4- and 5-year-old French-speaking children use head gestures rather than prosodic cues to mark the informational status of discourse referents, (b) the use of head gestures may gradually entrain the production of adult-like prosodic features, and that (c) head gestures with no referential relation with speech may serve a linguistic structuring function in communication, at least during language development.