Verbal working memory predicts co-speech gesture: Evidence from individual differences

Gesture facilitates language production, but there is debate surrounding its exact role. It has been argued that gestures lighten the load on verbal working memory (VWM; Goldin-Meadow, Nusbaum, Kelly, & Wagner, 2001), but gestures have also been argued to aid in lexical retrieval (Krauss, 1998). In the current study, 50 speakers completed an individual differences battery that included measures of VWM and lexical retrieval. To elicit gesture, each speaker described short cartoon clips immediately after viewing. Measures of lexical retrieval did not predict spontaneous gesture rates, but lower VWM was associated with higher gesture rates, suggesting that gestures can facilitate language production by supporting VWM when resources are taxed. These data also suggest that individual variability in the propensity to gesture is partly linked to cognitive capacities.     

The relation of tip-of-the-tongue states and retrieval time

The tip-of-the-tongue state (TOT) is the phenomenological experience that a word is on the verge of being recalled. Participants rated TOTs as either emotional or nonemotional. In Experiment 1, given general-information questions, participants spent more time attempting retrieval during emotional TOTs than during nonemotional TOTs or n-TOTs (retrieval failures not accompanied by TOTs). Experiment 2 replicated the effect that TOTs show longer retrieval times than n-TOTs. In Experiment 3, with word definitions as stimuli, retrieval times were longer for emotional TOTs. Experiment 4 showed the same relation between retrieval times and TOTs even when participants made retrospective decisions about whether they had experienced a TOT before they retrieved the correct target. Valence of emotion was correlated with correct resolution of the TOT. These results are discussed in the context of a metacognitive model, in which TOTs serve to monitor and control cognition.     

Movement and lexical access: Do noniconic gestures aid in retrieval?

The production of meaningful gestures has been claimed to enhance lexical access. However, the possibility that meaningless movements also improve retrieval has been largely ignored despite evidence that all types of movements increase with dysfluency. To examine this issue, we conducted two experiments to determine whether movements in general would improve lexical access in a tip–of–thetongue (TOT) paradigm. TOT states were induced by presenting definitions of rare words that participants were then asked to recall. Participants who were required to tap at their own pace while retrieving words obtained significantly higher resolution rates than those who were immobile. Thus, movement does not have to be semantically related to the lexical item in order to aid in retrieval. However, tapping did not improve lexical access in all retrieval tasks. In a lexical retrieval task that relied more on executive abilities (letter fluency), participants who tapped retrieved fewer words than those who were immobile. The fact that movement enhanced lexical access only when retrieval depended on the automatic spread of activation suggests that facilitation may occur because of the activation of neural areas common to both speech and movement.     

Relevance of the listener’s motor system in recalling phrases enacted by the speaker

Memory for series of action phrases improves in listeners when speakers accompany each phrase with congruent gestures compared to when speakers stay still. Studies reveal that the listeners’ motor system, at encoding, plays a crucial role in this enactment effect. We present two experiments on gesture observation, which explored the role of the listeners’ motor system at recall. The participants listened to the phrases uttered by a speaker in two conditions in each experiment. In the gesture condition, the speaker uttered the phrases with accompanying congruent gestures, and in the no-gesture condition, the speaker stayed still while uttering the phrases. The participants were then invited, in both conditions of the experiments, to perform a motor task while recalling the phrases proffered by the speaker. The results revealed that the advantage of observing gestures on memory disappears if the listeners move at recall arms and hands (same motor effectors moved by the speaker, Experiment 1a), but not when the listeners move legs and feet (different motor effectors from those moved by the speaker, Experiment 1b). The results suggest that the listeners’ motor system is involved not only during the encoding of action phrases uttered by a speaker but also when recalling these phrases during retrieval.     

舌尖效应产生和解决的词汇提取年老化机制：两阶段范式研究

舌尖效应年老化机制受到语言特异性因素的影响。本研究把Stroop效应作为协变量,在统计分析控制个体抑制能力的基础上,采用两阶段范式考察舌尖效应产生和解决中词汇提取的年老化机制。结果发现：（1）老年人的舌尖效应产生率和语音提取缺陷均显著高于青年人,语义提取缺陷年龄差异不显著;（2）老年人的舌尖效应解决率和语音促进效应量均显著低于青年人;（3）语义启动影响老年人的舌尖效应解决,而对青年人没有影响。上述结果表明,舌尖效应产生和解决的年老化均与语音提取衰退有关,与语义提取衰退无关,支持语言特异性衰退的观点。     

Dissociation between the cognitive process and the phenomenological experience of TOT: effect of the anxiolytic drug lorazepam on TOT states

TOT states may be viewed as a temporary and reversible microamnesia. We investigated the effects of lorazepam on TOT states in response to general knowledge questions. The lorazepam participants produced more commission errors and more TOTs following commission errors than the placebo participants (although the rates did not change). The resolution of the TOTs was unimpaired by the drug. Neither feeling-of-knowing accuracy nor recognition were affected by lorazepam. The higher level of incorrect recalls produced by lorazepam participants may be due to the fact that they were more frequently temporarily unable to access a known item. For some of these items, the awareness of the retrieval failure resulted in a commission TOT (phenonemological TOT after a commission error). The resolution of the TOT conflict is discussed in the light of the anxiolytic and anticonflict effects of lorazepam. The data are discussed in terms of contemporary theories of TOTs and the effects that benzodiazepines have on semantic memory.     

Increased pupil dilation during tip-of-the-tongue states

Tip-of-the-tongue states (TOTs) are feelings of impending word retrieval success during a current failure to retrieve a target word. Though much is known and understood about TOT states from decades of research, research on potential psychophysiological correlates of the TOT state is still in its infancy, and existing studies point toward the involvement of neural processes that are associated with enhanced attention, motivation, and information-seeking. In the present study, we demonstrate that, during instances of target retrieval failure, TOT states are associated with greater pupillary dilation (i.e., autonomic arousal) in 91% of our sample. This is the first study to demonstrate a pupillometric correlate of the TOT experience, and this finding provides an important step toward understanding emotional attributes associated with TOT states. Mean pupil dilation also increased such that instances of target identification failure that were unaccompanied by TOT states < instances in which TOTs occurred < instances of target identification success. It is possible that TOTs reflect an intermediary state between complete target retrieval failure and full target retrieval.     

自然情境下舌尖效应的认知年老化——日记研究

舌尖效应是一种话到嘴边却说不出来的单词提取失败现象(Tip-of-the-Tongue, TOT)。本研究通过TOT回溯问卷和日记记录方法对青年人和老年人进行了为期28天的追踪, 考察了自然情境下舌尖效应认知年老化的发生特点及机制。结果表明：(1)自然情境下TOT存在认知老化现象, 老年人TOT发生频率比青年人更高; (2) TOT发生时, 个体存在替代词和语义相关信息的提取, 且青年人比老年人产生了更强烈的兴奋感和疲惫感的元认知体验; (3) TOT发生后目标词几乎都能获得提取, 老年人TOT的解决时间比青年人长, 但其解决率无年龄差异。TOT的解决时间受目标词熟悉性、是否存在替代词和个体主观体验的认知和元认知因素影响。(4)对TOT认知状态和元认知状态的记录会影响后续发生TOT的状态, 且延长其解决时间, 表明被试付出了更多努力和时间解决TOT。TOT的认知状态和元认知状态的因素都对TOT的解决时间产生了影响。     

When motion improves working memory

ABSTRACT

In the present study, we used a complex span task to explore how memory traces resulting from Self-Performed Task (SPT) and Verbal Task (VT) are maintained in working memory. Participants memorised series of five sentences describing an action either through SPT or VT. Between pairs of sentences, participants performed a concurrent task that varied according to its nature and its cognitive load. The concurrent task was either a verbal task, a low cognitive load motor task or a high cognitive load motor task. A control condition served as a baseline. First, we observed that performance in SPT and VT did not decrease with verbal or motor suppression, but was lower with an increase of the cognitive load. This suggests that memory traces are maintained through attentional refreshing whatever the encoding (SPT or VT). Second, while the enactment effect was replicated in the control condition, it tended to vanish with a verbal concurrent task; moreover, it was reversed with motor concurrent tasks. Surprisingly, the latter effect resulted from an increase of VT memory performance when participants repeated the same gesture between sentences. Finally, our results provide additional evidence that the enactment effect does not rely on attention.     

Tip-of-the-tongue states reveal age differences in the syllable frequency effect

Syllable frequency has been shown to facilitate production in some languages but has yielded inconsistent results in English and has never been examined in older adults. Tip-of-the-tongue (TOT) states represent a unique type of production failure where the phonology of a word is unable to be retrieved, suggesting that the frequency of phonological forms, like syllables, may influence the occurrence of TOT states. In the current study, we investigated the role of first-syllable frequency on TOT incidence and resolution in young (18-26 years of age), young-old (60-74 years of age), and old-old (75-89 years of age) adults. Data from 3 published studies were compiled, where TOTs were elicited by presenting definition-like questions and asking participants to respond with "Know," "Don't Know," or "TOT." Young-old and old-old adults, but not young adults, experienced more TOTs for words beginning with low-frequency first syllables relative to high-frequency first syllables. Furthermore, age differences in TOT incidence occurred only for words with low-frequency first syllables. In contrast, when a prime word with the same first syllable as the target was presented during TOT states, all age groups resolved more TOTs for words beginning with low-frequency syllables. These findings support speech production models that allow for bidirectional activation between conceptual, lexical, and phonological forms of words. Furthermore, the age-specific effects of syllable frequency provide insight into the progression of age-linked changes to phonological processes. (PsycINFO Database Record (c) 2010 APA, all rights reserved).     

Gesture paves the way for language development

In development, children often use gesture to communicate before they use words. The question is whether these gestures merely precede language development or are fundamentally tied to it. We examined 10 children making the transition from single words to two-word combinations and found that gesture had a tight relation to the children's lexical and syntactic development. First, a great many of the lexical items that each child produced initially in gesture later moved to that child's verbal lexicon. Second, children who were first to produce gesture-plus-word combinations conveying two elements in a proposition (point at bird and say "nap") were also first to produce two-word combinations ("bird nap"). Changes in gesture thus not only predate but also predict changes in language, suggesting that early gesture may be paving the way for future developments in language.     

Isolating phonological components that increase tip-of-the-tongue resolution

Three experiments investigated the role of specific phonological components in priming tip-of-the-tongue (TOT) resolution. When in a TOT state, participants read a list of words that included phonological primes intermixed among unrelated words. The phonological primes contained either the same first letter as the target (Experiment 1), a single syllable (first, middle, or last) of the target (Experiment 2), or the first phoneme or first syllable of the target (Experiment 3). Reading first-letter primes in Experiment 1 did not help to resolve TOTs, whereas reading first-syllable primes significantly increased word retrieval in Experiment 2. Experiment 3 replicated the results of Experiments 1 and 2 using first-phoneme primes instead of first-letter primes and using two primes instead of three, although first-syllable priming occurred only for primes read silently. The results of these experiments support a transmission deficit model, where TOTs are caused by weak connections among phonological representations and can be resolved through internal or overt production of specific phonology.     

Gesturing helps memory encoding in aMCI

Encoding in episodic memory is a step often impaired in patients with amnestic Mild Cognitive Impairment (aMCI). However, procedural memory processes are still relatively preserved. In line with previous research on the enactment effect, we investigated the potential benefit of encoding words combined with imitative gestures on episodic memory. Based on the Grober and Buschke’s free/cued recall procedure, we developed the Symbiosis test in which 13 patients with aMCI and 16 healthy elderly participants learned 32 words belonging to 16 different semantic categories either in a verbal encoding (A) or a bimodal (B; verbal and motor imitation) condition, using a blocked ABBA/BAAB procedure. Overall, memory retrieval was better in healthy participants than in patients with aMCI, and better for cued retrieval in the bimodal encoding (gesture cues) than the verbal encoding (category cues) condition, but there was no interaction effect between group and encoding conditions. These results show that performing concomitant gestures can enhance cued episodic memory retrieval in patients with aMCI and in healthy elderly controls. The Symbiosis test broadens the scope of the enactment effect, from action phrases to isolated words learning in patients with aMCI. Future work should investigate how bimodal encoding provides novel perspectives for memory rehabilitation in patients with aMCI.     

Co‐thought gestures in children's mental problem solving: Prevalence and effects on subsequent performance

Co‐thought gestures are understudied as compared to co‐speech gestures yet, may provide insight into cognitive functions of gestures that are independent of speech processes. A recent study with adults showed that co‐thought gesticulation occurred spontaneously during mental preparation of problem solving. Moreover, co‐thought gesturing (either spontaneous or instructed) during mental preparation was effective for subsequent solving of the Tower of Hanoi under conditions of high cognitive load (i.e., when visual working memory capacity was limited and when the task was more difficult). In this preregistered study ( https://osf.io/dreks/ ), we investigated whether co‐thought gestures would also spontaneously occur and would aid problem‐solving processes in children (N = 74; 8–12 years old) under high load conditions. Although children also spontaneously used co‐thought gestures during mental problem solving, this did not aid their subsequent performance when physically solving the problem. If these null results are on track, co‐thought gesture effects may be different in adults and children.     

Does priming specific syllables during tip-of-the-tongue states facilitate word retrieval in older adults?

This experiment investigated whether phonological priming of syllables helps resolve tip-of-the-tongue (TOT) states in young and older adults. Young, young-old, and old-old adults read general knowledge questions and responded "know," "TOT," or "don't know" accordingly. Participants then read a list of 10 words that included 3 phonological primes corresponding solely to the first, middle, or last syllable of the target word. Young and young-old adults resolved more TOTs after first-syllable primes, but old-old adults showed no increase in TOT resolution following any primes. These results indicate that presentation of the first syllable of a missing word strengthens the weakened phonological connections that cause TOTs and increases word retrieval, but not for old-old adults who experience greater deficits in the transmission of priming across these connections.     

Partial knowledge in a tip-of-the-tongue state about two- and three-word proper names

Participants in this study attempted to name 44 famous people in response to reading biographical information about them. Half of the celebrities had names that contained two words (e.g., Gwyneth Paltrow and Sean Penn), and half of them had names containing three words (e.g., Catherine Zeta Jones and Billy Bob Thornton). Half of the names had previously been judged to be of high familiarity (e.g., Gwyneth Paltrow), and half were of lower familiarity (e.g., Billy Bob Thornton). The results showed that when in a tip-of-the-tongue (TOT) state, the participants were able to estimate at above-chance rates whether a celebrity’s name comprised two or three words. Accurate information about the number of words was not available to the participants unless they were in a TOT state or had already named the person. Attempts to identify celebrities whose name had three elements were associated with an increased number of TOTs, relative to celebrities whose name had two units, but there was no difference in the number of don’t know responses for names containing two or three words. Calculations based on Gollan and Brown (2006) suggested that having three names impaired the phonological but not the semantic stage of lexical retrieval, whereas low familiarity impaired both semantic and phonological retrieval stages.     

Evaluating Models of Gesture and Speech Production for People With Aphasia

People with aphasia use gestures not only to communicate relevant content but also to compensate for their verbal limitations. The Sketch Model (De Ruiter, 2000) assumes a flexible relationship between gesture and speech with the possibility of a compensatory use of the two modalities. In the successor of the Sketch Model, the AR-Sketch Model (De Ruiter, 2017), the relationship between iconic gestures and speech is no longer assumed to be flexible and compensatory, but instead iconic gestures are assumed to express information that is redundant to speech. In this study, we evaluated the contradictory predictions of the Sketch Model and the AR-Sketch Model using data collected from people with aphasia as well as a group of people without language impairment. We only found compensatory use of gesture in the people with aphasia, whereas the people without language impairments made very little compensatory use of gestures. Hence, the people with aphasia gestured according to the prediction of the Sketch Model, whereas the people without language impairment did not. We conclude that aphasia fundamentally changes the relationship of gesture and speech.     

Illusory Tip-of-the-tongue States

The tip-of-the-tongue state (TOT) is the phenomenological experience that a target word is on the verge of being recalled. An illusory TOT occurs when a person experiences a TOT, but the actual target is either unavailable, forgotten, or never learned. Illusory TOTs were induced by asking participants to answer questions that did not have correct answers. In Experiment 1, an episodic-memory paradigm, participants were shown fictional animals, some of which were accompanied by the animal's name (identified targets) and some of which were not (unidentified targets). Some participants experienced TOTs for unidentified targets. In Experiment 2, a semantic-memory paradigm, participants were asked generalinformation questions, some of which were questions with no correct answer. Every one of the 31 participants experienced at least one illusory TOT. The characteristics of illusory TOTs are discussed in light of inferential and directaccess views of TOTS.     

The effect of being in a tip-of-the-tongue state on subsequent items

The tip-of-the-tongue state (TOT) is the feeling that an inaccessible item will be recalled. In the TOT induction paradigm, participants are given a list of general information questions or word definitions, and the participants indicate whether they are in a TOT for each item. The present study explored the effect that being in a TOT for one item (N) has on the recall and the likelihood of a TOT for the subsequent item (N + 1). Three experiments were conducted. All three experiments showed that TOTs do not affect the rate of recall for the next item but decrease the likelihood of a TOT for the next item. This effect extended to items occurring two items after the initial TOT (N + 2) in two experiments. Thus, TOTs are less likely to occur after another TOT than after an item not in a TOT. These data are interpreted within a metacognitive framework.