Building phrases in language production: An MEG study of simple composition

Although research on language production has developed detailed maps of the brain basis of single word production in both time and space, little is known about the spatiotemporal dynamics of the processes that combine individual words into larger representations during production. Studying composition in production is challenging due to difficulties both in controlling produced utterances and in measuring the associated brain responses. Here, we circumvent both problems using a minimal composition paradigm combined with the high temporal resolution of magnetoencephalography (MEG). With MEG, we measured the planning stages of simple adjective–noun phrases (‘red tree’), matched list controls (‘red, blue’), and individual nouns (‘tree’) and adjectives (‘red’), with results indicating combinatorial processing in the ventro-medial prefrontal cortex (vmPFC) and left anterior temporal lobe (LATL), two regions previously implicated for the comprehension of similar phrases. These effects began relatively quickly (∼180 ms) after the presentation of a production prompt, suggesting that combination commences with initial lexical access. Further, while in comprehension, vmPFC effects have followed LATL effects, in this production paradigm vmPFC effects occurred mostly in parallel with LATL effects, suggesting that a late process in comprehension is an early process in production. Thus, our results provide a novel neural bridge between psycholinguistic models of comprehension and production that posit functionally similar combinatorial mechanisms operating in reversed order.     

Producing and recognizing words with two pronunciation variants: Evidence from novel schwa words

This study examined the lexical representations and psycholinguistic mechanisms underlying the production and recognition of novel words with two pronunciation variants in French. Participants first learned novel schwa words (e.g., /??nyk/), which varied in their alternating status (i.e., whether these words were learned with one or two variants) and, for alternating words, in the frequency of their variants. They were then tested in picture-naming (free or induced) and recognition memory tasks (i.e., deciding whether spoken items were learned during the experiment or not). Results for free naming show an influence of variant frequency on responses, more frequent variants being produced more often. Moreover, our data show an effect of the alternating status of the novel words on naming latencies, with longer latencies for alternating than for nonalternating novel words. These induced naming results suggest that both variants are stored as lexical entries and compete during the lexeme selection process. Results for recognition show an effect of variant frequency on reaction times and no effect of variant type (i.e., schwa versus reduced variant). Taken together, our findings suggest that participants both comprehend and produce novel French schwa words using two lexical representations, one for each variant.     

Creative Fixation is No Laughing Matter: The Effects of Funny and Unfunny Examples on Humor Production

How do people come up with humorous ideas? In creative cognition research, exposure to good examples sometimes causes fixation (people get “stuck” on the examples) but other times sparks inspiration (people's responses are more creative). The present research examined the effects of funny and unfunny examples on joke production. A sample of 175 adults read scenarios that they completed with funny responses. All participants were instructed to be funny, but before responding they read (a) funny responses as examples of good responses to emulate, (b) unfunny responses as examples of poor responses to avoid, or (c) no examples. The participants’ own responses were rated for funniness and for similarity to the example responses, and response times were recorded. Reading either funny or unfunny examples, compared to no examples, caused people to come up with funnier jokes. Similarity to the examples was low in all conditions, so fixation was relatively modest, but people who saw unfunny examples spent more time coming up with their responses. Taken together, the findings support the growing literature showing that examples are often inspiring rather than constraining, and they imply that good and bad examples spark creative thought via different paths.     

In which direction to move? Facilitative and interference effects of gestures on problem solver's thinking

Recent research shows that co-speech gestures can influence gesturers’ thought. This line of research suggests that the influence of gestures is so strong, that it can wash out and reverse an effect of learning. We argue that these findings need a more robust and ecologically valid test, which we provide in this article. Our results support the claim that gestures not only reflect information in our mental representations, but can also influence gesturer's thought by adding action information to one's mental representation during problem solving (Tower of Hanoi). We show, however, that the effect of gestures on subsequent performance is not as strong as previously suggested. As opposed to what previous research indicates, gestures' facilitative effect through learning was not nullified by the potentially interfering effect on subsequent problem-solving performance of incompatible gestures. To conclude, using gestures during problem solving seems to provide more benefits than costs for task performance.     

Single-word predictions of upcoming language during comprehension: Evidence from the cumulative semantic interference task

Comprehenders predict upcoming speech and text on the basis of linguistic input. How many predictions do comprehenders make for an upcoming word? If a listener strongly expects to hear the word “sock”, is the word “shirt” partially expected as well, is it actively inhibited, or is it ignored? The present research addressed these questions by measuring the “downstream” effects of prediction on the processing of subsequently presented stimuli using the cumulative semantic interference paradigm. In three experiments, subjects named pictures (sock) that were presented either in isolation or after strongly constraining sentence frames (“After doing his laundry, Mark always seemed to be missing one …”). Naming sock slowed the subsequent naming of the picture shirt – the standard cumulative semantic interference effect. However, although picture naming was much faster after sentence frames, the interference effect was not modulated by the context (bare vs. sentence) in which either picture was presented. According to the only model of cumulative semantic interference that can account for such a pattern of data, this indicates that comprehenders pre-activated and maintained the pre-activation of best sentence completions (sock) but did not maintain the pre-activation of less likely completions (shirt). Thus, comprehenders predicted only the most probable completion for each sentence.     

Contextual Integration in Multiparty Audience Design

Communicating with multiple addressees poses a problem for speakers: Each addressee necessarily comes to the conversation with a different perspective—different knowledge, different beliefs, and a distinct physical context. Despite the ubiquity of multiparty conversation in everyday life, little is known about the processes by which speakers design language in multiparty conversation. While prior evidence demonstrates that speakers design utterances to accommodate addressee knowledge in multiparty conversation, it is unknown if and how speakers encode and combine different types of perspective information. Here we test whether speakers encode the perspective of multiple addressees, and then simultaneously consider their knowledge and physical context during referential design in a three‐party conversation. Analyses of referential form—expression length, disfluency, and elaboration rate—in an interactive multiparty conversation demonstrate that speakers do take into consideration both addressee knowledge and physical context when designing utterances, consistent with a knowledge‐scene integration view. These findings point to an audience design process that takes as input multiple types of representations about the perspectives of multiple addressees, and that bases the informational content of the to‐be‐designed utterance on a combination of the perspectives of the intended addressees.     

Self‐Priming in Production: Evidence for a Hybrid Model of Syntactic Priming

Syntactic priming in language production is the increased likelihood of using a recently encountered syntactic structure. In this paper, we examine two theories of why speakers can be primed: error‐driven learning accounts (Bock, Dell, Chang, & Onishi, 2007; Chang, Dell, & Bock, 2006) and activation‐based accounts (Pickering & Branigan, 1999; Reitter, Keller, & Moore, 2011). Both theories predict that speakers should be primed by the syntactic choices of others, but only activation‐based accounts predict that speakers should be able to prime themselves. Here we test whether speakers can be primed by their own productions in three behavioral experiments and find evidence of structural persistence following both comprehension and speakers’ own productions. We also find that comprehension‐based priming effects are larger for rarer syntactic structures than for more common ones, which is most consistent with error‐driven accounts. Because neither error‐driven accounts nor activation‐based accounts fully explain the data, we propose a hybrid model.     

Audience Design in Multiparty Conversation

How do speakers design what they say in order to communicate effectively with groups of addressees who vary in their background knowledge of the topic at hand? Prior findings indicate that when a speaker addresses a pair of listeners with discrepant knowledge, that speakers Aim Low, designing their utterances for the least knowledgeable of the two addressees. Here, we test the hypothesis that speakers will depart from an Aim Low approach in order to efficiently communicate with larger groups of interacting partners. Further, we ask whether the cognitive demands of tracking multiple conversational partners' perspectives places limitations on successful audience design. We find that speakers can successfully track information about what up to four of their partners do and do not know in conversation. When addressing groups of 3–4 addressees at once, speakers design language based on the combined knowledge of the group. These findings point to an audience design process that simultaneously represents the perspectives of multiple other individuals and combines these representations in order to design utterances that strike a balance between the different needs of the individuals within the group.     

The role of working memory in syntactic sentence realization: A modeling & simulation approach

This paper examines the effects of working memory size in incremental grammatical encoding during language production. Our experiment tests different variants of a computational-cognitive model that combines an empirically validated framework of general cognition, ACT-R, with a linguistic theory, Combinatory Categorial Grammar. The model is induced from a corpus of spoken dialogue. This methodology facilitates comparison of different strategies and working memory capacities according to the similarity of the model’s produced sentences to the corpus sentences. The experiment presented shows that while having more working memory available improves performance, using less working memory during realization does as well, even after controlling sentence length. Sentences realized with a more incremental strategy also appear to more closely track the naturalistic data. As high incrementality is correlated with low working memory usage, this study offers a possible mechanism by which syntactic incrementality can be explained. Finally, this paper proposes a multi-disciplinary modeling and simulation-based approach to empirical psycholinguistic inquiry.