Speech Planning at Turn Transitions in Dialog Is Associated With Increased Processing Load

Speech planning is a sophisticated process. In dialog, it regularly starts in overlap with an incoming turn by a conversation partner. We show that planning spoken responses in overlap with incoming turns is associated with higher processing load than planning in silence. In a dialogic experiment, participants took turns with a confederate describing lists of objects. The confederate’s utterances (to which participants responded) were pre‐recorded and varied in whether they ended in a verb or an object noun and whether this ending was predictable or not. We found that response planning in overlap with sentence‐final verbs evokes larger task‐evoked pupillary responses, while end predictability had no effect. This finding indicates that planning in overlap leads to higher processing load for next speakers in dialog and that next speakers do not proactively modulate the time course of their response planning based on their predictions of turn endings. The turn‐taking system exerts pressure on the language processing system by pushing speakers to plan in overlap despite the ensuing increase in processing load.     

The Sound of Grasp Affordances: Influence of Grasp‐Related Size of Categorized Objects on Vocalization

Previous research shows that simultaneously executed grasp and vocalization responses are faster when the precision grip is performed with the vowel [i] and the power grip is performed with the vowel [ɑ]. Research also shows that observing an object that is graspable with a precision or power grip can activate the grip congruent with the object. Given the connection between vowel articulation and grasping, this study explores whether grasp‐related size of observed objects can influence not only grasp responses but also vowel pronunciation. The participants had to categorize small and large objects into natural and manufactured categories by pronouncing the vowel [i] or [ɑ]. As predicted, [i] was produced faster when the object's grasp‐related size was congruent with the precision grip while [ɑ] was produced faster when the size was congruent with the power grip (Experiment 1). The effect was not, however, observed when the participants were presented with large objects that are not typically grasped by the power grip (Experiment 2). This study demonstrates that vowel production is systematically influenced by grasp‐related size of a viewed object, supporting the account that sensory‐motor processes related to grasp planning and representing grasp‐related properties of viewed objects interact with articulation processes. The paper discusses these findings in the context of size–sound symbolism, suggesting that mechanisms that transform size‐grasp affordances into corresponding grasp‐ and articulation‐related motor programs might provide a neural basis for size‐sound phenomena that links small objects with closed‐front vowels and large objects with open‐back vowels.     

The use of mixed modeling to evaluate the impact of treatment integrity on learning

Treatment integrity, or the degree to which an intervention is implemented as intended, is a critical feature of skill acquisition tasks. Single‐case design consistently demonstrates that low treatment integrity slows or inhibits learning, but the relative impact of different types of instructional errors, or the presence of multiple errors, is less clear. The present study utilized a multilevel modeling approach to evaluate the impact of type of error (omission versus omission and commission) and error component (reinforcer delivery versus feedback) on learning. Findings revealed that learning outcomes worsened based on the type of error and as the complexity of errors increased; more specifically, participants performed better when only a single type of error occurred and when only a single error component was manipulated. Additionally, individual characteristics contributed to learning outcomes, highlighting the use of multilevel modeling as a helpful tool to supplement single‐case design. The differential impact of integrity errors on learning may be due to timing of errors (i.e., commission errors more likely to occur early in learning) or how errors affect reinforcement schedule versus discriminative control.     

Language as human ecology: A new agenda for linguistic education

The efficiency of linguistic education based on the code model of language is questioned. The view of written language as a representation of speech ignores the important difference between the experientially different cognitive domains of speech and writing which affect human cognitive development by establishing an extended ecology of languaging. As a consequence, functional illiteracy in societies with established literate cultures becomes a real threat. It can be avoided when it is understood that language is a kind of socially driven behavior which contributes, in a quite definitive way, to the rich context of the human ecological niche, including texts, without which it cannot be understood.     

Tone of voice guides word learning in informative referential contexts

Listeners infer which object in a visual scene a speaker refers to from the systematic variation of the speaker's tone of voice (ToV). We examined whether ToV also guides word learning. During exposure, participants heard novel adjectives (e.g., “daxen”) spoken with a ToV representing hot, cold, strong, weak, big, or small while viewing picture pairs representing the meaning of the adjective and its antonym (e.g., elephant–ant for big–small). Eye fixations were recorded to monitor referent detection and learning. During test, participants heard the adjectives spoken with a neutral ToV, while selecting referents from familiar and unfamiliar picture pairs. Participants were able to learn the adjectives' meanings, and, even in the absence of informative ToV, generalize them to new referents. A second experiment addressed whether ToV provides sufficient information to infer the adjectival meaning or needs to operate within a referential context providing information about the relevant semantic dimension. Participants who saw printed versions of the novel words during exposure performed at chance during test. ToV, in conjunction with the referential context, thus serves as a cue to word meaning. ToV establishes relations between labels and referents for listeners to exploit in word learning.     

Preparing or executing the wrong task: The influence on switch effects

In a previous study, it was proposed that executing a task leads to task strengthening. In other words, task activation at the moment of response execution determines subsequent switch effects (Steinhauser & Hübner, 2006). The authors investigated this issue by comparing switch effects after task and response errors. However, the use of bivalent stimulus–response mappings might have obscured some of the effects. Therefore, we replicated the experiment using univalent stimulus–response mappings. With this adjusted design, which overcomes some shortcomings of the original study, we were able to replicate the finding of switch benefits after task errors. Closer inspection of the data showed the importance of preexecution processes on subsequent switch effects. In a second experiment, we further elaborated on these preexecution processes. More precisely, we investigated the effect of task preparation on subsequent switch effects. Taken together, our data extend current accounts of task switching by showing that the preparatory processes occurring before the response on trial n influence the switch cost on trial n?+?1.     

Precision of working memory for speech sounds

Memory for speech sounds is a key component of models of verbal working memory (WM). But how good is verbal WM? Most investigations assess this using binary report measures to derive a fixed number of items that can be stored. However, recent findings in visual WM have challenged such “quantized” views by employing measures of recall precision with an analogue response scale. WM for speech sounds might rely on both continuous and categorical storage mechanisms. Using a novel speech matching paradigm, we measured WM recall precision for phonemes. Vowel qualities were sampled from a formant space continuum. A probe vowel had to be adjusted to match the vowel quality of a target on a continuous, analogue response scale. Crucially, this provided an index of the variability of a memory representation around its true value and thus allowed us to estimate how memories were distorted from the original sounds. Memory load affected the quality of speech sound recall in two ways. First, there was a gradual decline in recall precision with increasing number of items, consistent with the view that WM representations of speech sounds become noisier with an increase in the number of items held in memory, just as for vision. Based on multidimensional scaling (MDS), the level of noise appeared to be reflected in distortions of the formant space. Second, as memory load increased, there was evidence of greater clustering of participants' responses around particular vowels. A mixture model captured both continuous and categorical responses, demonstrating a shift from continuous to categorical memory with increasing WM load. This suggests that direct acoustic storage can be used for single items, but when more items must be stored, categorical representations must be used.     

The role of perceptual salience during the segmentation of connected speech

Statistical learning allows listeners to track transitional probabilities among syllable sequences and use these probabilities for subsequent speech segmentation. Recent studies have shown that other sources of information, such as rhythmic cues, can modulate the dependencies extracted via statistical computation. In this study, we explored how syllables made salient by a pitch rise affect the segmentation of trisyllabic words from an artificial speech stream by native speakers of three different languages (Spanish, English, and French). Results showed that, whereas performance of French participants did not significantly vary across stress positions (likely due to language-specific rhythmic characteristics), the segmentation performance of Spanish and English listeners was unaltered when syllables in word-initial and word-final positions were salient, but it dropped to chance level when salience was on the medial syllable. We argue that pitch rise in word-medial syllables draws attentional resources away from word boundaries, thus decreasing segmentation effectiveness.