Social eye gaze modulates processing of speech and co-speech gesture

In human face-to-face communication, language comprehension is a multi-modal, situated activity. However, little is known about how we combine information from different modalities during comprehension, and how perceived communicative intentions, often signaled through visual signals, influence this process. We explored this question by simulating a multi-party communication context in which a speaker alternated her gaze between two recipients. Participants viewed speech-only or speech + gesture object-related messages when being addressed (direct gaze) or unaddressed (gaze averted to other participant). They were then asked to choose which of two object images matched the speaker’s preceding message. Unaddressed recipients responded significantly more slowly than addressees for speech-only utterances. However, perceiving the same speech accompanied by gestures sped unaddressed recipients up to a level identical to that of addressees. That is, when unaddressed recipients’ speech processing suffers, gestures can enhance the comprehension of a speaker’s message. We discuss our findings with respect to two hypotheses attempting to account for how social eye gaze may modulate multi-modal language comprehension.     

The influence of speaker gaze on listener comprehension: Contrasting visual versus intentional accounts

Previous research has shown that listeners follow speaker gaze to mentioned objects in a shared environment to ground referring expressions, both for human and robot speakers. What is less clear is whether the benefit of speaker gaze is due to the inference of referential intentions (Staudte and Crocker, 2011) or simply the (reflexive) shifts in visual attention. That is, is gaze special in how it affects simultaneous utterance comprehension? In four eye-tracking studies we directly contrast speech-aligned speaker gaze of a virtual agent with a non-gaze visual cue (arrow). Our findings show that both cues similarly direct listeners’ attention and that listeners can benefit in utterance comprehension from both cues. Only when they are similarly precise, however, does this equality extend to incongruent cueing sequences: that is, even when the cue sequence does not match the concurrent sequence of spoken referents can listeners benefit from gaze as well as arrows. The results suggest that listeners are able to learn a counter-predictive mapping of both cues to the sequence of referents. Thus, gaze and arrows can in principle be applied with equal flexibility and efficiency during language comprehension.     

Patterns of Religious Education Policy in Switzerland: The Long Arm of Distanced Christians?

In spite of its different cantonal jurisdictions and traditions, the development of religious education in Switzerland over the past decade has taken a common direction: the state has assumed a more active role in the field of religious education in public (state‐run) schools. In this article, we ask the question: How do key social actors interpret these reforms and how do these interpretations relate to the social structure of religion in Switzerland, in particular with respect to the majority category of the so‐called distanced Christians? Drawing on qualitative interviews with members of the schools’ teaching staff, school administrators, and church representatives, the article highlights a dominant interpretative pattern that frames the socially accepted representation of religion in public schools. Thus, rather than addressing the pedagogical dimension of religious education, we discuss the significance of this pattern for the debate on the public presence of religion in Switzerland and Europe.     

Revisiting Chinese‐speaking children's understanding of argument structure

A causative verb is likely to appear in a sentence with two noun arguments, whereas a noncausative verb tends to appear in a sentence with a single argument. The present research investigates from what point children learning Chinese begin to show this knowledge of argument structure. Two‐, 3‐, 4‐, and 5‐year‐old children were tested using a forced‐choice pointing task. The results showed that Chinese‐speaking children aged 2 years could associate a transitive construction with a causative event, whereas they were not able to map an intransitive construction to a noncausative event even after reaching 5 years of age. The reason why Chinese children have such difficulty in learning knowledge of intransitive construction is discussed, focusing on (a) the semantic properties of certain intransitive verbs, which have been found not only in Chinese but also in other languages, and (b) the ellipsis of arguments, which is characteristic of Chinese.     

Adult language use and infant comprehension of English: Associations with encoding and generalization across cues at 20 months

Adult-provided language shapes event memory in children who are preverbal and in those who are able to discuss the past using language. The research conducted to date, however, has not yet established whether infant language comprehension abilities moderate the extent to which preverbal infants benefit from adult-provided supportive language. The present study was conducted to address this question by examining immediate imitation and 1-week delayed generalization across cues in 20-month-old infants as a function of (a) variability in adult-provided linguistic support at encoding and test, (b) infant language comprehension abilities, and (c) their interaction. The provision of supportive adult language at encoding and test was associated with delayed generalization across cues although supportive adult language at encoding did not influence performance at immediate imitation. Infant language comprehension abilities were associated with performance at immediate imitation and delayed generalization across cues. In addition, infant language comprehension abilities moderated the extent to which infants benefited from adult-provided supportive language at encoding and test. The findings contribute to the literature by demonstrating that adult language use and infant language comprehension are independently and differentially associated with immediate imitation and 1-week delayed generalization across cues but also serve to jointly structure event memory in the second year of life.     

Happy babies,chatty toddlers: Infant positive affect facilitates early expressive,but not receptive language

Eighty-three mother–infant dyads participated in this study. Positive affect (PA) broadly, along with fine-grained aspects of PA, was measured at 10 months of age. Language was measured at 14 months. Infant PA predicted expressive, but not receptive, language. The implications of these findings are discussed.     

Children Use Temporal Cues to Learn Causal Directionality

The ability to learn the direction of causal relations is critical for understanding and acting in the world. We investigated how children learn causal directionality in situations in which the states of variables are temporally dependent (i.e., autocorrelated). In Experiment 1, children learned about causal direction by comparing the states of one variable before versus after an intervention on another variable. In Experiment 2, children reliably inferred causal directionality merely from observing how two variables change over time; they interpreted Y changing without a change in X as evidence that Y does not influence X. Both of these strategies make sense if one believes the variables to be temporally dependent. We discuss the implications of these results for interpreting previous findings. More broadly, given that many real‐world environments are characterized by temporal dependency, these results suggest strategies that children may use to learn the causal structure of their environments.     

Perspective-taking in dialogue as self-organization under social constraints

We present a dynamical systems account of how simple social information influences perspective-taking. Our account is motivated by the notion that perspective-taking may obey common dynamic principles with perceptuomotor coupling. We turn to the prominent HKB dynamical model of motor coordination, drawing from basic principles of self-organization to describe how conversational perspective-taking unfolds in a low-dimensional attractor landscape. We begin by simulating experimental data taken from a simple instruction-following task, in which participants have different expectations about their interaction partner. By treating belief states as different values of a control parameter, we show that data generated by a basic dynamical process fits overall egocentric and other-centric response distributions, the time required for participants to enact a response on a trial-by-trial basis, and the action dynamics exhibited in individual trials. We end by discussing the theoretical significance of dynamics in dialog, arguing that high-level coordination such as perspective-taking may obey similar dynamics as perceptuomotor coordination, pointing to common principles of adaptivity and flexibility during dialog.     

Talking as doing: Language forms and public language

I discuss language forms as the primary means that language communities provide to enable public language use. As such, they are adapted to public use most notably in being linguistically significant vocal tract actions, not the categories in the mind as proposed in phonological theories. Their primary function is to serve as vehicles for production of syntactically structured sequences of words. However, more than that, phonological actions themselves do work in public language use. In particular, they foster interpersonal coordination in social activities. An intriguing property of language forms that likely reflects their emergence in social communicative activities is that phonological forms that should be meaningless (in order to serve their role in the openness of language at the level of the lexicon) are not wholly meaningless. In fact, the form-meaning “rift” is bridged bidirectionally: The smallest language forms are meaningful, and the meanings of lexical language forms generally inhere, in part, in their embodiment by understanders.     

What Does Children's Spatial Language Reveal About Spatial Concepts? Evidence From the Use of Containment Expressions

Children's overextensions of spatial language are often taken to reveal spatial biases. However, it is unclear whether extension patterns should be attributed to children's overly general spatial concepts or to a narrower notion of conceptual similarity allowing metaphor‐like extensions. We describe a previously unnoticed extension of spatial expressions and use a novel method to determine its origins. English‐ and Greek‐speaking 4‐ and 5‐year‐olds used containment expressions (e.g., English into, Greek mesa) for events where an object moved into another object but extended such expressions to events where the object moved behind or under another object. The pattern emerged in adult speakers of both languages and also in speakers of 10 additional languages. We conclude that learners do not have an overly general concept of Containment. Nevertheless, children (and adults) perceive similarities across Containment and other types of spatial scenes, even when these similarities are obscured by the conventional forms of the language.