The influence of speaker gaze on listener comprehension: Contrasting visual versus intentional accounts

Previous research has shown that listeners follow speaker gaze to mentioned objects in a shared environment to ground referring expressions, both for human and robot speakers. What is less clear is whether the benefit of speaker gaze is due to the inference of referential intentions (Staudte and Crocker, 2011) or simply the (reflexive) shifts in visual attention. That is, is gaze special in how it affects simultaneous utterance comprehension? In four eye-tracking studies we directly contrast speech-aligned speaker gaze of a virtual agent with a non-gaze visual cue (arrow). Our findings show that both cues similarly direct listeners’ attention and that listeners can benefit in utterance comprehension from both cues. Only when they are similarly precise, however, does this equality extend to incongruent cueing sequences: that is, even when the cue sequence does not match the concurrent sequence of spoken referents can listeners benefit from gaze as well as arrows. The results suggest that listeners are able to learn a counter-predictive mapping of both cues to the sequence of referents. Thus, gaze and arrows can in principle be applied with equal flexibility and efficiency during language comprehension.     

Examining transactional influences between reading achievement and antisocially-behaving friends

The association between poorer academic outcomes and having antisocial friends is reliably demonstrated yet not well understood. Genetically sensitive designs uniquely allow for measuring genetic vulnerabilities and/or environmental risk in the association of antisocial friend behavior and poor school achievement, allowing for a better understanding of the nature of the association. This study included 233 pairs of twins from the Florida Twin Project on Reading. First, the role of antisocial friends as an environmental moderator of reading comprehension was examined. Antisocial friends significantly moderated the nonshared environmental variance in reading comprehension, with increased variation at lower levels of association with antisocial friends, with niche-picking indicated. Second, the role of reading comprehension as an environmental moderator of antisocial friends was examined. Reading comprehension significantly moderated the nonshared environmental variance in associating with antisocial friends, with increased variance at lower levels of reading comprehension and indication that common genetic influences contributed to higher reading achievement and better-behaved friends. In total, these results suggested reciprocal influences between reading achievement and antisocially-behaving friends. The impact of antisocial friends appeared to be limited in the extent to which they can undermine reading achievement, and high reading achievement appeared to support less association with antisocial friends.     

Is it better to be happy or to be proud at school before doing a text comprehension task? First evidence with 10-year-old children

Introduction and objective

An experiment was conducted in a school context to examine whether joy and pride, two positive emotions, can promote children's acquisition of knowledge in a reading comprehension situation.

Investigating How Test-Takers Change Their Strategies to Handle Difficulty in Taking a Reading Comprehension Test: Implications for Score Validation

This article investigates how test-takers change their strategies to handle increased test difficulty. An adult sample reported their test-taking strategies immediately after completing the tasks in a reading test. Data were analyzed using structural equation modeling specifying a measurement-invariant, ability-moderated, latent transition analysis in Mplus (Muthén & Asparouhov, 2011). It was found that almost half of the test-takers (47%) changed their strategies when encountering increased task-difficulty. The changes were characterized by augmenting comprehending-meaning strategies with score-maximizing and test-wiseness strategies. Moreover, test-takers' ability was the driving influence that facilitated and/or buffered the changes. The test outcomes, when reviewed in light of adjusted test-taking strategies, demonstrated a form of process-based validity evidence.     

小学一年级阅读流畅性对二、三年级阅读理解的预测

采用追踪研究考察了124名小学一年级儿童的阅读流畅性对其二、三年级阅读理解的影响。结果发现,在控制了性别、家庭社会经济地位、推理能力、汉字识别、口语词汇及多种阅读相关认知技能之后,儿童一年级时的字词流畅性可以预期其二、三年级时的阅读理解水平,句子流畅性对二年级时阅读理解的变异有独特解释作用,但对三年级时阅读理解的变异没有显著的解释作用。相对于句子流畅性,字词流畅性在小学低年级阶段对阅读理解的贡献更大。     

Embodiment Effects and Language Comprehension in Alzheimer's Disease

It has been shown that when participants are asked to make sensibility judgments on sentences that describe a transfer of an object toward or away from their body, they are faster to respond when the response requires a movement in the same direction as the transfer described in the sentence. This phenomenon is known as the action compatibility effect (ACE). This study investigates whether the ACE exists for volunteers with Alzheimer's disease (AD), whether the ACE can facilitate language comprehension, and also whether the ACE can still be produced if the order of the two events is inverted, that is, whether overt movement can prime comprehension of transfer sentences. In Study 1, participants with AD, younger, and older adults were tested on an adaptation of the ACE Paradigm. In Study 2, the same paradigm was modified to include an arm movement that participants had to perform prior to sentence exposure on screen. In Study 1, young, older adults, and individuals with AD were faster to respond when the direction of the response movement matched the directionality implied by the sentence (ACE). In Study 2, no traditional ACE was found; participants were faster when the direction of the movement immediately preceding the sentence matched the directionality of the sentence. It was found that compatibility effects generated a relative advantage, that transfer schemata are easier to process, and that an ACE‐like effect can be the result of mutual priming between language and movement. Results suggested preservation in AD of the neural systems for action engaged during language comprehension, and conditions under which comprehension in AD can be facilitated in real life may be identified.     

Single-word predictions of upcoming language during comprehension: Evidence from the cumulative semantic interference task

Comprehenders predict upcoming speech and text on the basis of linguistic input. How many predictions do comprehenders make for an upcoming word? If a listener strongly expects to hear the word “sock”, is the word “shirt” partially expected as well, is it actively inhibited, or is it ignored? The present research addressed these questions by measuring the “downstream” effects of prediction on the processing of subsequently presented stimuli using the cumulative semantic interference paradigm. In three experiments, subjects named pictures (sock) that were presented either in isolation or after strongly constraining sentence frames (“After doing his laundry, Mark always seemed to be missing one …”). Naming sock slowed the subsequent naming of the picture shirt – the standard cumulative semantic interference effect. However, although picture naming was much faster after sentence frames, the interference effect was not modulated by the context (bare vs. sentence) in which either picture was presented. According to the only model of cumulative semantic interference that can account for such a pattern of data, this indicates that comprehenders pre-activated and maintained the pre-activation of best sentence completions (sock) but did not maintain the pre-activation of less likely completions (shirt). Thus, comprehenders predicted only the most probable completion for each sentence.     

First‐time viewers' comprehension of films: Bridging shot transitions

Which perceptual and cognitive prerequisites must be met in order to be able to comprehend a film is still unresolved and a controversial issue. In order to gain some insights into this issue, our field experiment investigates how first‐time adult viewers extract and integrate meaningful information across film cuts. Three major types of commonalities between adjacent shots were differentiated, which may help first‐time viewers with bridging the shots: pictorial, causal, and conceptual. Twenty first‐time, 20 low‐experienced and 20 high‐experienced viewers from Turkey were shown a set of short film clips containing these three kinds of commonalities. Film clips conformed also to the principles of continuity editing. Analyses of viewers' spontaneous interpretations show that first‐time viewers indeed are able to notice basic pictorial (object identity), causal (chains of activity), as well as conceptual (links between gaze direction and object attention) commonalities between shots due to their close relationship with everyday perception and cognition. However, first‐time viewers' comprehension of the commonalities is to a large degree fragile, indicating the lack of a basic notion of what constitutes a film.     

The coordinated interplay of scene, utterance, and world knowledge: evidence from eye tracking

Two studies investigated the interaction between utterance and scene processing by monitoring eye movements in agent–action–patient events, while participants listened to related utterances. The aim of Experiment 1 was to determine if and when depicted events are used for thematic role assignment and structural disambiguation of temporarily ambiguous English sentences. Shortly after the verb identified relevant depicted actions, eye movements in the event scenes revealed disambiguation. Experiment 2 investigated the relative importance of linguistic/world knowledge and scene information. When the verb identified either only the stereotypical agent of a (nondepicted) action, or the (nonstereotypical) agent of a depicted action as relevant, verb-based thematic knowledge and depicted action each rapidly influenced comprehension. In contrast, when the verb identified both of these agents as relevant, the gaze pattern suggested a preferred reliance of comprehension on depicted events over stereotypical thematic knowledge for thematic interpretation. We relate our findings to language comprehension and acquisition theories.