The coordinated interplay of scene, utterance, and world knowledge: evidence from eye tracking

Two studies investigated the interaction between utterance and scene processing by monitoring eye movements in agent–action–patient events, while participants listened to related utterances. The aim of Experiment 1 was to determine if and when depicted events are used for thematic role assignment and structural disambiguation of temporarily ambiguous English sentences. Shortly after the verb identified relevant depicted actions, eye movements in the event scenes revealed disambiguation. Experiment 2 investigated the relative importance of linguistic/world knowledge and scene information. When the verb identified either only the stereotypical agent of a (nondepicted) action, or the (nonstereotypical) agent of a depicted action as relevant, verb-based thematic knowledge and depicted action each rapidly influenced comprehension. In contrast, when the verb identified both of these agents as relevant, the gaze pattern suggested a preferred reliance of comprehension on depicted events over stereotypical thematic knowledge for thematic interpretation. We relate our findings to language comprehension and acquisition theories.     

The influence of speaker gaze on listener comprehension: Contrasting visual versus intentional accounts

Previous research has shown that listeners follow speaker gaze to mentioned objects in a shared environment to ground referring expressions, both for human and robot speakers. What is less clear is whether the benefit of speaker gaze is due to the inference of referential intentions (Staudte and Crocker, 2011) or simply the (reflexive) shifts in visual attention. That is, is gaze special in how it affects simultaneous utterance comprehension? In four eye-tracking studies we directly contrast speech-aligned speaker gaze of a virtual agent with a non-gaze visual cue (arrow). Our findings show that both cues similarly direct listeners’ attention and that listeners can benefit in utterance comprehension from both cues. Only when they are similarly precise, however, does this equality extend to incongruent cueing sequences: that is, even when the cue sequence does not match the concurrent sequence of spoken referents can listeners benefit from gaze as well as arrows. The results suggest that listeners are able to learn a counter-predictive mapping of both cues to the sequence of referents. Thus, gaze and arrows can in principle be applied with equal flexibility and efficiency during language comprehension.     

Aging and the use of context in ambiguity resolution: complex changes from simple slowing

Older and younger adults' abilities to use context information rapidly during ambiguity resolution were investigated. In Experiments 1 and 2, younger and older adults heard ambiguous words (e.g., fires) in sentences where the preceding context supported either the less frequent or more frequent meaning of the word. Both age groups showed good context use in offline tasks, but only young adults demonstrated rapid use of context in cross-modal naming. A 3rd experiment demonstrated that younger and older adults had similar knowledge about the contexts used in Experiments 1 and 2. The experiment results were simulated in 2 computational models in which different patterns of context use were shown to emerge from varying a single speed parameter. These results suggest that age-related changes in processing efficiency can modulate context use during language comprehension.     

The influence of populism on tolerance: a thematic content analysis of the Dutch Islam debate

Historically, religious tolerance has been an integral part of Dutch identity. Yet, this image has changed, particularly in the last 20 years due to the influence of populism that predominantly focused on the stigmatisation of Islam. This paper examines how this development has changed the meaning of tolerance in the public debate about Islam and what this change means for the social and political conditions for integration in the Netherlands. An analytical framework was used, breaking down the term ‘tolerance’ into five components: subject of tolerance, object of tolerance, hierarchy of values, power to interfere and limits to tolerance. The results show that while mainstream opinion leaders received more attention in public debate, populists managed to shape the tolerance discourse, changing the subjects and objects of tolerance, emphasising contradictions between different values, shaping the hierarchy of values and proposing intolerance for Islamic intolerance as limit of tolerance.     

Memory modulated saliency: A computational model of the incremental learning of target locations in visual search

The top-down guidance of visual attention is one of the main factors allowing humans to effectively process vast amounts of incoming visual information. Nevertheless we still lack a full understanding of the visual, semantic, and memory processes governing visual attention. In this paper, we present a computational model of visual search capable of predicting the most likely positions of target objects. The model does not require a separate training phase, but learns likely target positions in an incremental fashion based on a memory of previous fixations. We evaluate the model on two search tasks and show that it outperforms saliency alone and comes close to the maximal performance of the Contextual Guidance Model (CGM; Torralba, Oliva, Castelhano, & Henderson, 2006; Ehinger, Hidalgo-Sotelo, Torralba, & Oliva, 2009), even though our model does not perform scene recognition or compute global image statistics. The search performance of our model can be further improved by combining it with the CGM.     

Beyond common features: the role of roles in determining similarity

Historically, accounts of object representation and perceived similarity have focused on intrinsic features. Although more recent accounts have explored how objects, scenes, and situations containing common relational structures come to be perceived as similar, less is known about how the perceived similarity of parts or objects embedded within these relational systems is affected. The current studies test the hypothesis that objects situated in common relational systems come to be perceived as more similar. Similarity increases most for objects playing the same role within a relation (e.g., predator), but also increases for objects playing different roles within the same relation (e.g., the predator or prey role in the hunts relation) regardless of whether the objects participate in the same instance of the relation. This pattern of results can be captured by extending existing models that extract meaning from text corpora so that they are sensitive to the verb-specific thematic roles that objects fill. Alternative explanations based on analogical and inferential processes are also considered, as well as the implications of the current findings to research in language processing, decision making, and category learning.     

Of substance: The nature of language effects on entity construal

Shown an entity (e.g., a plastic whisk) labeled by a novel noun in neutral syntax, speakers of Japanese, a classifier language, are more likely to assume the noun refers to the substance (plastic) than are speakers of English, a count/mass language, who are instead more likely to assume it refers to the object kind [whisk; Imai, M., & Gentner, D. (1997). A cross-linguistic study of early word meaning: Universal ontology and linguistic influence. Cognition, 62, 169–200]. Five experiments replicated this language type effect on entity construal, extended it to quite different stimuli from those studied before, and extended it to a comparison between Mandarin speakers and English speakers. A sixth experiment, which did not involve interpreting the meaning of a noun or a pronoun that stands for a noun, failed to find any effect of language type on entity construal. Thus, the overall pattern of findings supports a non-Whorfian, language on language account, according to which sensitivity to lexical statistics in a count/mass language leads adults to assign a novel noun in neutral syntax the status of a count noun, influencing construal of ambiguous entities. The experiments also document and explore cross-linguistically universal factors that influence entity construal, and favor Prasada’s [Prasada, S. (1999). Names for things and stuff: An Aristotelian perspective. In R. Jackendoff, P. Bloom, & K. Wynn (Eds.), Language, logic, and concepts (pp. 119–146). Cambridge, MA: MIT Press] hypothesis that features indicating non-accidentalness of an entity’s form lead participants to a construal of object kind rather than substance kind. Finally, the experiments document the age at which the language type effect emerges in lexical projection. The details of the developmental pattern are consistent with the lexical statistics hypothesis, along with a universal increase in sensitivity to material kind.     

Categorical perception of colour in the left and right visual field is verbally mediated: evidence from Korean

In this study we demonstrate that Korean (but not English) speakers show Categorical perception (CP) on a visual search task for a boundary between two Korean colour categories that is not marked in English. These effects were observed regardless of whether target items were presented to the left or right visual field. Because this boundary is unique to Korean, these results are not consistent with a suggestion made by Drivonikou [Drivonikou, G. V., Kay, P., Regier, T., Ivry, R. B., Gilbert, A. L., Franklin, A. et al. (2007) Further evidence that Whorfian effects are stronger in the right visual field than in the left. Proceedings of the National Academy of Sciences 104, 1097-1102] that CP effects in the left visual field provide evidence for the existence of a set of universal colour categories. Dividing Korean participants into fast and slow responders demonstrated that fast responders show CP only in the right visual field while slow responders show CP in both visual fields. We argue that this finding is consistent with the view that CP in both visual fields is verbally mediated by the left hemisphere language system.     

The role of chance events in the school-to-work transition: The influence of demographic, personality and career development variables

Chance events are considered important in career development, yet little empirical research is available on their predictors and consequences. The present study investigated socio-demographic (gender, nationality, school-type), personality (openness, locus of control) and career development variables (career decidedness, career planning) in relation to perceived chance events with a retrospective (N = 229, eleventh grade), and 1-year longitudinal prospective study (N = 245, eighth/ninth grade) among Swiss adolescents. The results showed that the majority of both groups reported a significant influence of chance events on their transition from compulsory school to vocational education or high school. Importance of chance events related to socio-demographics and personality but not career preparation. Career preparation and chance events predicted subjective career success in terms of wish correspondence and overall satisfaction with transition outcome among the younger cohort. Implications include the necessity to integrate both thorough career preparation and chance events in theory and counseling practice.     

A sensitive period for language in the visual cortex: distinct patterns of plasticity in congenitally versus late blind adults

Recent evidence suggests that blindness enables visual circuits to contribute to language processing. We examined whether this dramatic functional plasticity has a sensitive period. BOLD fMRI signal was measured in congenitally blind, late blind (blindness onset 9-years-old or later) and sighted participants while they performed a sentence comprehension task. In a control condition, participants listened to backwards speech and made match/non-match to sample judgments. In both congenitally and late blind participants BOLD signal increased in bilateral foveal-pericalcarine cortex during response preparation, irrespective of whether the stimulus was a sentence or backwards speech. However, left occipital areas (pericalcarine, extrastriate, fusiform and lateral) responded more to sentences than backwards speech only in congenitally blind people. We conclude that age of blindness onset constrains the non-visual functions of occipital cortex: while plasticity is present in both congenitally and late blind individuals, recruitment of visual circuits for language depends on blindness during childhood.     

Rhythmic alternation and the optional complementiser in English: new evidence of phonological influence on grammatical encoding

In a recall-based spoken production experiment, native English-speaking participants' variable use of the complementiser that to introduce the sentential complement in sentences like Henry knew (that) Lucy/Louise washed the dishes was found to be related to whether that inclusion/omission resulted in an alternating sequence of stressed and unstressed syllables between the verb of the main clause and the subject of the complement clause. This finding is discussed in relation to the question of whether and how phonological encoding can influence grammatical encoding in spoken language production.     

The developing constraints on parsing decisions: the role of lexical-biases and referential scenes in child and adult sentence processing

Two striking contrasts currently exist in the sentence processing literature. First, whereas adult readers rely heavily on lexical information in the generation of syntactic alternatives, adult listeners in world-situated eye-gaze studies appear to allow referential evidence to override strong countervailing lexical biases (Tanenhaus, Spivey-Knowlton, Eberhard, and Sedivy, 1995). Second, in contrast to adults, children in similar listening studies fail to use this referential information and appear to rely exclusively on verb biases or perhaps syntactically based parsing principles (Trueswell, Sekerina, Hill, and Logrip, 1999). We explore these contrasts by fully crossing verb bias and referential manipulations in a study using the eye-gaze listening technique with adults (Experiment 1) and five-year-olds (Experiment 2). Results indicate that adults combine lexical and referential information to determine syntactic choice. Children rely exclusively on verb bias in their ultimate interpretation. However, their eye movements reveal an emerging sensitivity to referential constraints. The observed changes in information use over ontogenetic time best support a constraint-based lexicalist account of parsing development, which posits that highly reliable cues to structure, like lexical biases, will emerge earlier during development and more robustly than less reliable cues.     

The effects of age-of-acquisition and frequency-of-occurrence in visual word recognition: Further evidence from the Dutch language

It has been claimed that the frequency effect in visual word naming is an artefact of age-of-acquisition: Words are named faster not because they are encountered more often in texts, but because they have been acquired earlier. In a series of experiments using immediate naming, lexical decision, and masked priming, we found that frequency had a clear effect in lexical tasks when age-of-acquisition is controlled for. At the same time, age-of-acquisition was a significant variable in all tasks, whereas imageability had no effect. These results corroborate findings previously reported in English and Dutch.     

The effect of sonority on word segmentation: evidence for the use of a phonological universal

It has been well documented how language-specific cues may be used for word segmentation. Here, we investigate what role a language-independent phonological universal, the sonority sequencing principle (SSP), may also play. Participants were presented with an unsegmented speech stream with non-English word onsets that juxtaposed adherence to the SSP with transitional probabilities. Participants favored using the SSP in assessing word-hood, suggesting that the SSP represents a potentially powerful cue for word segmentation. To ensure the SSP influenced the segmentation process (i.e., during learning), we presented two additional groups of participants with either (a) no exposure to the stimuli prior to testing or (b) the same stimuli with pauses marking word breaks. The SSP did not influence test performance in either case, suggesting that the SSP is important for word segmentation during the learning process itself. Moreover, the fact that SSP-independent segmentation of the stimulus occurred (in the latter control condition) suggests that universals are best understood as biases rather than immutable constraints on learning.     

Two spatially separated attention systems in the visual field: evidence from inhibition of return

It has been demonstrated that the human visual field shows some functional inhomogeneities, in particular when the central and perifoveal regions are compared to the more peripheral regions. The present study examined this inhomogeneity by examining the effect of stimulus eccentricity on inhibition of return (IOR), a phenomenon that biases our attention towards novel locations against returning it back to previously attended locations. Eighteen subjects were examined in a visual detection task, in which a target appeared randomly following a nonpredictive spatial cue in the visual field. The eccentricities of the cues and targets were systematically manipulated from 5° to 30° with 5° increments. Results showed that response times to targets that appeared at cued locations were significantly slower than those at uncued locations for all stimulus eccentricities, demonstrating the IOR effects. However, response times at cued locations increased significantly when stimulus eccentricity shifted from 15° to 20°, leading to a much stronger IOR effect at more peripheral regions compared to central and perifoveal regions, indicating a functional dissociation between these two regions of the visual field. Possible neural mechanisms underlying this dissociation are discussed, and two attention systems modulating the two functional regions of the visual field are put forward to best account the present finding implicating in particular midbrain mechanism.     

The role of a parent's illness in the emotional experience of a child evidence from Klein's Narrative of a child analysis

Abstract

The analysis of Richard, described by Melanie Klein in Narrative of a Child Analysis, gives us some insight into the effect on a child of threats to the health of his parents. His mother was involved in a road accident when Richard was 2; his father collapsed during the time of the analysis when he was 10. This paper links these events with disturbances in Richard's relation to his father and to his mother, as well as with threats to his own integrity, as demonstrated in the analysis. Richard's reversal of roles with his father and mother is discussed, as are Klein's reaction to Richard's report of finding his father ‘ill and nearly fainting’ and Richard's response to her behaviour. The paper draws attention to the way in which a child's reaction to the ill health of one parent can affect relations with both parents, as well as disturbing his sense of himself.     

The effect of iconicity of visual displays on statistical reasoning: evidence in favor of the null hypothesis

Knowing which properties of visual displays facilitate statistical reasoning bears practical and theoretical implications. Therefore, we studied the effect of one property of visual diplays?– iconicity (i.e., the resemblance of a visual sign to its referent)?– on Bayesian reasoning. Two main accounts of statistical reasoning predict different effect of iconicity on Bayesian reasoning. The ecological-rationality account predicts a positive iconicity effect, because more highly iconic signs resemble more individuated objects, which tap better into an evolutionary-designed frequency-coding mechanism that, in turn, facilitates Bayesian reasoning. The nested-sets account predicts a null iconicity effect, because iconicity does not affect the salience of a nested-sets structure—the factor facilitating Bayesian reasoning processed by a general reasoning mechanism. In two well-powered experiments (N = 577), we found no support for a positive iconicity effect across different iconicity levels that were manipulated in different visual displays (meta-analytical overall effect: log OR = ?0.13, 95 % CI [?0.53, 0.28]). A Bayes factor analysis provided strong evidence in favor of the null hypothesis—the null iconicity effect. Thus, these findings corroborate the nested-sets rather than the ecological-rationality account of statistical reasoning.     

Living in History in Lebanon: The influence of chronic social upheaval on the organisation of autobiographical memories

The Living in History (LiH) effect is a litmus test for the degree to which historical events reorganise autobiographical memory. The LiH effect was studied in two Lebanese samples: a Beiruti sample that lived in the epicentre of the 15-year Lebanese Civil War (1975–1990) and another group from the Bi'qa region who lived in an area that was indirectly exposed for most of the civil war but experienced one short-term period of war during the Israeli invasion. Using the two-phase word-cueing task to elicit dated autobiographical memories, we observed a significantly stronger LiH effect in the Beirut sample but also a significant yet weaker LiH effect in the Bi'qa sample. In addition to the main finding we offer evidence that the LiH effect waxes and wanes with the level of conflict in an area and that reported personal experiences of war exposure predict the strength of the LiH effect. Our findings suggest that collective transitional events which produce a marked change in the fabric of daily living engender historically defined autobiographical periods which give structure and organisation to how individuals remember their past.     

Prediction,events, and the advantage of Agents: The processing of semantic roles in visual narrative

Agents consistently appear prior to Patients in sentences, manual signs, and drawings, and Agents are responded to faster when presented in visual depictions of events. We hypothesized that this “Agent advantage” reflects Agents’ role in event structure. We investigated this question by manipulating the depictions of Agents and Patients in preparatory actions in wordless visual narratives. We found that Agents elicited a greater degree of predictions regarding upcoming events than Patients, that Agents are viewed longer than Patients, independent of serial order, and that visual depictions of actions are processed more quickly following the presentation of an Agent vs. a Patient. Taken together these findings support the notion that Agents initiate the building of event representation. We suggest that Agent First orders facilitate the interpretation of events as they unfold and that the saliency of Agents within visual representations of events is driven by anticipation of upcoming events.     

The influence of incongruity and preexposure on the familiarity effect in visual selection of children

A consistent finding in the literature concerning visual selection is that Ss will spend more time viewing unfamiliar stimuli than stimuli with which they have been familiarized. In the present experiment, the relationship between the magnitude of this familiarity effect and the level of stimulus incongruity was examined and found to be monotonic and increasing. In addition, amount of stimulus preexposure had no significant effect on the magnitude of the familiarity effect. Furthermore, there was no overall difference in Ss' preference for familiar and unfamiliar stimuli. Results are interpreted as supporting a theory of visual selection based on information-conflict resolution.