Working memory and inferences: evidence from eye fixations during reading

Eye fixations during reading were monitored to examine the relationship between individual differences in working memory capacity-as assessed by the reading span task-and inferences about predictable events. Context sentences predicting likely events, or non-predicting control sentences, were presented. They were followed by continuation sentences in which a target word represented an event to be inferred (inferential word) or an unlikely event (non-predictable word). A main effect of reading span showed that high working memory capacity was related to shorter gaze durations across sentence regions. More specific findings involved an interaction between context, target, and reading span on late processing measures and regions. Thus, for high- but not for low-span readers, the predicting condition, relative to the control condition, facilitated reanalysis of the continuation sentence that represented the inference concept. This effect was revealed by a reduction in regression-path reading time in the last region of the sentence, involving less time reading that region and fewer regressions from it. These results indicate that working memory facilitates elaborative inferences during reading, but that this occurs at late text-integration processes, rather than at early lexical-access processes.     

Comparing eye movements during position tracking and identity tracking: No evidence for separate systems

There is an ongoing debate as to whether people track multiple moving objects in a serial fashion or with a parallel mechanism. One recent study compared eye movements when observers tracked identical objects (Multiple Object Tracking—MOT task) versus when they tracked the identities of different objects (Multiple Identity Tracking—MIT task). Distinct eye-movement patterns were found and attributed to two separate tracking systems. However, the same results could be caused by differences in the stimuli viewed during tracking. In the present study, object identities in the MIT task were invisible during tracking, so observers performed MOT and MIT tasks with identical stimuli. Observer were able to track either position and identity depending on the task. There was no difference in eye movements between position tracking and identity tracking. This result suggests that, while observers can use different eye-movement strategies in MOT and MIT, it is not necessary.     

Activation of shape and semantic information during ambiguous homophone processing: eye tracking evidence from Hindi

In two visual world eye tracking studies, we examined the activation of subordinate meanings of ambiguous homophones in Hindi and particularly when the sentence context is biased towards the dominant meaning. Participants listened to sentences that were either neutral or biased towards the dominant meaning of the homophone and saw a display containing four pictures. In experiment 1, the display had a shape competitor of the subordinate meaning of the homophone in both neutral and biased conditions along with three unrelated distractors. Experiment 2 had semantic competitors of the subordinate meaning of the homophones along with three distractors. Proportion of fixations to different objects overtime suggested that participants activated the subordinate meanings and oriented their attention to the shape and semantic competitors even when the prior context was biased towards the dominant meaning. Overall, these data from Hindi provide further support to those models of lexical access that assume exhaustive access of both the meanings of an ambiguous homophone. These data suggest even a dominant bias does not eliminate the activation of perceptual and conceptual features of the subordinate meaning.     

Similarity-based interference during language comprehension: Evidence from eye tracking during reading

The nature of working memory operation during complex sentence comprehension was studied by means of eye-tracking methodology. Readers had difficulty when the syntax of a sentence required them to hold 2 similar noun phrases (NPs) in working memory before syntactically and semantically integrating either of the NPs with a verb. In sentence structures that placed these NPs at the same linear distances from one another but allowed integration with a verb for 1 of the NPs, the comprehension difficulty was not seen. These results are interpreted as indicating that similarity-based interference occurs online during the comprehension of complex sentences and that the degree of memory accessibility conventionally associated with different types of NPs does not have a strong effect on sentence processing.     

The heterogeneous processes of cheating: Attention evidence from two eye tracking experiments

Dishonesty erodes society. Although much is known about dishonesty, the process leading up to the decision of whether to be honest or dishonest is often assumed to be homogenous and is not well understood. In this paper, we take a more nuanced approach and explore more closely the process of deciding whether to cheat or be honest when an opportunity to cheat arises. We do this in two laboratory eye tracking experiments. In our first experiment (n = 193), we identify heterogeneity in the decision to cheat. Some decisions on whether to cheat or be honest exhibit relatively little variation and appear to be oriented towards cheating (or honesty) with apparently little consideration of the alternative, whereas other decisions seem to be characterized by a higher degree of consideration for both decision alternatives. Our second experiment (n = 299) demonstrates that a gaze dependent intervention in the choices process is able to affect the behavioral outcomes.     

Vowel processing during silent reading: evidence from eye movements

Two eye movement experiments examined whether skilled readers include vowels in the early phonological representations used in word recognition during silent reading. Target words were presented in sentences preceded by parafoveal previews in which the vowel phoneme was concordant or discordant with the vowel phoneme in the target word. In Experiment 1, the orthographic vowel differed from the target in both the concordant and discordant preview conditions. In Experiment 2, the vowel letters in the preview were identical to those in the target word. The phonological vowel was ambiguous, however, and the final consonants of the previews biased the vowel phoneme either toward or away from the target's vowel phoneme. In both experiments, shorter reading times were observed for targets preceded by concordant previews than by discordant previews. Implications for models of word recognition are discussed.     

Focus identification during sentence comprehension: evidence from eye movements

Three eye movement experiments investigated focus identification during sentence comprehension. Participants read dative or double-object sentences (i.e., either the direct or indirect object occurred first), and a replacive continuation supplied a contrast that was congruous with either the direct or the indirect object. Experiments 1 and 2 manipulated focus by locating only adjacent to either the direct or indirect object of dative (Experiment 1) or double-object (Experiment 2) sentences. Reading-time effects indicated that the surface position of the focus particle influenced processing. In addition, Experiment 1 reading times were longer when the replacive was incongruous with the constituent that only adjoined, and particle position modulated a similar effect in Experiment 2. Experiment 3 showed that this effect was absent when only was omitted. We conclude that the surface position of a focus particle modulates focus identification during on-line sentence comprehension.     

Verbal cues facilitate memory retrieval during infancy

In three experiments, 18-month-olds were tested in a deferred imitation paradigm. Some infants received verbal information during the demonstration and at the time of the test (full narration), and some did not (empty narration). When tested after a 4-week delay, infants given full narration exhibited superior retention relative to infants given empty narration (Experiment 1). This retention advantage appears to be due to the effects of verbal cues at the time of memory retrieval. There was no effect of verbal cues that were presented only at the time of original encoding (Experiment 2A). Furthermore, infants who received verbal cues only at the time of retrieval exhibited superior retention relative to infants who received verbal cues only at the time of original encoding (Experiment 2B). These findings demonstrate that verbal cues can enhance memory retrieval by participants who are not yet fluent speakers themselves.     

The coordinated interplay of scene, utterance, and world knowledge: evidence from eye tracking

Two studies investigated the interaction between utterance and scene processing by monitoring eye movements in agent–action–patient events, while participants listened to related utterances. The aim of Experiment 1 was to determine if and when depicted events are used for thematic role assignment and structural disambiguation of temporarily ambiguous English sentences. Shortly after the verb identified relevant depicted actions, eye movements in the event scenes revealed disambiguation. Experiment 2 investigated the relative importance of linguistic/world knowledge and scene information. When the verb identified either only the stereotypical agent of a (nondepicted) action, or the (nonstereotypical) agent of a depicted action as relevant, verb-based thematic knowledge and depicted action each rapidly influenced comprehension. In contrast, when the verb identified both of these agents as relevant, the gaze pattern suggested a preferred reliance of comprehension on depicted events over stereotypical thematic knowledge for thematic interpretation. We relate our findings to language comprehension and acquisition theories.     

The time-course of recovery from interruption during reading: eye movement evidence for the role of interruption lag and spatial memory

Two experiments examined how interruptions impact reading and how interruption lags and the reader's spatial memory affect the recovery from such interruptions. Participants read paragraphs of text and were interrupted unpredictably by a spoken news story while their eye movements were monitored. Time made available for consolidation prior to responding to the interruption did not aid reading resumption. However, providing readers with a visual cue that indicated the interruption location did aid task resumption substantially in Experiment 2. Taken together, the findings show that the recovery from interruptions during reading draws on spatial memory resources and can be aided by processes that support spatial memory. Practical implications are discussed.     

The processing of spatial information in short-term memory: Insights from eye tracking the path length effect

Effects of averageness and symmetry on the judgment of facial attractiveness were investigated using a generalized Procrustes method and multiple regression analyses. Participants (n = 114) rated attractiveness of 96 photographs of faces with neutral expressions. Through a generalized Procrustes method, the faces and their mirror-reversed versions were represented as points on a hyperplane. Both averageness and symmetry of each individual were defined as distances on the plane. A multiple regression analysis was performed to examine the effect of symmetry and averageness for each gender. For male faces, both symmetry and averageness affected attractiveness ratings positively , and there was no difference between the effects of averageness and symmetry. On the other hand, for female faces only averageness affected attractiveness, whereas symmetry did not. However, these effects were not large.     

Influence of bilingualism on memory generalization during infancy

Very few studies have examined the cognitive advantages of bilingualism during the first two years of development, and a majority of the studies examining bilingualism throughout the lifespan have focused on the relationship between multiple languages and cognitive control. Early experience with multiple language systems may influence domain‐general processes, such as memory, that may increase a bilingual child’s capacity for learning. In the current study, we found that bilingual, but not monolingual, infants were able to generalize across cues at 18 months. This is the first study to show a clear bilingual advantage in memory generalization, with more equal or balanced exposure to each language significantly predicting ability to generalize. A video abstract of this article can be viewed at http://www.youtube.com/watch?v=31QsMqYtGGo&feature=plcp     

Competition during the processing of quantifier scope ambiguities: evidence from eye movements during reading

We investigated the processing of sentences containing a quantifier scope ambiguity, such as Kelly showed a photo to each critic, which is ambiguous between the indefinite phrase (a photo) having one or many referents. Ambiguity resolution requires the computation of relative quantifier scope, with either a photo or each critic taking wide scope, thereby determining the number of referents. Using eye tracking, we established that multiple factors, including the grammatical function and surface linear order of quantified phrases, along with their lexical characteristics, interact during the processing of relative quantifier scope, with conflict between factors incurring a processing cost. We discuss the results in terms of theoretical accounts attributing sentence-processing difficulty to either reanalysis (e.g., Fodor, 1982) or competition between rival analyses (e.g., Kurtzman & MacDonald, 1993).     

The other-race effect develops during infancy: evidence of perceptual narrowing

Experience plays a crucial role in the development of face processing. In the study reported here, we investigated how faces observed within the visual environment affect the development of the face-processing system during the 1st year of life. We assessed 3-, 6-, and 9-month-old Caucasian infants' ability to discriminate faces within their own racial group and within three other-race groups (African, Middle Eastern, and Chinese). The 3-month-old infants demonstrated recognition in all conditions, the 6-month-old infants were able to recognize Caucasian and Chinese faces only, and the 9-month-old infants' recognition was restricted to own-race faces. The pattern of preferences indicates that the other-race effect is emerging by 6 months of age and is present at 9 months of age. The findings suggest that facial input from the infant's visual environment is crucial for shaping the face-processing system early in infancy, resulting in differential recognition accuracy for faces of different races in adulthood.     

Multiple memory systems: evidence from stroke

In this report, we describe the "fractionation of memory systems" in a 62-yr.-old woman following a left anterior stroke. Despite the presence of a significant, persistent declarative memory (verbal learning) deficit, this patient exhibited relatively intact procedural learning. The latter was manifested over a 4-day period by improved performance on a maze task executed under "mirror-tracing" conditions. By the final set of trials, the patient's performance approximated that of a normal control subject with respect to speed, although not errors. The selective preservation of particular learning abilities in brain-damaged patients has implications for rehabilitative interventions.     

Activation of phonological codes during reading: evidence from errors detection and eye movements

This experiment explored the role of phonology in the activation of word meanings when homophonic and nonhomophonic errors were embedded in meaningful texts. The resulting data supported the position that phonological codes are activated very early in eye fixation and are compatible with the verification model of Van Orden (1987).     

Processing ambiguous verbs: evidence from eye movements

In 2 eye-tracking experiments, participants read verbs that had 2 (unrelated) meanings or 2 (related) senses in contexts that disambiguated before or after the verb, to the dominant or subordinate interpretation. A 3rd experiment used unambiguous verbs. The results indicated that the language processor used information about context in the early stages of resolving meaning ambiguities but only during integration for sense ambiguities. Effects of preference were delayed for both types of verbs. The results contrast with findings concerning the processing of nouns (e.g., K. Rayner & S. A. Duffy, 1986). For meaning ambiguities, the authors argue that delays in resolution allow both meanings to reach a high level of activation, thus reducing effects of frequency. For sense ambiguities, the authors argue that the processor does not access multiple senses but activates one underspecified meaning and uses context to home in on the appropriate sense.     

Working memory predicts subsequent episodic memory decline during healthy cognitive aging: evidence from a cross-lagged panel design

Aging adults experience declines in working memory and episodic memory, however, it is unclear how these declines operate over time. Decreased working memory may be associated with early changes in episodic memory, by reducing older adults’ ability to meaningfully integrate new information into pre-existing schemas and recall information without the assistance of cues. Given the increased prevalence of Alzheimer’s disease, and concerns based on subjective memory changes, it is important to understand how these processes interact over time. To assess the relationship between working memory and episodic memory during healthy cognitive aging, we performed neuropsychological assessments at multiple time points in a sample of 310 community-dwelling older adults. Using a cross-lagged panel design, we demonstrated that the lagged associations between working memory and later episodic free recall were 50% larger than the lagged associations between episodic recall and later working memory, suggesting working memory may be a useful metric of future episodic memory decline.     

Visual short-term memory during smooth pursuit eye movements

Visual short-term memory (VSTM) was probed while observers performed smooth pursuit eye movements. Smooth pursuit keeps a moving object stabilized in the fovea. VSTM capacity for position was reduced during smooth pursuit compared with a condition with eye fixation. There was no difference between a condition in which the items were approximately stabilized on the retina because they moved with the pursuit target and a condition in which the items moved across the retina because they were stationary in space. The reduction of capacity for position was eliminated when miniature items were presented on the pursuit target. Similarly, VSTM capacity for color did not differ between smooth pursuit and fixation. The results suggest that visuospatial attention is tied to the target during smooth pursuit, which impairs VSTM for the position of peripheral objects. Sensory memory during smooth pursuit was only slightly impaired.