The impact of continuity editing in narrative film on event segmentation

Filmmakers use continuity editing to engender a sense of situational continuity or discontinuity at editing boundaries. The goal of this study was to assess the impact of continuity editing on how people perceive the structure of events in a narrative film and to identify brain networks that are associated with the processing of different types of continuity editing boundaries. Participants viewed a commercially produced film and segmented it into meaningful events, while brain activity was recorded with functional magnetic resonance imaging (MRI). We identified three degrees of continuity that can occur at editing locations: edits that are continuous in space, time, and action; edits that are discontinuous in space or time but continuous in action; and edits that are discontinuous in action as well as space or time. Discontinuities in action had the biggest impact on behavioral event segmentation, and discontinuities in space and time had minor effects. Edits were associated with large transient increases in early visual areas. Spatial-temporal changes and action changes produced strikingly different patterns of transient change, and they provided evidence that specialized mechanisms in higher order perceptual processing regions are engaged to maintain continuity of action in the face of spatiotemporal discontinuities. These results suggest that commercial film editing is shaped to support the comprehension of meaningful events that bridge breaks in low-level visual continuity, and even breaks in continuity of spatial and temporal location.     

自传体叙事中的自我欺骗:个体的自我认同策略

自传体叙事中的自我欺骗是一种从个体内角度理解的自我欺骗,是无人际压力情况下个体自我建构过程中所使用的一种认同策略。这种自我欺骗发生在自传体叙事过程中,个体通过叙事语言拉开"新我"和"旧我"的叙事距离,建立新的目标追求并实现,最终构建新的叙事认同。在这个过程中,个体在维持正性自我概念的动机驱动下,采用有偏差的信息加工方式叙述自我故事,满足情绪体验与情绪评价一致性的需要,进而影响个体的自我意识,引发自我改变。未来研究可以探讨自传体叙事中自我欺骗在临床中的行为表现与治疗策略,考察其认知神经机制,并探讨不同社会文化背景下自我欺骗的特点与影响因素。     

Knowing in advance: the impact of prior event information on memory and event knowledge

We examined the influence of newly acquired information on children's memory and general representation of a personally experienced event. Thirty-five children between the ages of 5 and 7 years participated in the novel event (Visiting the Pirate). The day before participating, children were: (1) provided with new information specific to the up-coming event; (2) engaged in a discussion generally related to the event topic based on existing knowledge; or (3) discussed an unrelated topic. Advance information specific to the event led to better recall and, in particular, to better integration of the experience into a general event representation both soon after the event and at a follow-up interview 4 months later, whereas general discussion of the topic without the event specific information neither enhanced memory reports nor facilitated the integration of event information. Providing information in advance can have significant effects on memory and knowledge acquisition although many variables, including those relating to the specific content of the information, will affect this relation.     

An empirical and computational investigation of perceiving and remembering event temporal relations

Events have beginnings, ends, and often overlap in time. A major question is how perceivers come to parse a stream of multimodal information into meaningful units and how different event boundaries may vary event processing. This work investigates the roles of these three types of event boundaries in constructing event temporal relations. Predictions were made based on how people would err according to the beginning state, end state, and overlap heuristic hypotheses. Participants viewed animated events that include all the logical possibilities of event temporal relations, and then made temporal relation judgments. The results showed that people make use of the overlap between events and take into account the ends and beginnings, but they weight ends more than beginnings. Neural network simulations showed a self-organized distinction when learning temporal relations between events with overlap versus those without.     

Individual differences in children's event memory reports and the narrative elaboration technique

Children between 7 and 8 years old took part in a staged event at school and 1 week later were assessed using a short form of the Wechsler Intelligence scale for children (third edition) and measures of metamemory, narrative ability, and socioeconomic status. Two weeks following the event, children either received narrative elaboration training (NET; K.J. Saywitz & L. Snyder, 1996) and were prompted with the four NET cue cards at interview; received verbal prompts corresponding to the cue card categories, but without prior training; or were presented with the cards at interview without prior training. Children given verbal labels as prompts recalled as much information as children who received NET training and cue cards. Measures of intelligence were predictive of amount recalled for cards-only children but not for the other 2 groups, indicating that differences in recall between low- and high-IQ groups were attenuated when recall was supported by NET training or verbal prompting.     

Event-mapping tasks: investigating the effects of prior information and event complexity on performance

Infants younger than 11.5 months typically fail in event-mapping tasks with complex event sequences, yet succeed when the event sequences are made very simple and brief. The present research explored whether younger infants might succeed at mapping complex event sequences if infants were given information to help them organize and structure the event. Three experiments were conducted with 7.5-month-olds. In all of the experiments, the infants were shown a two-phase test event. In the first phase, infants saw a box–ball occlusion sequence in which the objects emerged at least once to each side of the screen, reversing direction each time to return behind the screen. In the second phase, infants saw a one-ball display. Prior to the test trials, infants were shown an “outline” of the test event that contained the basic components of the event. The experiments varied in (a) the kind of information included in the event outline and (b) the complexity of the box–ball test sequence (i.e., the number of object reversals). The results revealed that the 7.5-month-olds benefitted from viewing an event outline, although the performance of the males was more robust than the females. These results add to a growing body of research indicating that young infants can succeed on event-mapping tasks under more supportive conditions and provide insight into why event mapping is such a difficult task for young infants.     

Event completion: event based inferences distort memory in a matter of seconds

We present novel evidence that implicit causal inferences distort memory for events only seconds after viewing. Adults watched videos of someone launching (or throwing) an object. However, the videos omitted the moment of contact (or release). Subjects falsely reported seeing the moment of contact when it was implied by subsequent footage but did not do so when the contact was not implied. Causal implications were disrupted either by replacing the resulting flight of the ball with irrelevant video or by scrambling event segments. Subjects in the different causal implication conditions did not differ on false alarms for other moments of the event, nor did they differ in general recognition accuracy. These results suggest that as people perceive events, they generate rapid conceptual interpretations that can have a powerful effect on how events are remembered.     

Perceptual simulations and linguistic representations have differential effects on speeded relatedness judgements and recognition memory

We examined the effect of spatial iconicity (a perceptual simulation of canonical locations of objects) and word-order frequency on language processing and episodic memory of orientation. Participants made speeded relatedness judgements to pairs of words presented in locations typical of their real-world arrangements (e.g., ceiling on top and floor on bottom). They then engaged in a surprise orientation recognition task for the word pairs. We replicated Louwerse's (2008) Louwerse, M. M. 2008. Embodied representations are encoded in language. Psychonomic Bulletin & Review, 15: 838–844. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] finding that word-order frequency has a stronger effect on semantic relatedness judgements than does spatial iconicity. This is consistent with recent suggestions that linguistic representations have a stronger impact on immediate decisions about verbal materials than do perceptual simulations. In contrast, spatial iconicity enhanced episodic memory of orientation to a greater extent than word-order frequency did. This new finding indicates that perceptual simulations have an important role in episodic memory. Results are discussed with respect to theories of perceptual representation and linguistic processing.     

Parallel interactive retrieval of item and associative information from event memory

Memory contains information about individual events (items) and combinations of events (associations). Despite the fundamental importance of this distinction, it remains unclear exactly how these two kinds of information are stored and whether different processes are used to retrieve them. We use both model-independent qualitative properties of response dynamics and quantitative modeling of individuals to address these issues. Item and associative information are not independent and they are retrieved concurrently via interacting processes. During retrieval, matching item and associative information mutually facilitate one another to yield an amplified holistic signal. Modeling of individuals suggests that this kind of facilitation between item and associative retrieval is a ubiquitous feature of human memory.     

Beyond quantity: Individual differences in working memory and the ordinal understanding of numerical symbols

In two different contexts, we examined the hypothesis that individual differences in working memory (WM) capacity are related to the tendency to infer complex, ordinal relationships between numerical symbols. In Experiment 1, we assessed whether this tendency arises in a learning context that involves mapping novel symbols to quantities by training adult participants to associate dot-quantities with novel symbols, the overall relative order of which had to be inferred. Performance was best for participants who were higher in WM capacity (HWMs). HWMs also learned ordinal information about the symbols that lower WM individuals (LWMs) did not. In Experiment 2, we examined whether WM relates to performance when participants are explicitly instructed to make numerical order judgments about highly enculturated numerical symbols by having participants indicate whether sets of three Arabic numerals were in increasing order. All participants responded faster when sequential sets (3-4-5) were in order than when they were not. However, only HWMs responded faster when non-sequential, patterned sets (1-3-5) were in order, suggesting they were accessing ordinal associations that LWMs were not. Taken together, these experiments indicate that WM capacity plays a key role in extending symbolic number representations beyond their quantity referents to include symbol-symbol ordinal associations, both in a learning context and in terms of explicitly accessing ordinal relationships in highly enculturated stimuli.     

Developmental differences in the effects of repeated interviews and interviewer bias on young children's event memory and false reports

The present study investigated developmental differences in the effects of repeated interviews and interviewer bias on children's memory and suggestibility. Three- and 5-year-olds were singly or repeatedly interviewed about a play event by a highly biased or control interviewer. Children interviewed once by the biased interviewer after a long delay made the most errors. Children interviewed repeatedly, regardless of interviewer bias, were more accurate and less likely to falsely claim that they played with a man. In free recall, among children questioned once after a long delay by the biased interviewer, 5-year-olds were more likely than were 3-year-olds to claim falsely that they played with a man. However, in response to direct questions, 3-year-olds were more easily manipulated into implying that they played with him. Findings suggest that interviewer bias is particularly problematic when children's memory has weakened. In contrast, repeated interviews that occur a short time after a to-be-remembered event do not necessarily increase children's errors, even when interviews include misleading questions and interviewer bias. Implications for developmental differences in memory and suggestibility are discussed.     

Language knowledge and event knowledge in language use

This paper examines how semantic knowledge is used in language comprehension and in making judgments about events in the world. We contrast knowledge gleaned from prior language experience (“language knowledge”) and knowledge coming from prior experience with the world (“world knowledge”). In two corpus analyses, we show that previous research linking verb aspect and event representations have confounded language and world knowledge. Then, using carefully chosen stimuli that remove this confound, we performed four experiments that manipulated the degree to which language knowledge or world knowledge should be salient and relevant to performing a task, finding in each case that participants use the type of knowledge most appropriate to the task. These results provide evidence for a highly context-sensitive and interactionist perspective on how semantic knowledge is represented and used during language processing.     

Cognitive structures in comprehension and memory of narrative discourse

The effects of structure and content variables on memory and comprehension of prose passages were studied in two experiments. The experimental passages exemplify a class of simple narrative stories that is described by a generative grammar of plot structures. A comprehension model is proposed that assumes a hierarchical organizational framework of stories in memory, determined by the grammar, representing the abstract structural components of the plot. The quality and characteristics of subjects' memory for stories were tested on a variety of experimental tasks in which story organization was manipulated. Comprehensibility and recall were found to be a function of the amount of inherent plot structure in the story, independent of passage content. Recall probability of individual facts from passages depended on the structural centrality of the facts: Subjects tended to recall facts corresponding to high-level organizational story elements rather than lower-level details. In addition, story summarizations from memory tended to emphasize general structural characteristics rather than specific content. For successively presented stories, both structure and content manipulations influenced recall. Furthermore, repeating story structure across two passages produced facilitation in recall of the second passage, while repeating story content produced proactive interference. The implications for a model of memory for narrative discourse are discussed.     

Storage and processing in visuo-spatial working memory

Visuo-spatial working memory has been used to account for performance in a wide range of visuo-spatial tasks, including perceptuo-motor tracking and immediate recall of visually presented patterns. However a developing body of evidence points to a fractionation of the concept into visuo-spatial processing that calls on general purpose executive resources, and a visual 'cache' memory for temporary storage in on-line cognition. Two related experiments are described which address whether processing and temporary memory draw on overlapping or on distinct resources in working memory. Experiment 1 demonstrates that participants can accurately respond to a series of targets appearing in random locations whether or not they have the additional load of retaining and subsequently recalling the appearance of each target. Memory for target appearance likewise is largely unaffected by the additional load of requiring a response to each target. Experiment 2 demonstrates similar findings when verbal labeling of the patterns is inhibited through the use of articulatory suppression. Results are interpreted as consistent with a multiple component working memory system.     

Phonological representation and speech understanding with cochlear implants in deafened adults

In the present study cognitive performance in 15 deafened adult cochlear implant candidates was examined and related to level of speech understanding after 12 months of experience with the implant. The implant group performed on par with normal hearing controls in all cognitive tasks used in the study with one exception: Performance was significantly lower in cognitive tasks where use of a phonological representation of sound is a key task-demand. Observations of the implanted individuals’ level of speech understanding indicate that only those individuals who, pre-operatively, were in possession of phonological representations comparable to that of normal hearing could follow and understand a speaker that was out of sight. The results are discussed with respect to (a) deterioration in the phonological representation of sounds as a function of absence of external auditory stimulation, and (b) the role of cognitive factors in predicting success in speech understanding with the implant.     

An association between understanding cardinality and analog magnitude representations in preschoolers

The preschool years are a time of great advances in children’s numerical thinking, most notably as they master verbal counting. The present research assessed the relation between analog magnitude representations and cardinal number knowledge in preschool-aged children to ask two questions: (1) Is there a relationship between acuity in the analog magnitude system and cardinality proficiency? (2) Can evidence of the analog magnitude system be found within mappings of number words children have not successfully mastered? To address the first question, Study 1 asked three- to five-year-old children to discriminate side-by-side dot arrays with varying differences in numerical ratio, as well as to complete an assessment of cardinality. Consistent with the analog magnitude system, children became less accurate at discriminating dot arrays as the ratio between the two numbers approached one. Further, contrary to prior work with preschoolers, a significant correlation was found between cardinal number knowledge and non-symbolic numerical discrimination. Study 2 aimed to look for evidence of the analog magnitude system in mappings to the words in preschoolers’ verbal counting list. Based on a modified give-a-number task ( [Wynn, 1990] and [Wynn, 1992] ), three- to five-year-old children were asked to give quantities between 1 and 10 as many times as possible in order to assess analog magnitude variability within their developing cardinality understanding. In this task, even children who have not yet induced the cardinality principle showed signs of analog representations in their understanding of the verbal count list. Implications for the contribution of analog magnitude representations towards mastery of the verbal count list are discussed in light of the present work.     

Interactive effects of subjective memory complaints and hypertension on learning and memory performance in the elderly

This study evaluated whether the relation between subjective memory complaints and cognitive performance is influenced by the presence of hypertension in the elderly. One hundred and five healthy older adults, 70–89 years of age, with and without hypertension treatment or diagnosis, completed a scale of subjective memory complaints. Participants were divided into those with mild memory concerns and those with minimal or no complaints. All participants completed a battery of neuropsychological tests including measures of verbal and nonverbal memory. After controlling for differences in age, gender, education, and overall intellectual ability, there were significant main effects for memory concerns and significant interactions for memory complaints and hypertension on several measures of memory performance. There were no main effects for hypertension on memory performance. Simple effects analyses of the interactions showed that the hypertensive complainers demonstrated poorer performance on measures of long-term memory and greater reliance on short-term recall than the hypertensive non-complainers. There were no differences in memory performance for the non-hypertensive groups. Among healthy elderly community-dwelling adults, those with mild subjective memory complaints in the context of hypertension demonstrated greater objective cognitive difficulties than those without hypertension as well as a greater reliance on a less efficient learning strategy. These findings suggest that memory concerns in the presence of hypertension may be important when evaluating treatment efficacy in these individuals and for identifying differences in cognitive aging.     

Grammatical aspect and event recognition in children’s online sentence comprehension

This study investigated whether or not the temporal information encoded in aspectual morphemes can be used immediately by young children to facilitate event recognition during online sentence comprehension. We focused on the contrast between two grammatical aspectual morphemes in Mandarin Chinese, the perfective morpheme –le and the (imperfective) durative morpheme –zhe. The perfective morpheme –le is often used to indicate that an event has been completed, whereas the durative morpheme –zhe indicates that an event is still in progress or continuing. We were interested to see whether young children are able to use the temporal reference encoded in the two aspectual morphemes (i.e., completed versus ongoing) as rapidly as adults to facilitate event recognition during online sentence comprehension. Using the visual world eye-tracking paradigm, we tested 34 Mandarin-speaking adults and 99 Mandarin-speaking children (35 three-year-olds, 32 four-year-olds and 32 five-year-olds). On each trial, participants were presented with spoken sentences containing either of the two aspectual morphemes while viewing a visual image containing two pictures, one representing a completed event and one representing an ongoing event. Participants’ eye movements were recorded from the onset of the spoken sentences. The results show that both the adults and the three age groups of children exhibited a facilitatory effect trigged by the aspectual morpheme: hearing the perfective morpheme –le triggered more eye movements to the completed event area, whereas hearing the durative morpheme –zhe triggered more eye movements to the ongoing event area. This effect occurred immediately after the onset of the aspectual morpheme, both for the adults and the three groups of children. This is evidence that young children are able to use the temporal information encoded in aspectual morphemes as rapidly as adults to facilitate event recognition. Children’s eye movement patterns reflect a rapid mapping of grammatical aspect onto the temporal structures of events depicted in the visual scene.