Using movement and intentions to understand human activity

During perception, people segment continuous activity into discrete events. They do so in part by monitoring changes in features of an ongoing activity. Characterizing these features is important for theories of event perception and may be helpful for designing information systems. The three experiments reported here asked whether the body movements of an actor predict when viewers will perceive event boundaries. Body movements were recorded using a magnetic motion tracking system and compared with viewers’ segmentation of his activity into events. Changes in movement features were strongly associated with segmentation. This was more true for fine-grained than for coarse-grained boundaries, and was strengthened when the stimulus displays were reduced from live-action movies to simplified animations. These results suggest that movement variables play an important role in the process of segmenting activity into meaningful events, and that the influence of movement on segmentation depends on the availability of other information sources.     

Aging and the segmentation of narrative film

The perception of event structure in continuous activity is important for everyday comprehension. Although the segmentation of experience into events is a normal concomitant of perceptual processing, previous research has shown age differences in the ability to perceive structure in naturalistic activity, such as a movie of someone washing a car. However, past research has also shown that older adults have a preserved ability to comprehend events in narrative text, which suggests that narrative may improve the event processing of older adults. This study tested whether there are age differences in event segmentation at the intersection of continuous activity and narrative: narrative film. Younger and older adults watched and segmented a narrative film, The Red Balloon, into coarse and fine events. Changes in situational features, such as changes in characters, goals, and objects predicted segmentation. Analyses revealed little age-difference in segmentation behavior. This suggests the possibility that narrative structure supports event understanding for older adults.     

Using movement and intentions to understand simple events

In order to understand ongoing activity, observers segment it into meaningful temporal parts. Segmentation can be based on bottom-up processing of distinctive sensory characteristics, such as movement features. Segmentation may also be affected by top-down effects of knowledge structures, including information about actors’ intentions. Three experiments investigated the role of movement features and intentions in perceptual event segmentation, using simple animations. In all conditions, movement features significantly predicted where participants segmented. This relationship was stronger when participants identified larger units than when they identified smaller units, and stronger when the animations were generated randomly than when they were generated by goal-directed human activity. This pattern suggests that bottom-up processing played an important role in segmentation of these stimuli, but that this was modulated by top-down influence of knowledge structures. To describe accurately how observers perceive ongoing activity, one must account for the effects of distinctive sensory characteristics, the effects of knowledge structures, and their interactions.     

Event structure in perception and conception

Events can be understood in terms of their temporal structure. The authors first draw on several bodies of research to construct an analysis of how people use event structure in perception, understanding, planning, and action. Philosophy provides a grounding for the basic units of events and actions. Perceptual psychology provides an analogy to object perception: Like objects, events belong to categories, and, like objects, events have parts. These relationships generate 2 hierarchical organizations for events: taxonomies and partonomies. Event partonomies have been studied by looking at how people segment activity as it happens. Structured representations of events can relate partonomy to goal relationships and causal structure; such representations have been shown to drive narrative comprehension, memory, and planning. Computational models provide insight into how mental representations might be organized and transformed. These different approaches to event structure converge on an explanation of how multiple sources of information interact in event perception and conception.     

Activation of human motion processing areas during event perception

Observers are able to segment continuous everyday activity into meaningful parts. This ability may be related to processing low-level visual cues, such as changes in motion. To address this issue, the present study combined measurement of evoked responses to event boundaries with functional identification of the extrastriate motion complex (MT+) and the frontal eye field (FEF), two regions related to motion perception and eye movements. The results provided strong evidence that MT+ is activated by event boundaries: Individuals' MT+ regions showed strong responses to event boundaries, and MT+ was collocated with a lateral posterior region that responded at event boundaries. The evidence regarding the FEF was less conclusive: The FEF showed reliable but relatively reduced responses to event boundaries, but the FEF was medial and superior to a frontal area that responded at event boundaries. These results suggest that motion cues, and possibly eye movements, may play key roles in event structure perception.     

Understanding the Individual Cognitive Potential of Persons with Intellectual Disability in Workshops for Adapted Work

We aimed at using simple judgments of event segmentation to reveal cognitive problems in workers with intellectual disability regarding their assembly performance. We investigated event perception and assembly performance in 32 workers (mean IQ = 64.4). First, we assessed their ability to segment activity into meaningful events. The task involved segmenting four videos in coarse and fine events. We assessed event segmentation performance and compared it to 30 controls (IQ > 100). The workers detected fewer event boundaries than controls. A subgroup of the workers (12 of 32) defined more event boundaries in the coarse than the fine condition, indicating misconception of higher‐ and lower‐level content. The remaining 20 workers showed diminished hierarchical alignment compared to controls. Second, workers executed a Lego task. Better event segmentation performance was associated with enhanced assembly performance. These results suggest that the event segmentation task can serve as a diagnostic assessment for cognitive potential.Copyright © 2017 John Wiley & Sons, Ltd.     

Age differences in the perception of hierarchical structure in events

Everyday activities break down into parts and subparts, and appreciating this hierarchical structure is an important component of understanding. In two experiments we found age differences in the ability to perceive hierarchical structure in continuous activity. In both experiments, younger and older adults segmented movies of everyday activities into large and small meaningful events. Older adults’ segmentation deviated more from group norms than did younger adults’ segmentation, and older adults’ segmentation was less hierarchically organized than that of younger adults. Older adults performed less well than younger adults on event memory tasks. In some cases, measures of event segmentation discriminated between those older adults with better and worse memory. These results suggest that the hierarchical encoding of ongoing activity declines with age, and that such encoding may be important for memory.     

事件切割：我们如何知觉并记忆日常事件?

事件切割指的是人们将连续的外界信息析解成若干个有意义且互相关联的事件的过程, 实验室中通常使用事件切割任务对其进行研究。事件切割既包含自下而上的加工过程, 也有自上而下加工的成分。事件切割活动对记忆有着重要的影响, 个体知觉事件、回忆事件的能力被认为与其日常生活紧密相关。解释事件切割加工过程和特征的理论模型主要包括情境模型、事件切割理论和事件视界模型。未来的研究可以深入探讨事件记忆在不同测试类型上的差异, 并关注事件切割过程中的注意分配过程。     

Dissociations between featural versus conjunction-based texture processing in infancy: analyses of three potential contributing factors

Many models of object perception posit that adults encode individual features in visual scenes before processing the conjunction relations among these features to generate holistic representations. Prior research suggests that infants detect textural discrepancies based on individual features more readily than those based on feature conjunctions. While these results suggest adult-like qualitative differences in infants' processing of features versus conjunctions, there are potential alternative explanations. We examined three such explanations: (1) failure to process one of the features that constitute the conjunction, (2) failure to encode and remember conjunction information that is necessary to detect conjunction-based textural discrepancies, and (3) the fact that conjunction-based discrepancies involve stimuli that are more similar to original stimuli than those involving feature-based discrepancies. None of these factors could explain 5.5-month-olds' superior processing of featural than conjunction-based textural discrepancies. Thus, in infancy, as in adulthood, features and conjunction relations appear to be processed by qualitatively different mechanisms.     

Novelty Categorization Theory

Novelty Categorization Theory (NCT) attempts to predict when people perceive events as novel and how they process novel events across different domains. It is predicted that broad mental categories reduce the perception of an event being novel via inclusion processes, whereas narrow categories increase it via exclusion processes. Furthermore, based on a ‘motive to know’, when preparing for novel events, people broaden both perception and mental categories, because to understand novel information, it is essential to integrate it into pre-existing knowledge structures that are sufficiently broad. Over time, a ‘when-novel-then-process-globally’ routine develops that is automatically elicited when novelty is encountered. Self-protective motives can, however, counteract such processing styles so that threatening novelty leads to local processing. Relations to construal level theory and action identification theory and implications for future research are discussed.     

Walking through doorways causes forgetting: Event structure or updating disruption?

According to event cognition theory, people segment experience into separate event models. One consequence of this segmentation is that when people transport objects from one location to another, memory is worse than if people move across a large location. In two experiments participants navigated through a virtual environment, and recognition memory was tested in either the presence or the absence of a location shift for objects that were recently interacted with (i.e., just picked up or set down). Of particular concern here is whether this location updating effect is due to (a) differences in retention intervals as a result of the navigation process, (b) a temporary disruption in cognitive processing that may occur as a result of the updating processes, or (c) a need to manage multiple event models, as has been suggested in prior research. Experiment 1 explored whether retention interval is driving this effect by recording travel times from the acquisition of an object and the probe time. The results revealed that travel times were similar, thereby rejecting a retention interval explanation. Experiment 2 explored whether a temporary disruption in processing is producing the effect by introducing a 3-second delay prior to the presentation of a memory probe. The pattern of results was not affected by adding a delay, thereby rejecting a temporary disruption account. These results are interpreted in the context of the event horizon model, which suggests that when there are multiple event models that contain common elements there is interference at retrieval, which compromises performance.     

Cross-modal source monitoring confusions between perceived and imagined events

Two experiments tested the prediction based on the source monitoring framework that imagination is most likely to lead to false memories when related perceived events have occurred. Consistent with this, people were more likely to falsely remember seeing events when the events had been both imagined as seen and actually heard than when they were just heard, just visually imagined, or imagined both visually and auditorily. Furthermore, when people considered potential sources for memories or more carefully evaluated features of remembered events, source errors were reduced. On average, misattributed ("false") memories differed in phenomenal qualities from true memories. Taken together, these findings show that as different qualities of mental experience flexibly enter into source attributions, qualities derived from related perceptual events are particularly likely to lead to false claims that imagined events were seen, even when the event involves a primary modality (auditory) different from the target event (visual).     

Segmentation of coarticulated speech in perception

The research investigates how listeners segment the acoustic speech signal into phonetic segments and explores implications that the segmentation strategy may have for their perception of the (apparently) context-sensitive allophones of a phoneme. Two manners of segmentation are contrasted. In one, listeners segment the signal into temporally discrete, context-sensitive segments. In the other, which may be consistent with the talker’s production of the segments, they partition the signal into separate, but overlapping, segments freed of their contextual influences. Two complementary predictions of the second hypothesis are tested. First, listeners will use anticipatory coarticulatory information for a segment as information for the forthcoming segment. Second, subjects will not hear anticipatory coarticulatory information as part of the phonetic segment with which it co-occurs in time. The first hypothesis is supported by findings on a choice reaction time procedure; the second is supported by findings on a 4IAX discrimination test. Implications of the findings for theories of speech production, perception, and of the relation between the two are considered.     

Eye Movements Reveal the Influence of Event Structure on Reading Behavior

When we read narrative texts such as novels and newspaper articles, we segment information presented in such texts into discrete events, with distinct boundaries between those events. But do our eyes reflect this event structure while reading? This study examines whether eye movements during the reading of discourse reveal how readers respond online to event structure. Participants read narrative passages as we monitored their eye movements. Several measures revealed that event structure predicted eye movements. In two experiments, we found that both early and overall reading times were longer for event boundaries. We also found that regressive saccades were more likely to land on event boundaries, but that readers were less likely to regress out of an event boundary. Experiment 2 also demonstrated that tracking event structure carries a working memory load. Eye movements provide a rich set of online data to test the cognitive reality of event segmentation during reading.     

Social event segmentation

Humans are experts in understanding social environments. What perceptual and cognitive processes enable such competent evaluation of social information? Here we show that environmental content is grouped into units of “social perception”, which are formed automatically based on the attentional priority given to social information conveyed by eyes and faces. When asked to segment a clip showing a typical daily scenario, participants were remarkably consistent in identifying the boundaries of social events. Moreover, at those social event boundaries, participants' eye movements were reliably directed to actors' eyes and faces. Participants' indices of attention measured during the initial passive viewing, reflecting natural social behaviour, also showed a remarkable correspondence with overt social segmentation behaviour, reflecting the underlying perceptual organization. Together, these data show that dynamic information is automatically organized into meaningful social events on an ongoing basis, strongly suggesting that the natural comprehension of social content in daily life might fundamentally depend on this underlying grouping process.     

Incidental learning in preschool children as a function of level of cognitive analysis

Preschool children's recall and clustering of organized lists of pictures were examined under deliberate instructions to remember or in incidental learning situations. The incidental tasks either required comprehension (categorization, or a rating of pleasantness-unpleasantness) or were formal orienting tasks involving processing in terms of physical features.Explicit instruction to remember and formal incidental instructions did not differ, and both lead to poorer performance than the comprehension activities. Categorization, whether accompanied by explicit instructions to recall, or occurring in the context of a meaningful activity, was no more efficient than categorization in and for itself. With children as with adults, it is the activity of the children which determines depth of processing and subsequent retention, not the intent to remember per se.     

Making sense of abstract events: Building event schemas

Everyday events, such as making a bed, can be segmented hierarchically, with the coarse level characterized by changes in the actor’s goals and the fine level by subgoals (Zacks, Tversky, &; Iyer, 2001). Does hierarchical event perception depend on knowledge of actors’ intentions? This question was addressed by asking participants to segment films of abstract, schematic events. Films were novel or familiarized, viewed forward or backward, and simultaneously described or not. The participants interpreted familiar films as more intentional than novel films and forward films as more intentional than backward films. Regardless of experience and film direction, however, the participants identified similar event boundaries and organized them hierarchically. An analysis of the movements in each frame revealed that event segments corresponded to bursts of change in movement features, with greater bursts for coarse than for fine units. Perceiving event structure appears to enable event schemas, rather than resulting from them.