Event perception as a control process for visual awareness

ABSTRACT

We present evidence demonstrating that the structure of everyday events guides attention to and representation of visual properties. Incidental change detection increases dramatically at the boundaries between events, whereas individuals are largely unaware of the sequence of actions within a single event. Observers demonstrate a limited capacity for representing events, and inducing cognitive load by presenting two simultaneous events decreases detection of sequence errors. These studies support emerging evidence that the event perception network operates as a control process that guides attention and awareness in real-world settings.     

The use of perspective as a depth cue with a 2D display in 4 and 5-month-old infants

Four experiments were conducted to study the use of perspective as a depth cue in infants, using an eye-tracking-system. In the first experiment, no significant difference was observed between the looks for the "normal" and the "strange" events on the complete display and at the target in 4-month-olds. In the second experiment, the results of 5-month-olds were similar to those obtained by 4-month-olds but they looked more at the test events when the "strange" event was presented first. In the third experiment, 5 month-olds were shown a repeated presentation adapted from the "Partial-Lag" design. Infants' exploration of the target indicated that they looked more at the "strange" event than at the "normal" event. In the fourth experiment, the same design was used with 4-month-olds but no difference between conditions was observed. Five-month-olds seem to be able to use the perspective cues alone. These different data are discussed.     

Eye Movements Reveal the Influence of Event Structure on Reading Behavior

When we read narrative texts such as novels and newspaper articles, we segment information presented in such texts into discrete events, with distinct boundaries between those events. But do our eyes reflect this event structure while reading? This study examines whether eye movements during the reading of discourse reveal how readers respond online to event structure. Participants read narrative passages as we monitored their eye movements. Several measures revealed that event structure predicted eye movements. In two experiments, we found that both early and overall reading times were longer for event boundaries. We also found that regressive saccades were more likely to land on event boundaries, but that readers were less likely to regress out of an event boundary. Experiment 2 also demonstrated that tracking event structure carries a working memory load. Eye movements provide a rich set of online data to test the cognitive reality of event segmentation during reading.     

What constitutes an episode in episodic memory?

The idea of episodic memory implies the existence of a process that segments experience into episodes so that they can be stored in memory. It is therefore surprising that the link between event segmentation and the organization of experiences into episodes in memory has not been addressed. We found that after participants read narratives containing temporal event boundaries at varying locations in the narrative, their long-term associative memory for information across event boundaries was lower than their memory for information within an event. This suggests that event segmentation during encoding resulted in segmentation of those same events in memory. Further, functional imaging data revealed that, across participants, brain activity consistent with the ongoing integration of information within events correlated with this pattern of mnemonic segmentation. These data are the first to address the mechanisms that support the organization of experiences into episodes in long-term memory.     

时间维度在记叙文理解中的作用

采用事件分割范式探讨了中文条件下时间维度在记叙文理解中的作用。实验1在中文条件下重复了Speer和Zacks(2005)年的研究,结果发现读者更多将时间短语所在位置作为分割边界,表明时间转换在情景模型更新中发挥了重要作用。实验2探讨了在没有时间短语条件下读者对文本分割的情况,结果发现读者主要是按照事件单元进行分割;实验3a和3b在文本的事件单元中插入时间短语,形成时间转换与事件转换分离的条件,探讨读者在这种时间转换与事件单元转换不一致的条件下所采用的分割策略,结果表明,读者更多仍然按照事件单元转换进行分割,而且对事件单元转换的依赖强于时间转换,但同时时间短语仍对文本的分割有一定影响。上述结果表明,事件单元作为建构记叙文心理表征的核心单元,时间维度作为事件单元转换的线索,只有在标识事件转换的情况下,才能引发读者情景模型的更新。     

An empirical and computational investigation of perceiving and remembering event temporal relations

Events have beginnings, ends, and often overlap in time. A major question is how perceivers come to parse a stream of multimodal information into meaningful units and how different event boundaries may vary event processing. This work investigates the roles of these three types of event boundaries in constructing event temporal relations. Predictions were made based on how people would err according to the beginning state, end state, and overlap heuristic hypotheses. Participants viewed animated events that include all the logical possibilities of event temporal relations, and then made temporal relation judgments. The results showed that people make use of the overlap between events and take into account the ends and beginnings, but they weight ends more than beginnings. Neural network simulations showed a self-organized distinction when learning temporal relations between events with overlap versus those without.     

The relationship between the probability assessor and the outcomes of an event as a determiner of subjective probability

Two experiments were conducted in which 58 subjects assessed the probability of occurrence of positive and negative events. Two types of probabilities were assessed. The first was the probability that an event would occur, influencing the assessor him/herself (SPE). The second was the probability that the same event would occur to someone else, not influencing the assessor (SNPE). Six patterns of assessments were observed. Most of the subjects assessed SPE to be higher than SNPE for positive events and SNPE to be higher than SPE for negative events. In the first experiment SNPE was assessed in regard to someone very close and similar to the assessor while in the second experiment SNPE was assessed in regard to a less-defined “else”. In the latter case the differences between SPE and SNPE were more prominent than in the first. The explanation was given in terms of motivational factors and the availability heuristic.     

Temporal accent structure and the remembering of filmed narratives.

Effects of temporal accent structure on the remembering of filmed narratives were examined by varying the placement and number of commercial breaks. Commercials either highlighted a story's underlying organization by occurring between major episode boundaries (i.e., at breakpoint locations) or obscured this structural arrangement by occurring within episodes (i.e., at nonbreakpoints). Relative to the accentuation of nonbreakpoints, results indicated that the attentional highlighting of episode boundaries yielded higher recall and recognition performance and better memory for temporal order information and details from the story's plot. Selective recall and recognition of breakpoint scenes was significantly higher than that of nonbreakpoints, suggesting that people use episode boundaries as referents for attending and remembering. These findings illustrate certain structural invariants across environmental events and ways in which event structure can be used in remembering.     

Using movement and intentions to understand human activity

During perception, people segment continuous activity into discrete events. They do so in part by monitoring changes in features of an ongoing activity. Characterizing these features is important for theories of event perception and may be helpful for designing information systems. The three experiments reported here asked whether the body movements of an actor predict when viewers will perceive event boundaries. Body movements were recorded using a magnetic motion tracking system and compared with viewers’ segmentation of his activity into events. Changes in movement features were strongly associated with segmentation. This was more true for fine-grained than for coarse-grained boundaries, and was strengthened when the stimulus displays were reduced from live-action movies to simplified animations. These results suggest that movement variables play an important role in the process of segmenting activity into meaningful events, and that the influence of movement on segmentation depends on the availability of other information sources.     

Intelligent temporal subsampling of American Sign Language using event boundaries

How well can a sequence of frames be represented by a subset of the frames? Video sequences of American Sign Language (ASL) were investigated in two modes: dynamic (ordinary video) and static (frames printed side by side on the display). An activity index was used to choose critical frames at event boundaries, times when the difference between successive frames is at a local minimum. Sign intelligibility was measured for 32 experienced ASL signers who viewed individual signs. For full gray-scale dynamic signs activity-index subsampling yielded sequences that were significantly more intelligible than when every mth frame was chosen. This result was even more pronounced for static images. For binary images, the relative advantage of activity subsampling was smaller. We conclude that event boundaries can be defined computationally and that subsampling from event boundaries is better than choosing at regular intervals.     

Lights,camera, action: the role of editing and framing on the processing of filmed events

ABSTRACT

Filmmakers use various cinematic techniques in an effort to guide attention to certain aspects of these events. The present study was conducted to investigate how framing and editing can guide viewers’ attention toward character actions during event segmentation. Participants watched and segmented a movie that simultaneously showed two actors engaged in two related activities. Participants watched one of three versions of the movie: Static center version that did not foreground any character; Static off-center version that foregrounding one of the characters, and an edited version with a mix of shots that foregrounding both characters. Participants engaged in an event partonomy task in which they were asked to identify the boundaries between the events that were depicted in the movie. After watching the movie, they were asked to recall the events. The results showed converging evidence between the event segmentation and recall data, which both indicated that cinematic devices affect the perception and memory of the event structure depicted in the film.     

CRT信号显示的刺激率和信号率对警觉作业的影响

本实验系统地考察了在不同刺激率、信号率条件下警觉水平的变化 ,并分析了以往警觉理论的适应条件。实验一采用 5次 /分、1 5次 /分和 30次 /分的刺激率条件 ,发现检测正确率在各条件下随时间的变化是由于 d′下降所致 ,而β值基本不变 ,可以认为警觉随时间下降是由于疲劳所致 ;中等刺激率条件下的 d′最高 ,低刺激率次之 ,高刺激率最差并且高刺激率导致被试唤醒水平降低。实验二在 30次 /分的高刺激率条件下变化信号率 (分别为 3次 /分、6次 /分和 1 2次 /分 ) ,发现信号率变化不会改变 d′,但导致β值的变化 ,可以认为高信噪比导致被试的唤醒水平升高     

Walking through doorways differentially affects recall and familiarity

Previous research has reported that walking through a doorway to a new location makes memory for objects and events experienced in the previous location less accurate. This effect, termed the location updating effect, has been used to suggest that location changes are used to mark boundaries between events in memory: memories for objects encountered within the current event are more available than those from beyond an event boundary. Within a computer‐generated memory task, participants navigated through virtual rooms, walking through doorways, and interacting with objects. The accuracy and their subjective experience of their memory for the objects (remember/know and confidence) were assessed. The findings showed that shifts in location decreased accurate responses associated with the subjective experience of remembering but not those associated with the experience of knowing, even when considering only the most confident responses in each condition. These findings demonstrate that a shift in location selectively impacts recollection and so contributes to our understanding of boundaries in event memory.     

模糊规避的形成机制：基于可评价性假设的视角

模糊规避是指在相同奖赏的情况下,决策者会力图规避从主观上判断具有模糊概率的事件而偏好具有相同精确概率的事件。本研究使用同时评价、单独评价的研究范式从随机事件和自然事件两个领域来探讨模糊规避的形成机制。研究结果表明,当风险事件和模糊事件同时评价时,个体倾向于模糊规避;当风险事件和模糊事件单独评价时,模糊规避会消失。     

Event boundaries and anaphoric reference

The current study explored the finding that parsing a narrative into separate events impairs anaphor resolution. According to the Event Horizon Model, when a narrative event boundary is encountered, a new event model is created. Information associated with the prior event model is removed from working memory. So long as the event model containing the anaphor referent is currently being processed, this information should still be available when there is no narrative event boundary, even if reading has been disrupted by a working-memory-clearing distractor task. In those cases, readers may reactivate their prior event model, and anaphor resolution would not be affected. Alternatively, comprehension may not be as event oriented as this account suggests. Instead, any disruption of the contents of working memory during comprehension, event related or not, may be sufficient to disrupt anaphor resolution. In this case, reading comprehension would be more strongly guided by other, more basic language processing mechanisms and the event structure of the described events would play a more minor role. In the current experiments, participants were given stories to read in which we included, between the anaphor and its referent, either the presence of a narrative event boundary (Experiment 1) or a narrative event boundary along with a working-memory-clearing distractor task (Experiment 2). The results showed that anaphor resolution was affected by narrative event boundaries but not by a working-memory-clearing distractor task. This is interpreted as being consistent with the Event Horizon Model of event cognition.     

Client and counsellor narrative accounts of congruence during the most helpful and hindering events of an initial counselling session

The role of congruence in establishing and maintaining a therapeutic alliance has been emphasized by theorists within the humanistic/person‐centred tradition. However, there appears to be a lack of research that explores the processes occurring during moments of congruence or incongruence. The main objective of the present study was to gather qualitative data about congruence based on both participants’ narrative accounts of their subjective reactions during the most helpful and the most hindering event of an initial counselling session. Client and counsellor recollections of their experiences during these two events were stimulated through the replay of a video‐tape after the session. The event identification came from the client through a Brief Structured Recall interview. During the hindering event, both participants were incongruent. There was a mismatch between what they were feeling and what they were expressing verbally and/or non‐verbally. At the same time the client was feeling criticised and offended by counsellor's confrontation. By contrast, during the helpful event both participants were congruent. The counsellor was experiencing empathic understanding toward his client and the client was feeling accepted and understood. The implication of these findings are discussed in terms of how congruence might affect the construction of significant events during the therapeutic hour.     

A computational model of event segmentation from perceptual prediction

People tend to perceive ongoing continuous activity as series of discrete events. This partitioning of continuous activity may occur, in part, because events correspond to dynamic patterns that have recurred across different contexts. Recurring patterns may lead to reliable sequential dependencies in observers' experiences, which then can be used to guide perception. The current set of simulations investigated whether this statistical structure within events can be used 1) to develop stable internal representations that facilitate perception and 2) to learn when to update such representations in a self-organizing manner. These simulations demonstrate that experience with recurring patterns enables a system to accurately predict upcoming stimuli within an event, to identify boundaries between such events based on transient increases in prediction error, and to use such boundaries to improve prediction about subsequent activities.     

Event familiarity influences memory detection using the aIAT

The developers of the autobiographical Implicit Association Test (aIAT) describe it as a possible memory detection tool. This claim rests on the assumption the aIAT can reliably and automatically detect the accuracy of autobiographical events. However, the aIAT may be susceptible to factors that affect the assessment of truth vs. falseness, such as the relative familiarity of those events. We compared aIAT performance when participants reported recent vs. childhood autobiographical events, and when participants imagined vs. did not imagine a fabricated autobiographical event. The aIAT was less effective at distinguishing between real and fabricated events from childhood, compared to recent real and fabricated events. Imagining a fabricated event did not affect aIAT performance; however, there was a trend in the data suggesting imagination may have reduced the effect of event recency. Our results provide further evidence that reducing or enhancing source confusion—via familiarity—can influence the predictive value of the aIAT.