Inference-driven attention in symbolic and perceptual tasks: biases toward expected and unexpected inputs

The aims of this paper are (a) to gather support for the hypothesis that some basic mechanisms of attentional deployment (i.e., its high efficiency in dealing with expected and unexpected inputs) meet the requirements of the inferential system and have possibly evolved to support its functioning, and (b) to show that these orienting mechanisms function in very similar ways in two perceptual tasks and in a symbolic task. The general hypothesis and its predictions are sketched in the Introduction, after a discussion of current findings concerning visual attention and the generalities of the inferential system. In the empirical section, three experiments are presented where participants tracked visual trajectories (Experiments 1 and 3) or arithmetic series (Experiments 2 and 3), responding to the onset of a target event (e.g., to a specific number) and to the repetition of an event (e.g., to a number appearing twice consecutively). Target events could be anticipated when they were embedded in regular series/trajectories; they could be anticipated, with the anticipation later disconfirmed, when a regular series/trajectory was abruptly interrupted before the target event occurred; and they could not be anticipated when the series/trajectory was random. Repeated events could not be anticipated. Results show a very similar pattern of allocation in tracking visual trajectories and arithmetic series: Attention is focused on anticipated events; it is defocused and redistributed when an anticipation is not confirmed by ensuing events; however, performance decreases when dealing with random series/trajectory—that is, in the absence of anticipations. In our view, this is due to the fact that confirmed and disconfirmed anticipations are crucial events for “knowledge revision”—that is, the fine tuning of the inferential system to the environment; attentional mechanisms have developed so as to enhance detection of these events, possibly at all levels of inferential processing.     

Attentional load modulates mislocalization of moving stimuli,but does not eliminate the error

Localization of the onset and offset of a moving target is subject to a number of errors that have to be attributed to events following or preceding the target event. Apparently, observers are unable to ignore the spatiotemporal context surrounding the target event. In two experiments, observers’ attention was directed toward a single position along a trajectory, two positions along a single trajectory, or two positions along two different trajectories. In the latter condition, attention to details of a single trajectory was reduced. At the same time, motion type was manipulated by varying the temporal interval between successive target presentations. The localization error was not affected by attentional load; however, effects of motion type were eliminated when two trajectories had to be attended to. It may be sufficient to notice that the target has moved for localization errors to occur, while specifics of the trajectory are ignored.     

Detection of collision events on curved trajectories: optical information from invariant rate-of-bearing change

Previous research (Andersen & Kim, 2001) has shown that a linear trajectory collision event (i.e., a collision between a moving object and an observer) is specified by objects that expand and maintain a constant bearing (the object location remains constant in the visual field). In the present study, we examined the optical information for detecting a collision event when the trajectory was of constant curvature. Under these conditions, a collision event is specified by expansion of an object and a constant rate-of-bearing change. Three experiments were conducted in which trajectory curvature and display duration were varied while time to contact, speed, and initial image position of the collision objects were maintained. The results indicated that collision detection performance decreased with an increase in trajectory curvature and decreased with a decrease in display duration, especially for highly curved trajectories. In Experiment 3, we found that the presentation of a constant rate-of-bearing change in noncollision stimuli resulted in an increase in the false alarm rate. These results demonstrate that observers can detect collision events on curved trajectories and that observers utilize bearing change information.     

No anticipation without intention: Response–effect compatibility in effect-based and stimulus-based actions

Goal-directed behavior is characterized by the anticipation of the resulting effect during response selection. Such anticipations can be contextualized in the sense that response–effect relationships in one stimulus context are inverted in another stimulus context. The primary study aim was to test the hypothesis that contextualized effect anticipation might depend on whether subjects adopt either an effect-based action control style or a stimulus-based control style. Importantly, we hypothesized that the choice of control styles depends on explicit instruction. Effect anticipation during response selection was determined by assessing the behavioral impact of spatial compatibility between the required response and an additional task-irrelevant spatial feature attached to the anticipated effect that would be produced by that response in a given context. In two experiments we found a compatibility effect exclusively in blocks with effect-based instruction but not in stimulus-based blocks. Furthermore, subjects could quickly switch between styles without one strategy dominating the others. Together, this shows that contextualized anticipation of distal visual effects is not an automatic process but depends on the intention to produce an effect.     

Selective looking with minimal eye movements

Neisser and Becklen (1975) showed that one of two visually superimposed events could be followed without interference from the other. Neisser and Becklen allowed their subjects to move their eyes without restriction. The present experiment eliminated the possibility that the tracking eye movements of the subjects, which could have been used to maintain the stability of the event on the retina, were instrumental in following the desired event. The experiment of Neisser and Becklen was essentially replicated with one exception: subjects were required to fixate a spot in the center of the visual field during one-half of the trials. It was no more difficult for subjects to follow either a single event or one of two superimposed events when fixation was required. The suggestion was made that eye movements do not initiate a perceptual act, but rather are dependent upon perceptual anticipations.     

The effect of visual and cognitive distraction on driver’s anticipation in a simulated car following scenario

Distraction is a common cause of accidents (e.g. NHTSA, 2009), and different distraction conditions influence the driving behaviour in a specific way. Despite a lot of research in this area, most studies concentrate on perception errors as a result of visual distraction. The effects of different distraction conditions on higher cognitive processes are still unclear. The fact that accidents happen even if the drivers perceive all relevant information implies that cognitive factors contribute to accidents, too. For this reason, this study was conducted to investigate how different distraction conditions influence the anticipation of events in a car–following scenario. Anticipation is required to know what will happen next, and to react adequately to the situation. In a driving simulator, scenarios with different manoeuvres of a preceding car were created to generate various anticipations and therefore a different adaptation of the driving behaviour. Additionally, a cognitive and a visual secondary task were introduced. The question was in which way either a cognitive or visual distraction influences the generation of anticipations and the construction of an appropriate situation model.The results indicate that in the phase when the preceding car showed braking manoeuvres, drivers prolonged their safety distance only when being visually distracted which is probably done to compensate for this visual distraction. This compensation ensued to some extent in the second phase where the preceding cars drove with a constant speed. Additionally, drivers who were visually distracted went somewhat slower when the car in front had braked in phase one. Thus, the drivers seemed to anticipate that the car might brake again and adapted their speed accordingly. This was not found in drivers with cognitive distraction. Thus, cognitive distraction seems to disturb this anticipation.Finally, at an intersection, drivers with visual distraction had a smaller TTC and a higher velocity when the car in front made an unexpected turn. Thus, the impairment of perception due to the visual distraction leads to a slower reaction as compared to a cognitive distraction. Overall, cognitive distraction influences the anticipation of possible future actions of other car drivers negatively while visual distraction deteriorates perception and thus the reaction to critical, sudden events. Thus, different intervention strategies are required to prevent these kinds of accidents.     

Selective attention, inhibition for repeated events and hemispheric specialization

When two visual events appear consecutively in the same spatial location, our response to the second event is slower than to the first. This inhibition for repeated events may reflect a bias toward sampling novel locations, a bias useful for exploring visual space. It has been shown that the left hemisphere is more specialized in selective attentional processes than the right one. The aim of the present experiment was to test if this hemispheric specialization for selective attention may also affect the inhibition for repeated events. For this purpose, we asked 11 normal subjects to perform an identity-based discrimination task in which the target to be detected could appear alone or surrounded by flanking letters, in the left or in the right visual field. Results show that inhibition for repeated events is present only when selective attention is required and when the task is performed in the right specialized visual field.     

Attention and perception: An information-integration perspective

Attentional effects in perceptual processing are analyzed within a framework of a fuzzy logical model of perception. The recognition of a pattern is conceptualized as involving three stages of processing: featural evaluation, integration of features, and pattern classification. The model predicts no loss of resolution when multiple sources of information are integrated to recognize a perceptual event. This model is contrasted with a single-channel model in which only one source of information can be recognized at a time. The task involves a relatively novel situation of speech perception by ear and eye. No attentional decrement is observed when observers process both auditory and visual speech specifying a single speech event. This result contrasts with previous studies showing a loss when attention has to be divided between different events along auditory and visual modalities. The different results are interpreted in terms of the number of events that have to be processed. Processing two different modalities leads to an attentional decrement when the two inputs specify different events whereas no attentional decrement occurs when these inputs are integrated to recognize a single event. A distinction is made between detection that requires only the evaluation of a single source of information and recognition that requires the evaluation and integration of multiple sources of information. The current framework is also used to discuss previous empirical and theoretical work and the issue of early versus late selection.     

视觉预期的类型及神经机制

视觉预期是一种运用视觉信息的部分资源和先行资源对即将发生的事件进行预测的能力。为了人们更加清楚地认识视觉预期的内在加工过程,同时也有助于国内外研究者更为科学深入地探讨这种自上而下的加工,本文主要从婴幼儿和成人运动员两方面来阐述视觉预期的相关研究。首先从婴幼儿对物体相关属性和行为目标的视觉预期两方面探讨了视觉预期的类型,然后论述了成人视觉预期的神经机制。最后,指出今后的研究应加强视觉预期相关技术在临床诊断中的应用,注重环境在视觉预期中的作用,从神经网络角度研究视觉预期的神经基础。     

Prediction,events, and the advantage of Agents: The processing of semantic roles in visual narrative

Agents consistently appear prior to Patients in sentences, manual signs, and drawings, and Agents are responded to faster when presented in visual depictions of events. We hypothesized that this “Agent advantage” reflects Agents’ role in event structure. We investigated this question by manipulating the depictions of Agents and Patients in preparatory actions in wordless visual narratives. We found that Agents elicited a greater degree of predictions regarding upcoming events than Patients, that Agents are viewed longer than Patients, independent of serial order, and that visual depictions of actions are processed more quickly following the presentation of an Agent vs. a Patient. Taken together these findings support the notion that Agents initiate the building of event representation. We suggest that Agent First orders facilitate the interpretation of events as they unfold and that the saliency of Agents within visual representations of events is driven by anticipation of upcoming events.     

The Launching and Ensnaring Effects of Construing a Traumatic Event as Central to One's Identity and Life Story

Construing a traumatic event as central to one's life story and identity is associated with posttraumatic stress. The longitudinal relationship between centrality of event and trajectories of posttraumatic stress was examined. Data from ministerial employees were collected 10 months, 2 years, and 3 years after the 2011 Oslo bombing (N = 259). Using structural equation modeling, the launch and the snare hypotheses were tested. Support for the launch hypothesis was found; higher levels of event centrality 10 months after the attack were associated with higher levels of posttraumatic stress across time. Support for the snare hypothesis was also found; higher levels of centrality 10 months and 2 years after the bombing were related to higher levels of posttraumatic stress, beyond what could be anticipated based on the individual's general trajectory. This suggests that event centrality can influence the overall trajectory, and may also have additional time‐specific effects on posttraumatic stress.Copyright © 2016 John Wiley & Sons, Ltd.     

Valence and vertical space: Saccade trajectory deviations reveal metaphorical spatial activation

Concepts of positive and negative valence are metaphorically structured in space (e.g., happy is up, sad is down). In fact, coupling a conceptual task (e.g., evaluating words as positive or negative) with a visuospatial task (e.g., identifying stimuli above or below fixation) often gives rise to metaphorical congruency effects. For instance, after reading a positive concept, visual target processing is facilitated above fixation. However, it is possible that tasks requiring upwards and downwards attentional orienting artificially strengthen the link between vertical space and semantic valence. For this reason, in the present study the vertical axis was uncoupled from the response axis. Participants made eye movements along the horizontal axis after reading positive or negative affect words, while their saccade movement trajectories were recorded. Based on previous research on saccade trajectory deviation, we predicted that fast saccade trajectories curve towards the salient segment of space, whereas slow saccade trajectories would curve away from the salient segment. Examining saccadic trajectories revealed a pattern of deviations along the vertical axis consistent with the metaphorical congruency account, although this pattern was mainly driven by positive concepts. These results suggest that semantic processing of valence can automatically recruit spatial features along the vertical axis.     

How not to be seen: the contribution of similarity and selective ignoring to sustained inattentional blindness

When people attend to objects or events in a visual display, they often fail to notice an additional, unexpected, but fully visible object or event in the same display. This phenomenon is now known as inattentional blindness . We present a new approach to the study of sustained inattentional blindness for dynamic events in order to explore the roles of similarity, distinctiveness, and attentional set in the detection of unexpected objects. In Experiment 1, we found that the similarity of an unexpected object to other objects in the display influences attentional capture: The more similar an unexpected object is to the attended items, and the greater its difference from the ignored items, the more likely it is that people will notice it. Experiment 2 explored whether this effect of similarity is driven by selective ignoring of irrelevant items or by selective focusing on attended items. The results of Experiment 3 suggest that the distinctiveness of the unexpected object alone cannot entirely account for the similarity effects found in the first two experiments; when attending to black items or white items in a dynamic display, nearly 30% of observers failed to notice a bright red cross move across the display, even though it had a unique color, luminance, shape, and motion trajectory and was visible for 5 s. Together, the results suggest that inattentional blindness for ongoing dynamic events depends both on the similarity of the unexpected object to the other objects in the display and on the observer's attentional set.     

Unconscious modulation of the conscious experience of voluntary control

How does the brain generate our experience of being in control over our actions and their effects? Here, we argue that the perception of events as self-caused emerges from a comparison between anticipated and actual action-effects: if the representation of an event that follows an action is activated before the action, the event is experienced as caused by one's own action, whereas in the case of a mismatch it will be attributed to an external cause rather than to the self. In a subliminal priming paradigm we show that participants overestimated how much control they had over objectively uncontrollable stimuli, which appeared after free- or forced-choice actions, when a masked prime activated a representation of the stimuli immediately before each action. This prime-induced control-illusion was independent from whether primes were consciously perceived. Results indicate that the conscious experience of control is modulated by unconscious anticipations of action-effects.     

Infant sensitivity to trajectory forms

The authors investigated whether infants are sensitive to visual event trajectory forms, and whether they are sensitive to the underlying dynamics of trajectory forms. The authors habituated 8-month-old infants to a videotaped event run either forward or reversed in time and then switched them to the same event run in the opposite direction. Infants dishabituated when switched to the event with the novel direction in time, indicating sensitivity to the form of the trajectory. Infants exhibited equivalent habituation rates and looking times for forward and reversed events, thus failing to provide evidence that infants are sensitive to the underlying dynamics. In a partial replication of this first experiment, the same pattern of results was found. Both experiments revealed infant sensitivity to the trajectory forms, but not the underlying dynamics of events. The authors discuss implications for methods used in infant event perception studies.     

Rats’ anticipation of current and future trial outcomes in the ordered RNR/RNN serial pattern task

In the ordered RNR/RNN serial pattern task, rats often reduce their running speeds on trial 2 less within the RNR than within the RNN series. Initially, investigators (Capaldi, 1985; Capaldi et al., 1983) considered this trial 2 differential speed effect evidence for rats’ anticipation of inter-trial outcomes within each series. Later findings, however, suggest that this effect reflects some generalization of the ordinal position of trial 3 (Burns et al., 1986) or its similar runway cues during trial 2 (Capaldi et al., 1999). To test these generalization hypotheses, we made trial 2 more distinct from trial 3 in each series by forcing rats to alternate runways in a T-maze only on the last trial rather than on trial 2 in each series in Experiment 1, or by forcing rats to alternate runways between trials rather than to run down the same runway on all trials within each series in Experiment 2. Although enhancing the distinctiveness between these trials reduced the trial 2 differential speed effect, extensive training failed to eliminate it. Therefore, this residual difference between trial 2 speeds could reflect rats’ anticipation of trial 3 outcomes during trial 2 as originally proposed by Capaldi (1985) Experiment 3 was designed to determine whether we could enhance rats’ final trial outcome expectancies during trial 2 by making different trial 2 choices distinctive cues for each trial 3 outcome. The trial 2 speed effect was greater when rats were forced to alternate over all trials only within one of the series than when they were sometimes forced to do so in either series. Post-training probe tests revealed that both series position and the relevant within-series runway events contributed to this enhanced anticipation of trial 3 outcomes.     

Trajectory forms as information for visual event recognition: 3-D perspectives on path shape and speed profile

Trajectory forms in events consist of the path shape and the speed profile (Bingham, 1987, 1995). Wickelgren and Bingham (2004) showed that adults can use the speed profile as visual information to recognize events from different perspectives, despite perspective distortions and differences in optical components. We now investigate whether adults can use trajectory forms to recognize events when the forms are viewed from 3-D perspectives and the path shape and speed profile vary. In Experiment 1, we tested recognition of events that differ in path shape (with the speed profile held constant). In Experiment 2, we tested recognition of events in which speed profiles were mapped onto circular paths. In Experiment 3, as a strong test of sensitivity to trajectory forms, we tested simultaneous separate recognition of speed profile and path shape when both varied across events. In all three experiments, events were viewed from multiple 3-D perspectives. The results show that both the shape of the path and the speed profile provide information for visual event recognition. We found that adults exhibit constancy (or view invariance) in being able to use trajectory forms to identify the same events when viewed from different 3-D perspectives.     

Mediational use of internal representations of food and no-food events by pigeons

Two experiments were conducted with pigeons to determine whether internal representations of food and no-food events can act as mediators in the formation of new associations. Specifically we asked if the representation of an anticipated event can replace the event itself in an established conditional discrimination. In Phase 1 of both experiments pigeons were differentially autoshaped to peck hue stimuli, only one of which was followed by access to food. In Phase 2 they were trained on a symbolic 0-delay matching-to-sample (DMTS) task with food and no-food samples and line-orientation comparisons. In Phase 3 the birds were tested on a symbolic DMTS task in which the hue stimuli from Phase 1 were substituted for the Phase 2 food-event samples. For the Pos group, the hue followed by food in Phase 1 was substituted for the food sample and the hue associated with no-food was substituted for the no-food sample so that the resulting sample/comparison pairings were consistent with the food-event mediator. For the Neg group the pairings were reversed so that the sample/comparison pairings were inconsistent with the food-event mediators. In Experiment 1, when the no-food event was the absence of an event, acquisition of the transfer task was significantly more rapid in the Pos than in the Neg condition. In Experiment 2, when the no-food event was the presentation of an empty food hopper, the Pos group transferred at a significantly higher level than the Neg group. The two experiments provide evidence that in pigeons, representations involving event anticipations can be substituted for, and are thus similar to, the events themselves.     

Perspective distortion of trajectory forms and perceptual constancy in visual event identification

Previous studies have shown that people can use the information in trajectory forms to recognize visual events. A trajectory form is composed of the path of motion and the change in speed along that path. In past studies, however, only sensitivity to trajectory forms viewed from a single perspective was examined. The optical components change when an event is viewed from different perspectives, and the projected form of the trajectory is transformed. Does event recognition exhibit constancy despite these changes? In Experiment 1, participants were familiarized with five different trajectory forms viewed from a single perspective. Then the participants had to identify the same events viewed from different perspectives: from the side, at an angle, and entirely in depth. The participants exhibited perceptual constancy. Experiment 2 revealed, however, that both the change in optical components and the perspective transformations affected recognition.     

Sound support: intermodal information facilitates infants' perception of an occluded trajectory

In a visual occlusion task, 4-month-olds were given a dynamic sound cue (following the trajectory of an object), or a static cue (sound remained stationary). Infants' oculomotor anticipations were greater in the Dynamic condition, suggesting that representations of visual occlusion were supported by auditory information.