Effects of informative peripheral cues on eye movements: Revisiting William James’ “derived attention”

Two experiments examined effects of peripheral information on the latency of saccadic eye movements. In Experiment 1, simple target stimuli were presented to the left or right visual field. Prior to each target, a pair of cue letters was presented for 40msec bilaterally. The relative location of the letters (W-S or S-W) was related to target location, but participants were not informed of this contingency. After a brief practice period, saccadic latencies were faster for targets at the likely location, as indicated by the letter pair. This derived peripheral cueing effect was related to participants' awareness of the relation between cue type and target location. Experiments 2A and 2B employed monocular viewing in order to compare performance across the nasal and temporal visual fields. The effect observed in Experiment 1 was confined to the nasal visual field. In a reflexive orienting condition, the effect of a unilateral letter cue was larger in the temporal visual field. It is concluded that the neurocognitive processes responsible for derived peripheral cueing are distinct from those involved in either reflexive or voluntary orienting.     

Face detection differs from categorization: Evidence from visual search in natural scenes

In this study, we examined whether the detection of frontal, ¾, and profile face views differs from their categorization as faces. In Experiment 1, we compared three tasks that required observers to determine the presence or absence of a face, but varied in the extents to which participants had to search for the faces in simple displays and in small or large scenes to make this decision. Performance was equivalent for all of the face views in simple displays and small scenes, but it was notably slower for profile views when this required the search for faces in extended scene displays. This search effect was confirmed in Experiment 2, in which we compared observers’ eye movements with their response times to faces in visual scenes. These results demonstrate that the categorization of faces at fixation is dissociable from the detection of faces in space. Consequently, we suggest that face detection should be studied with extended visual displays, such as natural scenes.     

The effect of noun animacy on the processing of unambiguous sentences: Evidence from French relative clauses

It has previously been shown that moving images are remembered better than static ones. In two experiments, we investigated the basis for this dynamic superiority effect. Participants studied scenes presented as a single static image, a sequence of still images, or a moving video clip, and 3 days later completed a recognition test in which familiar and novel scenes were presented in all three formats. We found a marked congruency effect: For a given study format, accuracy was highest when test items were shown in the same format. Neither the dynamic superiority effect nor the study–test congruency effect was affected by encoding (Experiment 1) or retrieval (Experiment 2) manipulations, suggesting that these effects are relatively impervious to strategic control. The results demonstrate that the spatio-temporal properties of complex, realistic scenes are preserved in long-term memory.     

The spatial correspondence hypothesis and orienting in response to central and peripheral spatial cues

Two experiments examined visual orienting in response to spatial precues. In Experiment 1A participants were informed that targets usually (p =.8) appeared on the same side as cues in a particular colour (e.g., red). Rapid orienting was observed, with both central and peripherally presented cues. In Experiment IB cue displays were spatially symmetric. Participants were informed that target location (left or right) was usually predicted (p =.8) by cue colour (red or green). Orienting effects were observed, but these were slower to develop and much weaker than in Experiment 1 A. In Experiment 2A and 2B the cue was a single, centrally presented letter. We compared effects of spatially symmetric (T, X, v, o) and asymmetric (d, b) letter cues. Validity effects were present for asymmetric cues, but entirely absent for symmetric cues. These finding are discussed in terms of Lambert and Duddy's (2002) proposal that spatial correspondence learning plays a critical role in spatial precueing. Implications of the results for the distinction between endogenous and exogenous orienting are also considered.     

Ultra-rapid categorisation in non-human primates

The visual system of primates is remarkably efficient for analysing information about objects present in complex natural scenes. Recent work has demonstrated that they perform this at very high speeds. In a choice saccade task, human subjects can initiate a first reliable saccadic eye movement response to a target (the image containing an animal) in only 120 ms after image onset. Such fast responses impose severe time constraints if one considers neuronal responses latencies in high-level ventral areas of the macaque monkey. The question then arises: are non-human primates able to perform the task? Two rhesus macaque monkeys (Macaca mulatta) were trained to perform the same forced-choice categorization task as the one used in humans. Both animals performed the task with a high accuracy and generalized to new stimuli that were introduced everyday: accuracy levels were comparable both with new and well-known images (84% vs. 94%). More importantly, reaction times were extremely fast (minimum reaction time 100 ms and median reaction time 152 ms). Given that typical single units onset times in Inferotemporal cortex (IT) are about as long as the shortest behavioural responses measured here, we conclude that visual processing involved in ultra rapid categorisations might be based on rather simple shape cue analysis that can be achieved in areas such as extrastriate cortical area V4. The present paper demonstrates for the first time, that rhesus macaque monkeys (Macaca mulatta) are able to match human performance in a forced-choice saccadic categorisation task of animals in natural scenes.     

Spatial cueing and the relation between the accuracy of “where” and “what” decisions in visual search

To study the processes underlying selective attention in visual search, the relation between the accuracy of “where” (location) and “what” (same/different orientation matching) decisions was analysed under various display conditions. Target-non-target discriminability was varied by contrasting single and multiple element displays; further, attention was directly manipulated by spatial cueing. In Experiment 1, analyses for both single and multiple displays showed that localization accuracy remained above chance when same/different matching failed; the inverse also obtained. It seems that accurate matching is not a prerequisite for target localization, nor is accurate localization a prerequisite for same/different matching. However, localization is a prerequisite for the accurate recognition of target orientation (Experiment 2). In this case, it seems that features critical for localization “call” attention to a particular candidate location. This facilitates further (shape) analysis of the stimulus that is found there. This orienting process is by-passed if attention is cued to the location in advance.     

Attention orienting by eye gaze and arrows reveals flexibility to environmental changes

This study aimed to evaluate the difference in non-predictive cues between gaze and arrows in attention orienting. Attention orienting was investigated with gaze or arrows as separate cues in a simple condition (i.e., block design) in Experiment 1 and in an unpredictable condition (i.e., randomized design) in Experiment 2. Two kinds of sound (voice and tone) stimuli were used as targets. Results showed that gaze and arrow cues induced enhanced attention orienting to a voice versus tone target in the block condition. However, in the randomized condition, enhanced attention orienting to a voice versus tone target was found in gaze but not arrow cues. The congruency of the meaning between a social cue (i.e., gaze) and a social target (i.e., voice) was clear in the randomized but not blocked design, because social gaze and non-social arrow cues were implemented in the same block. Thus, attention orienting might be mediated by the associated relationship of cue–target in a randomized condition, as an enhanced orienting effect was found when the associated relationship of cue–target was strong (i.e., social cue and target). The present study suggests that the difference in attention orienting between gaze and arrows is apparent in a randomized design (the unpredictable condition), and people employ a flexibly strategy of orienting to better respond to environmental changes.     

Oculomotor readiness and covert orienting: differences between central and peripheral precues.

The costs produced by invalid precues can depend on the spatial relationship between the cued location and the target location. If oculomotor programs mediate attention shifts, then the effect of varying the spatial relation between the cue and target should be the same for covert orienting (indexed by manual responses) and saccadic responses. We found this to be true only for central precues. With central precues, both manual and saccadic costs were greater when cue and target occurred on opposite sides of the vertical meridian than when they occurred on the same side. With peripheral precues, there were no meridian effects in either response condition, but there was a significant dissociation in the pattern of saccadic and manual costs. For manual responses costs were greater when the target was eccentric relative to the cue, whereas for saccades costs were greater when the cue was eccentric to the target. These results provide additional support for the idea that different orienting mechanisms are engaged by central and peripheral precues. They further suggest that the relationship between oculomotor and attentional orienting may depend on the nature of the precue, with the potential for interdependence being greater with central precues.     

Eye-hand coordination: oculomotor control in rapid aimed limb movements

Three experiments are reported in which Ss produced rapid wrist rotations to a target while the position of their eyes was being monitored. In Experiment 1, Ss spontaneously executed a saccadic eye movement to the target around the same time as the wrist began to move. Experiment 2 revealed that wrist-rotation accuracy suffered if Ss were not allowed to move their eyes to the target, even when visual feedback about the moving wrist was unavailable. In Experiment 3, wrist rotations were equally accurate when Ss produced either a saccadic or a smooth-pursuit eye movement to the target. However, differences were observed in the initial-impulse and error-correction phases of the wrist rotations, depending on the type of eye movement involved. The results suggest that aimed limb movements use information from the oculomotor system about both the static position of the eyes and the dynamic characteristics of eye movements. Furthermore, the information that governs the initial impulse is different from that which guides final error corrections.     

Memory of movies by chimpanzees (Pan troglodytes).

How do animals remember what they see in daily life? The processes involved in remembering such visual information may be similar to those used in interpreting moving images on a monitor. In Experiment 1, 4 adult chimpanzees (Pan troglodytes) were required to discriminate between movies using a movie-to-movie matching-to-sample task. All chimpanzees demonstrated the ability to discriminate movies from the very 1st session onward. In Experiment 2, the ability to retain a movie was investigated through a matching-to-sample task using movie stills. To test which characteristics of movies are relevant to memory, the authors compared 2 conditions. In the continuous condition, the scenes comprising the movie progressed gradually, whereas in the discrete condition, the authors introduced a sudden change from one scene to another. Chimpanzees showed a recency effect only in the discrete condition, suggesting that composition and temporal order of scenes were used to remember the movies.     

Oculomotor readiness and covert orienting: Differences between central and peripheral precues

The costs produced by invalid precues can depend on the spatial relationship between the cued location and the target location. If oculomotor programs mediate attention shifts, then the effect of varying the spatial relation between the cue and target should be the same for covert orienting (indexed by manual responses) and saccadic responses. We found this to be true only for central precues. With central precues, both manual and saccadic costs were greater when cue and target occurred on opposite sides of the vertical meridian than when they occurred on the same side. With peripheral precues, there were no meridian effects in either response condition, but there was a significant dissociation in the pattern of saccadic and manual costs. For manual responses costs were greater when the target was eccentric relative to the cue, whereas for saccades costs were greater when the cue was eccentric to the target. These results provide additional support for the idea that different orienting mechanisms are engaged by central and peripheral precues. They further suggest that the relationship between oculomotor and attentional orienting may depend on the nature of the precue, with the potential for interdependence being greater with central precues.     

空间工作记忆负载对真实场景情境提示效应的影响

重复的画面布局能够促进观察者对目标项的搜索 (情境提示效应)。本研究采用双任务范式,分别在视觉搜索任务的学习阶段 (实验2a) 和测验阶段 (实验2b) 加入空间工作记忆任务, 并与单任务基线 (实验1)进行比较, 考察空间工作记忆负载对真实场景搜索中情境线索学习和情境提示效应表达的影响。结果发现: 空间负载会增大学习阶段的情境提示效应量, 同时削弱测验阶段的情境提示效应量, 而不影响情境线索的外显提取。由此可见, 真实场景中情境线索的学习和提示效应的表达均会受到有限的工作记忆资源的影响, 但情境线索提取的外显性不变。     

Hemispheric performance in object-based attention

The goal of the present study was to investigate whether object-based attention effects differ across the cerebral hemispheres. Previous research has suggested that object-based attention is preferentially lateralized to the left hemisphere (Egly, Driver, & Rafal, 1994; Egly, Rafal, Driver, & Starrveveld, 1994). However, work by Vecera (1994) has suggested that these previous studies may have failed to obtain a pure measure of object-based attention. The present study applied modified versions of Duncan's (1984) seminal object-based attention paradigm. Subjects were typically presented with one target object to a single visual field (one-object display), two target objects to the same visual field (two-object unilateral display), or two target objects to different visual fields (two-object bilateral display). In all three experiments, response accuracy was higher for the one-object displays than for the two-object displays. Most important, this object-based cost was especially severe when selection of two target elements was isolated to the right visual field (left hemisphere). We confirmed that this effect was specific to object-based attention in three different ways: Experiment 1 manipulated stimulus distance, as recommended by Vecera; Experiment 2 ensured that target selection was based on nonspatial attributes; and Experiment 3 used overlapping displays, as in Duncan (1984). Collectively, the data are in accord with previous conclusions that object-based attention is a specialized form of orienting subserved by lateralized cortical brain mechanisms. However, contrary to previous research, it appears that it is the right hemisphere, and not the left hemisphere, that is preferentially biased for committing object-based attention to elements in the visual environment.     

Positive and negative compatibility effects

This paper reports a series of four experiments that established a negative compatibility effect (NCE) by which compatible distractors led to slower and less accurate target performance than did incompatible ones (Experiment 1). This effect is interpreted as an early perceptual effect that delays the attribution of visual attention over the target location in the compatible condition. This view predicted that the NCE should be observed only when attention has to be selectively attributed to the target location. In Experiments 2 and 3, this prediction was tested by manipulating the perceptual load in the display. High perceptual load displays are known to require selective attention (Lavie, 1995). Accordingly, reliable NCEs were observed when high-load displays were used. In contrast, reduced NCEs were found in displays that did not require selective attention. Experiment 4 established that the manifestation of the NCE was influenced by low-level visual cues, such as brightness and contrast. Overall, these experiments indicated that the NCE can be understood as an early perceptual effect, which arises from a conflict between the cues that guide the distribution of attention when the task requires selective attention.     

Observation of another's action but not eye gaze triggers allocentric visual perspective

In the present paper, we investigated whether observation of bodily cues—that is, hand action and eye gaze—can modulate the onlooker's visual perspective taking. Participants were presented with scenes of an actor gazing at an object (or straight ahead) and grasping an object (or not) in a 2?×?2 factorial design and a control condition with no actor in the scene. In Experiment 1, two groups of subjects were explicitly required to judge the left/right location of the target from their own (egocentric group) or the actor's (allocentric group) point of view, whereas in Experiment 2 participants did not receive any instruction on the point of view to assume. In both experiments, allocentric coding (i.e., the actor's point of view) was triggered when the actor grasped the target, but not when he gazed towards it, or when he adopted a neutral posture. In Experiment 3, we demonstrate that the actor's gaze but not action affected participants' attention orienting. The different effects of others' grasping and eye gaze on observers' behaviour demonstrated that specific bodily cues convey distinctive information about other people's intentions.     

Fixation disengagement and eye-movement latency

We examined eye-movement latencies to a target that appeared during visual fixation of a stationary stimulus, a moving stimulus, or an extrafoveal stimulus. The stimulus at fixation was turned off either before target onset (gap condition) or after target onset (overlap condition). Consistent with previous research, saccadic latencies were shorter in gap conditions than they were in overlap conditions (the gap effect). In Experiment 1, a gap effect was observed for vergence eye movements. In Experiment 2, a gap effect was observed for saccades directed at a target that appeared during visual pursuit of a moving stimulus. In Experiment 3, a gap effect was observed for saccades directed at a target that appeared during extrafoveal fixation. The present results extend reports of the gap effect for saccadic shifts during visual fixation to (a) vergence shifts during visual fixation, (b) saccadic shifts during smooth visual pursuit, and (c) saccadic shifts during extrafoveal fixation. The present findings are discussed with respect to the incompatible goals of fixation-locking and fixation-shifting oculomotor responses.     

Number magnitude orients attention, but not against one’s will

Recent evidence has shown that uninformative numbers can trigger attention shifts congruent with the spatial representation of number magnitude (Fischer, Castel, Dodd, & Pratt, 2003). In the present study, three spatial-cuing experiments whose aim was to qualify the automaticity of this numbermediated orienting are described. Experiment 1 replicated the phenomenon, showing that uninformative numbers can evoke orienting in a simple detection task. In Experiment 2, target location was random, but the participants were encouraged to shift attention to the left in response to large numbers and to the right in response to small numbers. No evidence for strong automaticity was observed, since the participants’ performance was better when left-side targets were preceded by large numbers than when they were preceded by small numbers and vice versa. Experiment 3 corroborated this pattern by comparing gaze- and number-mediated cuing under conditions of real counterpredictiveness. The results indicate that unlike gaze-driven orienting, number-mediated orienting is not obligatory.     

Top-down attentional modulation of spatial frequency processing in scene perception

Recent evidence suggests that spatial frequency (SF) processing of simple and complex visual patterns is flexible. The use of spatial scale in scene perception seems to be influenced by people's expectations. However as yet there is no direct evidence for top-down attentional effects on flexible scale use in scene perception. In two experiments we provide such evidence. We presented participants with low- and high-pass SF filtered scenes and cued their attention to the relevant scale. In Experiment 1 we subsequently presented them with hybrid scenes (both low- and high-pass scenes present). We observed that participants reported detecting the cued component of hybrids. To explore if this might be due to decision biases, in Experiment 2, we replaced hybrids with images containing meaningful scenes at uncued SFs and noise at the cued SFs (invalid cueing). We found that participants performed poorly on invalid cueing trials. These findings are consistent with top-down attentional modulation of early spatial frequency processing in scene perception.     

Mental layout extrapolations prime spatial processing of scenes

Four experiments examined whether scene processing is facilitated by layout representation, including layout that was not perceived but could be predicted based on a previous partial view (boundary extension). In a priming paradigm (after Sanocki, 2003), participants judged objects' distances in photographs. In Experiment 1, full scenes (target), partial scenes, and two control primes were used. Partial scenes excluded the target objects' locations, but these areas could be predicted. Full and partial scenes produced equal performance facilitation. In Experiment 2, task-irrelevant partial scene primes were also tested. These primes did not facilitate performance (i.e. simple scene previews did not help). Experiment 3 showed that a partial prime's utility depended on the area of the scene that would be tested; the task-irrelevant primes used in Experiment 2 were useful for other distance judgments. Experiment 4 showed that partial scene facilitation is not limited to the area immediately surrounding the prime. The study demonstrated that perceived and mentally extrapolated layouts are equally effective.     

Representing statics as forces in equilibrium

Resting objects can be described according to the physical forces operating on them, forces that are balanced in static scenes. We hypothesized that in a related way, the perception of static scenes and objects might involve a representation of underlying dynamics. In our first experiments, subjects were shown a picture of a plant resting upon a table or hanging from a hook, followed by a picture of the plant in the same position without the supporting table or hook. Subjects attempted to remember the position of the plant and were then shown a third display, in which the plant was in the same position or was slightly above or slightly below the original position. We found that subjects made more errors for test displays showing the plant slightly below, as compared with displays showing the plant slightly above, the original position. That is, memory for the position of the previously supported object was distorted in the direction consistent with what would happen if the plant was to lose its source of support in real life. This effect depends on the initial display of support; in Experiment 2 we found no memory asymmetry when the plant was initially displayed without support. We replicated the results of Experiments 1 and 2 with a new stimulus set and modified procedure in Experiment 3. In our fourth study we experimented with a slightly different stable situation: a spring with a box on top of it. We found that subjects misremembered the spring as either more compressed or less compressed as predicted by the implied dynamics of the display sequence. We discuss issues raised by our findings, including the possibility that the conscious experience of concreteness in static scenes stems from the representation of underlying forces.