Controlling steering and judging heading: retinal flow,visual direction,and extraretinal information

The contribution of retinal flow (RF), extraretinal (ER), and egocentric visual direction (VD) information in locomotor control was explored. First, the recovery of heading from RF was examined when ER information was manipulated; results confirmed that ER signals affect heading judgments. Then the task was translated to steering curved paths, and the availability and veracity of VD were manipulated with either degraded or systematically biased RF. Large steering errors resulted from selective manipulation of RF and VD, providing strong evidence for the combination of RF, ER, and VD. The relative weighting applied to RF and VD was estimated. A point-attractor model is proposed that combines redundant sources of information for robust locomotor control with flexible trajectory planning through active gaze.     

Looking and thinking when driving: The impact of gaze and cognitive load on steering

Driving around bends at high speeds is a task performed by many on a daily basis but the underlying mechanisms of steering control remain largely unknown. Previous research has shown that when steering, gaze direction can be a critical component of success. However, with increased use of in-vehicle information systems (IVIS), there is growing competition over the same resources that are needed to steer (gaze as well as associated attentional resources). Although it can be argued that locomotor steering is an automatic task that can be performed without recourse to conscious “cognitive” control, much simpler locomotor-related tasks, such as judging one’s heading, have been shown to be affected by concurrent attentional tasks (Wann, Swapp, & Rushton, 2000). Here we examined whether an attentional task placed at an offset fixation point influenced concurrent steering performance along a computer simulated road. The experiments either used gaze-fixation points that had similar properties to real-world road signs (i.e. moved relative to the vehicle) or were more akin to IVIS (i.e. fixed to the vehicle). Results showed that gaze fixation eccentric to future path caused systematic steering biases. The degree or type of cognitive load did not change the degree of steering bias, but there was some evidence of decreased lane variability when viewing the IVIS-type displays. No differences in steering performance were found between the different types of cognitive task. We conclude that where you look is critical for safe driving, and IVIS-type displays might make drivers more susceptible to cognitive interference.     

Gaze-eccentricity effects on road position and steering

The effects of gaze eccentricity on the steering of an automobile were studied. Drivers performed an attention task while attempting to drive down the middle of a straight road in a simulation. Steering was biased in the direction of fixation, and deviation from the center of the road was proportional to the gaze direction until saturation at approximately 15 degrees gaze-angle from straight ahead. This effect remains when the position of the head was controlled and a reverse-steering task was used. Furthermore, the effect was not dependent on speed but reversed when the forward movement of the driver was removed from the simulation. Thus, small deviations in a driver's gaze can lead to significant impairments of the ability to drive a straight course.     

The role of visual and nonvisual information in the control of locomotion

During locomotion, retinal flow, gaze angle, and vestibular information can contribute to one's perception of self-motion. Their respective roles were investigated during active steering: Retinal flow and gaze angle were biased by altering the visual information during computer-simulated locomotion, and vestibular information was controlled through use of a motorized chair that rotated the participant around his or her vertical axis. Chair rotation was made appropriate for the steering response of the participant or made inappropriate by rotating a proportion of the veridical amount. Large steering errors resulted from selective manipulation of retinal flow and gaze angle, and the pattern of errors provided strong evidence for an additive model of combination. Vestibular information had little or no effect on steering performance, suggesting that vestibular signals are not integrated with visual information for the control of steering at these speeds.     

The role of edge lines in curve driving

In order to evaluate the role of edge lines in curve driving we examined steering behaviour in the face of unexpected gradual changes in road geometry. Experienced drivers (N = 13) operating a fixed-base driving simulator steered a car along a single-lane (3.80 m or 7.60 m wide) winding road. The experimental track consisted of eight 90° curves with radii of curvature varying between 75 m and 500 m, separated by 500-m long straight line segments. The model-based nature of the simulator was used to create unexpected online changes in road geometry, implemented through a gradual displacement of one or both edge lines while drivers steered around the delineated bend. Although they regulated their speed as a function of road curvature, drivers were found to consistently cut into and out of the curves. When the edge lines did not move, drivers stabilized their lane position during the 20°–70° curve segments, adopting a position closer to the interior edge line for the narrower lane width and smaller radii of curvature. Motion of the interior edge line, whether inward or outward, gave rise to systematic changes in lane position, while motion of the exterior edge line did not affect driving behaviour. Overall, the results point to a visuo-motor strategy of steering based on zeroing-out changes in the rate of change of angular bearing of the tangent point.     

A two-point visual control model of steering

When steering down a winding road, drivers have been shown to use both near and far regions of the road for guidance during steering. We propose a model of steering that explicitly embodies this idea, using both a 'near point' to maintain a central lane position and a 'far point' to account for the upcoming roadway. Unlike control models that integrate near and far information to compute curvature or more complex features, our model relies solely on one perceptually plausible feature of the near and far points, namely the visual direction to each point. The resulting parsimonious model can be run in simulation within a realistic highway environment to facilitate direct comparison between model and human behavior. Using such simulations, we demonstrate that the proposed two-point model is able to account for four interesting aspects of steering behavior: curve negotiation with occluded visual regions, corrective steering after a lateral drift, lane changing, and individual differences.     

Effects of visual roll on steering control and gaze behavior in a motorcycle simulator

The goal of this study was to examine the effects of visual roll tilt on gaze and riding behavior when negotiating a bend using a motorcycle simulator. To this end, experienced motorcyclists rode along a track with a series of right and left turns whilst the degree of visual roll tilt was manipulated in three different conditions. Gaze behavior was analyzed by using the tangent point as a dynamic spatial reference; the deviation of gaze to this particular point was computed in both the horizontal and vertical directions. Steering control was assessed in terms of the lateral positioning, steering stability and number of lane departures. In the no-roll condition, the motorcyclists tracked a steering point on the road ahead, which was compatible with the hypothesis of “steer where you look” behavior. In the roll condition, our results revealed that the horizontal distribution of gaze points relative to the tangent point was preserved. However, significantly more fixations were made further ahead of the tangent point in the vertical direction. This modification of visual behavior was coupled with a degradation in steering stability and an offset in lateral positioning, which sometimes led to lane departures. These results are discussed with regard to models of visual control of steering for bend negotiation.     

线索类型对阈下注视线索效应的影响

实验结合连续闪烁抑制范式和线索化范式, 通过操纵直视面孔和斜视面孔的呈现方式, 考察了动静线索类型对注视线索效应的影响。结果表明：两种线索在阈上条件都能产生注视线索效应, 且动态线索诱发的效应更大; 无意识条件下有且仅有动态注视线索能诱发注视线索效应。这说明眼睛运动是产生阈下注视线索效应的必要条件; 眼睛运动会增强阈上注视线索效应, 静态注视线索效应依赖于意识。研究结果支持了社会知觉与心理理论交互模型。     

Degree of Language Experience Modulates Visual Attention to Visible Speech and Iconic Gestures During Clear and Degraded Speech Comprehension

Visual information conveyed by iconic hand gestures and visible speech can enhance speech comprehension under adverse listening conditions for both native and non‐native listeners. However, how a listener allocates visual attention to these articulators during speech comprehension is unknown. We used eye‐tracking to investigate whether and how native and highly proficient non‐native listeners of Dutch allocated overt eye gaze to visible speech and gestures during clear and degraded speech comprehension. Participants watched video clips of an actress uttering a clear or degraded (6‐band noise‐vocoded) action verb while performing a gesture or not, and were asked to indicate the word they heard in a cued‐recall task. Gestural enhancement was the largest (i.e., a relative reduction in reaction time cost) when speech was degraded for all listeners, but it was stronger for native listeners. Both native and non‐native listeners mostly gazed at the face during comprehension, but non‐native listeners gazed more often at gestures than native listeners. However, only native but not non‐native listeners' gaze allocation to gestures predicted gestural benefit during degraded speech comprehension. We conclude that non‐native listeners might gaze at gesture more as it might be more challenging for non‐native listeners to resolve the degraded auditory cues and couple those cues to phonological information that is conveyed by visible speech. This diminished phonological knowledge might hinder the use of semantic information that is conveyed by gestures for non‐native compared to native listeners. Our results demonstrate that the degree of language experience impacts overt visual attention to visual articulators, resulting in different visual benefits for native versus non‐native listeners.     

Where a person with a squint is actually looking: Gaze-cued orienting in crossed eyes

In this study, we investigated gaze-cued attention orienting when the perceived eyes are not looking in the same direction. This condition occurs in strabismus (squint). Participants were asked to detect laterally presented reaction signals preceded by schematic faces in which the direction (left, straight, or right) of the left and right eye was independently manipulated. Consistent with earlier studies, the results showed a reliable cuing effect by two eyes with parallel gaze direction. Gaze-cued orienting was also shown in a situation when one eye was averted and the other eye was looking straight ahead. The gaze cuing was not significantly stronger in the former than in the latter situation. When both eyes were either nasally or temporally averted, no shifts of visual attention were observed. The results suggest that, if both eyes are visible, the direction of both eyes is computed and integrated for the gaze-cued orienting.     

Gaze behavior during urban cycling: Effects of subjective risk perception and vista space properties

In this research, we investigate how gaze behavior during urban cycling is affected by subjective risk perception and the local spatial configuration. For this purpose, participants cycled at five defined test locations while wearing a mobile eye tracking system. Next to the fixation duration, we extracted sight vector lengths (i.e., the distance between the current body location and the gaze location) and gaze angles (i.e., the degree to which the gaze deviates from the current travel direction). Concerning risk perception, participants provided a hazard estimate for each test location, as well as information about specific areas they experienced as dangerous. This information was aggregated into a local hazard level across all participants. Finally, the vista space (i.e., the space visible from the current position during a fixation) was quantified via isovist analysis. The results imply that spatially open locations, extending about equally into all directions, increase the level of perceived risk. Depending on the local spatial properties, participants also gaze into different directions, rather than further ahead and into their travel direction. Higher cycling experience and greater familiarity with a location enabled a more foresighted and focused gaze behavior. Our findings underline the importance to provide cyclists not only with enough space and with unobstructed views, but also to limit the space they are required to distribute their attention to.     

Perceived gaze direction and the processing of facial displays of emotion

There is good reason to believe that gaze direction and facial displays of emotion share an information value as signals of approach or avoidance. The combination of these cues in the analysis of social communication, however, has been a virtually neglected area of inquiry. Two studies were conducted to test the prediction that direct gaze would facilitate the processing of facially communicated approach-oriented emotions (e.g., anger and joy), whereas averted gaze would facilitate the processing of facially communicated avoidance-oriented emotions (e.g., fear and sadness). The results of both studies confirmed the central hypothesis and suggest that gaze direction and facial expression are combined in the processing of emotionally relevant facial information.     

Effects of head orientation on gaze perception: How positive congruency effects can be reversed

Several past studies have considered how perceived head orientation may be combined with perceived gaze direction in judging where someone else is attending. In three experiments we tested the impact of different sources of information by examining the role of head orientation in gaze-direction judgements when presenting: (a) the whole face; (b) the face with the nose masked; (c) just the eye region, removing all other head-orientation cues apart from some visible part of the nose; or (d) just the eyes, with all parts of the nose masked and no head orientation cues present other than those within the eyes themselves. We also varied time pressure on gaze direction judgements. The results showed that gaze judgements were not solely driven by the eye region. Gaze perception can also be affected by parts of the head and face, but in a manner that depends on the time constraints for gaze direction judgements. While “positive” congruency effects were found with time pressure (i.e., faster left/right judgements of seen gaze when the seen head deviated towards the same side as that gaze), the opposite applied without time pressure.     

Arrows don’t look at you: Qualitatively different attentional mechanisms triggered by gaze and arrows

Eye gaze conveys rich information concerning the states of mind of others, playing a critical role in social interactions, signaling internal states, and guiding others’ attention. On the basis of its social significance, some researchers have proposed that eye gaze may represent a unique attentional stimulus. However, contrary to this notion, the majority of the literature has shown indistinguishable attentional effects when eye gaze and arrows have been used as cues. Taking a different approach, in this study we aimed at finding qualitative attentional differences between gazes and arrows when they were used as targets instead of as cues. We used a spatial Stroop task, in which participants were required to identify the direction of eyes or arrows presented to the left or the right of a fixation point. The results showed that the two types of stimuli led to opposite spatial interference effects, with arrows producing faster reaction times when the stimulus direction was congruent with the stimulus position (a typical spatial Stroop effect), and eye gaze producing faster reaction times when it was incongruent (a “reversed” spatial Stroop effect). This reversed Stroop is interpreted as an eye-contact effect, therefore revealing the unique nature of eyes as special social-attention stimuli.     

Eye remember you two: gaze direction modulates face recognition in a developmental study

The effects of gaze direction on memory for faces were studied in children from three different age groups (6-7, 8-9, and 10-11 years old) using a computerized version of a task devised by Hood, Macrae, Cole-Davies and Dias (2003). Participants were presented with a sequence of faces in an encoding phase, and were then required to judge which faces they had previously encountered in a surprise two-alternative forced-choice recognition test. In one condition, stimulus eye gaze was either direct or deviated at the viewing phase, and eyes were closed at the test phase. In another condition, stimulus eyes were closed at the viewing phase, with either direct or deviated gaze at the test phase. Modulation of gaze direction affected hit rates, with participants demonstrating greater accuracy for direct gaze targets compared to deviated gaze targets in both conditions. Reaction times (RT) to correctly recognized stimuli were faster for direct gaze stimuli at the viewing phase, but not at the test phase. The age group of participants differentially affected these measures: there was a greater hit rate advantage for direct gaze stimuli in older children, although RTs were less affected by age. These findings suggest that while the facilitation of face recognition by gaze direction is robust across encoding and recognition stages, the efficiency of the process is affected by the stage at which gaze is modulated.     

What are you looking at? Acuity for triadic eye gaze

The authors measured observers' ability to determine direction of gaze toward an object in space. In Experiment 1, they determined the difference threshold for determining whether a live "looker" was looking to the left or right of a target point. Acuity for eye direction was quite high (approximately 30 s arc). Viewing the movement of the looker's eyes did not improve acuity. When one of the looker's eyes was occluded, the observers' acuity was disrupted and their point of subjective equality was shifted away from the exposed eye. Experiment 2 was a replication of Experiment 1, but digitized gaze displays were used. The results of Experiment 3 showed that the acuity for direction of gaze depended on the position of the looker's target. Overall, the results indicated that humans are highly sensitive to gaze direction and that information from both eyes is used to determine direction of regard.     

Effects of head orientation on gaze perception: how positive congruency effects can be reversed

Several past studies have considered how perceived head orientation may be combined with perceived gaze direction in judging where someone else is attending. In three experiments we tested the impact of different sources of information by examining the role of head orientation in gaze-direction judgements when presenting: (a) the whole face; (b) the face with the nose masked; (c) just the eye region, removing all other head-orientation cues apart from some visible part of the nose; or (d) just the eyes, with all parts of the nose masked and no head orientation cues present other than those within the eyes themselves. We also varied time pressure on gaze direction judgements. The results showed that gaze judgements were not solely driven by the eye region. Gaze perception can also be affected by parts of the head and face, but in a manner that depends on the time constraints for gaze direction judgements. While “positive” congruency effects were found with time pressure (i.e., faster left/right judgements of seen gaze when the seen head deviated towards the same side as that gaze), the opposite applied without time pressure.     

The role of visual and nonvisual feedback in a vehicle steering task

This article investigates vehicle steering control, focusing on the task of lane changing and the role of different sources of sensory feedback. Participants carried out 2 experiments in a fully instrumented, motion-based simulator. Despite the high level of realism afforded by the simulator, participants were unable to complete a lane change in the absence of visual feedback. When asked to produce the steering movements required to change lanes and turn a corner, participants produced remarkably similar behavior in each case, revealing a misconception of how a lane-change maneuver is normally executed. Finally, participants were asked to change lanes in a fixed-based simulator, in the presence of intermittent visual information. Normal steering behavior could be restored using brief but suitably timed exposure to visual information. The data suggest that vehicle steering control can be characterized as a series of unidirectional, open-loop steering movements, each punctuated by a brief visual update.     

Talking heads or talking eyes? Effects of head orientation and sudden onset gaze cues on attention capture

The direction of gaze towards or away from an observer has immediate effects on attentional processing in the observer. Previous research indicates that faces with direct gaze are processed more efficiently than faces with averted gaze. We recently reported additional processing advantages for faces that suddenly adopt direct gaze (abruptly shift from averted to direct gaze) relative to static direct gaze (always in direct gaze), sudden averted gaze (abruptly shift from direct to averted gaze), and static averted gaze (always in averted gaze). Because changes in gaze orientation in previous study co-occurred with changes in head orientation, it was not clear if the effect is contingent on face or eye processing, or whether it requires both the eyes and the face to provide consistent information. The present study delineates the impact of head orientation, sudden onset motion cues, and gaze cues. Participants completed a target-detection task in which head position remained in a static averted or direct orientation while sudden onset motion and eye gaze cues were manipulated within each trial. The results indicate a sudden direct gaze advantage that resulted from the additive role of motion and gaze cues. Interestingly, the orientation of the face towards or away from the observer did not influence the sudden direct gaze effect, suggesting that eye gaze cues, not face orientation cues, are critical for the sudden direct gaze effect.     

Influence of head orientation on visually and memory-guided arm movements

In the absence of visual supervision, tilting the head sideways gives rise to deviations in spatially defined arm movements. The purpose of this study was to determine whether these deviations are restricted to situations with impoverished visual information. Two experiments were conducted in which participants were positioned supine and reproduced with their unseen index finger a 2 dimensional figure either under visual supervision or from memory (eyes closed). In the former condition, the figure remained visible (using a mirror). In the latter condition, the figure was first observed and then reproduced from memory. Participants' head was either aligned with the trunk or tilted 30° towards the left or right shoulder. In experiment 1, participants observed first the figure with the head straight and then reproduced it with the head either aligned or tilted sideways. In Experiment 2, participants observed the figure with the head in the position in which the figure was later reproduced. Results of Experiment 1 and 2 showed deviations of the motor reproduction in the direction opposite to the head in both the memory and visually-guided conditions. However, the deviations decreased significantly under visual supervision when the head was tilted left. In Experiment 1, the perceptual visual bias induced by head tilt was evaluated. Participants were required to align the figure parallel to their median trunk axis. Results revealed that the figure was perceived as parallel with the trunk when it was actually tilted in the direction of the head. Perceptual and motor responses did not correlate. Therefore, as long as visual feedback of the arm is prevented, an internal bias, likely originating from head/trunk representation, alters hand-motor production irrespectively of whether visual feedback of the figure is available or not.