Amplitude Scaling Compensates for Serial Delays in Correcting Eye and Arm Movements

Spatial and metrical parameters of the eye and arm movements made by human subjects (N = 7) in response to visual targets that were stepped unexpectedly either once (single step) or twice (double step) were studied. For the double-step, the displacement of a visual target was decreased or increased in amplitude at intervals before and during a movement. Provided the second target step occurred more than 100 ms before the onset of movement, the amplitude of the subjects' first response was altered in the direction of the new target location. But this amplitude scaling was not always sufficient to reach the new target location, and a second corrective response was required. The latency in producing this second response was greatly increased above reaction time latencies of movements to single-step targets, especially when the target change occurred 100 ms or more before movement onset. These findings suggest that even though serial processing limitations delay the production of a second corrective response, continuous parallel processing of visual information enables the amplitude of the first response to be altered with minimal delay. This enables some degree of real-time continuous control by the visuomotor control system.     

The planning and execution of sequential eye movements: saccades do not show the one target advantage

The present experiment examined the one-target advantage (OTA) with regard to saccadic eye movements. The OTA, previously found with manual pointing responses, refers to the finding that movements are executed faster when the limb is allowed to stop on the target compared to the situation where it has to proceed and hit a second target. Using an adapted limb movement OTA task, saccades of 5 degrees and 15 degrees were made to (a) a single target (one-target), (b) one target and immediately to another target without a change in direction (two-target-extension), and (c) one target and immediately back to the start location (two-target-reversal). Unlike manual movements, the movement times for the initial saccade in the two-target-extension condition were not prolonged compared to either of the other two conditions. Moreover, this pattern of results was found for both the shorter and longer amplitude saccades. The results indicate that the OTA does not occur in the oculomotor system and therefore is not a general motor control phenomenon.     

Auditory cueing facilitates temporospatial accuracy of sequential movements

Effectively executing goal-directed behaviours requires both temporal and spatial accuracy. Previous work has shown that providing auditory cues enhances the timing of upper-limb movements. Interestingly, alternate work has shown beneficial effects of multisensory cueing (i.e., combined audiovisual) on temporospatial motor control. As a result, it is not clear whether adding visual to auditory cues can enhance the temporospatial control of sequential upper-limb movements specifically. The present study utilized a sequential pointing task to investigate the effects of auditory, visual, and audiovisual cueing on temporospatial errors. Eighteen participants performed pointing movements to five targets representing short, intermediate, and large movement amplitudes. Five isochronous auditory, visual, or audiovisual priming cues were provided to specify an equal movement duration for all amplitudes prior to movement onset. Movement time errors were then computed as the difference between actual and predicted movement times specified by the sensory cues, yielding delta movement time errors (ΔMTE). It was hypothesized that auditory-based (i.e., auditory and audiovisual) cueing would yield lower movement time errors compared to visual cueing. The results showed that providing auditory relative to visual priming cues alone reduced ΔMTE particularly for intermediate amplitude movements. The results further highlighted the beneficial impact of unimodal auditory cueing for improving visuomotor control in the absence of significant effects for the multisensory audiovisual condition.     

Coordination of Eye and Leg Movements During Visually Guided Stepping

In the present study, 2 related hypotheses were tested: first, that vision is used in a feedforward control mode during precision stepping onto visual targets and, second, that the oculomotor and locomotor control centers interact to produce coordinated eye and leg movements during that task. Participants' (N = 4) eye movements and step cycle transition events were monitored while they performed a task requiring precise foot placement at every step onto irregularly placed stepping stones under conditions in which the availability of visual information was either restricted or intermittently removed altogether. Accurate saccades, followed by accurate steps, to the next footfall target were almost always made even when the information had been invisible for as long as 500 ms. Despite delays in footlift caused by the temporary removal (and subsequent reinstatement) of visual information, the mean interval between the start of the eye movement and the start of the swing toward a target did not vary significantly (p > .05). In contrast, the mean interval between saccade onset away from a target and a foot landing on that target (stance onset) did vary significantly (p < .05) under the different experimental conditions. Those results support the stated hypotheses.     

汉字早期字形加工中的部件数效应

探讨部件数效应是否在汉字早期字形加工中存在。要求被试识别重复速示方式下的具有不同部件数的汉字字形。大学生为被试。在实验1中,发现4部件字比在通透性、笔画数、字频和像素数上匹配的2部件字更容易识别字形;在实验2中,2部件字的通透性比4部件字更好,此时没有识别成绩上的差异。上面的结果表明在字形加工中存在着部件数效应,它指部件越多越容易识别汉字字形。在讨论部分提出了一个字形加工的部分线索模型,它指被试可以根据汉字的部分线索(例如部件)识别整个汉字。     

Effects on prism adaptation of duration and timing of visual feedback during pointing

In two experiments, we investigated the effects of duration of visual feedback of the pointing limb and the time (early to late) in the movement when the limb first becomes visible (timing of visual feedback). Timing, rather than duration of visual feedback, proved to have the greater effect on the relative magnitude of visual and proprioceptive adaptation. Visual adaptation increased smoothly with feedback delay, but corresponding decreases in proprioceptive adaptation underwent an additional sharp change when feedback was delayed until about three-fourths of the way to the terminal limb position. These results are consistent with the idea that visual and proprioceptive adaptation are mediated by exclusive processes. Change in the limb position sense (i.e., proprioceptive adaptation) may be produced by visual guidance of the pointing limb, and view of the limb early in the pointing movement seems to be critical for such visual guidance. The limb may be ballistically released as it nears the terminal position, and, thereafter, any opportunity for visual guidance (i.e., view of the limb) is not effective. On the other hand, change in the eye position sense (i.e., visual adaptation) may be mediated by proprioceptive guidance of the eye; the eyes may track the imaged position of the nonvisible limb. Such proprioceptive guidance seems to be solely a function of the distance moved before the limb becomes visible.     

Effects on Prism Adaptation of Duration and Timing of Visual Feedback During Pointing

In two experiments, we investigated the effects of duration of visual feedback of the pointing limb and the time (early to late) in the movement when the limb first becomes visible (timing of visual feedback). Timing, rather than duration of visual feedback, proved to have the greater effect on the relative magnitude of visual and proprioceptive adaptation. Visual adaptation increased smoothly with feedback delay, but corresponding decreases in proprioceptive adaptation underwent an additional sharp change when feedback was delayed until about three-fourths of the way to the terminal limb position. These results are consistent with the idea that visual and proprioceptive adaptation are mediated by exclusive processes. Change in the limb position sense (i.e., proprioceptive adaptation) may be produced by visual guidance of the pointing limb, and view of the limb early in the pointing movement seems to be critical for such visual guidance. The limb may be ballistically “released“ as it nears the terminal position, and, thereafter, any opportunity for visual guidance (i.e., view of the limb) is not effective. On the other hand, change in the eye position sense (i.e., visual adaptation) may be mediated by proprioceptive guidance of the eye; the eyes may track the imaged position of the nonvisible limb. Such proprioceptive guidance seems to be solely a function of the distance moved before the limb becomes visible.     

眼动分析技术在句子理解研究中的应用*

句子理解是阅读研究中的一个重要部分。研究者采用了不同的手段和任务对这一问题进行了长期的研究,其中,眼动分析技术是一种行之有效的手段。本文从句子理解的三个阶段(视觉信息的提取,句子中的词汇识别和句子整合),探讨了眼动分析技术在句子理解研究中的优势作用。在此基础之上,提出了未来使用眼动分析技术进行句子理解研究需要注意的几个问题。     

Linguistically guided anticipatory eye movements in scene viewing

The present study replicated the well-known demonstration by Altmann and Kamide (1999) that listeners make linguistically guided anticipatory eye movements, but used photographs of scenes rather than clip-art arrays as the visual stimuli. When listeners heard a verb for which a particular object in a visual scene was the likely theme, they made earlier looks to this object (e.g., looks to a cake upon hearing The boy will eat …) than when they heard a control verb (The boy will move …). New data analyses assessed whether these anticipatory effects are due to a linguistic effect on the targeting of saccades (i.e., the where parameter of eye movement control), the duration of fixations (i.e., the when parameter), or both. Participants made fewer fixations before reaching the target object when the verb was selectionally restricting (e.g., will eat). However, verb type had no effect on the duration of individual eye fixations. These results suggest an important constraint on the linkage between spoken language processing and eye movement control: Linguistic input may influence only the decision of where to move the eyes, not the decision of when to move them.     

Sequential Aiming with Two Limbs and the One-Target Advantage

Movement times to the first target in a 2-target sequence are typically slower than in 1-target aiming tasks. The 1-target movement time advantage has been shown to emerge regardless of hand preference, the hand used, the amount of practice, and the availability of visual feedback. The authors tested central and peripheral explanations of the 1-target advantage, as postulated by the movement integration hypothesis, by asking participants to perform single-target movements, 2-target movements with 1 limb, and 2-target movements in which they switched limbs at the first target. Reaction time and movement time data showed a 1-target advantage that was similar for both 1- and 2-limb sequential aiming movements. This outcome demonstrates that the processes underlying the increase in movement time to the 1st target in 2-target sequences are not specific to the limb, suggesting that the 1-target advantage originates at a central rather than a peripheral level.     

Determinants of Offline Processing of Visual Information for the Control of Reaching Movements

The authors investigated the use of visual feedback as a form of knowledge of results (KR) for the control of rapid (200-250 ms) reaching movements in 40 participants. They compared endpoint accuracy and intraindividual variability of a full-vision group (FV) with those of no-vision groups provided with KR regarding (a) the endpoint in numerical form, (b) the endpoint in visual form, or (c) the endpoint and the trajectory in visual form (DEL). The FV group was more accurate and less variable than were the no-vision groups, and the analysis of limb trajectory variability indicated that their superior performance resulted primarily from better movement planning rather than from online visual processes. The FV group outperformed the DEL group even though both groups were obtaining the same amount of spatial visual information from every movement. That finding suggests that the effectiveness with which visual feedback is processed offline is not a simple function of the amount of visual information available, but depends on how that information is presented.     

Preparation of forefinger’s sequence on keyboard orients ocular fixations on computer screen

This study examined the links between attention, hand movements and eye movements when performed in different spatial areas. Participants performed a visual search task on a computer screen while preparing to press two keyboard keys sequentially with their index. Results showed that the planning of the manual sequence influenced the latency of the first saccade and the placement of the first fixation. In particular, even if the first fixation placement was influenced by the combination of both components of the prepared manual sequence in some trials, it was affected principally by the first component of the prepared manual sequence. Moreover, the probability that the first fixation placement did reflect a combination of both components of the manual sequence was correlated with the speed of the second component. This finding suggests that the preparation of the second component of the sequence influence simultaneous oculomotor behavior when motor control of the manual sequence relied on proactive motor planning. These results are discussed taking into account the current debate on the eye/hand coordination research.     

Modeling Lag‐2 Revisits to Understand Trade‐Offs in Mixed Control of Fixation Termination During Visual Search

An important question about eye‐movement behavior is when the decision is made to terminate a fixation and program the following saccade. Different approaches have found converging evidence in favor of a mixed‐control account, in which there is some overlap between processing information at fixation and planning the following saccade. We examined one interesting instance of mixed control in visual search: lag‐2 revisits, during which observers fixate a stimulus, move to a different stimulus, and then revisit the first stimulus on the next fixation. Results show that the probability of lag‐2 revisits occurring increased with the number of target‐similar stimuli, and revisits were preceded by a brief fixation on the intervening distractor stimulus. We developed the Efficient Visual Sampling (EVS) computational model to simulate our findings (fixation durations and fixation locations) and to provide insight into mixed control of fixations and the perceptual, cognitive, and motor processes that produce lag‐2 revisits.     

Amplitude Scaling Compensates for Serial Delays in Correcting Eye and Arm Movements

Spatial and metrical parameters of the eye and arm movements made by human subjects (N = 7) in response to visual targets that were stepped unexpectedly either once (single step) or twice (double step) were studied. For the double-step, the displacement of a visual target was decreased or increased in amplitude at intervals before and during a movement. Provided the second target step occurred more than 100 ms before the onset of movement, the amplitude of the subjects' first response was altered in the direction of the new target location. But this amplitude scaling was not always sufficient to reach the new target location, and a second corrective response was required. The latency in producing this second response was greatly increased above reaction time latencies of movements to single-step targets, especially when the target change occurred 100 ms or more before movement onset. These findings suggest that even though serial processing limitations delay the production of a second corrective response, continuous parallel processing of visual information enables the amplitude of the first response to be altered with minimal delay. This enables some degree of real-time continuous control by the visuomotor control system.     

Movement segmentation and visual perturbation increase developmental differences in motor control and learning

We examined the developmental differences in motor control and learning of a two‐segment movement. One hundred and five participants (53 female) were divided into three age groups (7–8 years, 9–10 years and 19–27 years). They performed a two‐segment movement task in four conditions (full vision, fully disturbed vision, disturbed vision in the first movement segment and disturbed vision in the second movement segment). The results for movement accuracy and overall movement time show that children, especially younger children, are more susceptible to visual perturbations than adults. The adults’ movement time in one of the movement segments could be increased by disturbing the vision of the other movement segment. The children's movement time for the second movement segment increased when their vision of the first movement segment was disturbed. Disturbing the vision of the first movement segment decreased the percentage of central control of the second movement in younger children, but not in the other two age groups. The children's normalized jerk was more easily increased by visual perturbations. The children showed greater improvement after practice in the conditions of partial vision disturbance. As the participants’ age increased, practice tended to improve their feedforward motor control rather than their feedback motor control. These results suggest that children's central movement control improves with age and practice. We discuss the theoretical implications and practical significance of the differential effects of visual perturbation and movement segmentation upon motor control and learning from a developmental viewpoint.     

The consequence of a limited-capacity short-term memory on repeated visual search

ABSTRACT

When participants search the same letter display repeatedly for different targets we might expect performance to improve on each subsequent search as they memorize characteristics of the display. However, here we find that search performance improved from a first search to a second search but not for a third search of the same display. This is predicted by a simple model that supports search with only a limited capacity short-term memory for items in the display. To support this model we show that a short-term memory recency effect is present in both the second and the third search. The magnitude of these effects is the same in both searches and as a result there is no additional benefit from the second to the third search.     

How is motion disparity integrated with binocular disparity in depth perception?

Two experiments presented motion disparity conflicting with binocular disparity to examine how these cues determined apparent depth order (convex, concave) and depth magnitude. In each experiment, 8 subjects estimated the depth order and depth magnitude. The first experiment showed the following. (1) The visual system used one of these cues exclusively in selecting a depth order for each display. (2) The visual system integrated the depth magnitude information from these cues by a weighted additive fashion if it selected the binocular disparity in depth order perception and if the depth magnitude specified by motion disparity was small relative to that specified by binocular disparity. (3) The visual system ignored the depth magnitude information of binocular disparity if it selected the motion disparity in depth order perception. The second experiment showed that these three points were consistent whether the subject’s head movement or object movement generated motion disparity.     

A multi-modal approach to cognitive training and assistance in minimally invasive surgery

Minimally-invasive surgery (MIS) offers many benefits to patients, but is considerably more difficult to learn and perform than is open surgery. One main reason for the observed difficulty is attributable to the visuo-spatial challenges that arise in MIS, taxing the surgeons’ cognitive skills. In this contribution, we present a new approach that combines training and assistance as well as the visual and the auditory modality to help surgeons to overcome these challenges. To achieve this, our approach assumes two main components: An adaptive, individualized training component as well as a component that conveys spatial information through sound. The training component (a) specifically targets the visuo-spatial processes crucial for successful MIS performance and (b) trains surgeons in the use of the sound component. The second component is an auditory display based on a psychoacoustic sonification, which reduces and avoids some of the commonly experienced MIS challenges. Implementations of both components are described and their integration is discussed. Our approach and both of its components go beyond the current state of the art in important ways. The training component has been explicitly designed to target MIS-specific visuo-spatial skills and to allow for adaptive testing, promoting individualized learning. The auditory display is conveying spatial information in 3-D space. Our approach is the first that encompasses both training for improved mastery and reduction of cognitive challenges in MIS. This promises better tailoring of surgical skills and assistance to the needs and the capabilities of the surgeons and, thus, ultimately, increased patient safety and health.     

The utilization of visual information in the control of rapid sequential aiming movements.

Two experiments were conducted to examine the role of vision in the execution of a movement sequence. Experiment 1 investigated whether individual components of a sequential movement are controlled together or separately. Participants executed a rapid aiming movement to two targets in sequence. A full vision condition was compared to a condition in which vision was eliminated while in contact with the first target. The size of the first target was constant, while the second target size was varied. Target size had an influence on movement time and peak velocity to the first target. Vision condition and target size did not affect the time spent on the first target. These results suggest that preparation of the second movement is completed before the first movement is terminated. Experiment 2 examined when this preparation occurred. A full vision condition was compared to a condition in which vision was occluded during the flight phase of the first movement. Movement initiation times were shorter when vision was continually available. Total movement time was reduced with vision in two-target condition, but not in a control one-target condition. The time spent on the first target was greater when vision was not available during the first movement component. The results indicate that vision prior to movement onset can be used to formulate a movement plan to both targets in the sequence [Fischman & Reeve (1992).     

The dual role of vision in sequential aiming movements

Previous research has demonstrated that movement times to the first target in sequential aiming movements are influenced by the properties of subsequent segments. Based on this finding, it has been proposed that individual segments are not controlled independently. The purpose of the current study was to investigate the role of visual feedback in the interaction between movement segments. In contrast to past research in which participants were instructed to minimize movement time, participants were set a criterion movement time and the resulting errors and limb trajectory kinematics were examined under vision and no vision conditions. Similar to single target movements, the results indicated that vision was used within each movement segment to correct errors in the limb trajectory. In mediating the transition between segments, visual feedback from the first movement segment was used to adjust the parameters of the second segment. Hence, increases in variability that occurred from the first to the second target in the no vision condition were curtailed when visual feedback was available. These results are discussed along the lines of the movement constraint and movement integration hypotheses.