The amendment of large-magnitude aiming-movement errors

Summary The amendment of large-magnitude errors is discussed with particular reference to the correction of directional errors. It is argued that the correction of a large-magnitude error may be understood as a double-step tracking situation in which the second step reflects an artificially induced error signal. At issue is how the motor system may respond to such stimuli in rapid succession. The temporal integration of error stimuli predicts an initial response which reflects the weighted average of the step positions. This approach, however, does not explain the marked increase in peak velocity for the corrective response, compared to an equivalent single-step response. Alternatively, it has been argued that the initial response is initiated as if it were a single-step response to the initial step position and is subsequently amended. The superposition hypothesis argued that the two responses are planned in parallel and overlap in time, to be superimposed one on the other. This hypothesis does not explain changes in the direction of a double-step response at its initiation. The braking hypothesis argues that the initial response is halted and a corrective response initiated as rapidly as possible. This approach cannot explain changes in the slope of an ATF as a function of the second target-step amplitude. A model of double-step tracking is proposed which integrates the temporal integration and braking hypotheses. Since the braking of the initial response would involve the application of large forces, it is argued that braking is facilitated by the temporal integration of step stimuli. The corrective response is then implemented as rapidly as possible. The implications of these findings to the understanding of directional errors is discussed.     

Adapting relative phase of bimanual isometric force coordination through scaling visual information intermittency

Visual information plays an adaptive role in the relation between bimanual force coupling and error corrective processes of isometric force control. In the present study, the evolving distribution of the relative phase properties of bimanual isometric force coupling was examined by scaling within a trial the temporal feedback rate of visual intermittency (short to long presentation intervals and vice versa). The force error (RMSE) was reduced, and time-dependent irregularity (SampEn) of the force output was increased with greater amounts of visual information (shorter intermittency). Multi-stable coordination patterns of bimanual isometric force control were differentially shifted toward and away from the intrinsic dynamics by the changing the intermittency of visual information. The distribution of Hilbert transformed relative phase values showed progressively a predominantly anti-phase mode under less intermittent visual information to predominantly an in-phase mode with limited (almost no) visual information. Correlation between the hands showed a continuous reduction, rather than abrupt “transition,” with increase in visual information, although no mean negative correlation was realized, despite the tendency towards an anti-phase distribution. Lastly, changes in both the performance outcome and bimanual isometric force coordination occurred at visual feedback rates faster than the minimal visual processing times established from single limb movement and isometric force protocols.     

The perception of collative properties in visual stimuli

Two experiments were conducted to determine how quickly subjects respond to collative properties (e. g., Complexity, Uncertainty) of visual stimuli. In Experiment 1 subjects were presented with reproductions of paintings and artificial patterns which varied in collative properties (e. g., Uncertainty, Redundancy). Subjects were able to discriminate these properties on related verbal scales after only a single glance (50 msec) as well as after multiple glances (500 and 5000 msec). In Experiment 2 subjects were presented with pairs of paintings and patterns differing along collative dimensions (e. g., High versus Low Uncertainty) in an exploratory choice paradigm. The results show that for exploratory choice subjects were particularly sensitive to unity or order after only a single glance (50 msec) and to diversity or complexity after multiple glances (500 and 5 000 msec). In general, the data for the single glance condition are consistent with theories which attribute holistic processing to the initial phase of perception.     

Multimodal access to verbal name codes

Congruent information conveyed over different sensory modalities often facilitates a variety of cognitive processes, including speech perception (Sumby & Pollack, 1954). Since auditory processing is substantially faster than visual processing, auditory-visual integration can occur over a surprisingly wide temporal window (Stein, 1998). We investigated the processing architecture mediating the integration of acoustic digit names with corresponding symbolic visual forms. The digits "1" or "2" were presented in auditory, visual, or bimodal format at several stimulus onset asynchronies (SOAs; 0, 75, 150, and 225 msec). The reaction times (RTs) for echoing unimodal auditory stimuli were approximately 100 msec faster than the RTs for naming their visual forms. Correspondingly, bimodal facilitation violated race model predictions, but only at SOA values greater than 75 msec. These results indicate that the acoustic and visual information are pooled prior to verbal response programming. However, full expression of this bimodal summation is dependent on the central coincidence of the visual and auditory inputs. These results are considered in the context of studies demonstrating multimodal activation of regions involved in speech production.     

Fast visual generation: its nature and chronometrics.

The fast-generation model for the matching of mixed-case letter pairs (e.g., Aa, Ab) states that one or both members of a pair activate visual representations in memory of the opposite case, supporting "same" or "different" responses through crossmatching to representations of the pair members themselves. Here the reaction time and error results of three experiments using simultaneous matches support a specific variant of the model in which generation proceeds from the uppercase letter. Furthermore, a manipulation of stimulus onset asynchrony in a fourth experiment using near-simultaneous matches indicates that fast generation produces a visual representation that occurs within 67 msec of initiation and that decays within 200 msec. A fifth experiment contrasts simultaneous and successive matches and in the case of successive matches finds evidence in support of a regeneration process acting after an initial decay. Models of mixed-case matching that are based on the phonetic representation of letter names, or on abstract-letter identities, completely fail to account for the results. Fast generation is distinguishable from slow generation in that it shows fast (vs. slow) dynamics, rapid decay (vs. maintainability), no imagery (vs. imagery), and (probably) automatic (vs. controlled) processing.     

Fast visual generation: Its nature and chronometrics

The fast-generation model for the matching of mixed-case letter pairs (e.g., Aa, Ab) states that one or both members of a pair activate visual representations in memory of the opposite case, supporting “same” or “different” responses through crossmatching to representations of the pair members themselves. Here the reaction time and error results of three experiments using simultaneous matches support a specific variant of the model in which generation proceeds from the uppercase letter. Furthermore, a manipulation of stimulus onset asynchrony in a fourth experiment using near-simultaneous matches indicates that fast generation produces a visual representation that occurs within 67 msec of initiation and that decays within 200 msec. A fifth experiment contrasts simultaneous and successive matches and in the case of successive matches finds evidence in support of a regeneration process acting after an initial decay. Models of mixed-case matching that are based on the phonetic representation of letter names, or on abstract-letter identities, completely fail to account for the results. Fast generation is distinguishable from slow generation in that it shows fast (vs. slow) dynamics, rapid decay (vs. maintainability), no imagery (vs. imagery), and (probably) automatic (vs. controlled) processing.     

Rapid visual feedback processing in single-aiming movements

A major line of behavioral support for motor-program theory derives from evidence indicating that feedback does not influence the execution and control of limited duration movements. Since feedback cannot be utilized, the motor-program is assumed to act as the controlling agent. in a classic study, Keele and Posner observed that visual feedback had no effect on the accuracy of 190-msec single-aiming movements. Therefore visual feedback processing time is greater than 190 msec, and, more importantly, limited duration movements are governed by motor programs. In the present paper, we observed that visual feedback can affect the spatial accuracy of movement with durations much less than 190 msec. We hypothesize that visual feedback can aid motor control via processes not associated with intermittent error corrections.     

The role of selective attention in visual awareness of stimulus features: Electrophysiological studies

Attention and awareness are closely related, but the nature of their relationship is unclear. The present study explores the timing and temporal evolution of their interaction with event-related potentials. The participants attended to specific conjunctions of spatial frequency and orientation in masked (unaware) and unmasked (aware) visual stimuli. A correlate of awareness appeared 100-200 msec from stimulus onset similarly to both attended and unattended features. Selection negativity (SN), a correlate of attentional selection, emerged in response to both masked and unmasked stimuli after 200 msec. This double dissociation between correlates of awareness and SN suggests that the electrophysiological processes associated with feature-based attentional selection and visual awareness of features can be dissociated from each other at early stages of processing. In a passive task, requiring no attention to the stimuli, early electrophysiological responses (before 200 msec) related to awareness were attenuated, suggesting that focal attention modulates visual awareness earlier than does selective feature-based attention.     

Amplitude Scaling Compensates for Serial Delays in Correcting Eye and Arm Movements

Spatial and metrical parameters of the eye and arm movements made by human subjects (N = 7) in response to visual targets that were stepped unexpectedly either once (single step) or twice (double step) were studied. For the double-step, the displacement of a visual target was decreased or increased in amplitude at intervals before and during a movement. Provided the second target step occurred more than 100 ms before the onset of movement, the amplitude of the subjects' first response was altered in the direction of the new target location. But this amplitude scaling was not always sufficient to reach the new target location, and a second corrective response was required. The latency in producing this second response was greatly increased above reaction time latencies of movements to single-step targets, especially when the target change occurred 100 ms or more before movement onset. These findings suggest that even though serial processing limitations delay the production of a second corrective response, continuous parallel processing of visual information enables the amplitude of the first response to be altered with minimal delay. This enables some degree of real-time continuous control by the visuomotor control system.     

The accuracy of aiming at a target: Some further evidence for a theory of intermittent control

On the assumption that intermittent corrections to accurate movements aimed at a target are made every 290 msec on average, it was possible to predict where the last possible correction should occur. This was done by determining the shape of the approach curves at different speeds. The relationship between speed and error was successfully predicted by relating the terminal error to this corrective reaction distance, and thus to speed.     

Information processing of letter and word pairs as a function of on and off times

The present study seeks to extend a provisional model of visual information processing with sequential inputs currently under development, employing a computer-based cathode-ray tube display system. Letter and word pairs were presented for 28 different on-off time combinations with on times ranging from 5 msec to 50 msec and off times ranging from 1 msec to 125 msec. The results suggest that both on, off, and total processing times affect per cent correct detections, and that while a gradual increase in per cent correct detections occurs up to about 50 msec of total processing time, a marked discontinuity appears to occur approximately between 50 and 60 msec of total processing time, with per cent correct detections jumping abruptly from about 40% correct detections to about 90% correct detections over a total processing time span of only 10 msec.     

Amplitude Scaling Compensates for Serial Delays in Correcting Eye and Arm Movements

Spatial and metrical parameters of the eye and arm movements made by human subjects (N = 7) in response to visual targets that were stepped unexpectedly either once (single step) or twice (double step) were studied. For the double-step, the displacement of a visual target was decreased or increased in amplitude at intervals before and during a movement. Provided the second target step occurred more than 100 ms before the onset of movement, the amplitude of the subjects' first response was altered in the direction of the new target location. But this amplitude scaling was not always sufficient to reach the new target location, and a second corrective response was required. The latency in producing this second response was greatly increased above reaction time latencies of movements to single-step targets, especially when the target change occurred 100 ms or more before movement onset. These findings suggest that even though serial processing limitations delay the production of a second corrective response, continuous parallel processing of visual information enables the amplitude of the first response to be altered with minimal delay. This enables some degree of real-time continuous control by the visuomotor control system.     

When visual search functions look like item recognition functions

Visual search data were collected from six Ss on three target set sizes on each of 30 days. Error level was low, and items assigned to memory sets were nonnested and changed from session tosession. For each S. the same item sometimes required a positive and sometimes a negative response (response inconsistency). Combining data over Ss and over successive 6-day blocks, visual search rates as a function of target set size were found to be linear for each of the five 6-day blocks. The slopes of the above functions (memory search time) did not differ significantly over the final four 6-day blocks, and averaged approximately.500 sec per six-character item. These results are qualitatively very similar to results obtained from item recognition studies when error level, memory set structure, degree of response’_ consistency, and practice are handled in the same way in that task. The significantly lower slope obtained on the first 6-day block is shown to be consistent with a speed-accuracy trade off interpretation when error rate is expressed per unit of processing time (percent errors/set size). Over the final three 6-day blocks, where all important parameters ofthe data were highly stable, the intercepts of the memory search functions were found to closely approximate zero, averaging .0068 sec. From this finding, along with the finding that the memory search functions are linear, it is inferred that visual search time is determined entirely by memory search time, or by memory search time and other processes which increase linearly with set size, under the conditions of this experiment. The estimate of memory search time (approximately 83 msec/character) obtained using this visual search procedure is much slower than that obtained using the item recognition procedure (approximately 35\2-40 msec/character). An explanation for this difference is proposed.     

Suitability of the IBM XT,AT, and PS/2 keyboard,mouse, and game port as response devices in reaction time paradigms

The IBM PC keyboard is a convenient response panel for subjects in a reaction time task when the stimuli are presented on the same machine. However, there is a mean delay of about 10 msec and a random error of ±7.5 msec (±5 msec on the AT or PS/2). Our analyses show that for typical single response experimental situations, this added variance is acceptable. With mouse buttons, timing resulted in a delay of 31 ±2 msec if the mouse ball was steady but 45 ±15 msec if it was moving, and a 25-msec refractory period before a second response could be detected. With keys connected to the game port, timing was accurate to 1 msec. For timing the interval between two nearly simultaneous responses, only the game port method is recommended. Any research application should provide an external check on reaction timing accuracy and should correct any mean error.     

Temporal kinetics of prefrontal modulation of the extrastriate cortex during visual attention

Single-unit, event-related potential (ERP), and neuroimaging studies have implicated the prefrontal cortex (PFC) in top-down control of attention and working memory. We conducted an experiment in patients with unilateral PFC damage (n=8) to assess the temporal kinetics of PFC-extrastriate interactions during visual attention. Subjects alternated attention between the left and the right hemifields in successive runs while they detected target stimuli embedded in streams of repetitive task-irrelevant stimuli (standards). The design enabled us to examine tonic (spatial selection) and phasic (feature selection) PFC-extrastriate interactions. PFC damage impaired performance in the visual field contralateral to lesions, as manifested by both larger reaction times and error rates. Assessment of the extrastriate P1 ERP revealed that the PFC exerts a tonic (spatial selection) excitatory input to the ipsilateral extrastriate cortex as early as 100 msec post stimulus delivery. The PFC exerts a second phasic (feature selection) excitatory extrastriate modulation from 180 to 300 msec, as evidenced by reductions in selection negativity after damage. Finally, reductions of the N2 ERP to target stimuli supports the notion that the PFC exerts a third phasic (target selection) signal necessary for successful template matching during postselection analysis of target features. The results provide electrophysiological evidence of three distinct tonic and phasic PFC inputs to the extrastriate cortex in the initial few hundred milliseconds of stimulus processing. Damage to this network appears to underlie the pervasive deficits in attention observed in patients with prefrontal lesions.     

A constant error in the perception of brief temporal intervals

Ss were presented two stimuli of equal duration separated in time. The parrs of stimuli were vibrotactile, auditory, or visual. The Ss adjusted the time between the two stimuli to be equal to the duration of the first stimulus. The results show that for stimulus durations ranging from 100 to 1,200 msec, Ss set the tune between the two stimuli too long and by a constant amount. For vibrotactfle stimuli, the constant was 596 msec; for auditory stimuli, 657 msec; and for visual stimuli, 436 msec. Changing the intensity of the vibrotactile stimuli did not change the size of the constant error. When Ss were presented two tones with a burst of white noise between the tones and adjusted the duration of the white noise to be equal to the duration of the first tone, the white noise was not adjusted too long by a constant amount. The results suggest that there is a constant error in the perception of unfilled relative to filled temporal intervals.     

Visual form recognition threshold and the psychological refractory period

Two experiments studied the effect of a reaction time response (RT) on visual form recognition threshold when the temporal interval separating the RT stimulus and the recognition stimulus was short. In Experiment 1 an initial RT response to an auditory signal did not impair the subsequent forced-choice visual form recognition threshold. Interstimulus intervals (ISI) of 0, 50, 100, 150, and 200 msec were used; S was always aware of the ISI under test. In Experiment 2 a visual stimulus was used to elicit the R T response; this shift to an intramodal stimulus did not alter the recognition threshold. These data were interpreted as supporting the hypothesis that two stimulus events can be processed simultaneously even when the temporal interval between them is short.     

Formation of visual "objects" in the early computation of spatial relations

Perceptual grouping is the process by which elements in the visual image are aggregated into larger and more complex structures, i.e., "objects." This paper reports a study of the spatial factors and time-course of the development of objects over the course of the first few hundred milliseconds of visual processing. The methodology uses the now well-established idea of an "object benefit" for certain kinds of tasks (here, faster within-object than between-objects probe comparisons) to test what the visual system in fact treats as an object at each point during processing. The study tested line segment pairs in a wide variety of spatial configurations at a range of exposure times, in each case measuring the strength of perceptual grouping as reflected in the magnitude of the object benefit. Factors tested included nonaccidental properties such as collinearity, cotermination, and parallelism; contour relatability; Gestalt factors such as symmetry and skew symmetry, and several others, all tested at fine (25 msec) time-slices over the course of processing. The data provide detailed information about the comparative strength of these factors in inducing grouping at each point in processing. The result is a vivid picture of the chronology of object formation, as objects progressively coalesce, with fully bound visual objects completed by about 200 msec of processing.     

Feedback-related brain activity predicts learning from feedback in multiple-choice testing

Different event-related potentials (ERPs) have been shown to correlate with learning from feedback in decision-making tasks and with learning in explicit memory tasks. In the present study, we investigated which ERPs predict learning from corrective feedback in a multiple-choice test, which combines elements from both paradigms. Participants worked through sets of multiple-choice items of a Swahili–German vocabulary task. Whereas the initial presentation of an item required the participants to guess the answer, corrective feedback could be used to learn the correct response. Initial analyses revealed that corrective feedback elicited components related to reinforcement learning (FRN), as well as to explicit memory processing (P300) and attention (early frontal positivity). However, only the P300 and early frontal positivity were positively correlated with successful learning from corrective feedback, whereas the FRN was even larger when learning failed. These results suggest that learning from corrective feedback crucially relies on explicit memory processing and attentional orienting to corrective feedback, rather than on reinforcement learning.     

Providing a sensory basis for models of visual information acquisition

Our major goal is to account for some simple digit-recall data with a theory that integrates two models from two scientific traditions. Therandom-sampling model, founded in the memory and attention literature, holds that (1) stimulus features are randomly sampled throughout the course of stimulus presence and (2) proportion correct recall is equal to the ratio of sampled features to total features.The linear-filter model, founded in the vision and sensation literature, holds that the initial stages of the visual system act as a low-pass temporal filter on the input stimulus, resulting in a time-varyingsensory response in the nervous system. We report two experiments in which a variable-duration, masked, four-digit string had to be immediately recalled. Experiment 1 was designed principally to replicate past data confirming the basic random-sampling model. Like others, we were able to confirm the model only by endowing it with an additionalprocessing-delay assumption: that feature sampling does not begin until the stimulus has been physically present for some minimal duration. Experiment 2 was an extension of Experiment 1 in which the target stimulus was preceded, 250 msec prior to its onset, by a 50-msec pre-presentation ofthe same stimulus called aprime. The Experiment 2 results allowed the following conclusions. First, the initial processing delay found in Experiment 1 is immutably tied to stimulus onset; that is, if there are two stimulus onsets, separated even briefly in time, there are two associated processing delays. Second, processing rate is essentially unaffected by the prime’s presentation. Third, being presented with a 50-msec prime is equivalent, in terms of memory performance, to increasing unprimed stimulus duration by approximately 30 msec; the prime can thus said to beworth 30 msec of additional exposure duration. This third conclusion seems superficially paradoxical, in the sense that one would expect that having seen a 50-msec prime would be equivalent to increasing exposure duration byat least the same 50 msec. However, both the initial processing delays and the 30-msec prime’s worth are natural consequences of our theory that conjoins the random-sampling model with the linear-filter model.