A Dual Process Account of Coarticulation in Motor Skill Acquisition

Many tasks, such as typing a password, are decomposed into a sequence of subtasks that can be accomplished in many ways. Behavior that accomplishes subtasks in ways that are influenced by the overall task is often described as “skilled” and exhibits coarticulation. Many accounts of coarticulation use search methods that are informed by representations of objectives that define skilled. While they aid in describing the strategies the nervous system may follow, they are computationally complex and may be difficult to attribute to brain structures. Here, the authors present a biologically- inspired account whereby skilled behavior is developed through 2 simple processes: (a) a corrective process that ensures that each subtask is accomplished, but does not do so skillfully and (b) a reinforcement learning process that finds better movements using trial and error search that is not informed by representations of any objectives. We implement our account as a computational model controlling a simulated two-armed kinematic “robot” that must hit a sequence of goals with its hands. Behavior displays coarticulation in terms of which hand was chosen, how the corresponding arm was used, and how the other arm was used, suggesting that the account can participate in the development of skilled behavior.     

Multiple schedules of conjugate reinforcement and extinction: A translational model for assessing automatically reinforced behavior

This study evaluated the extent to which a conjugate reinforcement schedule (CONJ) involving a contingency between pedaling a stationary bike and viewing a preferred movie could serve as a translational preparation for the analysis of automatically reinforced behavior. In part, researchers examined whether providing participants with either an accurate or an inaccurate rule about the extinction (EXT) component of a multiple schedule (MULT) contributed to the development of control by the MULT (CONJ EXT) schedule. Results show schedule control emerged for four of five participants who received the accurate rule and none of the five participants who received the inaccurate rule. In addition, participants who received accurate rules typically increased pedaling during CONJ components that followed two consecutive EXT components, suggesting that they experienced deprivation for audio and visual stimulation generated by pedaling. These preliminary findings suggest that researchers could use this translational preparation to identify matched interventions for some automatically reinforced behavior.     

Young children's spontaneous utterances of mental terms and the accuracy of their memory behaviors: a different methodological approach

The purpose of this study was to determine whether young children's spontaneous utterances of mental terms would be congruent with the accuracy of their memory behaviours, and whether the use of an incidental memory task would yield similar developmental patterns as other methodologies. It was hypothesized that if children realize that internal mental activities influence behavioural actions, then the children's behavioural actions (recall) would be congruent with their utterances. A total of 27 three‐ and five‐year‐old children spontaneously used cognitive verbs such as knowing, forgetting, remembering, thinking, guessing and betting during a recall task. The results revealed that 39% of the 3‐year‐old children's behavioural responses and 67% of the 5‐year‐old children were congruent with their spontaneous utterances. These and other findings were consistent with studies that utilized different methodologies. Copyright © 2002 John Wiley & Sons, Ltd.     

The effects of reinforcement rate on the spontaneous social initiations of socially withdrawn preschoolers.

Social skills priming was used to increase the spontaneous social initiations of 2 socially withdrawn preschoolers, 1 of whom had been diagnosed with autism. During priming sessions, the teacher prompted and reinforced social behaviors (e.g., smiling, verbal initiations). We varied the rate of reinforcement during priming sessions and measured the effects of this manipulation on the rate of spontaneous social initiations during the subsequent classroom activity. Spontaneous initiations were more frequent after high rates of reinforcement than after low rates of reinforcement.     

Stimulus Equivalence: Effects Of A Default-response Option On Emergence Of Untrained Stimulus Relations

Human subjects were exposed to a concurrent-chains schedule in which reinforcer amounts, delays, or both were varied in the terminal links, and consummatory responses were required to receive points that were later exchangeable for money. Two independent variable-interval 30-s schedules were in effect during the initial links, and delay periods were defined by fixed-time schedules. In Experiment 1, subjects were exposed to three different pairs of reinforcer amounts and delays, and sensitivity to reinforcer amount and delay was determined based on the generalized matching law. The relative responding (choice) of most subjects was more sensitive to reinforcer amount than to reinforcer delay. In Experiment 2, subjects chose between immediate smaller reinforcers and delayed larger reinforcers in five conditions with and without timeout periods that followed a shorter delay, in which reinforcer amounts and delays were combined to make different predictions based on local reinforcement density (i.e., points per delay) or overall reinforcement density (i.e., points per total time). In most conditions, subjects' choices were qualitatively in accord with the predictions from the overall reinforcement density calculated by the ratio of reinforcer amount and total time. Therefore, the overall reinforcement density appears to influence the preference of humans in the present self-control choice situation.     

Choice with delayed and probabilistic reinforcers: effects of prereinforcer and postreinforcer stimuli.

In Experiment 1, pigeons' pecks on a green key led to a 5-s delay with green houselights, and then food was delivered on 20% (or, in other conditions, 50%) of the trials. Pecks on a red key led to an adjusting delay with red houselights, and then food was delivered on every trial. The adjusting delay was used to estimate indifference points: delays at which the two alternatives were chosen about equally often. Varying the presence or absence of green houselights during the delays that preceded possible food deliveries had large effects on choice. In contrast, varying the presence of the green or red houselights in the intertrial intervals had no effects on choice. In Experiment 2, pecks on the green key led to delays of either 5 s or 30 s with green houselights, and then food was delivered on 20% of the trials. Varying the duration of the green houselights on nonreinforced trials had no effect on choice. The results suggest that the green houselights served as a conditioned reinforcer at some times but not at others, depending on whether or not there was a possibility that a primary reinforcer might be delivered. Given this interpretation of what constitutes a conditioned reinforcer, most of the results were consistent with the view that the strength of a conditioned reinforcer is inversely related to its duration.     

DO PARAKEETS EXHIBIT DERIVED STIMULUS CONTROL? SOME THOUGHTS ON EXPERIMENTAL CONTROL PROCEDURES

Breaking new ground in the study of emergent stimulus control in nonverbal subjects may require innovation in procedures. A recent study of parakeets is exemplary. This study used intricate procedures for maintaining test-trial performance without differential reinforcement of the target emergent performance. Also, it used successive simple discrimination procedures, which are rare in such studies. Given the importance of these innovations and the outcomes that they produced, we suggest additional control procedures that would rule out the possibility of adventitious reinforcement of the test-trial performances.     

THE USE OF PROMPTS TO ENHANCE VICARIOUS EFFECTS OF NONVERBAL APPROVAL

The effect of nonverbal teacher approval (physical contact in the form of patting approvingly) delivered to target subjects on the attentive behavior of adjacent peers was examined in a special-education classroom. In a reversal design, two pairs of moderately retarded children were exposed to nonverbal approval, with only one subject in each pair receiving approval. In different phases, nonverbal approval was delivered alone or in conjunction with a verbal prompt directed to the adjacent peer or to the class as a whole. The prompt was designed to make salient the target subject's attentive behavior and the nonverbal reinforcing consequences that followed. Providing contingent nonverbal approval alone consistently altered attentive behavior of the target subjects but did not alter the attentive behavior of adjacent peers. However, accompanying nonverbal approval with a verbal prompt did increase attentive behavior of nonreinforced peers.