A quantitative analysis of chain-schedule performance

Six pigeons were trained with a chain variable-interval variable-interval schedule on the left key and with reinforcers available on the right key on a single variable-interval schedule arranged concurrently with both links of the chain. All three schedules were separately and systematically varied over a wide range of mean intervals. During these manipulations, the obtained reinforcer rates on constant arranged schedules also frequently changed systematically. Increasing reinforcer rates in Link 2 of the chain increased response rates in both links and decreased response rates in the variable-interval schedule concurrently available with Link 2. Increasing Link-1 reinforcer rates increased Link-1 response rates and decreased Link-2 response rates. Increasing reinforcer rates on the right-key schedule decreased response rates in Link 1 of the chain but did not affect the rate in Link 2. The results extend and amplify previous analyses of chain-schedule performance and help define the effects that a quantitative model must describe. However, the complexity of the results, and the fact that constant arranged reinforcer schedules did not necessarily lead to constant obtained reinforcer rates, precluded a quantitative analysis.     

Effects of relative reinforcer frequency on complex color detection

Pigeons were trained under a discrete-trials detection procedure in which one of a set of color stimuli was presented on the center key and a single response turned off the stimulus and illuminated two side keys. Single responses to one or the other side key produced occasional reinforcers depending on the value of the color stimulus. In Experiment 1, one color-stimulus set comprised 559, 564, 569, and 574 nm, and right-key pecks were occasionally reinforced following presentations of members of this set. The other stimulus set comprised 579, 584, 589, and 594 nm, and left-key pecks were occasionally reinforced following presentations of members of this set. Across seven experimental conditions, the left/(left + right) relative reinforcer frequency was varied from .1 to .9. In Experiment 2, one stimulus set contained only one member, 574 nm, and right-key responses were occasionally reinforced following its presentation. Over 12 experimental conditions, two manipulations were carried out. First, the number of stimuli comprising the other stimulus set was increased from one (579 nm) to two (579 and 584 nm) to three (579, 584, and 589 nm) and to four (579, 584, 589, and 594 nm), and left-key responses were reinforced occasionally following center-key presentations of members of this set. Second, for each stimulus combination, the left/(left + right) relative reinforcer frequency was varied from .1 to .5 to .9 across three experimental conditions. The principal finding of Experiments 1 and 2 was that reinforcers and stimuli interacted in their effects on behavior. In Experiment 3, pairs of adjacent stimuli (5 nm apart) in the range 559 to 594 nm were presented in each experimental condition, and the left/(left + right) relative reinforcer frequency was held constant at .5. The data from all three experiments were analyzed according to a detection model describing performance in multiple-stimulus two-response procedures. This model provided independent measures of stimulus discriminability, contingency discriminability, and bias. The analysis showed that (a) consistent with the color-naming function, pigeons were better able to discriminate between higher nanometer values than lower nanometer values; (b) their ability to discriminate between the stimuli was independent of the number of wavelengths comprising each stimulus set; (c) they allocated delivered reinforcers very accurately to the previously emitted response; and (d) no consistent biases emerged.     

Algorithmic shaping and misbehavior in the acquisition of token deposit by rats

In two experiments, rats were trained to deposit ball bearings down a hole in the floor, using an algorithmic version of shaping. The experimenter coded responses expected to be precursors of the target response, ball bearing deposit; a computer program reinforced these responses, or not, according to an algorithm that mimicked the processes thought to occur in conventional shaping. In the first experiment, 8 of 10 rats were successfully shaped; in the second, 5 of 5 were successfully shaped, and the median number of sessions required was the same as for a control group trained using conventional shaping. In both experiments, “misbehavior,” that is, excessive handling and chewing of the ball bearings, was observed, and when the algorithmic shaping procedure was used, misbehavior could be shown to occur in spite of reduced reinforcement for the responses involved.     

Visually guided catching and tracking skills in pigeons: A preliminary analysis

Research on reaching, tracking, and catching in the pigeon has been hampered by limitations of technology. A new system was developed in which the target was a small rectangle presented on a video display terminal and the pecking response was detected with touch technology. The target moved up and down vertically with sinusoidal velocity. A coincidence between the location of the pigeon's beak and the cursor produced reinforcement. The pigeon pecked ahead and behind the target, but most pecks occurred behind the target so the dominant tracking strategy was lagging. The pigeon was adept at “catching” the target at many locations throughout the trajectory. Transfer of motor learning was tested on probe trials during which the trajectory changed from vertical to horizontal. On transfer trials the pigeons' dominant pattern of pecking immediately shifted from vertical to horizontal. The motor skill displayed by the pigeons was flexible and adaptive, suggesting that the pigeons had learned to track the cursor.     

Connectionist models of conditioning: A tutorial

Models containing networks of neuron-like units have become increasingly prominent in the study of both cognitive psychology and artificial intelligence. This article describes the basic features of connectionist models and provides an illustrative application to compound-stimulus effects in respondent conditioning. Connectionist models designed specifically for operant conditioning are not yet widely available, but some current learning algorithms for machine learning indicate that such models are feasible. Conversely, designers for machine learning appear to have recognized the value of behavioral principles in producing adaptive behavior in their creations.     

Visual fixation and postural sway in children

Adults are able to use a visual target to reduce quiet-standing postural sway (Lee & Lishman, 1975). The present study was designed to determine whether children, under varying postural conditions, are also able to use a visual target to reduce postural sway. A second purpose was to determine the ability of children to visually fixate under different postural conditions. An inability to visually fixate may limit the usefulness of a visual target. The results indicate that, like adults, children are able to reduce sway in the presence of a visual target. Young children are less able than older children and adults to visually fixate. In addition, children show more spontaneous visual saccades in the no-target condition than in the target condition and more saccades in the Romberg stance than in a feet-together stance. The fact that saccades decrease with increasing age, even in the seated, head-stabilized condition, precludes the possibility that increased instability of the young children is the only cause of increased number of saccades.     

Backward walking: a simple reversal of forward walking?

The purpose of this study was to determine whether backward walking represented a simple temporal reversal of forward walking and, hence, could be controlled by a reversed cycling of the same group of neurons. Electromyographic (EMG), joint angle, joint moment, and joint muscle power patterns were compared for forward and backward walking, in 6 subjects. The joint angle patterns with the time-base of the backward walking reversed were similar, with the exception of the ankle. The moment patterns were similar except for the knee, whereas the joint muscle powers were almost reversed-polarity images of each other. This suggests that somewhat similar muscle activation patterns could be used to produce both modes of locomotion, but the temporal cycling of muscle contraction would be reversed: Concentric muscle activity in forward walking would become eccentric activity in backward walking, and visa versa. The EMG results generally supported these findings.     

Gender and Sex-Role Influences on Children''s Self-Esteem

This study examined direct and moderating influences of gender and sex-role orientations on children's general self-esteem. Moderating influences of these variables on the prediction of self-esteem were examined with respect to two sets of competence beliefs regarding school achievement: perceived capacities and perceived strategies for doing well in school. One hundred nineteen fourth-, fifth-, and sixth-grade children were assessed using the Perceived Competence Scale for Children (Harter, 1982), the Multidimensional Measure of Children's Perceptions of Control (Connell, 1985), and the Children's Personal Attributes Questionnaire (Hall & Halberstadt, 1980). Correlational and hierarchical multiple regression analyses indicated that upper elementary schoolchildren's general self-esteem is (a) marginally related to biological gender, with boys showing a slight advantage; (b) significantly related to masculinity and androgyny; and (c) predicted more strongly by perceived capacities to do schoolwork in girls than in boys, and by perceived (lack of) strategies for academic success in nontraditionally sex-typed children than in traditionally sex-typed children. Of the two nontraditionally sex-typed groups, androgynous children were found to have more positive school competence beliefs than were undifferentiated children.     

On task and theory specificity

One of the significant limitations of the motor control and skill acquisition domain is that the theories, models, and hypotheses are, in most cases, task specific. Many lines of theorizing fail to hold up under even small changes in task constraints, although clearly the field does have some robust phenomena. It is proposed that a broader consideration of the role of task constraints, which is grounded in the methodology of nonlinear dynamics, may help to formulate a more general action theory of coordination and control.     

Qualitative dynamics of disordered human locomotion: a preliminary investigation

A qualitative approach to the evaluation of disordered locomotion is introduced within the framework of dynamical systems theory. Exemplar phase plane and angle-angle plots of knee and ankle movements were constructed from limb trajectories of neurologically impaired individuals and qualitatively compared with similar plots, reflecting normal locomotion. In phase plane trajectories of normal locomotion, characteristics of spring-like dynamics dominated the loading and unloading phases whereas those of ballistic pendular dynamics were seen during swing. The overall squareness of the normal phase plane trajectories suggested precisely timed and narrowly focused controls. in contrast, phase plane records from hemiparetic subjects had markedly reduced segmental velocities, pronounced velocity reversals in both stance and swing, and a loss of overall squareness. Knee-ankle plots of normal locomotion revealed important features of intersegmental coordination such as coupled out-of-phase coordination in loading and unloading, a decoupled phase offset in early swing, and a kind of active partitioning in late swing in which one segment moved while the other remained constant. These intersegmental relations were absent or distorted in the hemiparetic angle-angle plots. It is suggested that this qualitative approach, together with electromyography and force dynamics, may allow the characterization of the movement disorders associated with given neuropathologies.