Effects of relative reinforcer frequency on complex color detection

Pigeons were trained under a discrete-trials detection procedure in which one of a set of color stimuli was presented on the center key and a single response turned off the stimulus and illuminated two side keys. Single responses to one or the other side key produced occasional reinforcers depending on the value of the color stimulus. In Experiment 1, one color-stimulus set comprised 559, 564, 569, and 574 nm, and right-key pecks were occasionally reinforced following presentations of members of this set. The other stimulus set comprised 579, 584, 589, and 594 nm, and left-key pecks were occasionally reinforced following presentations of members of this set. Across seven experimental conditions, the left/(left + right) relative reinforcer frequency was varied from .1 to .9. In Experiment 2, one stimulus set contained only one member, 574 nm, and right-key responses were occasionally reinforced following its presentation. Over 12 experimental conditions, two manipulations were carried out. First, the number of stimuli comprising the other stimulus set was increased from one (579 nm) to two (579 and 584 nm) to three (579, 584, and 589 nm) and to four (579, 584, 589, and 594 nm), and left-key responses were reinforced occasionally following center-key presentations of members of this set. Second, for each stimulus combination, the left/(left + right) relative reinforcer frequency was varied from .1 to .5 to .9 across three experimental conditions. The principal finding of Experiments 1 and 2 was that reinforcers and stimuli interacted in their effects on behavior. In Experiment 3, pairs of adjacent stimuli (5 nm apart) in the range 559 to 594 nm were presented in each experimental condition, and the left/(left + right) relative reinforcer frequency was held constant at .5. The data from all three experiments were analyzed according to a detection model describing performance in multiple-stimulus two-response procedures. This model provided independent measures of stimulus discriminability, contingency discriminability, and bias. The analysis showed that (a) consistent with the color-naming function, pigeons were better able to discriminate between higher nanometer values than lower nanometer values; (b) their ability to discriminate between the stimuli was independent of the number of wavelengths comprising each stimulus set; (c) they allocated delivered reinforcers very accurately to the previously emitted response; and (d) no consistent biases emerged.     

Visually guided catching and tracking skills in pigeons: A preliminary analysis

Research on reaching, tracking, and catching in the pigeon has been hampered by limitations of technology. A new system was developed in which the target was a small rectangle presented on a video display terminal and the pecking response was detected with touch technology. The target moved up and down vertically with sinusoidal velocity. A coincidence between the location of the pigeon's beak and the cursor produced reinforcement. The pigeon pecked ahead and behind the target, but most pecks occurred behind the target so the dominant tracking strategy was lagging. The pigeon was adept at “catching” the target at many locations throughout the trajectory. Transfer of motor learning was tested on probe trials during which the trajectory changed from vertical to horizontal. On transfer trials the pigeons' dominant pattern of pecking immediately shifted from vertical to horizontal. The motor skill displayed by the pigeons was flexible and adaptive, suggesting that the pigeons had learned to track the cursor.     

Connectionist models of conditioning: A tutorial

Models containing networks of neuron-like units have become increasingly prominent in the study of both cognitive psychology and artificial intelligence. This article describes the basic features of connectionist models and provides an illustrative application to compound-stimulus effects in respondent conditioning. Connectionist models designed specifically for operant conditioning are not yet widely available, but some current learning algorithms for machine learning indicate that such models are feasible. Conversely, designers for machine learning appear to have recognized the value of behavioral principles in producing adaptive behavior in their creations.     

CO-WORKER IMPLEMENTED JOB TRAINING: THE USE OF COINCIDENTAL TRAINING AND QUALITY-CONTROL CHECKING ON THE FOOD PREPARATION SKILLS OF TRAINEES WITH MENTAL RETARDATION

In two studies, co-workers of persons with disabilities were taught to use coincidental training procedures while completing their own jobs. In Study 1, the effects of coincidental training on the salad-making skills of 3 trainees with mild and moderate mental retardation were evaluated. Coincidental training by co-workers resulted in improved accuracy of the salad-making skills of the trainees. In Study 2, trainees were also coincidentally taught to make quality-control checks of their salads. An alternating treatments and multiple baseline design indicated that the trainees more readily acquired the skills when taught to check the correctness of their work.     

The role of observing and attention in establishing stimulus control.

Early theorists (Skinner, Spence) interpreted discrimination learning in terms of the strengthening of the response to one stimulus and its weakening to the other. But this analysis does not account for the increasing independence of the two performances as training continues or for increases in control by dimensions of a stimulus other than the one used in training. Correlation of stimuli with different densities of reinforcement produces an increase in the behavior necessary to observe them, and greater observing of and attending to the relevant stimuli may account for the increase in control by these stimuli. The observing analysis also encompasses errorless training, and the selective nature of observing explains the feature-positive effect and the relatively shallow gradients of generalization generated by negative discriminative stimuli. The effectiveness of the observing analysis in handling these special cases adds to the converging lines of evidence supporting its integrative power and thus its validity.     

Temporal proximity and reinforcement sensitivity in multiple schedules

Distributions of reinforcers between two components of multiple variable-interval schedules were varied over a number of conditions. Sensitivity to reinforcement, measured by the exponent of the power function relating ratios of responses in the two components to ratios of reinforcers obtained in the components, did not differ between conditions with 15-s or 60-s component durations. The failure to demonstrate the “short-component effect,” where sensitivity is high for short components, was consistent with reanalysis of previous data. With 60-s components, sensitivity to reinforcement decreased systematically with time since component alternation, and was higher in the first 15-s subinterval of the 60-s component than for the component whose total duration was 15 s. Varying component duration and sampling behavior at different times since component transition may not be equivalent ways of examining the effects of average temporal distance between components.     

Contributions of elicitation to measures of self-control

Pigeons' not pecking or pecking constituted choice between a delayed, large reinforcer and an immediate, small reinforcer (self-control) and at other times between a delayed reinforcer and no reinforcer (omission). Both a tone and a keylight were tested as choice signals, and the delayed reinforcer was either response independent or response dependent. Pigeons pecked during the choice signals on over 95% of the trials in the self-control procedure, and pecked during the choice signals on over 75% of the trials in the omission procedure. Consistent pecking was observed with either the tone or the keylight as a choice signal, with the exception that a tone paired with a response-independent delayed reinforcer did not maintain pecking in the omission procedure. Pigeons pecked during more choice signals when delayed reinforcers were response dependent than when the delayed reinforcers were response independent. These results indicate that Pavlovian conditioning influences self-control experiments, especially in single-key procedures.     

USE OF ESCAPE AND REWARD IN THE MANAGEMENT OF YOUNG CHILDREN DURING DENTAL TREATMENT

A reinforced practice procedure was used to facilitate cooperative behavior in five children, aged 3 to 6 years, during dental treatment. In a multiple baseline design across subjects, the children were rewarded with escape, inexpensive stickers, and praise for cooperative behavior in the presence of the sights, sounds, and some sensations of the dental instruments prior to actual dental treatment. Direct observations of disruptive behavior via a 15-s interval recording system indicated baseline levels as high as 90% were reduced to less than 15% by the final treatment visit. In addition, the procedure was effective in reducing overall heart rate and blood pressure reactivity to dental treatment. All children were rated by the involved dental professionals as more cooperative and relaxed following exposure to reinforced practice.     

CORRESPONDENCE TRAINING: AN EXAMPLE OF RULE-GOVERNED BEHAVIOR?

Two groups of six mentally retarded adults were exposed to either a “say/do” correspondence training program or a “do only” reinforcement procedure to evaluate the suggestion of Rogers-Warren and Baer (1976) that reinforcement of the nonverbal target behavior in the absence of the relevant verbal behavior may account for the behavior changes seen in correspondence training. The participants worked in an experimental setting on a variety of manipulatory responses leading to various auditory and visual consequences. Analysis of individual patterns of responding indicated no apparent differences between the groups during training; four individuals in each group appeared to develop generalized correspondence skills. We conclude that the outcome of correspondence training may not necessarily be verbal regulation of behavior as is assumed. Rather, we suggest that the notion of rule-governed behavior can best account for the type of behavior changes seen in correspondence studies.     

SOCIAL INFLUENCES ON “SELF-STIMULATORY” BEHAVIOR: ANALYSIS AND TREATMENT APPLICATION

We tested the hypothesis that the “self-stimulatory” behaviors exhibited by some individuals may be socially mediated. Four developmentally disabled children who exhibited hand flapping and body rocking participated in a series of three experiments conducted to assess the influence of social variables on stereotyped behavior and to develop a treatment based on the assessment. Experiment 1 used an assessment procedure to determine the relative influences of social attention and task demands on stereotyped behavior. For all four children, hand flapping and body rocking increased when difficult academic tasks were introduced. Experiment 2 involved the use of a procedural time-out and demonstrated that removing task demands contingent on stereotyped behavior resulted in increased rates of hand flapping and body rocking. In Experiment 3, these results were used to develop a communication treatment that consisted of teaching the children to request assistance on the difficult tasks. This treatment resulted in significant reductions in self-stimulatory behavior. These results are consistent with the hypothesis that some forms of repetitive stereotyped behavior may come to serve social functions (e.g., escape from aversive situations). Teaching a functionally equivalent communicative alternative to escape-motivated stereotyped behavior can be an effective form of intervention for this problem.