Effects of relative reinforcer frequency on complex color detection

Pigeons were trained under a discrete-trials detection procedure in which one of a set of color stimuli was presented on the center key and a single response turned off the stimulus and illuminated two side keys. Single responses to one or the other side key produced occasional reinforcers depending on the value of the color stimulus. In Experiment 1, one color-stimulus set comprised 559, 564, 569, and 574 nm, and right-key pecks were occasionally reinforced following presentations of members of this set. The other stimulus set comprised 579, 584, 589, and 594 nm, and left-key pecks were occasionally reinforced following presentations of members of this set. Across seven experimental conditions, the left/(left + right) relative reinforcer frequency was varied from .1 to .9. In Experiment 2, one stimulus set contained only one member, 574 nm, and right-key responses were occasionally reinforced following its presentation. Over 12 experimental conditions, two manipulations were carried out. First, the number of stimuli comprising the other stimulus set was increased from one (579 nm) to two (579 and 584 nm) to three (579, 584, and 589 nm) and to four (579, 584, 589, and 594 nm), and left-key responses were reinforced occasionally following center-key presentations of members of this set. Second, for each stimulus combination, the left/(left + right) relative reinforcer frequency was varied from .1 to .5 to .9 across three experimental conditions. The principal finding of Experiments 1 and 2 was that reinforcers and stimuli interacted in their effects on behavior. In Experiment 3, pairs of adjacent stimuli (5 nm apart) in the range 559 to 594 nm were presented in each experimental condition, and the left/(left + right) relative reinforcer frequency was held constant at .5. The data from all three experiments were analyzed according to a detection model describing performance in multiple-stimulus two-response procedures. This model provided independent measures of stimulus discriminability, contingency discriminability, and bias. The analysis showed that (a) consistent with the color-naming function, pigeons were better able to discriminate between higher nanometer values than lower nanometer values; (b) their ability to discriminate between the stimuli was independent of the number of wavelengths comprising each stimulus set; (c) they allocated delivered reinforcers very accurately to the previously emitted response; and (d) no consistent biases emerged.     

Visually guided catching and tracking skills in pigeons: A preliminary analysis

Research on reaching, tracking, and catching in the pigeon has been hampered by limitations of technology. A new system was developed in which the target was a small rectangle presented on a video display terminal and the pecking response was detected with touch technology. The target moved up and down vertically with sinusoidal velocity. A coincidence between the location of the pigeon's beak and the cursor produced reinforcement. The pigeon pecked ahead and behind the target, but most pecks occurred behind the target so the dominant tracking strategy was lagging. The pigeon was adept at “catching” the target at many locations throughout the trajectory. Transfer of motor learning was tested on probe trials during which the trajectory changed from vertical to horizontal. On transfer trials the pigeons' dominant pattern of pecking immediately shifted from vertical to horizontal. The motor skill displayed by the pigeons was flexible and adaptive, suggesting that the pigeons had learned to track the cursor.     

Connectionist models of conditioning: A tutorial

Models containing networks of neuron-like units have become increasingly prominent in the study of both cognitive psychology and artificial intelligence. This article describes the basic features of connectionist models and provides an illustrative application to compound-stimulus effects in respondent conditioning. Connectionist models designed specifically for operant conditioning are not yet widely available, but some current learning algorithms for machine learning indicate that such models are feasible. Conversely, designers for machine learning appear to have recognized the value of behavioral principles in producing adaptive behavior in their creations.     

CO-WORKER IMPLEMENTED JOB TRAINING: THE USE OF COINCIDENTAL TRAINING AND QUALITY-CONTROL CHECKING ON THE FOOD PREPARATION SKILLS OF TRAINEES WITH MENTAL RETARDATION

In two studies, co-workers of persons with disabilities were taught to use coincidental training procedures while completing their own jobs. In Study 1, the effects of coincidental training on the salad-making skills of 3 trainees with mild and moderate mental retardation were evaluated. Coincidental training by co-workers resulted in improved accuracy of the salad-making skills of the trainees. In Study 2, trainees were also coincidentally taught to make quality-control checks of their salads. An alternating treatments and multiple baseline design indicated that the trainees more readily acquired the skills when taught to check the correctness of their work.     

The role of observing and attention in establishing stimulus control.

Early theorists (Skinner, Spence) interpreted discrimination learning in terms of the strengthening of the response to one stimulus and its weakening to the other. But this analysis does not account for the increasing independence of the two performances as training continues or for increases in control by dimensions of a stimulus other than the one used in training. Correlation of stimuli with different densities of reinforcement produces an increase in the behavior necessary to observe them, and greater observing of and attending to the relevant stimuli may account for the increase in control by these stimuli. The observing analysis also encompasses errorless training, and the selective nature of observing explains the feature-positive effect and the relatively shallow gradients of generalization generated by negative discriminative stimuli. The effectiveness of the observing analysis in handling these special cases adds to the converging lines of evidence supporting its integrative power and thus its validity.     

Contributions of elicitation to measures of self-control

Pigeons' not pecking or pecking constituted choice between a delayed, large reinforcer and an immediate, small reinforcer (self-control) and at other times between a delayed reinforcer and no reinforcer (omission). Both a tone and a keylight were tested as choice signals, and the delayed reinforcer was either response independent or response dependent. Pigeons pecked during the choice signals on over 95% of the trials in the self-control procedure, and pecked during the choice signals on over 75% of the trials in the omission procedure. Consistent pecking was observed with either the tone or the keylight as a choice signal, with the exception that a tone paired with a response-independent delayed reinforcer did not maintain pecking in the omission procedure. Pigeons pecked during more choice signals when delayed reinforcers were response dependent than when the delayed reinforcers were response independent. These results indicate that Pavlovian conditioning influences self-control experiments, especially in single-key procedures.     

CORRESPONDENCE TRAINING: AN EXAMPLE OF RULE-GOVERNED BEHAVIOR?

Two groups of six mentally retarded adults were exposed to either a “say/do” correspondence training program or a “do only” reinforcement procedure to evaluate the suggestion of Rogers-Warren and Baer (1976) that reinforcement of the nonverbal target behavior in the absence of the relevant verbal behavior may account for the behavior changes seen in correspondence training. The participants worked in an experimental setting on a variety of manipulatory responses leading to various auditory and visual consequences. Analysis of individual patterns of responding indicated no apparent differences between the groups during training; four individuals in each group appeared to develop generalized correspondence skills. We conclude that the outcome of correspondence training may not necessarily be verbal regulation of behavior as is assumed. Rather, we suggest that the notion of rule-governed behavior can best account for the type of behavior changes seen in correspondence studies.     

Multifactor measurement of bodily feelings: Conceptual development,scale construction,and empirical validation

A series of studies is described demonstrating a coherent exploratory and confirmatory factor-analytic approach to the scaling of self-reported bodily feelings. This approach attempts to optimize the orthogonality, parsimony, and meaningfulness of a multifactor inventory. Psychometric properties of the resulting 35-item Bodily Feeling Scale (BFS) are presented and its comparability with other inventories is discussed. A validity study using item-content-based scales of the Minnesota Multiphasic Personality Inventory showed both concurrent and discriminative validity of the BFS. Implications for clinical and research utility are discussed.Portions of this research were conducted while the first author was supported by a University Graduate Fellowship awarded by the Graduate School of Arts and Sciences at Vanderbilt University.Professor Nunnally passed away in August 1982. His major contributions to the several stages of this research program are recognized through coauthorship.     

The interaction of stimulus and reinforcer control in complex temporal discrimination.

Six pigeons were trained in a discrete-trials signal-detection procedure to discriminate between a fixed-duration stimulus (5 s or 20 s) and a set of variable durations ranging from 2.5 s to 57.5 s in steps of 5 s. For each fixed-duration stimulus, the ratio of reinforcer frequencies contingent upon reporting the fixed versus the variable stimulus was systematically manipulated. Detection performance was well controlled by both the stimulus value and the reinforcer ratio. Both the discriminability between the fixed duration and the set of variable durations, and the discriminability between the fixed duration and each of the variable durations, were independent of the reinforcer-frequency ratio when discriminability was measured as log d. The sensitivity of response bias to reinforcement-ratio changes was independent of the value of the fixed duration, but was not independent of the discriminability of the variable durations from the fixed durations. Under current models, discriminability measures in complex temporal discrimination may be independent of biasing manipulations, but bias measures are not independent of stimulus values.     

Control of responding during stimuli that precede transitions in reinforcement frequency

Pigeons' responses were reinforced on a variant of a mixed variable-interval extinction schedule of reinforcement in which the transition to the higher reinforcement rate was signaled by a trace stimulus projected on the response key prior to the onset of the component correlated with food delivery. In the first of two experiments, the duration of the trace stimulus preceding the component correlated with food delivery was varied from 1.5 to 50.0 s and in the second experiment, the reinforcement frequency in the same component was varied from 10 to 60 reinforcers per hour. Pigeons pecked at the trace stimulus preceding the onset of the component correlated with food delivery even though responding was not reinforced in its presence and only one of the changes in reinforcement rate (i.e., from extinction to reinforcement) was signaled. The rate of pecking during the trace stimulus was a function of its duration but not of the reinforcement frequency in the following component. Higher rates generally occurred at the shorter trace-stimulus durations. Component responding following the offset of the trace stimulus was under discriminative control of the trace stimulus whether or not responding occurred in the presence of the trace stimulus.