Formation of the sameness-difference concept by Japanese monkeys from a small number of color stimuli

Japanese monkeys were trained to form the sameness-difference concept. In Experiment 1, four monkeys were trained with two colors to discriminate matching stimulus pairs from nonmatching pairs by reinforcing only lever-pressing responses to matching pairs with a variable-interval schedule. Three monkeys showed successful transfer of this discrimination to two new colors, thus demonstrating that some Japanese monkeys are able to form this relational concept from a minimum number of stimuli. In Experiment 2, two monkeys were trained, in a Yes/No procedure with three colors, to press one lever under matching pairs and another lever under nonmatching pairs. Poor transfer performances to three new colors suggest that simultaneously establishing two different response patterns to matching and nonmatching pairs is ineffective in forming the concept. In Experiment 3, the amount of transfer to three new colors after mastering a standard three-color matching-to-sample task was compared with that of a modified task in which correct responses were reinforced with a within-trial variable-interval schedule. All three monkeys showed greater transfer with the modified procedure. The results suggest that the variable-interval schedule adopted within trials is effective in forming the sameness-difference concept.     

Auditory stimulus control in pigeons: Jenkins and Harrison (1960) revisited

Pigeons were trained to peck a key in the presence of a 1000-Hz tone on a variable-interval one-minute schedule of reinforcement. One group was trained with an illuminated key; the other was trained in a totally dark chamber. During a generalization test on tonal frequency, subjects trained and tested with the key illuminated produced rather shallow gradients around the training value; subjects trained and tested in the dark produced steeper generalization gradients. These data replicate Jenkins and Harrison's (1960) finding that tone acquires relatively little control over responding and demonstrate that this absence of control is a function of the presence of the keylight.     

Stimulus generalization from feeder to response key in the acquisition of autoshaped pecking

During autoshaping, a 6-second presentation of one stimulus and a variable time 30-second presentation of a second stimulus alternated in appearance on a pigeon key. Grain always was delivered for 3 seconds at the end of the first stimulus interval. In the first experiment, autoshaped pecking of the stimulus preceding grain delivery began much sooner when that stimulus was a black vertical line on a white background and the other stimulus was green than when the opposite stimulus arrangement was used. Because these two stimuli differed in form, hue, brightness, and similarity in hue and brightness to the illumination of the raised feeder, three subsequent experiments examined whether the differential speed of autoshaping in the two groups was due to a feature-positive, feature-negative effect, a preference for brighter over darker stimuli, a simple preference for white over green, or stimulus generalization from the brightness or hue of the illuminated, raised feeder to the stimulus on the key preceding grain delivery. The data from these experiments showed that the first autoshaped key peck was most likely to be made to the stimulus of the same hue as that illuminating the feeder, regardless of whether that stimulus was positively or negatively associated with grain delivery. At least under some conditions, therefore, stimulus-generalization mediated response transfer of pecking grain in the presence of the hue illuminating the feeder to pecking the key illuminated by a similar hue appears to account for the occurrence of autoshaped key pecking.     

Time limits for completing fixed ratios. IV. Components of the ratio

Pigeons received food after completing a fixed ratio if the temporal properties of responding exceeded minimum duration requirements. In one set of conditions, a minimum time had to elapse before the first response of the ratio (the initial pause). In another set, the minimum duration was the time between the first and last response of the ratio. Obtained times increased as a power function of required times in both conditions. The power function resembled that occurring in experiments involving temporal differentiation of individual responses, interresponse times, latencies, and entire fixed-ratio sequences. Moreover, in all of these experiments individual performances could be described as a function of the base duration (the duration occurring in the absence of temporal requirements) and the specific time requirement. Control conditions indicated that the effects resulted from temporal requirements and not from reinforcer intermittency.     

Selective punishment early and late in fixed-ratio schedules of food reinforcement

Pigeons key pecked for grain on a fixed-ratio 100 schedule; electric shocks occurred intermittently at the fifteenth or eighty-fifth response in the ratio. In Experiment I, shock was at the fifteenth response for two birds, and at the eighty-fifth response for two others, in every sixth, twelfth, or eighteenth ratio. Rate of responding decreased as frequency of shock increased, and the pattern of responding included an increased initial pause and low rates or pause-run sequences that extended further into the ratio when shock was at the fifteenth response than when it was at the eighty-fifth response. Shock early in the ratio engendered longer initial pauses than shock late in the ratio. In Experiment II, four birds responded on a two-component multiple schedule in which shock occurred at the fifteenth response of the third ratio in the presence of a white keylight and at the eighty-fifth response of the third ratio in the presence of a green keylight. The overall rates of responding decreased as shock intensity increased. All four birds responded differentially to the white and green keylights, but with a pattern that varied between birds. In general, punishment reduced the probability of responses that preceded it, regardless of the ordinal position of those responses. Both studies confirm that the probability of responding is reduced less by aversive stimuli produced late in a fixed-ratio than by aversive stimuli produced early in a fixed-ratio.     

Response summation to a compound stimulus in a context of choice

Key pecks by two groups of pigeons were reinforced on concurrent schedules. For group Ē, pecks were reinforced during either a visual or an auditory stimulus; for group E, an additional, extinction component was available, during which both visual and auditory stimuli were absent. After training, both groups were given a compound test to measure preference among four stimuli, the three used in training plus a compound of the visual and auditory stimulus. Group E showed preference for the compound, emitting more pecks and spending more time in this stimulus than in other stimuli. Group Ē showed no preference between the compound and visual stimulus, nor between the auditory stimulus and the absence of both stimuli, but preferred the former pair over the latter pair of stimuli.     

Dependency, temporal contiguity, and response-independent reinforcement

A comparison was made of the effects of variable-interval, variable-time, and tandem variable-interval fixed-time schedules on key-peck responding of pigeons. The variable-interval component of the tandem schedule retained the response-reinforcement dependency; the fixed-time component allowed the temporal proximity between responding and reinforcement to vary, constrained only by the duration of the fixed-time interval. Response rates were highest during the variable-interval and lowest during the variable-time schedule. Intermediate response rates occurred during the tandem schedule. The results of a yoked control condition showed that the effects of the tandem schedule were not due simply to changes in reinforcement distribution or frequency. The results suggest that substantial reductions in responding occur when reinforcement is response-dependent but not necessarily contiguous with the response required to produce reinforcement.     

Line-orientation generalization following signalled-reinforcer training

Three naive and three nonnaive pigeons key pecked for food on a multiple variable-interval 1-minute variable-interval 1-minute schedule with a black zero-degree vertical line on a white surround associated with one component and a black line shifted 30 degrees to the right (+30 degree) associated with the other component. Subsequently, a signalled-reinforcer procedure was introduced in the +30 degree component, i.e., whenever the reinforcer was available for the next response, the key changed to blank white. Following this training, the original unsignalled-reinforcer condition was re-instated. Line orientation generalization tests were given at the end of signalled-reinforcer training and after the second unsignalled-reinforcer condition. The signalled-reinforcer procedure reduced response rate in the +30-degree component in all subjects but facilitated responding during the zero-degree component (behavioral contrast) for two of the naive subjects only. However, average generalization gradients following signalled-reinforcer training indicated peak shift in two subjects and area shift in all five subjects that completed the experiment. There was no apparent relation between contrast and peak shift or degree of area shift. The data were interpreted as supporting the notion that the signalled-reinforcer procedure segments a variable-interval schedule into extinction and fixed ratio 1 segments.     

Response Stereotypy in Humans Maintained by Response-Contingent Events

The present study examined stereotyped behaviors developed during human performances that were generated by response-dependent intermittent schedules of reinforcement. Thirty university students were assigned to either fixed-interval 30-s or fixed-ratio 30-s schedules in which points or monetary reinforcers were produced only by presses on the number keys of a 41-key computer keyboard. Behavior patterns developed by all subjects were classified into four categories: optimal, random, unique, and general stereotypes. The general stereotypes category was further subdivided into five idiosyncratic types: connection, order, shift, repeat, and restriction. Analysis of the data demonstrated the role of contiguity: Whatever behavior happened to precede reinforcers was repeated even though reinforcers did not depend on that behavior. These findings support the argument that much of idiosyncratic and stereotyped human behavior is produced and maintained by contingencies of reinforcement, rather than schedule-induced or adjunctive behavior.     

Residence time in concurrent foraging with fixed times to prey arrival

Five pigeons were trained in a concurrent foraging procedure in which reinforcers were occasionally available after fixed times in two discriminated patches. In Part 1 of the experiment, the fixed times summed to 10 s, and were individually varied between 1 and 9 s over five conditions, with the probability of a reinforcer being delivered at the fixed times always .5. In Part 2, both fixed times were 5 s, and the probabilities of food delivery were varied over conditions, always summing to 1.0. In Parts 3 and 4, one fixed time was kept constant (Part 3, 3 s; Part 4, 7 s) while the other fixed time was varied from 1 s to 15 s. Median residence times in both patches increased with increases in the food-arrival times in either patch, but increased considerably more strongly in the patch in which the arrival time was increased. However, when arrival times were very different in the two patches, residence time in the longer arrival-time patch often decreased. Patch residence also increased with increasing probability of reinforcement, but again tended to fall when one probability was much larger than the other. A detailed analysis of residence times showed that these comprised two distributions, one around a shorter mode that remained constant with changes in arrival times, and one around a longer mode that monotonically increased with increasing arrival time. The frequency of shorter residence times appeared to be controlled by the probability of, and arrival time of, reinforcers in the alternative patch. The frequency of longer residence times was controlled directly by the arrival time of reinforcers in a patch, but not by the probability of reinforcers in a patch. The environmental variables that control both staying in a patch and exiting from a patch need to be understood in the study both of timing processes and of foraging.