Development of a complex multiple schedule in the chimpanzee

The development of chimpanzee behavior on a four-component, three-lever multiple schedule is described. Component schedules included the Sidman avoidance procedure with a concurrent discriminated avoidance schedule on a second lever, fixed ratio performance for food, differential reinforcement of low rate for water requiring a dual response chain, and a symbol discrimination task for continuous food reinforcement using three levers. The avoidance component of this schedule was employed during the January 31, 1961 suborbital space flight of the chimpanzee “Ham.” On November 29, 1961, the chimpanzee “Enos” performed on the multiple schedule during three orbits around the earth in a Mercury capsule.     

Avoidance of risk as a determinant of cooperation

Pairs of subjects could either cooperate or respond on a lower paying individual task. Whenever both subjects chose to cooperate, either subject could make a response that took $1.00 of the other's earnings. In Exp. I, a stimulus signalled when a “take” response had been made. Either subject could avoid the loss by switching to the individual task within 5 sec after the stimulus appeared. Rates of cooperation were high when losses could be avoided but decreased again when the avoidance condition was removed. In Exp. II, a response prevented “takes” from occurring for a specified time interval after the response. This procedure also maintained cooperation. When each avoidance response subtracted from earnings, both avoidance responding and cooperation were eliminated.     

A SIMULTANEOUS DISCRIMINATION PROCEDURE FOR THE MEASUREMENT OF VISION IN NONVERBAL CHILDREN1

Few nonverbal developmentally disabled children ever receive adequate vision assessment because of their limited language skills. The present study details a simultaneous discrimination procedure for measuring subjective visual acuity in such children. A stimulus fading procedure was used to train a discrimination between Snellen Es differing in orientation, and a psychophysical tracking method was used to determine acuity thresholds. The procedure was tested with 11 nonverbal autistic and schizophrenic children and validated with four nonpsychotic children. Eight of the psychotic children were successfully examined in one to three sessions. Two of these children were identified as having significant acuity losses. The validity assessment showed that the experimental procedure resulted in thresholds equal to or slightly lower than those obtained with the Illiterate E chart.     

Timing in free-operant and discrete-trial avoidance

A procedure (“discrete-trial” avoidance) was devised to differentiate between the two main theories of responding in Sidman's “free-operant” avoidance procedure. One theory, a version of two-factor theory, holds that responding is reinforced by the removal of a conditioned aversive stimulus. The conditioned aversive stimulus is held to be temporal, which accounts for the spaced responding, or timing, that Sidman's procedure produces. The other theory holds that the reinforcement for both responding and timing is shock-frequency reduction. The new procedure eliminated this reinforcement for timing, but retained the conditions for the formation of conditioned aversive temporal stimuli. According to one theory, the new procedure should have sustained timing as well as Sidman's, while according to the other, it should have sustained no timing. The results confirmed neither theory. Timing was found with both procedures, but unequally in degree and kind. Large variations in the precision of timing did not appear to be correlated with successful avoidance for either procedure.     

Selective attention: the effects of combining stimuli which control incompatible behavior

Four rhesus monkeys learned both a color and tilt discrimination. The stimuli were combined to produce incompatible behavior. The behavior controlled by one set of stimuli was reinforced until “errors” virtually disappeared. The stimuli were tested separately again. Sixteen replications of the entire procedure indicated that the stimuli producing “errors” were ignored.     

Free-operant avoidance conditioning in individual and paired human subjects

Male, medical and graduate students were subjected to a non-discriminated avoidance regimen with shock-shock and response-shock intervals of 10 sec. Using a yoked-chair procedure it was found that acquisition of the button-pressing avoidance response was influenced by the social environment in which the conditioning occurred. There was a significantly greater number of “learners” among subjects conditioned individually than among those exposed to the conditioning procedures in the presence of a second person.     

Perfect visual short-term memory for periodic patterns

Abstract

The short-term memory for spatial frequency information was assessed by measuring the spatial frequency discrimination thresholds for briefly flashed luminance gratings as a function of the time interval between the test and reference gratings, using a computer-controlled two-interval forced-choice procedure. Discrimination thresholds were stable for interstimulus intervals in the range 1–30 sec under all conditions tested. At low contrasts, short exposure times and low spatial frequencies discrimination thresholds increased, but no interactions between stimulus parameters affecting thresholds and interstimulus interval were observed. It is concluded that factors limiting spatial discrimination are associated with the sensory coding stage. Spatial discrimination and visual memory may be based on a common representation, which is perfectly retained in short-term memory. Visual half-field tests revealed no hemispheric differences in the processing and retention of spatial frequency information.     

The evaluation and control of acoustical standing waves

Calibration of a standard pigeon box subsequently modified for use as an acoustical chamber in a frequency discrimination experiment revealed that the enclosure was not acoustically “flat”. Standing waves were detected at each of the six frequencies measured. To ascertain whether the maximum standing waves recorded (3.0 dB) could serve as an added or alternative cue for pigeons tested in the chamber on a frequency discrimination problem, pure-tone intensity difference thresholds were determined for two pigeons at 1.0, 2.0, and 3.0 KHz. The results of the experiment indicated that the smallest intensity difference detectable was 10.0 dB, a value that was 7.0 dB above the maximum standing wave measured in the box. These data suggest that the modified pigeon chamber is suitable to test pure-tone frequency discriminations in pigeons in the range of 1.0 to 3.0 KHz.     

Duration-reduction of avoidance sessions as negative reinforcement

Five rats were exposed to a shock-postponement procedure in which responses on each of two levers initially had equivalent effects. After an initial training sequence that ensured at least some responding on each lever, an additional consequence was made conjointly operative on the previously less-preferred lever for each animal. Each response on this lever continued to postpone shock, but also reduced the session duration by one minute. The conjoint contingencies were operative until, through session-shortening responses and the passage of time, the session was scheduled to end in two minutes; during the final two minutes the session-shortening contingency was disabled while the shock-postponement contingency continued to be operative on both levers. When responding shifted to a predominance on the session-shortening lever, the conjoint contingency was shifted to the other lever; for four of the five rats this reversal was followed by two additional reversals. Two of the rats' responding showed clear, strong, and unambiguous sensitivity to the session-shortening contingency. The responding of two others was also systematically controlled by that contingency, but the effects were less clearcut. The fifth animal showed an initial shift when session-shortening was introduced, but its subsequent behavior proved insensitive to reversals of procedure. The results clearly indicate a sensitivity of behavior to events on a time scale quite distinct from that of immediate consequences. They also support an interpretation of avoidance sessions, considered in their entirety, as events whose contingent relationship to behavior can affect that behavior—even in the absence of stimuli that delineate those relationships. Finally, these results support an interpretation of aversively based conditioning within a broader context, analogous to the “open versus closed economy” interpretation of appetitively controlled behavior.     

Programming stimuli in matching to sample

In these investigations, a “teaching machine” was used to train pre-school and first-grade children in a series of progressively difficult discrimination tasks, leading up to matching to sample. Such training was much more efficient than training in the final discrimination alone. The errors the subjects made were found to be a functon both of the differences between consecutive discriminations (the “size of the steps” in the program) and the length of training on each discrimination. Theoretical and practical implications of these findings are discussed.     

Immobility as an avoidance response, and its disruption by drugs

Much of the available literature on avoidance behavior is based on responses which require the animal to run, lever-press, or to make some active response to avoid noxious stimulation. The purpose of Experiment I reported in this paper was to determine whether animals can learn to sit or stand motionless in order to escape or avoid electric shock. Five experimental rats were given escape-avoidance training, while five yoked control animals received electric shocks without any response-related contingency. It was shown that an immobility avoidance response, as distinct from the unconditioned “freezing” response to shock, can be trained. The results of Experiment II (30 rats) revealed that this response is more readily acquired at higher shock intensities than at lower ones, provided escape by jumping is prevented at the high shock intensities. The effects of six doses of each of three drugs on the immobility avoidance response were studied in Experiment III (13 rats). Methylphenidate, chlorpromazine, and imipramine all produced a decrement in the immobility response, but the pattern and amount of the effects of the three drugs were quite different, one from the other. The implications of these findings for a general theory of avoidance behavior and for drug screening are discussed.     

Stimulus-specific contrast effects during operant discrimination learning

In two experiments, pigeons' responding was equally reinforced in the presence of four line-orientation stimuli. Responding was then reinforced when only two of the four orientation stimuli were present; the remaining two orientations appeared during extinction. Response rates were often highest in the stimulus adjacent to the orientations presented during extinction and often lowest in that orientation adjacent to the orientations presented with reinforcement. These effects were stronger and more persistent when the stimuli were separated by a smaller angle, rendering the discrimination more difficult. These and other data suggest that discrimination training may not be accurately explained in terms of the simple effects of reinforcement and nonreinforcement associated with isolated stimuli, nor by accounts that depend upon stimulus generalization. Recent accounts of contrast that depend upon “emotionality” produced by nonreinforced responding or upon reinforcement-elicited responses are also difficult to apply to these data.     

Preference for signaled over unsignaled shock schedules: Ruling out asymmetry and response fixation as factors

Experiment 1 tested whether a “symmetrical” choice procedure yields results different from those previously reported using the “unidirectional” standard changeover procedure (e.g., Badia & Culbertson, 1972). Subjects could change at any time from unsignaled to signaled shock by pressing a lever and from signaled to unsignaled shock by pressing a second lever. Results were identical to those of the standard procedure and showed that the standard procedure is fully adequate. Experiment 2 tested whether choice of high density signaled shock over low-density unsignaled shock (Badia, Coker, & Harsh, 1973) resulted from initial training with equal-density schedules. Subjects were trained and tested with signaled shock twice as dense as unsignaled shock. Three of four subjects strongly preferred the signaled condition, thus ruling out carry-over and “response fixation” as alternative explanations.     

AN OPERANT TRACKING PROCEDURE IN THE AUDITORY ASSESSMENT OF PROFOUNDLY RETARDED INDIVIDUALS

The present study investigated a discrete-trials, operant tracking and a descending-series procedure for the determination of hearing levels with profoundly retarded individuals. These individuals were previously diagnosed as untestable. Following stimulus-control training with errorless discrimination procedures, hearing levels for each individual were examined with both procedures. For P-1 and P-2, the operant tracking procedure was administered following a descending-series procedure. Both were observed to “track” their own hearing levels. For P-3, the operant tracking procedure was administered first, followed by the descending-series procedure. Although P-3 also “tracked” her own hearing level, more variable responding was observed. Nonetheless, the operant tracking procedure proved quite workable and may provide for improved hearing testing with “difficult-to-test” individuals.     

Recognition by the pigeon of stimuli varying in two dimensions

Pigeons served in four experiments, each of which involved about 44,000 discrete 1.2-sec trials under steady-state conditions. The first experiment scaled a short segment of the visual wavelength continuum; this dimension was then combined in a conditional discrimination with each of three others; time after reinforcement, tone frequency, and line tilt. In the two-stimulus experiments, the birds' responses were reinforced in the presence of only one stimulus combination: “582 nm” together with “2 min after reinforcement”, “3990 Hz”, or “vertical line”. Many other stimulus combinations also appeared equally often and went without reinforcement. The wavelength stimuli conformed to an equal-interval scale, and per cent response was generally linear with wavelength, when scaled on cumulative normal coordinates. The components of the compound stimulus were found to interact in a multiplicative fashion; when one component differed greatly from its reinforcement value, changes in the other component had relatively little effect. For the “time”-“wavelength” compound, this interaction appeared to be modified by the effects of set or attention. Certain response latency data are reported, and other combination rules are discussed.     

Reinforcement duration and the peak shift in post-discrimination gradients

Pigeons were trained to key-peck for food, first with single-stimulus training and then with successive discrimination (multiple schedule) training. In the multiple schedule, two different wavelengths were each correlated with equally frequent variable-interval reinforcement but different durations (6 sec vs. 2 sec) of access to grain. For some birds, the different durations of feeding cycle were cued by different intensities of the food hopper light. For some of these “cued” birds, single-stimulus training had been carried out with 6-sec feedings and when multiple-schedule training was introduced, the novel stimulus was correlated with 2-sec feedings. For the others, 2-sec feedings were originally used, and the novel stimulus was then present during the 6-sec reinforcement duration. The cueing procedure enhanced discrimination performance, and was necessary for the consistent production of a peak shift. In addition, the condition in which original training had been carried out with 6-sec feedings, and thus reinforcement duration was reduced in the presence of the novel stimulus, led to the best performance.     

Inhibitory control and errorless discrimination learning

Pigeons learned to discriminate between a positive stimulus (white key) and a negative stimulus (red or green key, depending on the subject) via Terrace's fading procedure. Generalization tests, conducted with intermittent reinforcement for key pecking at various wavelengths, yielded minima at the value of the negative stimulus in most “errorless” birds. Terrace's contrary finding of flat gradients in errorless subjects probably resulted from a floor-effect (i.e., virtually zero responding) produced by his extinction-test procedure. The present and other findings do not support Terrace's conclusions that the negative stimulus of an errorless discrimination is behaviorally neutral; inhibition apparently develops to the nonreinforced stimulus even during errorless discrimination learning. A negative correlation between stimulus and reinforcer seems the crucial factor in producing an inhibitory stimulus.     

Effects of chlorpromazine and d-amphetamine on escape and avoidance behavior under a temporally defined schedule of negative reinforcement

Chlorpromazine hydrochloride and d-amphetamine sulphate were administered to two rats responding on a baseline temporally defined schedule of negative reinforcement which produced both “escape-like” and “avoidance-like” behavior. The effects of these drugs appeared similar to those expected on the more customary sort of non-cued avoidance schedule.     

Deficits in visual learning produced by posterior temporal lesions in cats

Eight cats with lesions in the posterior temporal (PT) cortex, seven cats with lesions in the basolateral amygdala (BLA), and eight intact controls were observed on eight tests of visual discrimination learning and of spontaneous responses to salient visual stimuli. The effects of the two lesions were somewhat dissociable. The PT lesions were accompanied by a severe deficit in pattern discrimination learning but no loss in visual tracking or orientation to the silhouette of a threatening cat. The BLA lesions produced a milder and less consistent loss in pattern discrimination but serious defects in tracking and reponse to the cat silhouette. Both operated groups performed well on the visual cliff. The deficit from PT lesions appeared independent of damage to the geniculocortical system. The parallel of symptoms from PT lesions in cats and inferotemporal lesions in monkeys is discussed.     

The effect of overtraining on behavioral contrast and the peak-shift

Following initial discrimination training between two wavelength stimuli and a subsequent generalization test to the wavelength dimension, Group 1 was “overtrained” for 105 days on the original discrimination. Group 2 was “overtrained” with the original positive stimulus and a new negative stimulus, a white line. Group 3 was “overtrained” with the original negative stimulus and a new positive stimulus, the white line. Each 15 days of extended training were followed by a wavelength generalization test similar to the first test. The results suggest that there is no consistent relationship between the response rate in positive stimulus immediately before the generalization test and whether or not a peak shift occurs during the test.