Fixed-interval punishment

The average rate of bar-pressing maintained by a variable-interval schedule of milk reinforcement in 33 rats was found to be a decreasing function of intensity of concurrent punishment and, over a wide range of shock intensities, was inversely related to punishment frequency. Cumulative records were, however, negatively accelerated during 30-min punishment sessions with complete suppression occurring earlier and earlier (after fewer and fewer shocks) as intensity increased. In addition, acceleration was often observed between successive fixed-interval shock presentations and, at low and moderate intensities, bursts of responding occurred after each shock. The time to recover between punishment sessions (post-punishment recovery) was an increasing monotonic function of punishment intensity.     

Reflections on stimulus control

The topic of stimulus control is too broad and complex to be traceable here. It would probably take a two-semester course to cover just the highlights of that field's evolution. The more restricted topic of equivalence relations has itself become so broad that even an introductory summary requires more time than we have available. An examination of relations between equivalence and the more general topic of stimulus control, however, may reveal characteristics of both the larger and the more limited field that have not been generally discussed. Consideration of these features may in turn foster future developments within each area. I speak, of course, about aspects of stimulus control that my own experiences have made salient to me; others would surely emphasize different characteristics of the field. It is my hope that cooperative interactions among researchers and theorists who approach stimulus control from different directions will become more common than is currently typical.     

Fixed-interval work habits of Congress

The rate at which Congress passes bills during its legislative session exhibits a fixed-interval pattern: the rate of passage is extremely low three to four months after commencement followed by a positively accelerated growth rate that continues until the time of adjournment. This scalloped configuration appears uniformly in each of the eight Congresses sampled, from 1947 to 1968, and in both sessions of each Congress.     

Fixed-interval behavior maintained by conditioned reinforcement

The key-pecking of a pigeon was reinforced with grain on an 18-min second-order schedule. During the 18 min, a key peck which completed a 3-min fixed interval produced a stimulus of 0.5-sec duration. The first 3-min fixed interval completed after 18 min resulted in primary reinforcement. Behavior characteristic of fixed-interval schedules was produced on both the 3-min components and the 18-min schedule. This performance was shown to be enhanced whenever the 0.5-sec stimulus was also presented before the presentation of grain.     

Fixed-interval punishment of running in hamsters

Four hamsters received brief electric shocks contingent upon running in a wheel. The fixed interval between shocks was varied systematically from 0 to 60 sec. Time spent running was directly related to the length of the fixed interval, while running speed remained roughly constant. Running depended on the fixed interval between shocks in the same way as bar-pressing maintained by food reinforcement, despite the fact that running was not established with nor maintained by explicit reinforcement.     

Sample stimulus control shaping and restricted stimulus control in capuchin monkeys: a methodological note

This paper reports use of sample stimulus control shaping procedures to teach arbitrary matching-to-sample to 2 capuchin monkeys (Cebus apella). The procedures started with identity matching-to-sample. During shaping, stimulus features of the sample were altered gradually, rendering samples and comparisons increasingly physically dissimilar. The objective was to transform identity matching into arbitrary matching (i.e., matching not based on common physical features of the sample and comparison stimuli). Experiment 1 used a two-comparison procedure. The shaping procedure was ultimately effective, but occasional high error rates at certain program steps inspired a follow-up study. Experiment 2 used the same basic approach, but with a three-comparison matching task. During shaping, the monkey performed accurately until the final steps of the program. Subsequent experimentation tested the hypothesis that the decrease in accuracy was due to restricted stimulus control by sample stimulus features that had not yet been changed in the shaping program. Results were consistent with this hypothesis, thus suggesting a new approach that may transform the sample stimulus control shaping procedure from a sometimes useful laboratory tool to a more general approach to teaching the first instance of arbitrary matching performances to participants who show protracted difficulties in learning such performances.     

Fixed-interval behavior: effects of percentage reinforcement

The percentage of fixed intervals terminating with food presentation was varied parametrically. Intervals that did not end with food were terminated by a stimulus uncorrelated with food presentation (a timeout stimulus). In Experiment I, the pigeons' response rates were an inverted U-shaped function of the percentage of food presentations: decreasing the percentage from 100% to 90%, 70%, or 50% produced an increase in response rates; lower percentages decreased the rates. The patterns of responding in the 100% condition differed from those of the other conditions. In Experiment II, the chamber was darkened after food presentations and timeouts. Response rate was directly related to the percentage of food presentations: decreasing the percentage decreased the response rate. Characteristic fixed-interval patterns of responding were maintained as long as there were occasional food presentations; pausing followed by positively-accelerated responding occurred in percentage conditions ranging from 7% to 100%. The ability to maintain fixed-interval performance with percentage reinforcement suggested that the behavioral sequences occurring in each interval may operate as unitary responses.     

Contextual control of stimulus generalization and stimulus equivalence in hierarchical categorization

The purpose of this study was to determine whether hierarchical categorization would result from a combination of contextually controlled conditional discrimination training, stimulus generalization, and stimulus equivalence. First, differential selection responses to a specific stimulus feature were brought under contextual control. This contextual control was hierarchical in that stimuli at the top of the hierarchy all evoked one response, whereas those at the bottom each evoked different responses. The evocative functions of these stimuli generalized in predictable ways along a dimension of physical similarity. Then, these functions were indirectly acquired by a set of nonsense syllables that were related via transitivity relations to the originally trained stimuli. These nonsense syllables effectively served as names for the different stimulus classes within each level of the hierarchy.     

Fixed-interval performance and self-control in children.

Operant responses of 16 children (mean age 6 years and 1 month) were reinforced according to different fixed-interval schedules (with interreinforcer intervals of 20, 30, or 40 s) in which the reinforcers were either 20-s or 40-s presentations of a cartoon. In another procedure, they received training on a self-control paradigm in which both reinforcer delay (0.5 s or 40 s) and reinforcer duration (20 s or 40 s of cartoons) varied, and subjects were offered a choice between various combinations of delay and duration. Individual differences in behavior under the self-control procedure were precisely mirrored by individual differences under the fixed-interval schedule. Children who chose the smaller immediate reinforcer on the self-control procedure (impulsive) produced short postreinforcement pauses and high response rates in the fixed-interval conditions, and both measures changed little with changes in fixed-interval value. Conversely, children who chose the larger delayed reinforcer in the self-control condition (the self-controlled subjects) exhibited lower response rates and long postreinforcement pauses, which changed systematically with changes in the interval, in their fixed-interval performances.     

Fixed-interval performances with added stimuli in monkeys

The performance of two monkeys, on fixed-interval schedules, was examined with a visual, an auditory and a combined auditory-visual clock. The clock, a voltmeter and/or a variable frequency tone, produced performances different in many aspects from those recorded earlier with pigeons. Instead of the sustained high rates of responding at the optimal settings of the clock, the monkey's rates of responding were often extremely low even though a limited-hold contingency was utilized.     

Inhibitory stimulus control in concurrent schedules

Six pigeons were exposed to two keys, a main key and a changeover key. Pecking the main key was reinforced on a variable-interval 5-min schedule when the key was blue and never reinforced when the key displayed a vertical line on a blue background. Each peck on the changeover key changed the stimulus displayed on the main key. Each subject was given two generalization tests, consisting of presentations on the main key of six orientations of the line on the blue background, with no reinforcements being given. In one test changeover-key pecks changed the stimulus; in the other test the changeover key was covered and the experimenter controlled stimulus changes. Both responses to the six stimuli and time spent in the presence of the stimuli gave U-shaped gradients when the changeover key was operative. With most subjects, absolute rates of responding to each stimulus produced unsystematic gradients, whether or not the changeover key was operative.     

Some determinants of inhibitory stimulus control

Interspersed reinforcement and extinction during discrimination learning generate a U-shaped gradient of inhibition about the stimulus correlated with extinction. The present work showed that extinction is not a necessary determinant of inhibitory stimulus control. In Exp. I, a reduction in the rate of reinforcement, through a shift from a multiple variable-interval 1-min variable-interval 1-min schedule to a multiple variable-interval 1-min variable-interval 5-min schedule, resulted in a post-discrimination line orientation gradient of inhibition about the stimulus correlated with the variable-interval 5-min schedule. In Exp. II, the rates of reinforcement, correlated with a pair of stimuli, were held constant during a shift from a multiple variable-interval 1-min variable-interval 1-min schedule to a multiple variable-interval 1-min differential-reinforcement-of-low-rate schedule. Inhibitory stimulus control about the stimulus correlated with the differential reinforcement of low rate was obtained. In both experiments, a reduction in the rate of responding during one stimulus and behavioral contrast during the other stimulus preceded the observation of inhibitory stimulus control.     

On the development of stimulus control

Pigeons were trained to peck one key when presented with white noise at any of five intensities lower than a reference intensity, and to peck another key when presented with white noise at any of five intensities greater than the reference intensity. The shape of the stimulus control curves (proportion of responses to one key versus stimulus intensity) changed from a horizontal line at the beginning of training to the sigmoid form of typical psychometric functions at the end of training. The development of stimulus control is described in terms of a model based on the theory of signal recognition and a concept of attention.     

Behavioral control by an imprinted stimulus

Newly hatched ducklings were exposed to imprinting procedures and subsequently trained to peck a key by presenting the imprinting stimulus as the reinforcing (response contingent) event. It was found that the key peck was learned only when imprinting procedures were initiated during the first 6 to 8 hr after hatch. Additional studies revealed that: (1) the duckling's distress vocalizations were reduced in the presence of the imprinting stimulus and enhanced in its absence; (2) when the ducklings had constant access to the imprinted stimulus (via a key peck), pecking responses occurred in bursts and relatively few distress vocalizations occurred; (3) the initial effect of extinction procedures was an increase in key peck rate. When, however, repeated key pecks failed to produce the imprinted stimulus, distress vocalization ensued and peck rate declined; (4) both the presentation of an unfamiliar mechanical figure and delivery of electrical shock enhanced distress vocalization and key pecks; (5) for some ducklings, certain familiar objects in the environment influenced distress calls in a manner comparable to the imprinted stimulus in that distress calls increased when these objects were removed.     

Dimensional stimulus control following brief wavelength training

Pigeons with extensive training pecking a key illuminated by a white line then had brief training with the key illuminated by 555 nanometers. This was immediately followed by a wavelength generalization test in extinction. Dimensional stimulus control about the training wavelength increased with the duration and number of reinforcements given on variable-interval 30-sec and variable-interval 10-sec schedules in Experiment I. In Experiment II, dimensional stimulus control was obtained after only 4 min of wavelength training from birds with prior and independent discrimination training. Experiment III provided groups equated in number of reinforcers with groups in Experiment I and two 8-min duration groups. Analyses, which included results from both Experiments I and III, showed that dimensional stimulus control increased: (a) more rapidly as a function of the duration of variable-interval 10-sec than variable-interval 30-sec reinforcement; (b) at the same rate across variable-interval reinforcement schedules, as a function of the number of reinforcers available during brief wavelength training.     

Observing behavior and atypically restricted stimulus control

Restricted stimulus control refers to discrimination learning with atypical limitations in the range of controlling stimuli or stimulus features. In the study reported here, 4 normally capable individuals and 10 individuals with intellectual disabilities (ID) performed two-sample delayed matching to sample. Sample-stimulus observing was recorded with an eye-tracking apparatus. High accuracy scores indicated stimulus control by both sample stimuli for the 4 nondisabled participants and 4 participants with ID, and eye tracking data showed reliable observing of all stimuli. Intermediate accuracy scores indicated restricted stimulus control for the remaining 6 participants. Their eye-tracking data showed that errors were related to failures to observe sample stimuli and relatively brief observing durations. Five of these participants were then given interventions designed to improve observing behavior. For 4 participants, the interventions resulted initially in elimination of observing failures, increased observing durations, and increased accuracy. For 2 of these participants, contingencies sufficient to maintain adequate observing were not always sufficient to maintain high accuracy; subsequent procedure modifications restored it, however. For the 5th participant, initial improvements in observing were not accompanied by improved accuracy, an apparent instance of observing without attending; accuracy improved only after an additional intervention that imposed contingencies on observing behavior. Thus, interventions that control observing behavior seem necessary but may not always be sufficient for the remediation of restricted stimulus control.     

Inhibitory stimulus control following errorless discrimination learning

Three generalization procedures were used to investigate inhibitory stimulus control following discrimination learning with few errors. Three groups of pigeons acquired a discrimination between a green stimulus (the positive stimulus) and a vertical or horizontal line (the negative stimulus) through differential autoshaping followed by multiple schedule presentation of the two stimuli with gradually increasing stimulus durations. Genereralization testing was along a line-tilt continuum. For one group, the test involved a resistance-to-reinforcement procedure in which responses to all line tilts were reinforced on a variable-interval schedule. For a second group, also tested with the resistance-to-reinforcement procedure, the lines were superimposed on the green field that formerly served as the positive stimulus. A third group was tested in extinction with the combined stimuli. Control groups had no discrimination training but responding to green was nondifferentially reinforced. The control subjects responded more to all line tilts during testing than did the comparable experimental subjects, indicating that the negative stimulus had become an inhibitory stimulus. Both resistance-to-reinforcement groups revealed inhibitory gradients around the negative stimulus, but the gradient for the extinction group was relatively flat. These data are consistent with others that modify Terrace's early conclusion concerning the failure of inhibition to develop during errorless training.