Fixed-interval punishment

The average rate of bar-pressing maintained by a variable-interval schedule of milk reinforcement in 33 rats was found to be a decreasing function of intensity of concurrent punishment and, over a wide range of shock intensities, was inversely related to punishment frequency. Cumulative records were, however, negatively accelerated during 30-min punishment sessions with complete suppression occurring earlier and earlier (after fewer and fewer shocks) as intensity increased. In addition, acceleration was often observed between successive fixed-interval shock presentations and, at low and moderate intensities, bursts of responding occurred after each shock. The time to recover between punishment sessions (post-punishment recovery) was an increasing monotonic function of punishment intensity.     

Intermittent punishment of human responding maintained by intermittent reinforcement

To determine the effects of variable-interval shock punishment on behavior maintained by variable-interval and variable-ratio reinforcement, human subjects' key-pressing behavior was reinforced with money on a four-component multiple schedule. Components 1 and 2 were variable-interval 30-sec, and Components 3 and 4 were variable-ratio 210. After responding was stabilized, response-contingent electric shock was scheduled on a variable-interval 10-sec schedule during the second and fourth components of each cycle. Subjects instructed as to the reinforcement contingencies showed gradually increasing suppression of variable-interval responding at increasing shock intensities and either very high or very low rates of variable-ratio responding at higher intensities. Minimally instructed subjects showed suppression at higher shock intensities, but no clear differential suppression as a function of reinforcement schedule. Recovery from initial suppression was observed within sessions.     

Discriminated punishment: avoidable and unavoidable shock

Warning stimuli for two punishment conditions were alternated with periods of appetitive responding by rats. In either warning stimulus, the first response produced a brief shock, terminated the stimulus, and started an interval during which the baseline appetitive schedule was in effect. Not responding resulted in stimuli of random duration, which terminated with a shock under one condition and without a shock under the other. Each subject was exposed to several shock intensities, with trials for the two conditions programmed during alternate portions of the session. In general, response frequency in the warning signal for either condition decreased with increasing intensity; however, at a given intensity, responding was more frequent in the stimulus invariably terminating with shock than in the stimulus terminating without shock when no response was made. The frequency difference was greatest at intensities intermediate between those producing minimal and maximal suppression.     

Some effects of punishment shock intensity upon discriminative responding

Three pigeons received visual discrimination training under both multiple variable-ratio extinction and variable-interval extinction schedules. All birds developed nearly perfect discrimination. When punishment for every tenth response during food reinforcement was presented, responding decreased as shock intensity increased. At the same time, responding during extinction, which was not punished, increased at intermediate punishment intensities, but returned to low levels under severe punishment. A second procedure, in which punishment and no-punishment sessions alternated unsystematically, was employed with two of the birds. The results under this procedure essentially replicated the data obtained as punishment shock intensity increased gradually.     

Modification of observing behavior

The effects on monitoring performance of a limited hold (LH) terminated by a bell or by electric shock and of periodic rest periods were investigated. The sensitivity of basal skin conductance to different monitoring conditions was also studied. Humans monitored a visual display in several 2-hr sessions under the Holland procedure. In each session, signals were programmed by one of the following three multiple schedules: a variable interval of 6 min (VI 6) and a VI 6 with a limited hold (LH) terminated by a bell; a VI 6 and a VI 6 LH terminated by electric shock; a VI 6 LH terminated by shock and a time-out (TO). The two components of each schedule alternated at 15-min intervals. The average observing response rate of eight subjects was lowest during the VI 6 periods, higher in periods when the LH was terminated by a bell, and highest when the LH was terminated by shock. Periodic TO periods did not appreciably increase the response rate under the VI 6 LH shock component. A differential level of palmar skin conductance under the two components of a schedule was present only under the mult VI 6 LH shock-TO.     

Tolerance to cocaine's rate-increasing effects upon repeated administration.

Four squirrel monkeys responded daily under a fixed-interval 5-min or 8-min schedule of food-pellet delivery. Cocaine (0.03 to 1.7 mg/kg) and saline were injected before occasional daily sessions (acute administration). Some doses of cocaine produced substantial overall increases in response rate for 3 of the subjects; effects were less substantial for the remaining subject, who exhibited modest increases in response rate early in the session and during the middle portion of the intervals. A dose that increased response rate when administered acutely was then administered before each session (chronic administration). Chronic administration resulted in a reduction in the increases in response rate seen under acute administration for all subjects.     

The effect of a pre-shock signal on a free-operant avoidance response

After 25 free-operant avoidance training sessions, a 1-min signal followed by a brief shock was presented on the average of once every 4 min. During the signal, the avoidance schedule was suspended (20 sessions). Response rates during the signal were markedly reduced. Shock rates during non-signalled periods increased. Fifteen additional sessions were given during which the signal was presented without shock. Response rates during signalled periods were greater than previously observed during signalled periods, indicating that signalled shock had suppressive control over a previously acquired avoidance response rate.     

Classical conditioning and extinction of human systolic blood pressure

Fifty-five male and female undergraduates underwent 3 sessions of conditioning and one of extinction. Shock (UCS) occurred intermittently during light-on (CS+) and never in light-off (CS-). Results showed that (1) pressure in CS+ was significantly higher than CS-throughout all sessions; (2) within session adaptation was significantly retarded while incoming pressure levels did not adapt across sessions; (3) conditioned effects persisted 6 months after the last shock session; (4) verbal information as to non-appearance of shock significantly dropped pressure levels and reduced the discriminative light effect; (5) the post-shock unconditioned pressure response was a peak rise at 52 seconds, then a decrease which stabilized to the pre-shock level at 2 minutes. Pavlovian control of blood pressure was demonstrated and the present methodology offers an explicit procedure for further laboratory exploration.     

The effect of punishment shock intensity upon responding under multiple schedules

In the first of two experiments, responses of two pigeons were maintained by multiple variable-interval, variable-ratio schedules of food reinforcement. Concurrent punishment was introduced, which consisted of a brief electric shock after each tenth response. The initial punishment intensities had no lasting effect upon responding. Then, as shock intensity increased, variable-ratio response rates were suppressed more quickly than variable-interval response rates. When shock intensity decreased, variable-interval responding recovered more quickly, but the rates under both schedules eventually returned to their pre-punishment levels. In the second experiment, the following conditions were studied in three additional pigeons: (1) With each shock intensity in effect for a number of sessions, punishment shock intensity was gradually increased and decreased and responding was maintained by multiple variable-ratio, fixed-ratio schedules of food reinforcement; (2) Changes in punishment shock intensity as described above with responding maintained by either a variable-ratio or a fixed-ratio schedule, which were presented on alternate days; (3) Session-to-session changes in shock intensity with responding maintained by multiple variable-ratio, fixed-ratio schedules. Responding under the two schedules was suppressed to approximately the same extent by a particular shock intensity. Also, post-reinforcement pauses under the fixed-ratio schedule increased as response suppression increased.     

Stock optimizing: maximizing reinforcers per session on a variable-interval schedule.

In Experiment 1, 2 monkeys earned their daily food ration by pressing a key that delivered food according to a variable-interval 3-min schedule. In Phases 1 and 4, sessions ended after 3 hr. In Phases 2 and 3, sessions ended after a fixed number of responses that reduced food intake and body weights from levels during Phases 1 and 4. Monkeys responded at higher rates and emitted more responses per food delivery when the food earned in a session was reduced. In Experiment 2, monkeys earned their daily food ration by depositing tokens into the response panel. Deposits delivered food according to a variable-interval 3-min schedule. When the token supply was unlimited (Phases 1, 3, and 5), sessions ended after 3 hr. In Phases 2 and 4, sessions ended after 150 tokens were deposited, resulting in a decrease in food intake and body weight. Both monkeys responded at lower rates and emitted fewer responses per food delivery when the food earned in a session was reduced. Experiment 1's results are consistent with a strength account, according to which the phases that reduced body weights increased food's value and therefore increased subjects' response rates. The results of Experiment 2 are consistent with an optimizing strategy, because lowering response rates when food is restricted defends body weight on variable-interval schedules. These contrasting results may be attributed to the discriminability of the contingency between response number and the end of a session being greater in Experiment 2 than in Experiment 1. In consequence, subjects lowered their response rates in order to increase the number of reinforcers per session (stock optimizing).     

The affective interval: An investigation of the peaks and valleys during high- and moderate-intensity interval exercise in regular exercisers

Evidence supports the notion that people generally feel worse during high(er) intensity exercise but experience an affective rebound immediately following cessation that often exceeds pre-exercise feeling states. Considering rest/recovery is an integral part of interval exercise, it is of interest to determine the degree of affective reactivity and recovery that may occur during interval exercise of different intensities. The purpose of the present study was to examine affective reactivity to and recovery from an acute bout of moderate-intensity (MIIE) and high-intensity interval exercise (HIIE). Participants (N = 25, 13 females, 23.3 ± 4.0 yrs, BMI = 25.7 ± 4.1 kg m⁻²) completed 4 sessions at the same time of day with at least 24-h between each session: a baseline session to record resting affect, a graded exercise test on a stationary bike (cycle ramp protocol 25 W·min-1) to volitional exhaustion, and then completed a high- (HIIE) and moderate-intensity interval exercise (MIIE) session where affect was recorded prior to, during, and up to 30-min post exercise. Participants reported more negative feeling states during the HIIE session compared to the MIIE session, but these states recovered similarly as early as 5-min post-exercise. In addition, while affective change (reactivity and rebounds) were relatively equal during the MIIE, declines in affect during the HIIE outweighed the affective rebounds associated with rest, resulting in a large decline in affective state from pre-exercise.     

Continuous punishment of free-operant avoidance in the rat

Three groups of albino rats were trained under a free-operant avoidance (Sidman) procedure with equal shock-shock and response-shock intervals. After stable performance was achieved, the animals were concurrently exposed to a brief electric shock after each response. The procedures were as follows: Punishment Schedule I: punishment shock was introduced at an intensity approximately one quarter that of avoidance shock; increments of nearly this same size were made as stable performance was achieved at succeeding punishment shock intensities. Punishment Schedule II: punishment shock was introduced at approximately one-half the intensity of avoidance shock; after stable performance, punishment shock was increased to the same intensity as avoidance shock. Punishment Schedule III: punishment shock was introduced and maintained at the same intensity as avoidance shock. Punishment was continued for all groups until one of two suppression criteria was attained. All animals made fewer responses and received more avoidance shocks as a function of increasing punishment shock. Half of the animals under Punishment Schedule I required punishment shock higher than avoidance shock to meet their assigned suppression criterion. A comparison of all procedures showed that suppression was greater when punishment shock was initially at high intensity.     

Punishment of shock-induced aggression

Squirrel monkeys were restrained in a chair equipped with a tail-shock apparatus and a pneumatic bite hose located in front of the subject's face. An aggressive response was recorded when the monkey bit the hose. Initial sessions in which no shocks were delivered produced some biting. When biting during these sessions stabilized at a near-zero level, regularly scheduled shocks were delivered to the monkey's tail, causing a consistently higher rate of biting. After several sessions under these conditions, a punishment phase was introduced in which the previous shock conditions were maintained, and every bite was followed immediately by another, more intense shock. Biting under these conditions was suppressed to a near-zero level. When the punishment contingency was removed, biting increased. With one subject, two additional bite-contingent stimuli were examined: (1) a milder shock that, when made contingent upon hose biting, also suppressed that response, and (2) a contingent tone that had no obvious suppressing or facilitating effect. Individual differences among subjects were extreme, but the effect of bite-contingent shock was consistent. Observations of the subjects during the punishment sessions indicated the existence of certain side effects that resulted from the use of punishment to suppress shock-induced aggression.     

Effect of CS-US pairings on shock-elicited aggression as a function of US intensity

In two experiments with paired rats, the effect of superimposing CS-US pairings on a baseline of shock-elicited aggression was studied. Baseline shocks (3.0 mA, 0.125-sec duration) occurred at a rate of 20 shocks per min throughout each session. In Experiment I, each independent group of two pairs of subjects received (in addition to baseline shocks) US shocks of 1.0, 3.0, or 5.0 mA and 5-sec duration, each shock signalled by a 1-min CS. At all three US intensities, aggression increased during the CS. In Experiment II, pairs of subjects received each unconditioned stimulus intensity in a within-subjects design. This procedure revealed a direct relationship between rate of responding and unconditioned shock intensity.     

Sequential contrast effects with human subjects

Institutionalized retardates were exposed to a multiple variable-interval: extinction schedule of reinforcement in which 5-min periods of variable-interval reinforcement and 5-min periods of extinction were presented in a random order. This schedule was found to generate sequential contrast effects: response rates during variable-interval reinforcement were higher when a variable-interval period followed an extinction period than when it followed another variable-interval period. The rate of responding within a variable-interval period also was affected by the number of extinction periods preceding a variable-interval period. As the number of successive extinction periods that preceded a variable-interval period increased, the rate of responding during that variable-interval period increased. The sequential contrast effects were transient, being most evident during the early sessions and generally disappearing by the tenth session.     

Operant punishment of eye elevation in the green crab, Carcinus maenas

Extension of the eye after reflex withdrawal was suppressed by punishing each extension with a brief puff of air. Experimental animals showed a decrease in the rate of responding, and an increase in the latency to the next response during 30-min sessions. The effect of punishment per se was controlled for by the use of yoked animals that received punishments whenever the experimental (master) animals did. This control group did not show the increased latency, and kept the eye erect for most of the session. Experiments were performed with pairs of animals, one eye of each used as master or control, or, alternatively, with single animals in which one eye served as the yoked control for the other. This latter group gave more reliable and reproducible differences between master and yoke than the pairs of animals. Retention was tested by subjecting animals to three sessions separated by a 12-hr rest. The results indicated some savings but this was not a dramatic effect. To demonstrate that the learning was operant in nature, that is, that it depended on the contingency between the act of eye extension and punishment, experiments were performed in which a delay was introduced between the response and the onset of punishments. A delay of 20 s was found to completely eliminate the learned suppression: animals showed latencies close to that of naive animals and responded at a constant high rate throughout the session. Delays of 10, 5, and 2.5 s were found to have a decreasing effect on the learning, and a delay of 1.25 s produced behavior that was within experimental error of that of animals subjected to immediate punishment.     

Effects of session duration on functional analysis outcomes.

We examined the extent to which variations in session duration affected the outcomes of functional analyses. Forty-six individuals, all diagnosed with mental retardation and referred for assessment and treatment of self-injurious or aggressive behavior, participated in functional analyses, consisting of repeated exposure to multiple test conditions during 15-min sessions. For each set of assessment data, new data sets based on session durations of 10 and 5 min were prepared by deleting data from the last 5 and 10 min, respectively, of each session. Each graph (N = 138) was then reviewed individually by graduate students who had previous experience conducting and interpreting functional analyses, but who were blind to both participant identity and session duration. Interpretations of behavioral function based on the 10- and 5-min data sets were then compared with those based on the 15-min data sets. All of the 10-min data sets yielded interpretations identical to those based on 15-min data sets. Interpretations based on the 5-min and 15-min data sets yielded three discrepancies, all of which were the result of increased response rates toward the latter parts of sessions. These results suggest that the efficiency of assessment might be improved with little or no loss in clarity by simply reducing the duration of assessment sessions.     

Remote effects of aversive contingencies: Disruption of appetitive behavior by adjacent avoidance sessions

Disruption of ongoing appetitive behavior before and after daily avoidance sessions was examined. After baselines of appetitive responding were established under a fixed-interval 180-s schedule of food presentation, 4 rats were exposed to 40-min sessions of the appetitive schedule just prior to 100-min sessions of electric shock postponement, while another 4 rats received the 40-min appetitive sessions just following daily sessions of shock postponement. In all 8 subjects, fixed-interval response rates decreased relative to baseline levels, the effect being somewhat more pronounced when the avoidance sessions immediately followed. The disruption of fixed-interval responding was only partially reversed when avoidance sessions were discontinued. During the initial exposure to the avoidance sessions, patterns of responding under the fixed-interval schedule were differentially sensitive to disruption, with high baseline response rates generally more disturbed than low rates. These disruptions were not systematically related to changes in reinforcement frequency, which remained fairly high and invariant across all conditions of the experiment; they were also not systematically related to the response rates or to the shock rates of the adjacent avoidance sessions. The results, while qualitatively resembling patterns of conditioned suppression as typically studied, occurred on a greatly expanded time scale. As disruption of behavior extending over time, the present data suggest that some forms of conditioned suppression are perhaps best viewed within a larger temporal context.     

Choice for signalled over unsignalled shock as a function of shock intensity

Choice between a signalled shock schedule and an unsignalled one was examined at various shock intensities. Three rats were given the opportunity to change from the unsignalled schedule to the signalled one at intensity values between 0.15 mA and 1.0 mA. Steps were usually 0.15 mA and both ascending and descending series were given. For two other rats, shock intensity increased from 0.20 mA to 1.0 mA in 0.20-mA increments; for two additional rats, shock intensity was first 3.0 mA and was then reduced to 1.0 mA. Subjects tended to remain in the unsignalled schedule at the lower shock intensities, but spent most of each session under the signalled schedule at the higher intensities (1.0 mA and 3.0 mA). In addition, the time spent in the signalled schedule tended to vary systematically with shock intensity over at least part of the range of intensity values. It was concluded that the relationship between shock intensity and choice behavior is similar to the relationship between intensity and behavior in procedures involving avoidance, escape, and punishment.     

Conditioned suppression or facilitation as a function of the behavioral baseline

Rats were exposed to a multiple schedule of reinforcement. During one component, a bar-press was followed by reinforcement only if it occurred between 15 and 20 sec after the previous response. This differential-reinforcement-of-low-rate (DRL) schedule produced a typical slow rate of responding. During the other component, reinforcement followed the first response to be emitted during limited periods of time which occurred at fixed intervals. These fixed-interval schedules with a limited hold produced higher response rates, described as `interval' or `ratio-like' behavior. Responding during the DRL component increased in frequency during a tone which ended with an unavoidable shock of low intensity, but decreased during the tone when the shock intensity was raised. The `interval' and `ratio-like' responding decreased in frequency during the tone at all shock intensities. Initial acceleration of the DRL responding appeared to be due to adventitious punishment of collateral behavior which was observed between the bar-presses. The more severe conditioned suppression during the fixed-interval components might be the result of the lower probability of reinforcement after any single response.