Distributional properties of operant-level locomotion in the rat

Four rats had continuous access to activity wheels first, then access for 1 hr per day, and, subsequently, continuous access. Limiting S's access to the wheel substantially increased the total frequency of running. A distributional analysis of response duration, burst duration, and interburst interval showed that the increased frequency arose almost entirely from a shortening of the interval between successive bursts. In contrast, speed of the individual response and number of responses per burst changed only negligibly. If S were running, the probability that it would either stop or continue did not differ appreciably for the conditions of continuous or limited access to the wheel. But if S were not running, the probability that it would start running was appreciably greater for limited than for continuous access.     

Timeout postponement without increased reinforcement frequency

Three experiments were conducted to examine pigeons' postponement of signaled extinction periods (timeouts) from a schedule of food reinforcement when such responding neither decreased overall timeout frequency nor increased the overall frequency of food reinforcement. A discrete-trial procedure was used in which a response during the first 5 s of a trial postponed an otherwise immediate 60-s timeout to a later part of that same trial but had no effect on whether the timeout occurred. During time-in periods, responses on a second key produced food according to a random-interval 20-s schedule. In Experiment 1, the response-timeout interval was 45 s under postponement conditions and 0 s under extinction conditions (responses were ineffective in postponing timeouts). The percentage of trials with a response was consistently high when the timeout-postponement contingency was in effect and decreased to low levels when it was discontinued under extinction conditions. In Experiment 2, the response-timeout interval was also 45 s but postponement responses increased the duration of the timeout, which varied from 60 s to 105 s across conditions. Postponement responding was maintained, generally at high levels, at all timeout durations, despite sometimes large decreases in the overall frequency of food reinforcement. In Experiment 3, timeout duration was held constant at 60 s while the response-timeout interval was varied systematically across conditions from 0 s to 45 s. Postponement responding was maintained under all conditions in which the response-timeout interval exceeded 0 s (the timeout interval in the absence of a response). In some conditions of Experiment 3, which were designed to control for the immediacy of food reinforcement and food-correlated (time-in) stimuli, responding postponed timeout but the timeout was delayed whether a response occurred or not. Responding was maintained for 2 of 3 subjects, suggesting that behavior was negatively reinforced by timeout postponement rather than positively reinforced by the more immediate presentation of food or food-correlated (time-in) stimuli.     

The rabbit as a subject in behavioral research

Domestic rabbits were exposed to a wide variety of variables employed in behavioral research. It was found that: (1) Although food could be used as a reinforcer, the long periods of severe deprivation required to reduce body weight made its use impractical. (2) Water was an efficient reinforcer in that it maintained high rates of behavior after 22 hr of deprivation. (3) Except that rates of responding were higher, fixed-ratio and variable-interval schedules of reinforcement produced patterns of behavior similar to those demonstrated by rats and pigeons. (4) Although the duration of the post-reinforcement pause was a function of the duration of the interval under fixed-interval schedules, scalloping, as defined as a gradually increasing rate of responding between reinforcement, was not evident. (5) When provided with the means to both turn on and turn off intracranial stimulation, the duration of the stimulation and the frequency with which it was turned on and off was a function of the intensity of the stimulation. (6) Electric shock could suppress behavior and maintain escape responding, but would maintain avoidance responding only in a few subjects.     

A response duration schedule: effects of training, extinction, and deprivation

Rats were trained to hold down a lever for at least 40 consecutive seconds. When the lever had been held down for 40 sec, white noise came on. Releasing the bar in the presence of the noise turned off the noise and operated a feeder that delivered a pellet of food. At the end of training, frequency distributions of response durations peaked at 40 to 41 sec. If as in training, holding down the lever produced white noise at the end of 40 sec, and release of the lever terminated the noise and operated the feeder, but no food delivery occurred, duration distributions and several other measures were initially not very different from when food was delivered. However, if during extinction white noise was never produced by lever holding, and feeder operation did not occur upon lever release, most responses were shorter than 1 sec in duration, some were much longer than 41 sec, and duration distributions did not peak at 40 to 41 sec. When reinforcement was reinstated after extinction, performance quickly returned to pre-extinction measures. Further sessions at different levels of deprivation produced only temporary disruptions in performance.     

Leptin inhibits and ghrelin augments hypothalamic noradrenaline release after stress

Metabolic conditions affect hypothalamo-pituitary-adrenal responses to stressful stimuli. Here we examined effects of food deprivation, leptin and ghrelin upon noradrenaline release in the hypothalamic paraventricular nucleus (PVN) and plasma adrenocorticotropic hormone (ACTH) concentrations after stressful stimuli. Food deprivation augmented both noradrenaline release in the PVN and the increase in plasma ACTH concentration following electrical footshocks (FSs). An intracerebroventricular injection of leptin attenuated the increases in hypothalamic noradrenaline release and plasma ACTH concentrations after FSs, while ghrelin augmented these responses. These data suggest that leptin inhibits and ghrelin facilitates neuroendocrine stress responses via noradrenaline release and indicate that a decrease in leptin and an increase in ghrelin release after food deprivation might contribute to augmentation of stress-induced ACTH release in a fasting state.     

Effects of food deprivation on the performance of a two-turn task in a temporal circular maze

Ten hooded rats were trained to perform a two-turn task in a temporal circular maze. The effects of levels of food deprivation (2, 26, 50, 74, 98, 122 hr.) on performance were evaluated. It was found that the correct responses were not affected, but both running time and competing behaviour decreased significantly with increase in hours of food deprivation. In a second experiment 8 rats were trained in a similar way and after attaining a stable performance, were run for a further 4 sessions at 24 hr. deprivation, and then at 72 hr. deprivation. The results precluded the possibility that the results obtained in Experiment I were due to practice effects, and support the findings on the effects of deprivation.     

Tolerance to the effects of cocaine on performance under behavior-correlated reinforcement magnitude

Four pigeons responded under a fixed-interval 8-min schedule of food delivery in which the amount of food delivered at the end of each interval depended on performance during the interval (i.e., a correlated schedule). Specifically, duration of access to grain was contingent upon the number of responses made during the first 4 min of the interval. This differential outcome did not affect response rates or patterning relative to performance under a simple fixed-interval 8-min schedule. Behavior under the correlated schedule was then investigated under doses of cocaine ranging from 0.3 to 10.0 mg/kg. A bitonic dose-response function was obtained for response rates and the time with head in the food hopper, whereas dose-dependent decreases were observed in the mathematical index of curvature (Fry, Kelleher, & Cook, 1960). The dose that produced the greatest increase in the head-in-hopper time was then administered prior to each session. Following repeated administration of cocaine, disruptions in response patterning were attenuated for all 4 pigeons; tolerance was also observed to the rate-increasing effects and increased head-in-hopper time for 2 pigeons after chronic cocaine administration. Tolerance therefore developed despite the fact that the initial effect of cocaine was to increase the amount of food obtained.     

Conditioning of the aggressive behavior of pigeons by a fixed-interval schedule of reinforcement

Operant reinforcement of aggression was studied in food-deprived pigeons by delivering food for attacks against a target pigeon. The food was delivered according to a fixed-interval schedule and attack behavior was recorded automatically. Attack could be conditioned and extinguished, and the proportion of time spent in attack was a direct function of the frequency of reinforcement of the attack. The fixed-interval schedule produced an increasing rate of attack during the interval between food reinforcements. This positive curvature was an inverse function of the duration of the interval. The findings revealed that the duration and temporal patterning of the complex social behavior of attack can be influenced in a substantial and predictable manner by the schedule and frequency of operant reinforcement.     

Discriminated timeout avoidance in pigeons: the roles of added stimuli

Two experiments examined pigeons' postponement of a signaled extinction period, or timeout (TO), from an ongoing schedule of response-dependent food delivery. A concurrent-operant procedure was used in which responses on one (food) key produced food according to a variable-interval schedule and responses on a second (postponement) key delayed the next scheduled TO according to a response-TO (R-TO) interval. A series of response-independent stimulus changes on the food key temporally partitioned the R-TO into three equal segments (S1, S2, and S3). Postponement responses, in addition to postponing TO, also reinstated S1, the stimulus correlated with the greatest temporal distance from TO. In Experiment 1, the R-TO interval was manipulated systematically across blocks of sessions (conditions) at a given ratio of R-TO:TO duration. This R-TO:TO ratio was manipulated across blocks of conditions (phases). Postponement response rates varied inversely with R-TO interval in each phase. Changes in the R-TO:TO ratio did not produce consistent differences except at the 1:10 ratio for some pigeons, where it disrupted postponement responding in some conditions. Most of the postponement responses occurred in the presence of S2 and S3, the stimuli most proximal to TO, whereas most of the food-key responses occurred in S1. In Experiment 2, the R-TO contingencies were systematically manipulated in the presence of the time-correlated stimuli. In one set of conditions, the R-TO contingencies were made either ineffective or less effective in the presence of one or more stimuli. Postponement responses typically shifted to stimuli in the presence of which responses were relatively more effective. Postponement responses decreased markedly when the added stimuli were removed, and then recovered when the stimuli were reinstated. Results from both experiments indicate that the added stimuli in a discriminated TO-avoidance procedure serve predominately discriminative functions, delineating periods during which behavior is maximally effective. The results parallel those obtained in shock-avoidance procedures, providing further evidence that TO functions as an aversive stimulus.     

Fixed-ratio punishment

Responses were maintained by a variable-interval schedule of food reinforcement. At the same time, punishment was delivered following every nth response (fixed-ratio punishment). The introduction of fixed-ratio punishment produced an initial phase during which the emission of responses was positively accelerated between punishments. Eventually, the degree of positive acceleration was reduced and a uniform but reduced rate of responding emerged. Large changes in the over-all level of responding were produced by the intensity of punishment, the value of the punishment ratio, and the level of food deprivation. The uniformity of response rate between punishments was invariant in spite of these changes in over-all rate and contrary to some plausible a priori theoretical considerations. Fixed-ratio punishment also produced phenomena previously observed under continuous punishment: warm-up effect and a compensatory increase. This type of intermittent punishment produced less rapid and less complete suppression than did continuous punishment.     

Fixed-ratio escape reinforcement

Escape responses of squirrel monkeys were reinforced according to a fixed-ratio schedule. The reinforcement was a period of safety from a stimulus that signalled the delivery of intermittent pain-shocks. When the frequency of shock was gradually reduced, the performance remained at a high level until the shocks were quite infrequent. Similarly, the duration of the period of safety could be reduced to a few seconds with little loss of behavior. Thus, the responses appeared to be reinforced by even a brief period of safety, the actual degree of shock reduction being fairly slight. The changes in responding during this fixed-ratio escape procedure were comparable to the response changes typically obtained during fixed-ratio food procedures.     

Priming effects with food and water reinforcers in hamsters

Hamsters were tested in a square maze with either food or water in each corner compartment. A substantial priming effect (runway times increase as intertrial interval increases) was demonstrated using both food and water reinforcers. A lengthy period of free access to food and water (satiation) immediately abolished the priming effect, although runway times in general remained relatively rapid for some time. Extinction of rapid runway times proceeded more slowly under food than under water deprivation. It is concluded that priming is a widespread phenomenon associated with the presentation of a reinforcing stimulus to an appropriately deprived animal.     

The effects of number of responses on the postreinforcement pause in fixed-interval schedules

The present study manipulated the number of responses in a modified fixed-interval schedule by imposing a blackout after each unreinforced response during the interval. The blackout duration was varied, and the duration of the fixed interval was held constant. The subjects were initially exposed to a fixed-interval 300-sec schedule. Blackout durations of 0, 10, and 50 sec were used. Following this, a fixed-interval 30-sec schedule was used with blackout durations of 0, 1, and 5 sec. Under the fixed-interval 300-sec schedule, the number of interreinforcement responses varied over a wider range than occurred under the fixed-interval 30-sec schedule. The duration of the postreinforcement pause decreased as blackout durations were increased and number of responses decreased on the fixed-interval 300-sec schedule, but pause length did not vary with changes in blackout duration and number of responses for the fixed-interval 30-sec schedule. The differences in the effects of blackout duration and response manipulation on the two fixed-interval schedules were attributed to relatively greater changes in the number of interreinforcement responses for the fixed-interval 300-sec schedule.     

Choice, rate of reinforcement, and the changeover delay

Pigeons distribute their responses on concurrently available variable-interval schedules in the same proportion as reinforcements are distributed on the two schedules only when a changeover delay is used. The present study shows that this equality between proportions of responses and proportions of reinforcements (“matching”) is obtained when the value of the changeover delay is varied. When responses are partitioned into the set of rapid response bursts occurring during the delay interval and the set of responses occurring subsequently, the proportion of neither set of responses matches the proportion of reinforcements. Instead, each set deviates from matching but in opposite directions. Matching on the gross level results from the interaction of two patterns evident in the local response rates: (I) the lengthening of the changeover delay response burst is accompanied by a commensurate decrease in the number of changeovers; (2) the changeover delay response burst is longer than the scheduled delay duration. When delay responses are eliminated by introducing a blackout during the delay interval, response matching is eliminated; the pigeon, however, continues to match the proportion of time spent responding on a key to the proportion of reinforcements obtained on that key.     

Latency and frequency of responding under discrete-trial fixed-interval schedules of reinforcement

Pigeons' key pecking was studied under a number of discrete-trial fixed-interval schedules of food reinforcement. Discrete trials were presented by briefly illuminating the keylight repetitively throughout the interreinforcement interval. A response latency counterpart to the fixed-interval scallop was found, latency showing a gradual, negatively accelerated decrease across the interval. This latency pattern was largely invariant across changes in fixed-interval length, number of trials per interval, and maximum trial duration. Frequency of responding during early trials in the intervals varied, however, with different schedule parameters, being directly related to fixed-interval length, inversely related to number of trials, and complexly affected by conjoint variations of fixed-interval length and number of trials. Response latency thus was found to be simply related to elapsed time during the interval while response frequency was complexly determined by other factors as well.     

Leaving patches: effects of economy, deprivation, and session duration

Three pigeons pecked keys for food reinforcers in a laboratory analogue of foraging in patches. Half the patches contained food (were prey patches). In prey patches, pecks to one key occasionally produced a reinforcer, followed by a fixed travel time and then the start of a new patch. Pecks to another key were exit responses, and immediately produced travel time and then a new patch. Travel time was varied from 0.25 to 16 s at each of three session durations: 1, 4, and 23.5 hr. This part of the experiment arranged a closed economy, in that the only source of food was reinforcers obtained in prey patches. In another part, food deprivation was manipulated by varying postsession feeding so as to maintain the subjects' body weights at percentages ranging from 85% to 95% of their ad lib weights, in 1-hr sessions with a travel time of 12 s. This was an open economy. Patch residence time, defined as the time between the start of a patch and an exit response, increased with increasing travel time, and consistently exceeded times predicted by an optimal foraging model, supporting previously published results. However, residence times also increased with increasing session duration and, in longer sessions, consistently exceeded previously reported residence times in comparable open-economy conditions. Residence times were not systematically affected by deprivation levels. In sum, the results show that the long residence times obtained in long closed-economy sessions should probably be attributed to session duration rather than to economy or deprivation. This conclusion is hard to reconcile with previous interpretations of longer-than-optimal residence times but is consistent with, in economic terms, a predicted shift in consumption towards a preferred commodity when income is increased.     

Effects of sleep deprivation on free-operant avoidance

Two studies examined effects of sleep deprivation on free-operant avoidance by rats. In Experiment 1, a 5-s shock-shock (SS) interval and 20-s response-shock (RS) interval produced baseline performances, which were reestablished after each experimental manipulation. Once baselines were established, animals were exposed to 24, 48, or 96 hr of sleep deprivation and equivalent periods of home cage and food restriction as a control condition. Compared to baseline, sleep deprivation increased response rates by increasing the proportion of brief interresponse times (IRTs); response rates changed little in the control conditions. Percentage of shocks avoided did not systematically change across conditions. In Experiment 2, the RS interval was manipulated (10, 20, and 40 s), while the SS interval (5 s) and level of sleep deprivation (48 hr) were held constant. Across RS intervals, sleep deprivation increased response rates via a shift toward brief IRTs. In addition, sleep deprivation increased the percentage of shocks avoided as an inverse function of RS intervals.     

Effects of cycle length on performance on a temporally defined avoidance schedule

Three rats were trained on a temporally defined avoidance schedule logically similar to a fixed-interval, limited-hold positive reinforcement schedule. This avoidance schedule was composed of time periods during which responses had no scheduled consequences alternating with time periods during which a response precluded shock. As with fixed-interval length and response rate on positive reinforcement schedules, an inverse relationship was obtained between the length of the no-consequence interval and response rate during the no-consequence interval. An inverse relationship was also obtained between the length of the no-consequence interval and the per cent of shocks avoided. A rate increase within the no-consequence interval, similar to that typically produced by fixed-interval positive reinforcement procedures, was displayed by one of the rats where the no-consequence interval was at intermediate values and frequency of shock was relatively high. The introduction of a discriminative stimulus correlated with the avoidance interval produced typical discriminated avoidance behavior as well as alterations in temporal patterning of responses during the no-consequence interval in the two rats exposed to this procedure. These alterations in temporal patterning disappeared when the discriminative stimulus was removed. The results were consonant with those reported in the literature involving food reinforcement and fixed-interval, limited-hold schedules.     

Affect regulation and food intake in bulimia nervosa: emotional responding to food cues after deprivation and subsequent eating

Emotional responding to salient food cues and effects of food deprivation and consumption were investigated in 32 women with bulimia and 32 control women. One half of each group was food deprived before viewing unpleasant, neutral, pleasant, and food-related pictures. Then participants could eat from a buffet before viewing a parallel picture set. Women with bulimia showed a substantial potentiation of startle responses during viewing of food cues relative to control women. This startle potentiation was attenuated by food deprivation and augmented by increased food consumption. These data support the affective regulation model suggesting that food cues prompt negative affective states in women with bulimia, who are overwhelmed by fasting. The resulting deprivation increases the incentive value of food cues and may thus trigger binge eating.     

Control of responding during stimuli that precede transitions in reinforcement frequency

Pigeons' responses were reinforced on a variant of a mixed variable-interval extinction schedule of reinforcement in which the transition to the higher reinforcement rate was signaled by a trace stimulus projected on the response key prior to the onset of the component correlated with food delivery. In the first of two experiments, the duration of the trace stimulus preceding the component correlated with food delivery was varied from 1.5 to 50.0 s and in the second experiment, the reinforcement frequency in the same component was varied from 10 to 60 reinforcers per hour. Pigeons pecked at the trace stimulus preceding the onset of the component correlated with food delivery even though responding was not reinforced in its presence and only one of the changes in reinforcement rate (i.e., from extinction to reinforcement) was signaled. The rate of pecking during the trace stimulus was a function of its duration but not of the reinforcement frequency in the following component. Higher rates generally occurred at the shorter trace-stimulus durations. Component responding following the offset of the trace stimulus was under discriminative control of the trace stimulus whether or not responding occurred in the presence of the trace stimulus.