The effect of acceleration on food-reinforced DRL and FR

Performance on DRL 10 sec and FR 5 was studied after exposure to acceleration. After four rats, two on each of the above schedules, had stabilized they were exposed to 5 hr of acceleration at 5 G immediately before daily experimental sessions. Food intake was also studied in rats given access to food daily in their home cages and exposed to acceleration immediately before the free-feeding session. Weight gain of free-feeding animals and reinforcement intake of experimental animals dropped after acceleration. Over-all response rate on the FR was depressed markedly by acceleration but local response rates did not appear to be affected. IRT distributions of DRL sessions after acceleration were markedly shifted toward the long intervals. A sequential plot of IRTs on acceleration days showed an altered, but relatively stable, temporal patterning of responses followed by an abrupt return to the normal baseline toward the end of the session.     

Fixed-ratio performance with and without a postreinforcement timeout

Pigeons pecked a key, producing food reinforcement on fixed-ratio (FR) schedules requiring 50, 100, or 150 responses. In each session, 30-second timeouts were inserted before a random half of the FR trials, whereas the other trials began immediately after reinforcement. In general, preratio pauses were shorter on trials preceded by timeouts. On these trials, the probability of a first response tended to be highest in the first 20 seconds of the trials, suggesting that the shorter pauses were the result of transient behavioral contrast. Direct observations and analyses of interresponse times (IRTs) after the preratio pause indicated that IRTs could be grouped into three categories: (1) IRTs of about .1 second, which were produced by small head movements in the vicinity of the key; (2) IRTs of about .3 second, which were produced by distinct pecking motions; and (3) IRTs greater than .5 second, which were accompanied by pausing or movements away from the key. At all ratio sizes, as a subject progressed through a trial, the probability of a long IRT decreased, whereas the probability of an intermediate IRT usually increased at first and then decreased. The probability of a short IRT increased monotonically across a trial. The results show that responding changes systematically as a subject progresses through a ratio on an FR schedule. Some characteristics of performance varied as functions of the absolute size of the response requirement, whereas others appeared to depend on the relative location within a ratio (i.e., the proportion of the ratio completed at a given moment).     

Session duration and the VI response function: Within-session prospective and retrospective effects

Two experiments examined the effects of session duration on responding during simple variable-interval schedules. In Experiment 1, rats were exposed to a series of simple variable-interval schedules differing in both session duration (10 min or 30 min) and scheduled reinforcement rate (7.5 s, 15 s, 30 s, and 480 s). The functions relating response rate to reinforcement rate were predominantly monotonic for the short (10-min) sessions but were predominantly bitonic for the long (30-min) sessions, when data from the entire session were considered. Examination of responding within sessions suggested that differences in the whole-session data were produced by a combination of prospective processes (i.e., processes based on events scheduled to occur later in the session) and retrospective processes (i.e., processes based on events that had already occurred in the session). In Experiment 2, rats were exposed to a modified discrimination procedure in which pellet flavor (standard or banana) predicted session duration (10 min or 30 min). All rats came to respond faster during the short (10-min) sessions than during the first 10 min of the long sessions. As in Experiment 1, the results seemed to reflect the simultaneous operation of both prospective and retrospective processes. The results shed light on the recent controversy over the form of the variable-interval response function by identifying one variable (session duration) and two types of processes (prospective and retrospective) that influence responding on these schedules.     

Septal lesions lower responding under fixed-ratio schedules of reinforcement.

Albino Sprague-Dawley rats with complete septal lesions and rats with control operations were studied under fixed-ratio (FR) schedules of reinforcement. Both groups were trained for 10 sessions each under FR 10, 20, 40, 60, 80, and 100. In contrast to findings from progressive FR studies and some simple FR studies, septal lesions resulted in lower overall and local response rates along with longer postreinforcement pauses. These effects were especially evident during the FR 100 schedule of reinforcement. A comparison of reinforcement rate as a function of FR size within the context of behavioral economics (i.e., a demand function) indicated that septal lesions did not alter the reward value of food. These findings suggest that responding on FR schedules of reinforcement can be altered by the various procedures used to train rats to reach the terminal value of a reinforcement schedule.     

Performance on a fixed-ratio schedule with correlated amount of reward

Four rats were trained to bar press on FR 9 TO 30 sec. They were reinforced with a large or small amount of water according to whether their final IRT was long or short respectively. Four control rats always received the small amount of reinforcement. The control animals produced the high rates of responding typical of fixed-ratio performance. The experimental animals, with one exception, developed superstitious behavior and maintained slow responding throughout the ratio. However, some features of the results pointed to a persistent influence of the factors which favor short IRTs.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.     

Fixed ratio and extinction performance of infants in the second year of life

Five 14(1/2)- to 19(1/2)-month-old infants were trained to lever press for snacks on small fixed ratio schedules of reinforcement. Within four to nine sessions, responding under FR 10 was established for four subjects and FR 15 for the other. Each subject's last session revealed behavioral patterns similar to animal and human FR trained subjects-a high and constant ratio rate, mixed with a zero rate following reinforcements. Deviations were mostly in the form of prolonged and variable post-reinforcement pauses. These and other irregularities were probably due to the limited deprivation conditions and improper training procedures in which the ratio (for two subjects) was ascended too early and too quickly. Extinction was instituted during the last session. The degree to which extinction performance matched that of other organisms depended upon how stable and "ratio-like" performance was during conditioning.     

Lesions of rat infralimbic cortex enhance recovery and reinstatement of an appetitive Pavlovian response

The prefrontal cortex (PFC) has a well-established role in the inhibition of inappropriate responding, and evidence suggests that the infralimbic (IL) region of the rat medial PFC (MPFC) may be involved in some aspects of extinction of conditioned fear. MPFC lesions including, but not those sparing the IL cortex increase spontaneous recovery of extinguished conditioned fear when tested 24 h after an initial extinction session. The current experiment extended these findings by use of appetitive rather than aversive conditioning. Ten IL-lesioned and 11 sham-operated rats were trained on a Pavlovian task in which a conditioned stimulus (CS) was followed by food pellets (the unconditioned stimulus or US). IL lesions had no effect on extinction of the conditioned response (CR, magazine entries) during the first extinction session. However, the level of spontaneous recovery between the first extinction session and a second, 24 h later, was increased in IL-lesioned rats relative to sham animals. In contrast, evidence of savings measured between the extinction sessions did not differ between groups. Furthermore, reinstatement of the CR following unsignaled delivery of the US was also increased in IL-lesioned rats.     

Responding on concurrent-chains schedules in open and closed economies.

Pigeons' key pecks were reinforced according to concurrent-chains schedules of reinforcement. The programmed average time from the onset of the initial links to a terminal link entry was held constant across conditions while the value of variable-interval schedules in the terminal links was varied. Performance was assessed under two economic conditions: (a) an open economy in which session duration was limited to 1 hr and subjects were maintained at 80% of their free-feeding body weights with postsession food when necessary; and (b) a closed economy in which sessions were 23.5 hr long and no deprivation regimen was in effect. In all cases, the relative rate of responding in the initial links matched the reduction in overall delay to primary reinforcement correlated with entry into one terminal link relative to the reduction in delay correlated with entry into the other terminal link. Although the sum of responses made in the initial links and terminal links was found to increase, then decrease, as the rate of food presentation decreased in the closed economy, there was no consistent effect of overall rate of food presentation on total responding in the open economy. The choice data suggest that relative delay reduction predicts choice accurately, regardless of economic context.     

Interactions between the effects of food and water motivating operations on food‐ and water‐reinforced responding in mice

Two experiments examined interactions between the effects of food and water motivating operations (MOs) on the food‐ and water‐reinforced operant behavior of mice. In Experiment 1, mice responded for sucrose pellets and then water reinforcement under four different MOs: food deprivation, water deprivation, concurrent food and water deprivation, and no deprivation. The most responding for pellets occurred under food deprivation and the most responding for water occurred under water deprivation. Concurrent food and water deprivation decreased responding for both reinforcers. Nevertheless, water deprivation alone increased pellet‐reinforced responding and food deprivation alone likewise increased water‐reinforced responding relative to no deprivation. Experiment 2 demonstrated that presession food during concurrent food and water deprivation increased in‐session responding for water relative to sessions where no presession food was provided. Conversely, presession water during concurrent food and water deprivation did not increase in‐session responding for pellets. These results suggest that a) the reinforcing value of a single stimulus can be affected by multiple MOs, b) a single MO can affect the reinforcing value of multiple stimuli, and c) reinforcing events can also function as MOs. We consider implications for theory and practice and suggest strategies for further basic research on MOs.     

Response suppression by visual stimuli paired with postsession d-amphetamine injections in the pigeon

Responding of pigeons, maintained under a fixed-interval 3-minute schedule of food presentation, was decreased on days that the color of the lights illuminating the food magazine was changed and d-amphetamine (1.0 mg/kg, i.m.) was injected after the session. Responding was not decreased by keylight color changes paired with postsession d-amphetamine or by postsession injections of saline. Administration of pentobarbital (3.0 to 5.6 mg/kg), but not d-amphetamine (.3 to 3.0 mg/kg), before the session increased rates of responding suppressed by drug-paired magazine lights. Responding maintained under a fixed-ratio 30-response schedule was not decreased when differently colored magazine lights were paired with a low (.3 mg/kg) postsession dose of d-amphetamine; with high (3.0 mg/kg) postsession doses, however, responding was completely suppressed after two pairings. The effects of pairing magazine stimuli with an intermediate (1.0 mg/kg) postsession dose of d-amphetamine depended upon the magnitude of prior postsession doses. After being paired with a low dose, stimuli paired with 1.0 mg/kg did not suppress responding. After being paired with a high dose, stimuli paired with 1.0 mg/kg completely suppressed responding. The suppression of food-maintained responding by stimuli paired with postsession drug administration depends upon both behavioral and pharmacological variables.     

Cooperative responding in rats maintained by fixed‐ and variable‐ratio schedules

The present study investigated the effects of fixed‐ratio (FR) and variable‐ratio (VR) reinforcement schedules on patterns of cooperative responding in pairs of rats. Experiment 1 arranged FR 1, FR 10, and VR 10 schedules to establish cooperative responding (water delivery depended on the joint responding of two rats). Cooperative response rates and proportions were higher under intermittent schedules than under continuous reinforcement. The FR 10 schedule generated a break‐and‐run pattern, whereas the VR 10 schedule generated a relatively high and constant rate pattern. Experiment 2 evaluated the effects of parametric manipulations of FR and VR schedules on cooperative responding. Rates and proportions of cooperative responding generally increased between ratio sizes of 1 and 5 but showed no consistent trend as the ratio increased from 5 to 10. Experiment 3 contrasted cooperative responding between an FR6 schedule and a yoked control schedule. Coordinated behavior occurred at a higher rate under the former schedule. The present study showed that external consequences and the schedules under which the delivery of these consequences are based, select patterns of coordinated behavior.     

“Level of Aspiration”: Preference for Time Versus Response Feedback and History Effects on the Setting of Personal Performance Standards

Human subjects responded on a computer keyboard and accumulated points according to fixed-ratio (FR) reinforcement schedules. In Experiment 1, subjects responded under a FR 500 schedule. Under baseline conditions satisfying the schedule requirement resulted in counter points and session termination. Subsequently, subjects could (a) choose to have a clock appear on the screen during the interreinforcement interval (IRI) as well as to enter a target time which they would attempt to better during that session, (b) choose to enter a target time or respond under baseline conditions, and (c) enter a target time and choose between having a clock appear throughout or at the end of experimental sessions. In Experiment 2, subjects responded under a FR 500 schedule, entered a target time each session, and could respond during the session to briefly produce either (a) clock feedback, or (b) the number of responses emitted by the subject. In Experiment 3, subjects responded under FR 250, 500, 1000, and 2000 schedule parameters, entered target times and responded for either clock or response feedback. Subjects (a) preferred responding under conditions in which target times were entered to responding under baseline conditions, (b) preferred to have the clock illuminated throughout rather than at the end of experimental sessions, (c) preferred response to clock feedback under all schedule parameters, (d) responded to having equaled or bettered a target time by lowering target time for the subsequent session, and (e) responded to having missed a target time by maintaining the same time during the subsequent session. The results were interpreted within the context of behavior analytic as opposed to more traditional personality theory.

     

Effects of post-session wheel running on within-session changes in operant responding

This study tested the effects of post-session wheel running on within-session changes in operant responding. Lever-pressing by six rats was reinforced by a food pellet under a continuous reinforcement (CRF) schedule in 30-min sessions. Two different flavored food pellets were used as reinforcers. In the wheel conditions, 30-min operant-sessions with one of the flavored pellets were followed by 30-min free-wheel running sessions. Meanwhile, in the home conditions, rats’ operant responding was reinforced by the other flavored pellets during 30-min operant-sessions, and the rats were then returned to their homecages. All rats were exposed to 4 wheel and 4 homecage sessions. Operant responding was lowered during the wheel conditions. However, post-session running did not alter the within-session pattern of operant responding. These effects were practically identical to the effects of drug-induced taste-aversion learning on within-session changes in operant responding, suggesting similar mechanisms in both taste-aversion preparations.     

A choice procedure to assess the aversive effects of drugs in rodents

The goal of this series of experiments was to develop an operant choice procedure to examine rapidly the punishing effects of intravenous drugs in rats. First, the cardiovascular effects of experimenter‐administered intravenous histamine, a known aversive drug, were assessed to determine a biologically active dose range. Next, rats responded on each of two levers with concurrently available fixed‐ratio 1 schedules of food reinforcement. Intravenous histamine was delivered along with food when responses were made on one of the options, and the lever on which both food and histamine were contingent was switched on a regular basis. A dose of 1.0 mg/kg/inj of histamine was effective in moving responding to the alternate lever, whereas saline, 0.1, or 0.3 mg/kg/inj of histamine were not. Histamine injections produced reliable selection of the alternate lever when they were presented on the same lever for three consecutive sessions, but not when they were switched between levers on each session. In addition, histamine produced greater selection of the alternate lever when it was presented with shorter intertrial interval durations. These findings indicate that, with appropriate parameters, the aversive effects of histamine and perhaps other drugs can be established rapidly using a concurrent choice procedure.     

Cooperative responding in rats: II. Performance on fixed-ratio schedules of mutual reinforcement

Coordinated responses of 5 dyads of rats were investigated under fixed-ratio (FR) schedules of mutual water reinforcement. Coordinated responding was defined as 2 consecutive lever-presses, 1 from each of 2 rats, occurring <.5 s apart. In the FR schedules, each coordinated episode was defined as 1 response in the FR sequence. The size of FR schedules was parametrically manipulated assuming the values of FR 1, 6, 12, 18, 24, 30, 50, and 9, in this order. Each FR remained in effect until responding reached stability. Under all conditions, pairs of rats received access to water simultaneously (mutual reinforcement). Rates and proportions of coordinated responding showed a bitonic inverted U-shaped function of ratio size. Postreinforcement pauses increased systematically as the interreinforcement interval increased. Local rates and proportions increased as a function of response location within ratios. Results of a control condition with relaxed temporal constraints for mutual reinforcement showed decreases in rates and proportion of coordinated responses, suggesting that the coordinated responses were controlled by the mutual reinforcement contingencies. The present experiment showed that coordinated responding is quantitatively affected by 3 properties of FR schedules: response requirement, reinforcement rates, and proximity to reinforcement.     

WITHIN‐SESSION TRANSITIONS IN CHOICE: A STRUCTURAL AND QUANTITATIVE ANALYSIS

The present study used within‐session transitions between two concurrent schedules to evaluate choice in transition. Eight female Long‐Evans rats were trained to respond under concurrent schedules of reinforcement during experimental sessions that lasted 22 hr. The generalized matching equation was used to model steady‐state behavior at the end of each session, while transitional behavior that emerged following the change in reinforcement schedules was modeled using a logistic equation. The generalized matching and logistic equations were appropriate models for behavior generated during single‐session transitions. A local analysis of behavior on the two response alternatives during acquisition was used to determine the source of preference as revealed in response ratios. The number of “low‐response” visits, those containing three to five responses, remained stable. Preference ratios largely reflected a sharp increase in the number of visits with long response bouts on the rich alternative and a decrease in the number of such visits to the leaner alternative.     

Accurate and rapid reconditioning of spaced responding

The performance maintained by reinforcing responses only when they terminated interresponse times (IRTs) of 20 sec or greater (DRL schedule) was almost the same during the first session of reconditioning as before extinction. As few as two reinforcements accurately reinstated both the pre-extinction rate of responding and the function relating the duration of an IRT to its conditional probability of occurrence (IRTs/op).     

Predicting preference for items during periods of extended access based on early response allocation

Top‐ranked items were identified during 30‐min free‐operant preference assessments for 9 individuals. Data from each session were analyzed to identify the item (a) that was engaged with first in each session and (b) to which the most responding was allocated after 5 min, 10 min, 15 min, 20 min, and 25 min had elapsed in each session. The results indicated that the first‐engaged item and the 5‐min high‐allocation item predicted the top‐ranked item in 55% and 62% of the sessions, respectively. The results also showed that engagement with the top‐ranked item from the first session decreased across subsequent sessions for 6 of the 9 participants. The implications of the results for brief versus extended stimulus preference assessments are discussed.