Successive interresponse times in fixed-ratio and second-order fixed-ratio performance

Three rats were trained on a schedule in which every sixth response produced a timeout of 5 sec minimum duration, and food was delivered at the onset of timeout. Successive interresponse times were measured under these conditions, and also when behavior was maintained by second-order fixed-ratio and fixed-interval schedules. Under the second-order schedules, each six-response fixed-ratio component was followed by a timeout, and occasionally food was delivered at the onset of a timeout. In the fixed-ratio schedule, the successive interresponse times showed a decrease followed by an increase before food delivery, but this systematic variation in interresponse times was not found when the performance was under second-order reinforcement. Under both second-order schedules the latencies of successive components, and the successive interresponse times within each component, showed a decrease as food delivery was approached.     

Fractional punishment of fixed-ratio performance

Key-peck responses of pigeons under a fixed-rate 60 (Exp. I) or fixed-ratio 99 (Exp. II) schedule of positive reinforcement were punished by response-dependent electric shock during a segment of the ratio. The punishing stimulus was scheduled in one of three locations: the first third of the ratio, the middle third, or the final third. At high shock levels, the different loci of punishment differentially affected the typical fixed-ratio performance pattern. Post-reinforcement pauses were lengthened by all punishment conditions but to a greater degree when the responses in initial third of the ratio were punished. Disruption of responses before the punished segment of the ratio was a conspicuous feature of the performances when the middle or final third of the ratio was punished. Two of the punishment conditions produced similar effects on both fixed-ratio baselines but punishing the final third of the ratio suppressed the punished responses of the ratio only with the fixed-ratio 99 schedule. General effects of all punishment conditions included consistent intra-session recoveries of partially suppressed performances, the rapid recovery of the FR performances after the punishment dependency was removed after complete suppression, and the facilitation of overall and/or local response rates of most subjects by low-intensity shock.     

Selective punishment of fixed-ratio performance

Key-pecking of pigeons, maintained by an FR 50 grain reinforcement schedule, was punished by shocking the first, middle, or last response of the ratio. Under high shock levels, the three punishment conditions produced differential effects on the behavior. Punishment of the first response of the ratio resulted in consistent and extended post-reinforcement pausing and frequent extended breaks after the initial response(s) of the ratio. Punishment of the 25th response disrupted responding in the first half of the ratio with little effect on the last half of the ratio. Punishment of the final response resulted in breaks and local rate changes in various parts of the ratio. Durations of pauses after reinforcement were more variable when the 25th and 50th responses were punished relative to those when the first response was punished.     

Comparison of drug effects on fixed-ratio performance and chain performance maintained under a second-order fixed-ratio schedule.

In one component of a multiple schedule, pigeons were required to complete the same four-response chain each session by responding sequentially on three identically lighted keys in the presence of four successively presented colors (chain performance). Food presentation occurred after five completions of the chain (i.e., after 20 correct responses). Errors, such as responding on the center or right key when the left was designated correct, produced a brief timeout but did not reset the chain. In the other component, responding on a single key (lighted white) was maintained by food presentation under a fixed-ratio 20 schedule. In general, phencyclidine and d-amphetamine produced dose-dependent decreases in the overall response rates in both components. With pentobarbital, overall rate in each component generally increased at intermediate doses and decreased at higher doses. All three drugs produced dose-dependent disruptive effects on chain-performance accuracy. Phencyclidine and pentobarbital increased percent errors at doses that had little or no rate-decreasing effects, whereas d-amphetamine generally increased percent errors only at doses that substantially decreased overall rate. At high doses, all three drugs produced greater disruption of chain performance than of fixed-ratio performance, as indicated by a slower return to control responding, although the effects of d-amphetamine were less selective than those of phencyclidine or pentobarbital.     

Reinforcing the absence of fixed-ratio performance

Pigeons received food for key pecking according to a fixed-ratio schedule, while, at the same time, food also was available for not pecking for a specified time. With a fixed ratio of 60, responding was not affected by not-pecking times of 80 or 40 seconds, and was eliminated completely at 10 seconds. With ratios of 180, pecking stopped with not-pecking times of 80 seconds or less; with ratios of 300, it stopped at 120 seconds or less. Not-responding schedules produced steady-state performance immediately following contact with the schedule. With return to the fixed-ratio schedule alone, response rate sometimes was elevated temporarily. When response-independent food presentations replaced the not-pecking schedule, response rate often was enhanced, and the ratio pattern was lost. Only the highest densities of food delivery eliminated responding, even with a fixed ratio of 300. In general, the effects corresponded to those of punishment, except that contrast had appeared both during and after punishment, and now appeared only after the response elimination procedure was suspended.     

Human performance on conjunctive fixed-interval fixed-ratio schedules

Eighteen young adults performed a lever-pulling task for money. Subjects were initially exposed to a fixed-interval 80-second schedule and subsequently to one of three conjunctive schedules in which the added fixed-ratio requirement was set at either 10, 80, or 120 responses. Three fixed-interval response patterns emerged: high constant rate, intermediate rate, or low rate, with most subjects displaying the last. Conjunctive performance was related to the subjects' prior fixed-interval patterns and the conjunctive ratio requirements. Low-rate subjects tended to optimize reinforcement (maximum reinforcers for minimum responses) on conjunctive schedules. Response rate was directly related to ratio requirements. Subjects' performance closely corresponded to their verbal statements of the contingencies.     

Response acquisition and fixed-ratio escalation based on interresponse times in rats

The effectiveness of a fixed‐ratio (FR) escalation procedure, developed by Pinkston and Branch (2004) and based on interresponse times (IRTs), was assessed during lever‐press acquisition. Forty‐nine experimentally naïve adult male Long Evans rats were deprived of food for 24 hr prior to an extended acquisition session. Before the start of the session, three food pellets were placed in the magazine. Otherwise, no magazine training, shaping, nor autoshaping procedure was employed. The first 20 presses each resulted in the delivery of a 45‐mg food pellet. Then, the FR increased (2, 4, 8, 11, 16, 20, 25, 30) when each IRT in the ratio was less than 2 s during three consecutive ratios. Sessions lasted 13 hr or until 500 pellets were earned. On average, rats reached a terminal ratio of 11 (mean) or 16 (median) during the first session. Seven rats reached the maximum value of FR 30 and only one rat did not acquire the response. In most rats, a break‐and‐run pattern of responding characteristic of FR schedules began to develop in this acquisition session. Subsequently, the ratio‐escalation procedure continued during daily 2‐hr sessions. In these sessions, the starting ratio requirement was set at the terminal ratio reached in the previous session. Using this procedure, over half (26) of the rats reached the FR 30 requirement by the fourth session. These data demonstrate that a ratio‐escalation procedure based on IRTs provides a time‐efficient way of establishing ratio responding.     

Response cost,reinforcement, and children's porteus maze qualitative performance

Sixty fourth-grade children were given two different series of the Porteus Maze Test. The first series was given as a baseline, and the second series was administered under one of four different experimental conditions: control, response cost, positive reinforcement, or negative verbal feedback. Response cost and positive reinforcement, but not negative verbal feedback, led to significant decreases in the number of all types of qualitative errors in relation to the control group. The reduction of nontargeted as well as targeted errors provides evidence for the generalized effects of response cost and positive reinforcement.     

Delayed reinforcement of fixed-ratio performance without mediating exteroceptive conditioned reinforcement

The performance of pigeons was studied under conditions in which the completion of a fixed-ratio requirement was not contiguous with the presentation of a reinforcer. Timein and timeout periods alternated throughout the experimental sessions. Responses made by an experimental bird during the timein period were accumulated, and when a fixed-ratio requirement had been met, grain was presented to the experimental bird and a yoked control following their first response in the next timein period. Across most manipulations of the fixed-ratio requirement and of the duration of the timeout period, the response rates of the experimental birds were considerably higher than those of their controls, suggesting that the response-reinforcer dependency controlled the behavior of the experimental bird in the absence of a close temporal association between responding on the ratio schedule and reinforcer presentations.     

Drug discrimination under a concurrent fixed-ratio fixed-ratio schedule.

Pigeons were trained to discriminate 5.0 mg/kg pentobarbital from saline under a two-key concurrent fixed-ratio 10 fixed-ratio 40 schedule of food presentation, in which the fixed-ratio component with the lower response requirement was programmed to reinforce responding on one key after drug administration (pentobarbital-biased key) and on the other key after saline administration (saline-biased key). After responding stabilized, pigeons averaged 98% of their responses on the pentobarbital-biased key during training sessions preceded by pentobarbital, and they averaged 90% of their responses on the saline-biased key during training sessions preceded by saline. In test sessions preceded by doses of pentobarbital, chlordiazepoxide, or ethanol, pigeons switched from responding on the saline-biased key at low doses to responding on the pentobarbital-biased key at higher doses (the dose-response curve was quantal). High doses of phencyclidine produced responding on both keys, whereas pigeons responded almost exclusively on the saline-biased key after all doses of methamphetamine. These and previous experiments using concurrent reinforcement schedules to study drug discrimination illustrate that the schedule of reinforcement is an important determinant of the shape of dose-effect curves in drug-discrimination experiments.     

The development of fixed-ratio performance under the influence of ribonucleic acid

The transition from fixed-ratio 1 performance (every response reinforced) to fixed-ratio 30 performance (every thirtieth response reinforced) was studied in nine pigeons. These were divided into three treatment groups given daily oral doses of saline, or 250 mg/kg/day or 500 mg/kg/day of yeast ribonucleic acid. Detailed computer-assisted analyses of how fixed-ratio behavior develops revealed the following typical sequence. After the transition, the first few ratios typically were emitted without long interresponse times within the ratio. Steady responding then ceased, and numerous long interresponse times occurred, with no systematic relationship to ordinal position within the ratio. Gradually, a new pattern evolved, characterized by a consistently long post-reinforcement time, a border region of the next few interresponse times within which the mean interresponse time monotonically decreased, and short interresponse times within the last 80% of the ratio. Long interresponse times were eliminated from this last section of the ratio without regard to proximity to reinforcement. Various analytical procedures suggested that the final pattern can be conceived, in part, as the shaping of a reliable response topography. The group of three pigeons given 250 mg/kg/day of yeast ribonucleic acid responded at higher rates than the saline and 500 mg/kg/day groups. The latter group, in contrast to the saline and lower dose groups, which continued to increase their rates, reached a rate asymptote very early.     

Responding under fixed-ratio and multiple fixed-interval fixed-ratio schedules of electric shock presentation

Squirrel monkeys, initially trained under a schedule of electric shock postponement and then under fixed-interval schedules of electric shock presentation, were studied under multiple fixed-interval fixed-ratio and under fixed-ratio schedules of shock presentation. Under the fixed-interval (10-min) component of the multiple schedule, a pause was followed by a gradual increase in responding to a rate maintained until shock presentation; under the fixed-ratio (3-, 10-, or 30-response) component of the multiple schedule, a brief pause was typically followed by a relatively high and uniform rate of responding until shock was presented. When the 60-sec timeout periods, which usually followed shock presentation, were eliminated from the multiple schedule for one monkey, responding was only transiently affected. In the one monkey studied, responding was maintained under a fixed-ratio schedule alone (with timeout periods), but rates of responding were lower than under the fixed-ratio component of the multiple schedule. Characteristic patterns of responding, similar to those engendered under schedules of food presentation or shock termination, can be maintained under fixed-ratio schedules of shock presentation; further, patterns of responding can be controlled by discriminative stimuli in multiple schedules.     

Cocaine and food deprivation: effects on food-reinforced fixed-ratio performance in pigeons.

Key pecking by 6 pigeons was maintained by a fixed-ratio 30 schedule of food presentation while body weights were 80% of free-feeding weights. Acute administration of cocaine (0.3 to 13.0 mg/kg, i.m.) dose-dependently decreased response rates. Dose-effect curves were shifted to the right when 3 of the 6 pigeons were maintained at 70% of free-feeding weights and were shifted to the left when the other 3 pigeons were maintained at 90% of free-feeding weights. Then a dose of cocaine that initially decreased response rates by more than 95% of control rates was administered before each daily session. Comparable degrees of tolerance to these rate-decreasing effects developed in the two groups. The rate at which responding recovered was relatively rapid for pigeons in the 70% free-feeding-weight group and was slower for 2 of the 3 pigeons in the 90% free-feeding-weight group. When body weights were then increased from 70% to 80% or were decreased from 90% to 80% of free-feeding weight, performance was disrupted initially only for pigeons whose weight went from 70% to 80% of free feeding. In the present experiment the degree of deprivation may have indirectly influenced the degree of tolerance that developed to cocaine's response rate-decreasing effects because it directly influenced the dose chosen to be administered chronically. The degree of deprivation appeared to have a more direct influence on the rate at which tolerance developed.     

Response cost in mainstreamed settings

This study illustrates the use of a response cost token system to decrease inappropriate behaviors of mainstreamed students in the regular classroom milieu. Data were taken on a student's inappropriate request for teacher attention and another student's inappropriate verbalizations. A reversal design was employed. Results showed that a response cost token system was a viable and effective method for decreasing inappropriate behaviors of mainstreamed students in the regular classroom. Reasons for the effectiveness of this technique were discussed.     

A choice technique to assess the effects of selective punishment on fixed-ratio performance

The emission of a fixed number of responses by rats was followed by food reinforcement. This fixed number could be accumulated in any way from two continuously available but mutually incompatible response classes, bar pressing, and not bar pressing for a fixed time period. A preference for one response class was arranged by specifying different maximum reinforcement rates for the two classes. Under selective punishment conditions, the preferred response occasionally led to both food and electric shock, while the non-preferred response led only to food. Selective punishment effects were measured through changes in the preference to the two responses in the sequence. The actions of shock intensity, deprivation, the specification of the non-preferred response, and three drugs were investigated. The results were broadly similar to the work reported by Dardano and Sauerbrunn (1964), who found localized increases in interresponse times before punished responses in fixed-ratio schedules. Performance under this procedure was found to be stable and sensitive to each of the experimental variables examined.     

Second-order schedules of token reinforcement: comparisons of performance under fixed-ratio and variable-ratio exchange schedules

Rats' lever pressing produced tokens according to a 20-response fixed-ratio schedule. Sequences of token schedules were reinforced under a second-order schedule by presentation of periods when tokens could be exchanged for food pellets. When the exchange period schedule was a six-response fixed ratio, patterns of completing the component token schedules were bivalued, with relatively long and frequent pauses marking the initiation of each new sequence. Altering the exchange period schedule to a six-response variable ratio resulted in sharp reductions in the frequency and duration of these initial pauses, and increases in overall rates of lever pressing. These results are comparable to those ordinarily obtained under simple fixed-ratio and variable-ratio schedules.