Oral self-administration of pentobarbital by rhesus monkeys: relative reinforcing effects under concurrent fixed-ratio schedules.

During daily 3-hr sessions, orally delivered pentobarbital solutions and water, or two separate pentobarbital solutions, were concurrently available to rhesus monkeys according to fixed-ratio schedules of mouth contacts with a spout. First water, and then each of four "comparison-concentration" pentobarbital solutions (0.0625, 0.25, 1, and 4 mg/mL), was successively available from one spout for a block of sessions under a fixed-ratio-64 (three monkeys) or fixed-ratio-16 (one monkey) schedule. Under an identically sized fixed-ratio schedule, deliveries of a "standard-concentration" pentobarbital solution were concurrently available from a second spout. The concentration of the standard solution remained unchanged throughout testing of the series of comparison solutions. Each of three pentobarbital concentrations (4, 1, and 0.25 mg/mL) in turn served as the standard concentration. Within each pair of concurrently available solutions, the higher drug concentration maintained more behavior than the lower concentration. Thus when monkeys were provided with concurrent access to different pentobarbital concentrations, relative reinforcing effects were directly related to drug concentration. Further, the amount of behavior maintained by a particular drug concentration was dependent on the concentration of the concurrently available drug solution. Thus, the relative effectiveness of a reinforcer in maintaining behavior is a function of both the reinforcer's magnitude and the availability of alternative reinforcers in the environment.     

An operant approach to rehabilitation medicine: overcoming learned nonuse by shaping.

A new approach to the rehabilitation of movement, based primarily on the principles of operant conditioning, was derived from research with deafferented monkeys. The analysis suggests that a certain proportion of excess motor disability after certain types of injury involves a learned suppression of movement and may be termed learned nonuse. Learned nonuse can be overcome by changing the contingencies of reinforcement so that they strongly favor use of an affected upper extremity in the chronic postinjury situation. The techniques employed here involved 2 weeks of restricting movement of the opposite (unaffected) extremity and training of the affected limb. Initial work with humans has been with chronic stroke patients for whom the approach has yielded large improvements in motor ability and functional independence. We report here preliminary data suggesting that shaping with verbal feedback further enhances the motor recovery.     

Adventitious control by the location of comparison stimuli in conditional discriminations.

In a conditional discrimination procedure, samples appeared in a center key, and comparisons appeared in two of four outer keys. The location of comparison keys varied from trial to trial. Separate learning curves for each of the six possible pairs of comparison keys were plotted in a signal-detection space, revealing different patterns of progress on each pair. Also, when learned conditional discriminations were disrupted, pairs of keys differed in their patterns of disruption. Varying the location of comparison stimuli among six different pairs of keys had not eliminated key position as a controlling aspect of the stimuli. The variations simply increased the number of stimulus compounds--key position and experimental stimuli--that the subject learned. Plotting conditional-discrimination learning curves in a signal-detection space reveals relations among hits, false alarms, accuracy, and comparison preference that help to define a subject's progress.     

Preference for less frequent shock under fixed-interval schedules of electric-shock presentation.

Lever pressing by 2 squirrel monkeys was maintained under fixed-interval 6-min and fixed-interval 2-min schedules of electric-shock presentation. Preference for these schedules was assessed during three experimental phases. In all phases, responses on one lever produced shock according to one or the other fixed-interval schedule, and responses on a second, changeover, lever switched between schedules. The opportunity to change over was presented during separate choice periods (during which the fixed-interval schedules did not operate) that followed the first through fourth shocks in each schedule. If no changeover occurred during those choice periods, a changeover automatically occurred following the fifth shock. In Phase I, durations of the choice periods were fixed. In Phase II, the choice periods equaled a proportion of their respective fixed interval. During Phase III (completed with 1 monkey) a response on the changeover lever during a given choice period reinstated the most recent fixed interval, and a failure to respond resulted in a changeover. During each of these phases, distinct preferences developed for the 6-min schedule. These results suggest that the maintenance of lever pressing by fixed-interval presentation of electric shock may not be an example of positive reinforcement, and that the response-maintaining characteristics of shock presentation may derive from other properties of the schedule.     

Analysis of fixed-ratio behavior maintained by drug reinforcers.

Behavior maintained by intravenously delivered alfentanil, cocaine, or ketamine was assessed using a fixed-ratio schedule of reinforcement. As the dose of each drug was increased, rate of responding also increased up to a maximum. Further increases in dose resulted in decreased response rates (inverted U-shaped curve). An analysis of postreinforcement-pause-time and run-time measures for the ascending limb of the inverted U-shaped functions revealed that behavior was characterized by systematic decreases in both pause time and run time as dose and rate increased. An examination of the descending limb of the dose-response functions revealed that lowered response rates for cocaine and ketamine were correlated with increases in run time and small and inconsistent effects on postreinforcement pause time. Behavior maintained by rate-reducing doses of alfentanil was characterized by lengthened postreinforcement pauses with small increases in run time. These data suggest that at larger doses, drug reinforcers may have unconditioned or direct effects on the behavior that the drug is maintaining, and more important, that the nature of these unconditioned effects depends on the drug that is maintaining behavior.     

Enhancement of conditioned autonomic responses in monkey when preshock signals occasion operant suppression.

Classical pairings of a sound stilulus with shock elicited larger magnitude and more rapidly conditioned autonomic responses when subjects were responding on variable-interval schedules for food than when they were eating freely available food. The difference was not attributable to changes in control values of heart rate and blood pressure, or to alterations in motor activity, but appeared related to operant suppression.     

Pentobarbital self-administration in rhesus monkeys: drug concentration and fixed-ratio size interactions.

Performances of three rhesus monkeys were reinforced by the oral delivery of pentobarbital and studied as functions of fixed-ratio size and drug concentration. Pentobarbital solutions and water were concurrently available on identical reinforcement schedules from separate liquid-delivery systems during 3-hour sessions. Under a fixed-ratio 16 schedule of drug availability, a descending series of drug concentrations was tested (4, 2, 1, 0.5, 0.25, 0.125, and 0.0625 mg/ml, followed by a retest at 4 mg/ml). Partial concentration series beginning with the highest concentration were repeated with fixed-ratios of 32 and 64, with a fixed-ratio 128 for two monkeys, and with fixed-ratio 256 for one. At each fixed-ratio value, response rate and number of drug deliveries were inverted U-shaped functions of pentobarbital concentration. Drug intake (mg/kg/session) increased directly with drug concentration. As the fixed-ratio size was increased, the number of liquid deliveries decreased. For each drug concentration, when the numbers of drug deliveries at fixed-ratios of 32, 64, and 128 responses were plotted as percentages of those obtained at fixed-ratio 16, the following orderly relationship emerged: the higher the drug concentration, the less that drug deliveries were decreased by increases in fixed-ratio size. This relationship indicates an increase in reinforcing efficacy with increases in pentobarbital concentration.     

An interresponse-time analysis of responding maintained by schedules of response-produced electric shock

The present study investigated ratio contingencies to evaluate factors that may determine the maintenance of responding when electric shock is the consequent event. Initially, squirrel monkeys (Saimiri sciureus) were exposed to a continuous-avoidance schedule to initiate bar pressing. Subsequently, a multiple random-interval variable-ratio yoked schedule of response-produced shock was used to maintain and to compare interval and ratio performance. A microcomputer recorded and stored the number of responses and interresponse times occurring between successive shock presentations during a given random-interval component, and these numbers determined the ratio requirements during the subsequent ratio component. Responding was maintained for more than 80 sessions in two of three monkeys under the multiple schedule with the ratio yoked to the interval component. Responding during the ratio component persisted in only one monkey, however, when the components were no longer yoked. An analysis of the interresponse times immediately preceding shock under the multiple yoked schedule revealed that the terminal interresponse times were longer under the interval schedule than under the ratio contingency. The interresponse-time analysis indicated that differential interresponse-time relationships may be major determinants of the maintenance of behavior controlled by schedules of electric-shock presentation.     

Formation of the sameness-difference concept by Japanese monkeys from a small number of color stimuli

Japanese monkeys were trained to form the sameness-difference concept. In Experiment 1, four monkeys were trained with two colors to discriminate matching stimulus pairs from nonmatching pairs by reinforcing only lever-pressing responses to matching pairs with a variable-interval schedule. Three monkeys showed successful transfer of this discrimination to two new colors, thus demonstrating that some Japanese monkeys are able to form this relational concept from a minimum number of stimuli. In Experiment 2, two monkeys were trained, in a Yes/No procedure with three colors, to press one lever under matching pairs and another lever under nonmatching pairs. Poor transfer performances to three new colors suggest that simultaneously establishing two different response patterns to matching and nonmatching pairs is ineffective in forming the concept. In Experiment 3, the amount of transfer to three new colors after mastering a standard three-color matching-to-sample task was compared with that of a modified task in which correct responses were reinforced with a within-trial variable-interval schedule. All three monkeys showed greater transfer with the modified procedure. The results suggest that the variable-interval schedule adopted within trials is effective in forming the sameness-difference concept.     

The conditioned reinforcement of repeated acquisition

Three monkeys were trained to emit a chain of three responses on three separate levers in a set of six levers to obtain food. The chain producing food (correct chain) was changed each day. During a trial, a press on any lever produced a feedback stimulus; a press on a correct lever produced an additional distinctive stimulus; the third correct press produced a food pellet. Test sessions in which either the food or the distinctive stimuli were removed were interspersed with baseline sessions. In tests without food presentations, the subjects acquired the correct chain rapidly, with a level of accuracy comparable to baseline. Removing the distintive stimuli for either the first or second member of the correct chain greatly retarded acquisition of that member of the chain. Removing all distinctive stimuli often reduced accuracy throughout the chain to chance level, even though food was presented following each correct chain. These results were interpreted as evidence that the distinctive stimuli presented after correct responses functioned as conditioned reinforcers. Reductions in accuracy following an omitted distinctive stimulus indicated that they were also discriminative stimuli for correct responding in their presence.