Social preference in rats

Rats were given repeated choices between social and nonsocial outcomes, and between familiar and unfamiliar social outcomes. Lever presses on either of 2 levers in the middle chamber of a 3-chamber apparatus opened a door adjacent to the lever, permitting 45-s access to social interaction with the rat in the chosen side chamber. In Experiment 1, rats preferred (a) social over nonsocial options, choosing their cagemate rat over an empty chamber, and (b) an unfamiliar over a familiar rat, choosing a non-cagemate over their cagemate. These findings were replicated in Experiment 2 with 2 different non-cagemate rats. Rats preferred both non-cagemate rats to a similar degree when pitted against their cagemate, but were indifferent when the 2 non-cagemates were pitted against each other. Similar preference for social over nonsocial and non-cagemate over cagemate was seen in Experiment 3, with new non-cagemate rats introduced after every third session. Response rates (for both cagemate and non-cagemate rats) were elevated under conditions of nonsocial (isolated) housing compared to conditions of social (paired) housing, demonstrating a social deprivation effect. Together, the experiments contribute to an experimental analysis of social preference within a social reinforcement framework, drawing on methods with proven efficacy in the analysis of reinforcement more generally.     

A comparison of accumulated and distributed reinforcement periods with children exhibiting escape-maintained problem behavior

Differential reinforcement is a common treatment for escape-maintained problem behavior in which compliance is reinforced on a fixed-ratio (FR) 1 schedule with brief access to positive and/or negative reinforcement. Recent research suggests some individuals prefer to complete longer work requirements culminating in prolonged (i.e. accumulated) reinforcement periods relative to brief (i.e. distributed) periods, but prolonged work exposure may evoke problem behavior and prevent compliance from contacting reinforcement when treating escape-maintained problem behavior. We exposed 3 children with escape-maintained problem behavior to both distributed (FR 1 resulting in 30 s of reinforcement) and accumulated (FR 15 resulting in 7.5 min of reinforcement) arrangements to compare their efficacy in maintaining low levels of problem behavior. We then assessed participants' preferences for these conditions in a concurrent-chains arrangement. Accumulated-reinforcement arrangements did not occasion additional problem behavior, but rather resulted in consistently lower levels of problem behavior for 2 of 3 participants. Participants demonstrated idiosyncratic preferences.     

Concurrent access to two concentrations of orally delivered phencyclidine: effects of feeding conditions.

Two experiments addressed the effects of food satiation and deprivation on oral self-administration of two concurrently available phencyclidine concentrations. In the first experiment, 8 rhesus monkeys self-administered either of two concentrations of phencyclidine ("PCP, angel dust") and water under concurrent fixed-ratio 16 schedules. One concentration was always held constant (0.25 mg/mL) while a series of other phencyclidine concentrations, ranging from 0 (water) to 1.0 mg/mL, was presented in a nonsystematic order. Initially the monkeys were tested while food satiated, and the procedure was then repeated during food deprivation. The monkeys usually selected the higher concentration within the first few minutes of the session, indicating that taste and/or other immediate postingestional effects were important factors. Contrary to a number of previous reports, there were no consistent differences across subjects in the mean number of liquid deliveries or mean drug intake (mg/kg) during food satiation and deprivation. However, for all monkeys the within-session time course of responding during food satiation consistently differed from that during deprivation. A second experiment assessed whether the failure to find consistent differences in drug intake during food satiation and deprivation had been due to the history of concurrent access to different phencyclidine concentrations or to the extended experience with phencyclidine under food-satiation conditions. Six additional monkeys (Group 2) were exposed to the phencyclidine self-administration procedure (during food satiation and deprivation) for the same length of time as the monkeys in Experiment 1 (Group 1), except they received only concurrent access to phencyclidine (0.25 mg/mL) and water. Both groups then received concurrent access to phencyclidine and water during five repeated cycles of food deprivation and satiation. There were also marked individual differences in Group 2: During food satiation, 2 of the monkeys' responding increased, 1 showed no change, and 3 decreased. Examination of a number of historical variables indicated that the greater the percentage of total sessions spent during food satiation with phencyclidine available (before these experiments began), the greater the amounts of phencyclidine consumed during food satiation and the smaller the differences in phencyclidine intake when the two feeding conditions were compared.     

Effects of delayed conditioned reinforcement in chain schedules.

The contingency between responding and stimulus change on a chain variable-interval 33-s, variable-interval 33-s, variable-interval 33-s schedule was weakened by interposing 3-s delays between either the first and second or the second and third links. No stimulus change signaled the delay interval and responses could occur during it, so the obtained delays were often shorter than the scheduled delay. When the delay occurred after the initial link, initial-link response rates decreased by an average of 77% with no systematic change in response rates in the second or third links. Response rates in the second link decreased an average of 59% when the delay followed that link, again with little effect on response rates in the first or third links. Because the effect of delaying stimulus change was comparable to the effect of delaying primary reinforcement in a simple variable-interval schedule, and the effect of the unsignaled delay was specific to the link in which the delay occurred, the results provide strong evidence for the concept of conditioned reinforcement.     

Variable-interval schedules of timeout from avoidance

Rats were trained on concurrent schedules in which pressing one lever postponed shock and pressing the other occasionally produced a 2-min timeout during which the shock-postponement schedule was suspended and its correlated stimuli were removed. Throughout, the shock-postponement schedule maintained proficient levels of avoidance. Nevertheless, in Experiment 1 responding on the timeout lever was established rapidly, was maintained at stable levels on variable-interval schedules, was extinguished by withholding timeout, was reestablished when timeout was reintroduced, and was brought under discriminative control with a multiple variable-interval extinction schedule of timeout. These results are in contrast with Verhave's (1962) conclusion that timeout is an ineffective reinforcer when presented to rats on intermittent schedules. In Experiment 2 the consequence of responding on the timeout lever was altered so that the shock-postponement schedule remained in effect even though the stimulus conditions associated with timeout were produced for 2 min. Responding extinguished, indicating that suspension of the shock-postponement schedule, not stimulus change, was the source of reinforcement. By establishing the reinforcing efficacy of timeout with standard variable-interval schedules, these experiments illustrate a procedure for studying negative reinforcement in the same way as positive reinforcement.     

Superstitious behavior in humans

Twenty undergraduate students were exposed to single response-independent schedules of reinforcer presentation, fixed-time or variable-time, each with values of 30 and 60 s. The reinforcer was a point on a counter accompanied by a red lamp and a brief buzzer. Three color signals were presented, without consistent relation to reinforcer or to the subjects' behavior. Three large levers were available, but the subjects were not asked to perform any particular behavior. Three of the 20 subjects developed persistent superstitious behavior. One engaged in a pattern of lever-pulling responses that consisted of long pulls after a few short pulls; the second touched many things in the experimental booth; the third showed biased responding called sensory superstition. However, most subjects did not show consistent superstitious behavior. Reinforcers can operate effectively on human behavior even in the absence of a response-reinforcer contingency and can, in some cases, shape stable superstitious patterns. However, superstitious behavior is not a consistent outcome of exposure of human subjects to response-independent reinforcer deliveries.     

Control of responding during stimuli that precede transitions in reinforcement frequency

Pigeons' responses were reinforced on a variant of a mixed variable-interval extinction schedule of reinforcement in which the transition to the higher reinforcement rate was signaled by a trace stimulus projected on the response key prior to the onset of the component correlated with food delivery. In the first of two experiments, the duration of the trace stimulus preceding the component correlated with food delivery was varied from 1.5 to 50.0 s and in the second experiment, the reinforcement frequency in the same component was varied from 10 to 60 reinforcers per hour. Pigeons pecked at the trace stimulus preceding the onset of the component correlated with food delivery even though responding was not reinforced in its presence and only one of the changes in reinforcement rate (i.e., from extinction to reinforcement) was signaled. The rate of pecking during the trace stimulus was a function of its duration but not of the reinforcement frequency in the following component. Higher rates generally occurred at the shorter trace-stimulus durations. Component responding following the offset of the trace stimulus was under discriminative control of the trace stimulus whether or not responding occurred in the presence of the trace stimulus.     

A cost-benefit analysis of demand for food.

Laboratory studies of consumer demand theory require assumptions regarding the definition of price in the absence of a medium of exchange (money). In this study we test the proposition that the fundamental dimension of price is a cost-benefit ratio expressed as the effort expended per unit of food value consumed. Using rats as subjects, we tested the generality of this "unit price" concept by varying four dimensions of price: fixed-ratio schedule, number of food pellets per fixed-ratio completion, probability of reinforcement, and response lever weight or effort. Two levels of the last three factors were combined in a 2 x 2 x 2 design giving eight groups. Each group was studied under a series of six FR schedules. Using the nominal values of all factors to determine unit price, we found that grams of food consumed plotted as a function of unit price followed a single demand curve. Similarly, total work output (responses x effort) conformed to a single function when plotted in terms of unit price. These observations provided a template for interpreting the effects of biological factors, such as brain lesions or drugs, that might alter the cost-benefit ratio.     

Preference and resistance to change with constant-duration schedule components

Previous research on preference between variable-interval terminal links in concurrent chains has most often used variable-duration terminal links ending with a single reinforcer. By contrast, most research on resistance to change in multiple schedules has used constant-duration components that include variable numbers of reinforcers in each presentation. Grace and Nevin (1997) examined both preference and resistance in variable-duration components; here, preference and resistance were examined in constant-duration components. Reinforcer rates were varied across eight conditions, and a generalized-matching-law analysis showed that initial-link preference strongly over-matched terminal-link reinforcer ratios. In multiple schedules, baseline response rates were unaffected by reinforcer rates, but resistance to intercomponent food, to extinction, and to intercomponent food plus extinction was greater in the richer component. The between-component difference in resistance to change exhibited additive effects for the three resistance tests, and was systematically related to reinforcer ratios. However, resistance was less sensitive to reinforcer ratios than was preference. Resistance to intercomponent food and to intercomponent food plus extinction was more sensitive to reinforcer ratios in the present study than in Grace and Nevin (1997). Thus, relative to variable-duration components, constant-duration components increased the sensitivity of both preference and relative resistance, supporting the proposition that these are independent and convergent measures of the effects of a history of reinforcement.     

Temporal discrimination learning of operant feeding in goldfish (Carassius auratus)

Operant temporal discrimination learning was investigated in goldfish. In the first experiment, there was a fixed daily change in illumination. Eight subjects were trained to operate a lever that reinforced each press with food. The period during which responses were reinforced was then progressively reduced until it was 1 hr in every 24. The final 1-hr feeding schedule was maintained over 4 weeks. The feeding period commenced at the same time each day throughout. The food dispensers were then made inactive, and a period of extinction ensued for 6 days. The pattern of responding suggested that the fish were able to exhibit temporal discrimination in anticipation of feeding time. This pattern of responding persisted for a limited number of days during the extinction procedure. The second experiment produced evidence that operant temporal discrimination could develop under continuous illumination.