Deprivation and satiation: The interrelations between food and wheel running

Two experiments were designed to assess whether depriving rats of food would increase the reinforcement effectiveness of wheel running (Experiment 1) and whether satiation for wheel running would decrease the reinforcement effectiveness of food (Experiment 2). In Experiment 1, a progressive-ratio schedule was used to measure the reinforcement effectiveness of wheel running when rats were deprived or not deprived of food. Completion of a fixed number of lever presses released a brake on a running wheel for 60 s, and the response requirement was systematically increased until the rat stopped pressing or until 8 hr had elapsed. The ratio value reached (and the total number of lever presses) was an inverted-U function of food deprivation (percentage body weight). In Experiment 2, when wheel running preceded test sessions, fewer food-reinforced lever presses were maintained by the progressive-ratio schedule, and responding occurred at a lower rate on a variable-interval schedule. An interpretation of these results is that deprivation or satiation with respect to one event (such as food) alters the reinforcement effectiveness of a different event (such as access to wheel running).     

CONTINGENT REINFORCEMENT FOR CARBON MONOXIDE REDUCTION: WITHIN-SUBJECT EFFECTS OF PAY AMOUNT

The relationship between reinforcer amount and daytime smoking reduction in smokers offered money for reduced afternoon breath carbon monoxide (CO) levels was examined. Twenty-three hired regular smokers with average baseline CO levels of about 30 ppm were exposed in random order to five sliding scale payment schedules that changed daily or weekly. Money was available for afternoon CO readings between 0 and 21 ppm with pay amount inversely related to the absolute CO reading obtained. Maximum pay amount for readings below 7 ppm varied among $0, $1.50, $3, $6, and $12 per day. Contingent reinforcement promoted CO and daytime cigarette reduction within individuals with the amount of behavior change related to the amount of payment available. Average CO levels decreased from 30 to 15 ppm as a function of pay amount whereas self-reported daytime cigarettes decreased from 12 to 5 per day. Average minutes of cigarette abstinence prior to the afternoon study contact increased from 62 to 319 minutes as a function of pay amount, whereas the percentage of available money earned increased from 22% to 48%. Nontargeted evening cigarette use also decreased during periods of daytime smoking reduction. The orderly effects of this contingent reinforcement intervention on daytime smoking of regular smoker volunteers suggest that this is a sensitive model for continued evaluation of factors that influence smoking reduction and cessation.     

REDUCING SELF-INJURY AND CORRESPONDING SELF-RESTRAINT THROUGH THE STRATEGIC USE OF PROTECTIVE CLOTHING

We examined the use of protective clothing to reduce a retarded male's face-punching and leg-kicking and two corresponding forms of self-restraint—arm and leg self-restraint. The resident was observed each day in three sessions of randomly ordered conditions (one condition per session): without any protective clothing, with a padded helmet, and with a padded helmet and padded slippers. Use of the padded helmet substantially reduced face-punching and arm self-restraint. The addition of padded slippers reduced leg-kicking and leg self-restraint. These results suggest a practical and effective means of controlling self-injury and self-restraint. They are also consistent with the possibility that the resident's arm restraint was maintained in part by escape or avoidance of face-punching and that his leg restraint was maintained in part by escape or avoidance of leg-kicking.     

Delayed reinforcement as an indiscriminable contingency in verbal/nonverbal correspondence training

We investigated the programming of generalization and maintenance of correspondence between verbal and nonverbal behavior in a preschool setting. Four children participated in a series of multiple-baseline designs. In Experiment 1, delayed reinforcement of verbal behavior effectively controlled maintenance of correspondence with previously trained responses and also resulted in generalization of correspondence to one untrained response. As the latter effect was limited, Experiment 2 was a further assessment of the effects of delayed reinforcement of generalization of correspondence to untrained responses, and consistent generalization was shown. Experiment 2 also showed that generalization, if lost, could be recovered through use of "booster training," in which the original contingencies were reinstated for a brief period. Experiment 3 provided replications, with two additional children, of the effects of delayed reinforcement on maintenance of correspondence. Results are discussed in terms of using delayed reinforcement as an indiscriminable contingency.     

STIMULUS (INSTRUCTIONAL) FADING DURING EXTINCTION OF SELF-INJURIOUS ESCAPE BEHAVIOR

Three individuals with developmental disabilities were exposed to a series of assessment conditions to identify the source of reinforcement for their self-injurious behavior. In each case, self-injury occurred most often in instructional (demand) situations containing a brief time-out from the task contingent on self-injury, indicating that the behavior was an escape response (i.e., maintained by negative reinforcement). Treatment was implemented in a multiple baseline across subjects design and consisted of extinction (prevention of escape) plus instructional fading (initial elimination of instructions followed by their gradual reintroduction). Results showed that the combined treatment produced immediate and large reductions in self-injury that were maintained as the frequency of instructions was increased across sessions to match the original baseline rate of presentation. Results of a component analysis conducted with 1 subject suggested that stimulus fading accelerated the behavior-reducing effects of extinction.     

Effects of differences between stimuli, responses, and reinforcer rates on conditional discrimination performance

In a discrete-trial conditional discrimination procedure, 4 pigeons obtained food reinforcers by pecking a key with a short latency on trials signaled by one stimulus and by pecking the same key with a long latency on trials signaled by a second stimulus. The physical difference between the two stimuli and the temporal separation between the latency values required for reinforcement were varied factorially over four sets of conditions, and the ratio of reinforcer rates for short and long latencies was varied within each set of conditions. Stimulus discrimination varied directly with both stimulus and response differences and was unaffected by the reinforcer ratio. Sensitivity to reinforcement, estimated by generalized-matching-law fits to the data within each set of conditions, varied directly with the response difference but inversely with the stimulus difference arranged between sets of conditions. Because variations in stimulus differences, response differences, and reinforcer differences did not have equivalent effects, these findings question the functional equivalence of the three terms of the discriminated operant: antecedent stimuli, behavior, and consequences.     

Delay reduction: current status.

Delay-reduction theory states that the effectiveness of a stimulus as a conditioned reinforcer may be predicted most accurately by the reduction in time to primary reinforcement correlated with its onset. We review support for the theory and then discuss two new types of experiments that assess it. One compares models of choice in situations wherein the less preferred outcome is made more accessible; the other investigates whether frequency of conditioned reinforcement affects choice beyond the effect exerted by frequency of primary reinforcement.     

Violations of transitivity: Implications for a theory of contextual choice

Violations of strong stochastic transitivity in concurrent-chains choice were first reported by Navarick and Fantino. In a series of articles, Navarick and Fantino concluded that neither a unidimensional model capable of predicting exact choice probabilities nor a fixed-variable equivalence rule was possible for the concurrent-chains procedure. I show that when choice is modeled contextually (i.e., when preference for a schedule is affected by factors other than the schedule itself, e.g., aspects of the alternative schedule), a unidimensional, exact-choice probability model is possible that both predicts the intransitivities reported by Navarick and Fantino and provides a fixed-variable equivalence rule for the concurrent-chains procedure. The contextual model is an extension of the generalized matching law and violates a key assumption underlying traditional choice models—simple scalability—because of (a) schedule interdependence and (b) bias from procedural contingencies. Therefore, strong stochastic transitivity cannot be expected to hold. Contextual scalability is analyzed to reveal a hierarchy of context effects in choice. Navarick and Fantino's intransitivities can be satisfactorily explained by bias. If attribute sensitivity is context dependent, however, and if there are similarity structures among choice alternatives, the contextual model is shown to be able to predict violations of ordinal preference. Therefore, it may be possible to formulate a deterministic, general psychophysical model of choice as a behavioral alternative to probabilistic, multidimensional choice theories.