Non‐generalized and generalized conditioned reinforcers: establishment and validation

Conditioned reinforcers, or tokens, are frequently used in clinical settings; however, little applied research has focused on establishing and validating their effectiveness. Following pairing of a novel token with an edible reinforcer in the present study, preference and reinforcer assessments verified that the tokens functioned as conditioned reinforcers. Results indicated that the tokens were established as conditioned reinforcers that matched the reinforcer value of the primary reinforcers with which they had been paired. The effects of motivating operations (MOs) on the effectiveness of these conditioned reinforcers were then evaluated. Conditioned reinforcer effectiveness decreased during satiation conditions. Subsequently it was found that increasing the number of backup reinforcers with which the token was paired resulted in the effectiveness maintaining during satiation conditions. Copyright © 2008 John Wiley & Sons, Ltd.     

Effective use of the blank comparison procedure in simple discrimination by infant capuchin monkeys: A methodological note

In studies of simple and conditional discrimination, procedures are needed to measure those aspects of stimuli that control behavior. The blank comparison procedure is one such procedure. It was designed explicitly for assessing S+ and S- functions when discriminative stimuli are presented simultaneously. In this procedure, a neutral stimulus serves sometimes as S+ and sometimes as S-. Its discriminative function is defined in relation to other stimuli in the display. The present study aimed to prepare 2 infant female capuchin monkeys for the effective use of the blank comparison procedure in a simple discrimination task. First, simple discrimination training was applied up to a stable accuracy criterion of ≥90%. This training was followed by the replacement of S+ and then of S- stimuli with new stimuli. Ultimately, trials with the blank comparison were introduced. Following this sequence, both monkeys immediately displayed highly accurate blank-comparison performances without the need for stimulus control shaping or other preparatory discrimination training. Thus, this procedure sequence may be an efficient, effective method for establishing blank-comparison baselines for experimental analyses of S+/S- discriminative functions and perhaps for other applications in teaching simple and conditional discrimination performances to this species and others.     

Establishing praise as a conditioned reinforcer: Pairing with one versus multiple reinforcers

Praise and other forms of attention may not function as reinforcers for the behavior of children with autism. Previous research demonstrated that contingently pairing praise with reinforcers (response stimulus) can establish praise as a conditioned reinforcer. We evaluated a procedure for establishing praise as a generalized conditioned reinforcer (pair praise with four reinforcers) and compared it with a procedure to establish praise as a conditioned reinforcer (pair praise with one reinforcer). We compared the two conditions in a reversal design with “praise” and “no programmed consequence” conditions rapidly alternated after pairing phases. With three out of five participants with autism, responding in the “pair‐with‐four” condition showed higher levels of responding or more increasing trends compared with that in “pair‐with‐one” condition. We also replicated previous contingent pairing research with two participants in a multiple baseline across participants design. A limitation was the absence of manipulating motivating operations in assessing the efficacy of praise as a generalized conditioned reinforcer. Nevertheless, these data contribute to the research on establishing praise as a reinforcer, and we recommend directions for future research.     

Observing responses maintained by conditional discriminative stimuli.

In a conditional discrimination procedure, pigeons' observing responses were analyzed to examine whether two color stimuli (blue or red), conditionally related to whether each of two line stimuli (vertical or horizontal) accompanied reinforcement or nonreinforcement, functioned as conditioned reinforcers. If a variable-interval (VI) 10-s requirement was fulfilled, an observing response produced onset of a color stimulus. A little later, a line stimulus was presented independently of responding, added to the color stimulus to form a compound stimulus. If 55 s elapsed with a response not having occurred either through 55 s or after the variable-interval 10-s had timed out, one of the color-line compound stimuli was presented independently of responding. To control for sensory reinforcement effects and for earlier entrance to the later link, a simple discrimination procedure also was conducted in which reinforcement was not correlated with the color stimuli but with the line stimuli only. As in the conditional discrimination, the observing response also could produce earlier presentation of blue or red. The observing response occurred more frequently during the conditional discrimination than during the simple discrimination. The results were related to different theoretical accounts of conditioned reinforcement, particularly the information hypothesis.     

Conditioned suppression, punishment, and aversion

Three experiments were conducted to assess the aversive properties of a visual stimulus in the presence of which one group of birds received response-contingent shock (discriminated punishment) while a yoked group of birds received non-contingent shocks (conditioned suppression). In Experiment 1, presentation of the visual stimulus contingent on key pecking reduced the response rate (conditioned punishment effect) for birds under the conditioned suppression procedure but did not reduce the response rate of birds under the discriminative punishment procedure. Non-contingent shocks also produced greater suppression of responding maintained by positive reinforcement in the presence of a visual stimulus than did response-contingent shocks. In Experiment 2, a greater shock intensity (2 mA) was used. All the differences between the two groups found in Experiment 1 were also found in Experiment 2. Experiment 3 demonstrated that response-contingent shock did not result in a conditioned punishment effect even when positive reinforcers were unavailable during the discriminative punishment schedule. The exteroceptive stimulus that was paired with shock in the conditioned suppression procedure acquired the ability to punish behavior. The exteroceptive stimulus in the discriminative punishment schedule did not acquire this ability.     

Conditioned reinforcement and discrimination in second-order schedules

Pigeons were exposed to multiple second-order schedules in which responding on the “main key” was reinforced according to either a variable-interval or fixed-interval schedule by production of a brief stimulus on the “brief-stimulus key”. A response was required to the brief stimulus during its fourth (final) presentation to produce food; responses to the earlier brief stimuli indicated the extent to which the final brief stimulus was discriminated from preceding ones. Main-key response rates were higher in early components of paired brief-stimulus schedules, in which each brief stimulus was the same as that paired with reinforcement, than in comparable unpaired brief-stimulus or tandem schedules. Poor discrimination occurred between paired brief stimuli (Experiment I). When chain stimuli on the main key induced a discrimination between the first two and second two brief stimuli, the response-rate enhancement in the paired brief-stimulus schedule persisted (Experiment II). Rate enhancement diminished when the initial link of the chain included the first three components (Experiment IV). Eliminating the contingency between responding and brief-stimulus production also diminished rate enhancement (Experiment III). The results show that the discriminative and conditioned reinforcing effects of food-paired brief stimuli may be selectively manipulated and suggest that the reinforcing effects are modulated by other reinforcers in the situation.     

A PRELIMINARY EVALUATION OF EMPIRICALLY DERIVED CONSEQUENCES FOR THE TREATMENT OF PICA

Individualized treatment packages were developed for 3 children with high-rate severe pica using a discrimination training paradigm and a behavioral assessment-based procedure known as empirically derived consequences. Children received empirically derived reinforcers for eating under appropriate stimulus conditions (i.e., eating food only from a plate and placemat that served as a discriminative stimulus) and empirically derived punishers for attempts to engage in pica. This treatment package resulted in marked reductions in pica and an increase in appropriate eating for all 3 children in a “baited” analogue condition. In addition, low rates of pica were maintained for 9 months for all 3 children. These results suggest that treatment effectiveness may be enhanced when behavioral assessment data are used to identify potent consequences.     

Response-independent milk delivery enhances persistence of pellet-reinforced lever pressing by rats

If, during training, one stimulus is correlated with a higher rate of reinforcement than another, responding will be more resistant to extinction in the presence of that higher rate signal, even if many of the reinforcers have been presented independently of responding. For the present study we asked if the response-independent reinforcers must be the same as the response-dependent reinforcers to enhance the response's persistence. Twelve Long-Evans hooded rats obtained 45-mg food pellets by lever pressing (variable-interval 100-s schedules) in the presence of two discriminative stimuli (blinking vs. steady lights) that alternated every minute during daily sessions. Also, in the presence of one of the stimuli (counterbalanced across rats), the rats received additional response-independent deliveries of sweetened condensed milk (a variable-time schedule). Extinction sessions were exactly like training sessions except that neither pellets nor milk were presented. Lever pressing was more resistant to extinction in the presence of the milk-correlated stimulus when (a) the size of the milk deliveries during training (under a variable-time 30 s schedule) was 0.04 ml (vs. 0.01 ml) and (b) 120-s or 240-s blackouts separated components. Response-independent reinforcers do not have to be the same as the response-dependent reinforcers to enhance persistence.     

Instrumental learning as a result of omission training on wheel running

The present experiment sought to provide unequivocal evidence of instrumental learning under omission training. Hungry rats received free food reinforcement while spontaneously running in a wheel. For an omission group, running postponed or cancelled reinforcers in the presence of a discriminative stimulus (SD) requiring subjects to reduce responding to earn food. Background food presentations were then yoked to reinforcement delivered in the presence of the discriminative stimulus. For a control group, which received the same stimulus presentations, reinforcement delivery was yoked to the experimental group at all times. The procedure allowed both within- and between-subject comparisons between omission and response-independent schedules. The response-reinforcer delay under the omission contingency was adjusted so as to equate reinforcement frequency in the presence and absence of the SD. As the SD was not correlated differentially with reinforcement and the running response did not involve approach or withdrawal to the site of food delivery, the successful discrimination performance observed in this experiment cannot be accounted for by appeal to implicit classical conditioning. Instead, it is suggested that decreased running in the presence of the discriminative stimulus was based on the animals' veridical representation of the negative contingency between the response and reinforcement.     

Control by reinforcers across time and space: A review of recent choice research

Reinforcers affect behavior. A fundamental assumption has been that reinforcers strengthen the behavior they follow, and that this strengthening may be context‐specific (stimulus control). Less frequently discussed, but just as evident, is the observation that reinforcers have discriminative properties that also guide behavior. We review findings from recent research that approaches choice using nontraditional procedures, with a particular focus on how choice is affected by reinforcers, by time since reinforcers, and by recent sequences of reinforcers. We also discuss how conclusions about these results are impacted by the choice of measurement level and display. Clearly, reinforcers as traditionally considered are conditionally phylogenetically important to animals. However, their effects on behavior may be solely discriminative, and contingent reinforcers may not strengthen behavior. Rather, phylogenetically important stimuli constitute a part of a correlated compound stimulus context consisting of stimuli arising from the organism, from behavior, and from physiologically detected environmental stimuli. Thus, the three‐term contingency may be seen, along with organismic state, as a correlation of stimuli. We suggest that organisms may be seen as natural stimulus‐correlation detectors so that behavioral change affects the overall correlation and directs the organism toward currently appetitive goals and away from potential aversive goals. As a general conclusion, both historical and recent choice research supports the idea that stimulus control, not reinforcer control, may be fundamental.     

Dimensional stimulus control following brief wavelength training

Pigeons with extensive training pecking a key illuminated by a white line then had brief training with the key illuminated by 555 nanometers. This was immediately followed by a wavelength generalization test in extinction. Dimensional stimulus control about the training wavelength increased with the duration and number of reinforcements given on variable-interval 30-sec and variable-interval 10-sec schedules in Experiment I. In Experiment II, dimensional stimulus control was obtained after only 4 min of wavelength training from birds with prior and independent discrimination training. Experiment III provided groups equated in number of reinforcers with groups in Experiment I and two 8-min duration groups. Analyses, which included results from both Experiments I and III, showed that dimensional stimulus control increased: (a) more rapidly as a function of the duration of variable-interval 10-sec than variable-interval 30-sec reinforcement; (b) at the same rate across variable-interval reinforcement schedules, as a function of the number of reinforcers available during brief wavelength training.     

Substitutability between conditioned and primary reinforcers in discrimination acquisition.

Rats and pigeons were trained on a series of reversals of a conditional simultaneous discrimination. The percentage of reinforcement for correct trials was varied across reversals. When nonreinforced correct trials produced the same feedback as incorrect trials, the number of errors to reach an acquisition criterion was greater for smaller percentages of reinforcement, but the number of reinforcers required was either approximately constant or smaller for the smaller percentages. When a stimulus paired with food (the conditioned reinforcer) was added on nonreinforced correct trials, both measures were substantially decreased. When the same stimulus was presented, but without a history of food pairing, learning rate was similar to when no stimulus was presented on nonreinforced trials. The results provide direct evidence that conditioned reinforcers may substitute, although imperfectly, for a primary reinforcer, and that pairing with the primary reinforcer is a necessary condition for such substitutability to occur.     

Effects of ageing on visual discrimination learning in Drosophila melanogaster

Two experiments examined conditioned suppression of the Proboscis Extension Response (PER), unconditionally released by sucrose stimulation of gustatory tarsal receptors, in young (7-day-old), middle-aged (30-day-old) and old (50-day-old) Drosophila melanogaster males, reared at 25°C. Individual flies were trained in a differential conditioning procedure in which a white stimulus signalled a quinine reinforcer, whereas a black stimulus was non-reinforced. When trained from the outset with the discriminative procedure, flies of all ages acquired the discrimination, although the acquisition of PER suppression to the white stimulus was retarded in middle-aged and old flies. The retardation of the acquisition of PER suppression in middle-aged and old flies was replicated in a second study in which the flies received simple conditioning to the white stimulus prior to discrimination training.     

Function-altering effects of contingency-specifying stimuli

Contingengy-specifying stimuli (CSSs) can function differently than discriminative stimuli. Rather than evoking behavior due to a history of discrimination training, they alter the function of other stimuli and, therefore, the behavioral relations involving those stimuli. CSSs can alter the evocative function of discriminative stimuli, establishing operations, and conditional stimuli, as well as the efficacy of reinforcing and punishing stimuli and of stimuli that can function in second-order respondent conditioning. The concept of function-altering CSSs has implications for such areas of interest as stimulus equivalence, the terminology involving "rules" and "rule-governed behavior," and the way in which behavior analysts view the effects of such basic processes as reinforcement and punishment.     

Autoshaping the pigeon's gape response: acquisition and topography as a function of reinforcer type and magnitude.

The pigeon's key-pecking response is experimentally dissociable into transport (head movement) and gape (jaw movement) components. During conditioning of the key-pecking response, both components come under the control of the conditioned stimulus. To study the acquisition of gape conditioned responses and to clarify the contribution of unconditioned stimulus (reinforcer) variables to the form of the response, gape and key-contact responses were recorded during an autoshaping procedure and reinforcer properties were systematically varied. One group of 8 pigeons was food deprived and subgroups of 2 birds each were exposed to four different pellet sizes as reinforcers, each reinforcer signaled by a keylight conditioned stimulus. A second group was water deprived and received water reinforcers paired with the conditioned stimulus. Water- or food-deprived control groups received appropriate water or food reinforcers that were randomly delivered with respect to the keylight stimulus. Acquisition of the conditioned gape response frequently preceded key-contact responses, and gape conditioned responses were generally elicited at higher rates than were key contacts. The form of the conditioned gape was similar to, but not identical with, the form of the unconditioned gape. The gape component is a critical topographical feature of the conditioned key peck, a sensitive measure of conditioning during autoshaping, and an important source of the observed similarities in the form of conditioned and consummatory responses.     

Positive conditioned suppression: conditioned suppression using positive reinforcers as the unconditioned stimuli

Research has revealed the phenomenon of conditioned suppression in which the rate of responding is reduced during a stimulus that is paired with noncontingent shock. The present study replicated this procedure, but used noncontingent positive reinforcers instead of the aversive shock. The lever-pressing responses of rats were reinforced with food or water. While the rats were responding, a stimulus was occasionally presented and paired with the delivery of a noncontingent positive reinforcer, which was either food, water, or brain stimulation for different rats. The result was a reduction in the rate of responding during the conditioned stimulus. This finding shows that conditioned suppression occurs during a signal for reinforcing as well as aversive stimuli.     

Resistance to extinction versus extinction as discrimination

The hypothesis that response strength might be measured by persistence of responding in the face of extinction was discredited in the 1960s because experiments showed that responding persists longer following intermittent reinforcers than following continuous reinforcers. Instead, researchers proposed that the longer persistence following intermittent reinforcers arises because intermittent reinforcement more closely resembles extinction—a discrimination theory. Attention to resistance to extinction revived because one observation seemed to support the persistence hypothesis: Following training on a multiple schedule with unequal components, responding usually persisted longer in the formerly richer component than in the formerly lean component. This observation represents an anomaly, however, because results with single schedules and concurrent schedules contradict it. We suggest that the difference in results arises because the multiple-schedule procedure, while including extensive training on stimulus discrimination, includes no training on discrimination between food available and food unavailable, whereas comparable single- and concurrent-schedule procedures include such training with repeated extinction. In Experiment 1, we replicated the original result, and in Experiment 2 showed that when the multiple-schedule procedure includes training on food/no-food discrimination, extinction following multiple schedules contradicts behavioral momentum theory and agrees with the discrimination theory and research with single and concurrent schedules.     

Contextual conditional discriminations

Three experiments used a discriminated operant procedure to study conditional discrimination learning in rats. The first experiment showed that rats were capable of learning a biconditional discrimination in which two contexts served as conditional cues signalling the reinforcement contingencies associated with two discriminative stimuli. The discrimination was learned equally well when one discriminative stimulus signalled food, the other its absence, and when one stimulus signalled food, the other extinction plus mild footshock.

In Experiment 2 it was shown that prior training on such a conditional discrimination enhanced the subsequent context specificity of simple conditioning relative to control groups of animals for whom the prior training had not been conditional. Experiment 3 showed that a reversal of the significance of one pair of discriminative stimuli produced no spontaneous reversal in performance to a second, target, pair.

The pattern of results is best accounted for by an analysis of contextual conditional discrimination learning in terms of stimulus configurations and offers no support for the notion that rats may learn a general conditional rule or set.     

Establishing books as conditioned reinforcers for preschool children as a function of an observational intervention

We tested the effects of an observational intervention (Greer & Singer-Dudek, 2008) on establishing children's books as conditioned reinforcers using a delayed multiple baseline design. Three preschool students with mild language and developmental delays served as the participants. Prior to the intervention, books did not function as reinforcers for any of the participants. The observational intervention consisted of a situation in which the participant observed a confederate being presented with access to books contingent on correct responses and the participant received nothing for correct responses. After several sessions of this treatment, the previously neutral books acquired reinforcing properties for maintenance and acquisition responses for all three participants.     

The effect of discrimination training on responses to a new stimulus

Most previous research on the effect of the duration of preceding discrimination training on responding to a new stimulus has measured the responding during extinction. To reduce effects originating in the extinction procedure itself, the present study assessed the effect of discrimination training on responses to a new negative stimulus added during continued discrimination training. Pigeons were given a new negative stimulus (blue key) after 0, 1, 3, or 9 days of discrimination training with a yellow key as the positive stimulus, and both a green key and a red key as negative. Fewer responses were made to the blue key when it was introduced after nine days of discrimination training than after less discrimination training. That effect of long discrimination training agrees with reported results from extinction tests. However, the effect of briefer discrimination training in the present study differed from reported results with extinction testing. It appears that testing during continued discrimination training eliminates a distortion present in extinction tests of the effect of discrimination training on responding to a new stimulus.