Stimulus control and compounding with ambient odor as a discriminative stimulus on a free-operant baseline

Previous experiments have demonstrated that the simultaneous presentation of independently established discriminative stimuli can control rates of operant responding substantially higher than the rates occasioned by the individual stimuli. This "additive summation" phenomenon has been shown with a variety of different reinforcers (e.g., food, water, shock avoidance, cocaine, and heroin). Discriminative stimuli previously used in such studies have been limited to the visual and auditory sensory modalities. The present experiment sought to (1) establish stimulus control on a free-operant baseline with an ambient olfactory discriminative stimulus, (2) compare olfactory control to that produced with an auditory discriminative stimulus, and (3) determine whether compounding independently established olfactory and auditory discriminative stimuli produces additive summation. Rats lever pressed for food on a variable-interval schedule in the presence of either a tone or an odor, with comparable control developed to each stimulus. In the absence of these stimuli responding was not reinforced. During stimulus compounding tests, the tone-plus-odor compound occasioned more than double the responses occasioned by either the tone or odor presented individually. Thus, the current study (1) established stimulus control with an ambient olfactory discriminative stimulus in a traditional free-operant setting and (2) extended the generality of stimulus-compounding effects by demonstrating additive summation when olfactory and auditory discriminative stimuli were presented simultaneously.     

Compounding discriminative stimuli controlling free-operant avoidance

The performances of three rats were stabilized on a multiple schedule that maintained responding by a free-operant avoidance schedule during independent presentations of tone and light. The simultaneous absence of these stimuli signalled shock-free periods and controlled response cessation. Subsequently, test sessions were administered consisting of independent presentations of each stimulus and these stimuli compounded (tone-plus-light). During an extinction test, additive summation was observed to the compounded stimuli, i.e., more responses were emitted to the compound than to either tone or light. During a series of 28 maintenance-test sessions in which the shock schedule remained operative, the compounded stimuli produced a generally enhanced response rate and fewer pauses terminating with shock than either single stimulus condition. These results extend the generality of free-operant additive summation to responding maintained by aversive control. In addition, a comparison of the present study with previous experiments reporting additive summation of positively reinforced responding indicates that similar variables—rate and aversive differences between training stimulus conditions—should be considered in accounting for response distributions during stimulus compounding when responding is controlled by either positive or negative contingencies.     

The integration of habits maintained by food and water reinforcement through stimulus compounding.

In Experiment 1, a light and a tone were correlated independently with water reinforcement of bar pressing by rats. With different naive subjects in Experiment 2, one of these stimuli was correlated with food and the other with water reinforcement (counterbalanced). In both experiments the absence of tone and light signaled extinction. Tests of stimulus-reinforcer independence in Experiment 2 indicated that tone and light controlled behavior whose rate was specifically affected by deprivation state. In the stimulus-compounding tests of both experiments, response rates were higher to tone-plus-light than to tone or light presented alone (additive summation). This is the first report of additive summation produced through compounding stimuli paired with different reinforcers. The results are discussed in the context of the effects of incentive motivation on operant performance.     

Differential effects of a food-based conditioned inhibitor on food- or cocaine-seeking behavior

The present experiment compared the effects of a food-based conditioned inhibitor on food seeking vs. cocaine seeking behavior. In two groups of rats, the A+/AB− Pavlovian conditioned inhibition procedure was used to create a conditioned inhibitor for food. Then, for one group of rats (Food-Food Group), a click stimulus was established as an operant discriminative stimulus (S^D) for food-reinforced lever pressing. In the other group (Food-Cocaine Group), the click was established as an S^D for cocaine self-administration. In testing, the putative inhibitor for food was simultaneously presented with the click for the first time in both groups. In the Food-Food Group, the food-based inhibitor suppressed responding occasioned by the click significantly more than did a neutral control stimulus. In contrast, in the Food-Cocaine Group, there was no difference in the amount of suppression produced by the food-based inhibitor and the control stimulus. These results suggest that the effects of food-based Pavlovian conditioned inhibitors are specific for food-motivated behavior and do not easily transfer to cocaine-motivated behavior.     

Compounding of discriminative stimuli from the same and different sensory modalities

Rats' responding was maintained by fixed-interval schedules of reinforcement in the presence of a tone or two separate lights. The lights were either of low, moderate, or high intensity. Compounds of these single discriminative stimuli each maintained a greater frequency of response than did the single stimuli, and the compound composed of stimuli from different sensory modalities (light+tone) maintained a greater level of responding than did the compound composed of stimuli from the same sensory modality (light+light). Combining lights of different intensity had no differential effect on responding. However, in the second experiment, a compound composed of a light and a tone, each of greater intensity than the light and tone of another compound, initially maintained a higher frequency of response, demonstrating intensity effects during stimulus compounding when the increase in intensity occurs through the component stimuli. This intensity effect, however, was only transitory.     

Visual dominance in inhibitory conditioning in the pigeon

In a conditioned inhibition paradigm (A+, B+, AX?_, pigeons received either of two keylight stimuli reliably followed by food (A+, B+). However, when one of these keylights was accompanied by another stimulus, food did not follow (AX?). For some groups, the putative inhibitor was a tone, whereas for others it was illumination of a red houselight. The birds pecked the A and B stimuli at a high rate. When X was red houselight, the birds pecked A at a much lower rate in the presence of X. When X was a tone, discrimination between A and AX was much poorer. Moreover, in a transfer test, red houselight inhibited responding to the other keylight, B, but tone did not. These results indicate that red houselight becomes a conditioned inhibitor more quickly than tone in appetitive situations, just as red houselight becomes a conditioned excitor more quickly in those situations. These results contradict the assertion that the latter outcome occurs because red houselight is a stronger appetitive excitor than tone at the start of the experiment (the “head start” hypothesis).     

Compounding of discriminative stimuli that maintain responding on separate response levers

In Experiment 1, rats' responses were reinforced on a fixed-interval 30-sec schedule in the presence of either a light or a tone and were not reinforced in their absence. Each stimulus was correlated with its own response lever, with only one lever present during a session. When light and tone were compounded in the presence of the tone-correlated lever, no change in responding occurred. However, when tone was compounded with light in the presence of the light-correlated lever, level of responding was greater than to light alone (response summation). Summation was also found when each stimulus was correlated with the same lever. Next, light and tone were again correlated with separate levers, but both levers were always simultaneously present. Compounding produced both summation and emission of most responses on the light-correlated lever. This prepotency of light was reduced (1) by leaving a houselight on throughout the session; and (2) by correlating each stimulus with a different schedule (either fixed-interval 4.7-sec or fixed-interval 30-sec). With a medium- and high-intensity houselight and with the different reinforcement schedules, similar results were obtained during compounding, regardless of whether compounding occurred in the presence of the light- or tone-correlated lever.     

Effects of compounding drug-related stimuli: escalation of heroin self-administration

Previous experiments have demonstrated that presenting independently established discriminative stimuli in compound can substantially increase operant responding maintained by food reinforcement or shock avoidance. Recently, this phenomenon was also shown to occur with cocaine self-administration. The present study further assessed the generality of these stimulus-compounding effects by systematically replicating them with heroin self-administration. Rats' nose-poke responses produced intravenous heroin (0.025 mg/kg per infusion) on a variable-ratio schedule when either a tone or a light was present. In the absence of these stimuli, responding was not reinforced. Once discriminative control by the tone and light had been established, the stimuli were presented in compound under extinction (with heroin discontinued) or maintenance conditions (with heroin available during test-stimulus presentations). In extinction, the tone-light compound increased responding approximately threefold compared to tone or light alone. Under maintenance conditions, compounding increased heroin intake approximately twofold. These effects closely matched those obtained earlier with cocaine. This consistency across pharmacological classes and across drug and nondrug reinforcers further confirms that (a) self-administered drugs support conditioning and learning in a manner similar to that supported by other reinforcers; and (b) multiple drug-related cues interact in lawful and predictable ways to affect drug seeking and consumption.     

Unequal associative changes when excitors and neutral stimuli are conditioned in compound

In four experiments a compound of a previously conditioned excitor and a neutral stimulus was either reinforced with food or nonreinforced. Two experiments used a magazine approach procedure in rats, and two used an autoshaping procedure in pigeons. All experiments employed a novel compound test procedure, which permitted evaluation of the size of the associative change that took place for the excitatory and neutral stimuli. Reinforcement of the compound resulted in greater increments in the associative strength of the neutral stimulus than of the excitor. Nonreinforcement of the compound resulted in greater decrements in the associative strength of the excitor than of the neutral stimulus. These results agree with earlier experiments with compounds of excitors and inhibitors and provide an additional challenge to contemporary error-correction models of conditioning.     

Conditional acceleration and external disinhibition of operant lever pressing by prereward, neutral, and reinforcing stimuli

Rats responding under a differential-reinforcement-of-low-rate schedule increased their rates of lever pressing during a 20-second click/flash stimulus that preceded the delivery of a response-independent food pellet. The increase could not be attributed to suppression of collateral behavior that has been said to mediate temporally-spaced responding. We propose that the prereward stimulus functioned as an external disinhibitor of lever pressing that had been inhibited by the constraints of the operant schedule. Support is derived from the observed disinhibitory effects of a 10-second unpaired click/flash stimulus and of unsignaled, response-independent pellets that were presented while the animals were responding under the same schedule.     

Nodal structure and stimulus relatedness in equivalence classes: post-class formation preference tests

Three experiments used postclass formation within-class preference test performances to evaluate the effects of nodal distance on the relatedness of stimuli in equivalence classes. In Experiment 1, two 2-node four-member equivalence classes were established using the simultaneous protocol in which all of the baseline relations were trained together, after which all emergent relations probes were presented together. All training and testing was done using match-to-sample trials that contained two comparisons. After class formation, the effects of nodal distance were evaluated using within-class preference tests that contained samples and both comparisons from the same class. These tests yielded inconsistent performances for most participants. Experiment 2 replicated Experiment 1, but a third null comparison was used on all trials during class formation. Thereafter, virtually all of the within-class probes, for all participants, evoked performances that were consistent with the predicted effects of nodal distance, that is, the selection of comparisons that were nodally closer to the samples. It appears, then, that the establishment of the equivalence classes with a third null comparison induced control by nodal structure of the classes. Experiment 3 demonstrated the generality of these findings with larger classes that contained more nodal separations, that is, three-node five-member classes. Emergent-relations tests conducted immediately after the within-class tests showed the classes to be intact. Thus, the differential relatedness of stimuli in a class or their interchangeability depended on the content of a test trial: within-class probes occasioned responding indicative of differential strength among the stimuli in the class, while cross-class tests occasioned responding indicative of interchangeability of stimuli in the same class.     

Summation of responding maintained by fixed-interval schedules

A light and tone were separately correlated with responding maintained by fixed-interval schedules, in which the level of responding varied continuously throughout the duration of the interval. Responding during the presence of the single stimuli and their compound was compared during the successive segments of the interval. The following results were obtained: (1) more responses were emitted during compounding than were emitted during either stimulus alone in all segments of the interval; (2) increases in the number of responses across the interval during compounding paralleled increases during single-stimulus presentations. The sum of the responses emitted during the single stimuli was similar to the number of responses emitted during compounding, suggesting that the response tendencies correlated with the single stimuli combined in a summative or additive fashion.     

Effects of associatively significant posttrial stimuli on learning and memory

Pigeons were trained on a delayed conditional discrimination in which the choice between two simultaneously presented stimuli depended on how the trial started. Choice of one of the stimuli was reinforced if the trial had been initiated by presentation of a food sample and choice of the other was reinforced if no sample had been presented. Subsequently, test trials were administered on which an associatively significant stimulus was presented during the retention interval. This manipulation was intended to modulate the short-term retention of information about the food sample. It was found that performance on food sample test trials was enhanced by presentation of an excitor for food, disrupted by presentation of an inhibitor for food and unaffected by presentation of an associatively neutral stimulus. The impact of these posttrial stimuli was also assessed on the ability of the food sample to serve as a reinforcer. This was done by recording the development of responding to a keylight that signalled the food sample on these test trials. Compared to the associatively neutral stimulus, both the excitor and the inhibitor interfered with the development of keypecking. These results are discussed with regard to the issue of how posttrial events modulate associative learning.     

Self-punitive behavior in humans: Effects of a self-fulfilling prophecy

Human subjects were exposed to contingencies which programmed aversive tones (100 db). Two types of contingencies were employed: self-confirming (i.e., self-fulfilling prophecies), in which the aversive tone was occasioned by the prediction it was about to occur; and self-disconfirming, in which the tone was probable when subjects predicted it would not occur. Experiments 1 and 2 used a modified classical conditioning paradigm, and demonstrated that a self-confirming contingency maintained reliable self-punitive responding, i.e., subjects consistently predicted and therefore obtained tones on every trial. Subjects in Experiment 3 were instructed to express predictions continuously throughout four sessions to ensure adequate sampling of the various predictions. Subjects exposed to a self-disconfirming contnngency reliably evidenced awareness of the contingency in effect (judged by answers on a postexperimental questionnaire), whereas subjects exposed to a self-confirming contingency failed to show effective avoidance behavior or contingency awareness. Experiment 4 investigated free-operant self-punitive behavior, utilizing a single prediction response button, which subjects depressed repeatedly. Subjects were exposed to either periodic or aperiodic punishment schedules over as many as four sessions. In general, more persistent self-punitive responding was found in the groups receiving periodic punishment. The results from the four experiments show that self-confirming contingencies can effectively prolong self-punitive responding in human subjects. The findings are consistent with a blocking interpretation of self-punitive behavior, which asserts that when an aversive event is already predicted by stimuli in the situation (including temporal cues), the association between a response and punishment is impaired, and self-punitive responding is likely to be maintained. An integration of human and animal self-punitive research is proposed.     

Effects of within-class differences in sample responding on acquired sample equivalence

Two experiments examined whether acquired sample equivalence in many-toone matching was affected by variation in sample-response requirements. In each experiment, pigeons responded on either identical or different response schedules to the sample stimuli that occasioned the same reinforced comparison choice (i.e., to the within-class samples). Transfer-of-control tests were then conducted to determine acquired equivalence, or lack thereof, between these samples. In both experiments, there was minimal or no evidence of acquired sample equivalence when pigeons responded differently to the samples within each common-choice class. By contrast, transfer was observed if pigeons responded (a) identically to all sample stimuli, or (b) identically to samples within each common-choice class (viz., to samples that occasioned the same reinforced choice) and differently to samples from different classes (viz., to samples that occasioned different choices). These results may help to explain the recent lack of evidence for response membership in pigeons' acquired equivalence (Urcuioli, Lionello-DeNolf, Michalek, & Vasconcelos, 2006). They also raise questions about the functional sample stimuli and about possible interactions between acquired equivalence and acquired distinctiveness.     

Transfer of inhibition after serial and simultaneous feature negative discrimination training

Three experiments examined the nature of inhibitory learning in Pavlovian simultaneous (A+, XA-) and serial (A+, X → A-) feature negative discrimination prodecures in a conditioned suppression situation with rat subjects. The feature (X) trained with simultaneous procedures readily inhibited suppression conditioned to another excitor (B) that was not involved in the feature negative discrimination with X. But the feature trained with serial procedures showed little or no ability to inhibit suppression conditioned to other excitors. These results were obtained with both between- and within-subjects designs, with a variety of test procedures, and after extinction of the A excitor used to establish the inhibition to X. They suggest that nature of the inhibition learned in feature negative discriminations depends on the temporal arrangement of stimuli. We favored the possibility that inhibitors established using simultaneous stimulus arrangements modulate behavior by acting on a representation of the unconditioned stimulus, but inhibitors established with serial procedures act on particular conditioned stimulus-unconditioned stimulus associations.     

Conditioned Inhibition Produced by Extinction of a Conditioned Stimulus

Four experiments used a conditioned taste aversion procedure to examine the potential for CS-alone extinction treatment to produce a conditioned stimulus that possesses inhibitory properties. In Experiment 1, saccharin was paired with LiCl, and then saccharin was presented alone for several trials to produce extensive behavioral extinction. Animals receiving this treatment were retarded in reacquiring conditioned responding to saccharin relative to control subjects receiving conditioning to the flavor for the first time. In Experiment 2, the extinguished saccharin stimulus was shown to decrease conditioned responding to a known excitor when the two stimuli were presented in compound as a summation test. Experiments 3A and 3B replicated the findings of Experiments 1 and 2 while providing evidence that the effects were not due to the differential effects of neophobia during testing. These three experiments revealed that an extinguished conditioned excitor passes retardation and summation tests for conditioned inhibition. Experiment 4 found that extinction of a known excitor was slowed when the excitor was extinguished in compound with a previously extinguished conditioned stimulus. That is, an extinguished CS provided protection from extinction to another CS, a finding also consistent with the view that extinction produces conditioned inhibition.     

ASSESSING STIMULUS CONTROL IN NATURAL SETTINGS: AN ANALYSIS OF STIMULI THAT ACQUIRE CONTROL DURING TRAINING

When a learner is taught a new response, the stimuli that influence its display are often unknown. The presence or absence of these stimuli alters the probability of occurrence of the response. By identifying the stimuli influencing the probability of newly acquired responses, interventionists may program for their generalization more effectively and efficiently. This investigation describes the application of an operant methodology to assess functional relationships between responses and specific stimulus variables. Four young adults with moderate mental retardation were taught to include “please” as part of requests they made in school. Four environmental stimuli, present during training, were assessed for the controlling properties they acquired. Each of the four was assessed prior to and after training by presenting it in isolation (i.e., the other three were varied). If the presence of a single stimulus associated with training did not occasion “please,” then pairs of stimuli were probed. The results revealed that single-stimulus probing occasioned responding by only 1 learner; paired-stimulus probing set the occasion for including “please” by 2 others. Control of the 4th learner's responding was lost before training was introduced, because he began including “please” in his requests during baseline. The implications of these results are discussed in terms of analyzing stimulus control and promoting stimulus generalization.     

Combining stimuli signalling response-dependent food and shock

Three rats were exposed to a multiple schedule in which separate presentations of light and tone alternated with periods during which light and tone were absent. In Phase 1, light and tone each signalled identical variable-interval schedules of food delivery. In Phase 2, light and tone signalled separate but concurrent variable-interval schedules of food and shock delivery. In both phases, the absence of light and tone was associated with the differential reinforcement of other behavior. Test presentations of light, tone, and a light-plus-tone combination indicated that in both phases, light-plus-tone controlled higher response rates than either light or tone alone. The combination continued to control enhanced responding even when the test stimuli signalled variable-interval schedules of food and fixed-ratio schedules of shock. In these latter sessions, enhanced control by the combination increased shock frequency with no corresponding change in food frequency. Apparently, the level of behavior controlled by the absence of two single stimuli may be more important than the consequences of responding in determining the effects of combined-stimulus presentations.     

On the role of covarying functions in stimulus class formation and transfer of function

This experiment investigated whether directly trained covarying functions are necessary for stimulus class formation and transfer of function in humans. Initial class training was designed to establish two respondent-based stimulus classes by pairing two visual stimuli with shock and two other visual stimuli with no shock. Next, two operant discrimination functions were trained to one stimulus of each putative class. The no-shock group received the same training and testing in all phases, except no stimuli were ever paired with shock. The data indicated that skin conductance response conditioning did not occur for the shock groups or for the no-shock group. Tests showed transfer of the established discriminative functions, however, only for the shock groups, indicating the formation of two stimulus classes only for those participants who received respondent class training. The results suggest that transfer of function does not depend on first covarying the stimulus class functions.