Information integration and compounding of discriminative stimuli in pigeons

Keypecks were reinforced with food in three pigeons according to a multiple schedule with variable interval schedules of reinforcement associated with the components. If the key was green (G) or white with three horizontal black lines (H), variable interval 30 sec was in effect. A red key (R) or three black vertical lines on a white surround (V) indicated that variable interval 60 sec was in effect. Following this training, a single test session was conducted in which the reinforcer was not available and in which the single stimuli and the compounds HG, HR, VG, and VR were presented. Response rates to the compounds were generally less than to the elements alone. This unexpected result was apparently due to degrading of the stimuli during superimposition. However, the compound rates aligned well with a linear model that assumes no interaction between orientation and color stimuli. This initial agreement with Anderson’s information integration approach suggests further application of the model to stimulus compounding in infrahuman animals.

     

Instructions as discriminative stimuli

Four undergraduates were exposed to a fixed-ratio schedule under an instruction to respond slowly and to a differential-reinforcement-of-low-rate 5-s schedule under an instruction to respond rapidly. Following this, a fixed-interval schedule was in effect under those same two sets of instructions. For 3 of 4 subjects, response rates were higher with the instruction to respond slowly than with the instruction to respond rapidly during the fixed-interval schedule. For the remaining subject, low-rate responding with the instruction to respond rapidly continued during the first 17 reinforcements of the fixed-interval schedule. Such control by instructions was not observed for other subjects exposed only to a fixed-interval schedule, with or without instructions. The results demonstrate that the effect of instructions can be altered by contingencies and suggest that instructions can function as discriminative stimuli.     

Reinforcement contingencies as discriminative stimuli

A matching paradigm was used to examine the discriminative properties of two different reinforcement contingencies. Responding according to either a differential-reinforcement-of-low-rate or a differential-reinforcement-of-other-behavior schedule produced a choice situation in which each of two keys was illuminated with a unique color. The correct choice response was defined by the contingency that was met to produce the choice. Eighty to 100% correct matching was obtained and recovered during two reversals of the choice stimuli. Introduction of a delay between completion of the reinforcement contingency and presentation of the choice stimuli resulted in decrements in matching performances similar to those obtained when other types of sample stimuli are used. The results provided evidence of the discriminative properties of the relation between behavior and other classes of stimuli.     

Separating discriminative and function-altering effects of verbal stimuli

Ever since Skinner's first discussion of rule-governed behavior, behavior analysts have continued to define rules, either explicitly or implicitly, as verbal discriminative stimuli. Consequently, it is not difficult to find, in the literature on rule-governed behavior, references to stimulus control, antecedent control, or to rules occasioning behavior. However, some verbal stimuli have effects on behavior that are not easily described as discriminative. Such stimuli don't evoke behavior as discriminative stimuli, but rather alter the functions of other stimuli in a manner analogous to operant and respondent conditioning. Hence, this type of control has been called function altering. Any known stimulus function (e.g., evocative, or [conditioned] reinforcing or punishing functions) can apparently be altered by such function-altering stimuli. Describing these stimuli as discriminative stimuli obscures their possible function-altering effects and consequently may retard inquiry into them. This paper encourages behavior analysts to begin separating the discriminative and function-altering effects of verbal stimuli and suggests that by doing so, behavior analysts may better understand what may be most unique about these stimuli. Results from several experiments, especially those in which children served as subjects, are analyzed. Finally, some speculations are offered concerning the genesis of function-altering stimuli.     

Compounding discriminative stimuli controlling free-operant avoidance

The performances of three rats were stabilized on a multiple schedule that maintained responding by a free-operant avoidance schedule during independent presentations of tone and light. The simultaneous absence of these stimuli signalled shock-free periods and controlled response cessation. Subsequently, test sessions were administered consisting of independent presentations of each stimulus and these stimuli compounded (tone-plus-light). During an extinction test, additive summation was observed to the compounded stimuli, i.e., more responses were emitted to the compound than to either tone or light. During a series of 28 maintenance-test sessions in which the shock schedule remained operative, the compounded stimuli produced a generally enhanced response rate and fewer pauses terminating with shock than either single stimulus condition. These results extend the generality of free-operant additive summation to responding maintained by aversive control. In addition, a comparison of the present study with previous experiments reporting additive summation of positively reinforced responding indicates that similar variables—rate and aversive differences between training stimulus conditions—should be considered in accounting for response distributions during stimulus compounding when responding is controlled by either positive or negative contingencies.     

The use of rats as discriminative stimuli

A FREE OPERANT PROCEDURE WAS USED TO DETERMINE WHETHER OR NOT ONE RAT COULD DISCRIMINATE: (1) between the presence and absence of a second rat, and (2) between two other rats of the same species and sex. The subjects were four male Wistar rats. The discriminatory response was a bar press and food was used as reinforcement during training. Although there were wide individual differences in rate of learning, all subjects learned to make both discriminations.     

Distinguishing between discriminative and motivational functions of stimuli.

A discriminative stimulus is a stimulus condition which, (1) given the momentary effectiveness of some particular type of reinforcement (2) increases the frequency of a particular type of response (3) because that stimulus condition has been correlated with an increase in the frequency with which that type of response has been followed by that type of reinforcement. Operations such as deprivation have two different effects on behavior. One is to increase the effectiveness of some object or event as reinforcement, and the other is to evoke the behavior that has in the past been followed by that object or event. "Establishing operation" is suggested as a general term for operations having these two effects. A number of situations involve what is generally assumed to be a discriminative stimulus relation, but with the third defining characteristic of the discriminative stimulus absent. Here the stimulus change functions more like an establishing operation than a discriminative stimulus, and the new term, "establishing stimulus," is suggested. There are three other possible approaches to this terminological problem, but none are entirely satisfactory.     

Conditioned reinforcement by conditional discriminative stimuli.

A concurrent-chains schedule was used to examine how a delay to conditional discriminative stimuli affects conditioned reinforcement strength. Pigeons' key-peck responses in the initial link produced either of two terminal links according to independent variable-interval 30-s schedules. Each terminal link involved an identical successive conditional discrimination and was segmented into three links: a delay interval (green), a color conditional discriminative stimulus (blue or red), and a line conditional discriminative stimulus (vertical or horizontal lines). Food delivery occurred 45 s after entering the terminal link with a probability of .5, but its conditional probability (1.0 or 0) depended on the combination of the color and the line stimuli. One of the color stimuli occurred independently of further responding, 5 s after entry into the right terminal link, but it occurred 35 s after entry into the left terminal link. One of the line stimuli occurred independently of responding 40 s after entry into either terminal link, synchronized with the offset of the color stimulus. The initial-link relative response rate for the right was consistently higher in comparison with a control condition in which the color stimuli occurred 20 s after entry into either terminal link. The preference for the short delay to the color conditional discriminative stimuli suggests the possibility of conditioned reinforcement by information about the relation between the line conditional discriminative stimuli and the outcomes.     

Analysis of discriminative control by social behavioral stimuli

Visual discriminative control of the behavior of one rat by the behavior of another was studied in a two-compartment chamber. Each rat's compartment had a food cup and two response keys arranged vertically next to the clear partition that separated the two rats. Illumination of the leader's key lights signaled a “search” period when a response by the leader on the unsignaled and randomly selected correct key for that trial illuminated the follower's keys. Then, a response by the follower on the corresponding key was reinforced, or a response on the incorrect key terminated the trial without reinforcement. Accuracy of following the leader increased to 85% within 15 sessions. Blocking the view of the leader reduced accuracy but not to chance levels. Apparent control by visual behavioral stimuli was also affected by auditory stimuli and a correction procedure. When white noise eliminated auditory cues, social learning was not acquired as fast nor as completely. A reductionistic position holds that behavioral stimuli are the same as nonsocial stimuli; however, that does not mean that they do not require any separate treatment. Behavioral stimuli are usually more variable than nonsocial stimuli, and further study is required to disentangle behavioral and nonsocial contributions to the stimulus control of social interactions.     

The role of discriminative stimuli in concurrent performances

Key pecking in pigeons was examined under concurrent and parallel arrangements of two independent and simultaneously available variable-interval schedules. Pecks on the changeover key alternated the schedule of reinforcement for responses on the main key. Under concurrent schedules, discriminative stimuli were paired with the reinforcement schedule arranged in each component and changeover responses also alternated these stimuli. Under parallel schedules, changeover responses alternated the effective reinforcement schedule, but did not change the discriminative stimulus. On concurrent procedures, changeover response rate was inversely related to the difference in reinforcement rate between the two components, whereas on parallel schedules no consistent relationship was found. With both schedules, absolute response and reinforcement rates were positively related, although for a given set of reinforcement frequencies, rates were often higher on the concurrent schedules. On concurrent schedules, relative response rates and relative times were equal to relative reinforcement rates. On parallel schedules these ratios were positively related, but response and time ratios were much smaller than were obtained with comparable concurrent schedules. This inequality was most pronounced when absolute reinforcement frequencies were lowest.     

Short-term remembering of discriminative stimuli in pigeons.

Pigeons learned to peck the left or right of two white keys depending on whether a red or a green stimulus was displayed on a third key. The opportunity to peck the white keys was then dealyed for zero to six seconds after the red or green (to-be-remembered) stimulus. On half the trials, the feeder operated during the delay to interrupt behavior that might mediate discriminated responding. No events were scheduled on the remaining trials. In a later condition, the pigeons had the opportunity to peck the white keys during the delay. In general, accuracy decreased as delay increased in all conditions, but performance was least accurate following feeder operations and most accurate when pecking was allowed during the delay. The procedures may be analogous to varying the opportunity for rehearsal in studies of human short-term memory.     

On conditioned reinforcing effects of negative discriminative stimuli

Observing responses by pigeons were studied during sessions in which a food key and an observing key were available continuously. A variable-interval schedule and extinction alternated randomly on the food key. In one condition, food-key pecking during extinction decreased reinforcement frequency during the next variable-interval component, and in the other condition such pecking did not affect reinforcement frequency. Observing responses either changed both keylight colors from white to green (S+) or to red (S−) depending on the condition on the food key, or the observing responses never produced the S+ but produced the S− when extinction was in effect on the food key. Observing responses that produced only S− were maintained only when food-key pecking during extinction decreased reinforcement frequency in the subsequent variable-interval component. The red light conformed to conventional definitions of a negative discriminative stimulus, rendering results counter to previous findings that production of S− alone does not maintain observing. Rather than offering support for an informational account of conditioned reinforcement, the results are discussed in terms of a molar analysis to account for how stimuli acquire response-maintaining properties.     

Compounding of discriminative stimuli correlated with chained and multiple schedules

In studies of stimulus compounding (1) the stimuli are presented randomly, (2) primary reinforcement is correlated with each stimulus, (3) a specific response is emitted during each stimulus, and (4) the response is necessary to produce the reinforcer. The present experiments assessed the importance of these procedures by (1) presenting light and tone stimuli in fixed order, (2) removing reinforcement (food) during one stimulus, (3) preventing the response (lever pressing) from being emitted, and (4) eliminating the contingency between lever pressing and food. These variables were presented in various combinations within the context of chained and multiple schedules. When the stimuli were combined in the schedule component correlated with each stimulus, the frequency of lever pressing increased in most instances (additive summation). This suggests that the effect of combining stimuli was not closely tied to the specific procedures used in previous experiments. However, presenting the stimuli in a fixed order did have an effect: the level of responding to the compound was generally greatest when the stimuli were combined in the component correlated with the higher frequency of lever pressing to the single stimulus. Additive summation failed to occur consistently when response-independent food was correlated with each stimulus, and when both lever pressing and food were eliminated during one stimulus.     

Observing responses maintained by conditional discriminative stimuli.

In a conditional discrimination procedure, pigeons' observing responses were analyzed to examine whether two color stimuli (blue or red), conditionally related to whether each of two line stimuli (vertical or horizontal) accompanied reinforcement or nonreinforcement, functioned as conditioned reinforcers. If a variable-interval (VI) 10-s requirement was fulfilled, an observing response produced onset of a color stimulus. A little later, a line stimulus was presented independently of responding, added to the color stimulus to form a compound stimulus. If 55 s elapsed with a response not having occurred either through 55 s or after the variable-interval 10-s had timed out, one of the color-line compound stimuli was presented independently of responding. To control for sensory reinforcement effects and for earlier entrance to the later link, a simple discrimination procedure also was conducted in which reinforcement was not correlated with the color stimuli but with the line stimuli only. As in the conditional discrimination, the observing response also could produce earlier presentation of blue or red. The observing response occurred more frequently during the conditional discrimination than during the simple discrimination. The results were related to different theoretical accounts of conditioned reinforcement, particularly the information hypothesis.     

Maintenance of behavior controlling the duration of discriminative stimuli

The maintenance of a response controlling the duration of positive and negative discriminative stimuli in a multiple schedule was examined with respect to the possible consequences of the response: none, escape from the negative stimulus, production of the positive stimulus, and initiation of the reinforcement schedule associated with the latter. The last two seemed to be the major factors in producing and maintaining the response. Escape from the negative stimulus maintained it in most subjects, but only at a much lower level.     

Effects of compounding drug-related stimuli: escalation of heroin self-administration

Previous experiments have demonstrated that presenting independently established discriminative stimuli in compound can substantially increase operant responding maintained by food reinforcement or shock avoidance. Recently, this phenomenon was also shown to occur with cocaine self-administration. The present study further assessed the generality of these stimulus-compounding effects by systematically replicating them with heroin self-administration. Rats' nose-poke responses produced intravenous heroin (0.025 mg/kg per infusion) on a variable-ratio schedule when either a tone or a light was present. In the absence of these stimuli, responding was not reinforced. Once discriminative control by the tone and light had been established, the stimuli were presented in compound under extinction (with heroin discontinued) or maintenance conditions (with heroin available during test-stimulus presentations). In extinction, the tone-light compound increased responding approximately threefold compared to tone or light alone. Under maintenance conditions, compounding increased heroin intake approximately twofold. These effects closely matched those obtained earlier with cocaine. This consistency across pharmacological classes and across drug and nondrug reinforcers further confirms that (a) self-administered drugs support conditioning and learning in a manner similar to that supported by other reinforcers; and (b) multiple drug-related cues interact in lawful and predictable ways to affect drug seeking and consumption.     

Transformation of the discriminative and eliciting functions of generalized relational stimuli

In three experiments, match-to-sample procedures were used with undergraduates to establish arbitrary relational functions for three abstract visual stimuli. In the presence of samples A, B, and C, participants were trained to select the smallest, middle, and largest member, respectively, of a series of three-comparison arrays. In Experiment 1, the B (choose middle) stimulus was then used to train a steady rate of keyboard pressing before the A (choose smallest) and the C (choose largest) stimuli were presented. Participants pressed slower to A and faster to C than to B. Then B was paired with mild shock in a Pavlovian procedure with skin conductance change as the dependent variable. When presented with A and C, 6 of 8 experimental participants showed smaller skin conductance changes to A and larger skin conductance changes to C than to B. In Experiment 2, A was then used as a sample in a match-to-sample procedure to establish an arbitrary size ranking among four same-sized colored circle comparisons. One of the middle circles was then used to establish a steady rate of pressing before the other circles were presented. Five of 6 participants responded slower to the "smaller" circle and faster to the "larger" circle than they did to the "middle" circle. In Experiment 3, A, B, and C were then presented on a series of test trials requiring participants to pick the comparison that was less than, greater than, or equal to the sample. Novel stimuli were included on some trials. Results indicated that the relational training procedures produced derived relations among the stimuli used in training and that these allowed correct inferences of relative size ranking among novel stimuli.     

The interaction between discriminative stimuli and outcomes during instrumental learning

Rats were trained on a biconditional discrimination in which the delivery of a food pellet stimulus signalled that pressing on one of two levers would be reinforced, whereas the delivery of a sucrose solution stimulus signalled that the reward was contingent on pressing the other lever. The outcome was the same food type as the discriminative stimulus in the congruent group but the other food type in the incongruent group. Both responses were rewarded with the same outcome in the same group. All the three groups learned the discrimination at statistically indistinguishable rates. Prefeeding one of the outcomes selectively reduced the associated response thereby demonstrating that responding was mediated by a representation of the outcome. Moreover, the outcome of one trial controlled responding on the next trial in accord with the stimulus function of the food type. These results are discussed in relation to the associative structures mediating the discriminative control of instrumental performance.