Conditional discrimination and equivalence relations: Control by negative stimuli

Three adult subjects were taught the following two-sample, two-comparison conditional discriminations (each sample is shown with its positive and negative comparison, in that order): A1-B1B2, A2-B2B1; B1-C1C2, B2-C2C1; and C1-D1D2, C2-D2D1. A teaching procedure was designed to encourage control by negative comparisons. Subjects were then tested for emergent performances that would indicate whether the baseline conditional discriminations were reflexive, symmetric, and transitive. The tests documented the emergence of two classes of equivalent stimuli: A1, B2, C1, D2 and A2, B1, C2, D1. These were the classes to be expected if the negative comparisons were the controlling comparisons in the baseline conditional discriminations. The negative comparisons, however, were not the comparisons that subjects were recorded as having chosen in the baseline conditional discriminations. Differential test results confirmed predictions arising from a stimulus-control analysis: In reflexivity tests (AA, BB, CC, DD), subjects chose comparisons that differed from the sample; one-node transitivity (AC, BD) and "equivalence" (CA, DB) tests also yielded results that were the opposite of those to be expected from control by positive comparisons; symmetry tests (BA, CB, DC), two-node transitivity (AD) tests, and two-node "equivalence" (DA) tests yielded results that were to be expected from control by either positive or negative comparisons.     

Auditory–Visual stimuli: Effects on derived relations with compound stimuli

This research explored the effect of teaching conditional discriminations with three procedures on the derivation of 36 stimuli relations (derived relations). The stimuli used consisted of three characteristics musical instruments, along with the corresponding picture. In the first experiment six university students were trained with simple stimuli and tested with compound auditory–visual samples; therefore, a one‐to‐many structure was used. In the second experiment, auditory stimuli were replaced by visual stimuli, for the samples used, for new students. A third experiment was implemented with an extra phase of training with compound stimuli for six new students. The structure of the experiments was: pretests (Xbcd–A; Xacd–B; Xabd–C; Xabc–D), training (A–B; A–C; A–D), and posttests (same as pretests). The difference between these conditions was the kind of stimuli used and a new phase of teaching used in condition 3: (Xbcd–A). The results indicate that training with simple stimuli on discriminations that include stimuli that are easy to discriminate from each other (words and sounds) is a sufficient condition for good posttest performance. However, when comparisons are made difficult (words only), participants show better performance on new tests if they have a learning history with compound stimuli.     

Generalization of the disruptive effects of alternative stimuli when combined with target stimuli in extinction

Differential‐reinforcement treatments reduce target problem behavior in the short term but at the expense of making it more persistent long term. Basic and translational research based on behavioral momentum theory suggests that combining features of stimuli governing an alternative response with the stimuli governing target responding could make target responding less persistent. However, changes to the alternative stimulus context when combining alternative and target stimuli could diminish the effectiveness of the alternative stimulus in reducing target responding. In an animal model with pigeons, the present study reinforced responding in the presence of target and alternative stimuli. When combining the alternative and target stimuli during extinction, we altered the alternative stimulus through changes in line orientation. We found that (1) combining alternative and target stimuli in extinction more effectively decreased target responding than presenting the target stimulus on its own; (2) combining these stimuli was more effective in decreasing target responding trained with lower reinforcement rates; and (3) changing the alternative stimulus reduced its effectiveness when it was combined with the target stimulus. Therefore, changing alternative stimuli (e.g., therapist, clinical setting) during behavioral treatments that combine alternative and target stimuli could reduce the effectiveness of those treatments in disrupting problem behavior.     

Observing responses maintained by conditional discriminative stimuli.

In a conditional discrimination procedure, pigeons' observing responses were analyzed to examine whether two color stimuli (blue or red), conditionally related to whether each of two line stimuli (vertical or horizontal) accompanied reinforcement or nonreinforcement, functioned as conditioned reinforcers. If a variable-interval (VI) 10-s requirement was fulfilled, an observing response produced onset of a color stimulus. A little later, a line stimulus was presented independently of responding, added to the color stimulus to form a compound stimulus. If 55 s elapsed with a response not having occurred either through 55 s or after the variable-interval 10-s had timed out, one of the color-line compound stimuli was presented independently of responding. To control for sensory reinforcement effects and for earlier entrance to the later link, a simple discrimination procedure also was conducted in which reinforcement was not correlated with the color stimuli but with the line stimuli only. As in the conditional discrimination, the observing response also could produce earlier presentation of blue or red. The observing response occurred more frequently during the conditional discrimination than during the simple discrimination. The results were related to different theoretical accounts of conditioned reinforcement, particularly the information hypothesis.     

Assessing the role of alternative response rates and reinforcer rates in resistance to extinction of target responding when combining stimuli

Studies of behavioral momentum reveal that reinforcing an alternative response in the presence of a target response reduces the rate of target responding but increases its persistence, relative to training the target response on its own. Because of the parallels between these studies and differential‐reinforcement techniques to reduce problem behavior in clinical settings, alternative techniques to reduce problem behavior without enhancing its persistence are being explored. One potential solution is to train an alternative response in a separate stimulus context from problem behavior before combining the alternative stimulus with the target stimulus. The present study assessed how differences in reinforcement contingencies and rate for alternative responding influenced resistance to extinction of target responding when combining alternative and target stimuli in pigeons. Across three experiments, alternative stimuli signaling a response–reinforcer dependency and greater reinforcer rates more effectively decreased the persistence of target responding when combining alternative and target stimuli within the same extinction tests, but not when compared across separate extinction tests. Overall, these findings reveal that differences in competition between alternative and target responding produced by contingencies of alternative reinforcement could influence the effectiveness of treating problem behavior through combining stimulus contexts.     

Effects of differences between stimuli, responses, and reinforcer rates on conditional discrimination performance

In a discrete-trial conditional discrimination procedure, 4 pigeons obtained food reinforcers by pecking a key with a short latency on trials signaled by one stimulus and by pecking the same key with a long latency on trials signaled by a second stimulus. The physical difference between the two stimuli and the temporal separation between the latency values required for reinforcement were varied factorially over four sets of conditions, and the ratio of reinforcer rates for short and long latencies was varied within each set of conditions. Stimulus discrimination varied directly with both stimulus and response differences and was unaffected by the reinforcer ratio. Sensitivity to reinforcement, estimated by generalized-matching-law fits to the data within each set of conditions, varied directly with the response difference but inversely with the stimulus difference arranged between sets of conditions. Because variations in stimulus differences, response differences, and reinforcer differences did not have equivalent effects, these findings question the functional equivalence of the three terms of the discriminated operant: antecedent stimuli, behavior, and consequences.     

Differential responding in the presence and absence of discriminative stimuli during multielement functional analyses

We evaluated the extent to which discriminative stimuli (S(D)s) facilitate differential responding during multielement functional analyses. Eight individuals, all diagnosed with mental retardation and referred for assessment and treatment of self-injurious behavior (SIB) or aggression, participated. Functional analyses consisted of four or five assessment conditions alternated in multielement designs. Each condition was initially correlated with a specific therapist and a specific room color (S(D)s), and sessions continued until higher rates of target behaviors were consistently observed under a specific test condition. In a subsequent analysis, the programmed S(D)s were removed (i.e., all conditions were now conducted by the same therapist in the same room), and sessions continued until differential responding was observed or until twice as many sessions were conducted with the S(D)s absent (as opposed to present), whichever came first. Results indicated that the inclusion of programmed S(D)s facilitated discrimination among functional analysis conditions for half of the participants. These results suggest that the inclusion of salient cues may increase either the efficiency of functional analyses or the likelihood of obtaining clear assessment outcomes.     

Effects of antecedent variables on disruptive behavior and accurate responding in young children in outpatient settings

The effects of manipulations of task variables on inaccurate responding and disruption were investigated with 3 children who engaged in noncompliance. With 2 children in an outpatient clinic, task directives were first manipulated to identify directives that guided accurate responding; then, additional dimensions of the task were manipulated to evaluate their influence on disruptive behavior. With a 3rd child, similar procedures were employed at school. Results showed one-step directives set the occasion for accurate responding and that other dimensions of the task (e.g., preference) functioned as motivating operations for negative reinforcement.     

Attention in the pigeon: testing for excitatory and inhibitory control by the weak elements.

In two experiments, pigeons were trained on a successive discrimination between a color and either a compound S+ or a compound S- consisting of a form superimposed on a second color. Two stimulus control tests followed discrimination training: an attention test in which the form and colors used in training were presented singly and in combination, and then a resistance-to-reinforcement test using the form element of S+ or S- and a novel form. In the attention test, the birds trained with a compound S+ responded most to the S+ compound, less to the S+ color alone, and still less to the S+ form on a dark key. Few responses were made to the negative stimulus, either alone or with the S+ form added. The birds trained with a compound S- pecked most at the S+ color and to a compound of the S+ color with the S- form added. The resistance-to-reinforcement test showed that the birds trained with a compound S+ responded more to the S+ form than to a novel form. However, the birds trained with a compound S- did not reliably respond more to a novel form than to the S- form. These findings suggested that the form element of a compound S+ gains some excitatory control, but the form element of a compound S- does not acquire inhibitory control. The possibility existed that low levels of responding to the S+ form on a dark background in the first experiment were due to use of a darkened key to separate S+ and S- periods during discrimination training. However, the essential findings were the same in a second experiment in which darkening of the chamber separated S+ and S- periods.     

Combinations of response-dependent and response-independent schedule-correlated stimulus presentation in an observing procedure

Pigeons pecked a response key on a variable-interval (VI) schedule, in which responses produced food every 40 s, on average. These VI periods, or components, alternated in irregular fashion with extinction components in which food was unavailable. Pecks on a second (observing) key briefly produced exteroceptive stimuli (houselight flashes) correlated with the component schedule currently in effect. Across conditions within a phase, the dependency between observing and presentation of the stimuli was decreased systematically while the density of stimulus presentation was held constant. Across phases, the proportion of session time spent in the VI component was adjusted from 0.5 to 0.25, and then to 0.75. Results indicate that rate of observing decreased as the dependency between responses and stimulus presentations was decreased. Further, discriminative control by the schedule-correlated stimuli was systematically weakened as dependency was decreased. Increasing the proportion of session time spent in VI decreased the rate of observing. This effect was additive with the manipulation of the dependency between observing and presentation of the stimuli. Overall, these results show that conditioned reinforcers function similarly to unconditioned reinforcers with respect to response-consequence dependencies, and that stimulus control is enhanced under conditions in which the relevant stimuli are produced by an organism's behavior.     

Control by the auditory or the visual element of a compound discriminative stimulus: effects of feedback.

Groups of pigeons were trained to depress a treadle in the presence of a compound stimulus consisting of a tone and a red houselight (a) to avoid electric shock, or (b) to obtain grain. Immediate, exteroceptive feedback was equated for avoidance and appetitive groups within an experiment, but varied across experiments from elevation of a nonilluminated feeder to darkening of the chamber, termination of the tone, and elevation of an illuminated feeder. Responding in the absence of the compound stimulus postponed its next occurrence. After performance had stabilized, the degree to which each element controlled treadle pressing was determined. Generally, in the appetitive tests, the red light controlled much more responding than did the tone, but in the avoidance tests, the tone controlled more responding than did the red light.     

Effects of chlorpromazine on fixed-ratio responding: modification by fixed-interval discriminative stimuli.

Effects of chlorpromazine (1 to 100 mg/kg) were assessed on two pigeons' responding under various modifications of a multiple schedule of food delivery. During a fixed-interval component, the first response after 5 min produced food; during the subsequent, fixed-ratio component, the 30th response produced food. Modifications of the schedule entailed changes in stimulus conditions imposed during the fixed-ratio component that did not systematically alter characteristics of performance under non-drug conditions. In the first phase of the experiment, distinctive visual stimuli were correlated with each schedule component (conventional multiple schedule); chlorpromazine produced small decreases in fixed-ratio responding (20% at 30 mg/kg). When each response during the fixed-ratio component produced the stimulus correlated with the fixed-interval schedule (fixed-interval discriminative stimulus) for 1.2 s, effects of chlorpromazine were not different from those under the conventional multiple schedule. Chlorpromazine produced greater decreases in fixed-ratio responding (55% at 30 mg/kg) when either the first response of each fixed ratio changed the stimulus correlated with the fixed-ratio schedule to the fixed-interval discriminative stimulus for the remainder of the fixed-ratio component, or when the fixed-interval discriminative stimulus was presented independently of responding according to a matched temporal sequence. When the fixed-interval discriminative stimulus was present continuously during the fixed-ratio component (mixed schedule), chlorpromazine produced even more substantial decreases in fixed-ratio responding (greater than 80% at 30 mg/kg). Effects of chlorpromazine on fixed-interval responding were also modified by the schedules of fixed-interval discriminative stimulus presentation. The effects of chlorpromazine were a joint function of the stimuli prevailing during the multiple schedule and the degree to which responding influenced these stimuli.     

Instructions as discriminative stimuli (2): A within‐subject examination of the effect of differential reinforcement on establishing novel instructional control1

Abstract: Six undergraduates were exposed to a fixed‐ratio schedule with an instruction to respond slowly and to a differential‐reinforcement‐of‐low‐rate schedule with an instruction to respond rapidly when a white circle was presented on a display monitor. When a yellow circle was presented, however, the subjects were exposed to the fixed‐ratio schedule with the instruction to respond rapidly and to the differential‐reinforcement‐of‐low‐rate schedule with the instruction to respond slowly. Following this, a fixed‐interval schedule was in effect during those stimuli and instructions. Under the white circle, response rates were higher with the instruction to respond slowly than with the instruction to respond rapidly during the fixed‐interval schedule. Such control by instructions was not observed under the yellow circle. A previous study examined establishment of novel instructional control by between‐subject comparisons and found that for three of four subjects ( Okouchi, 1999 ). In contrast, the present results demonstrate the instructional control through within‐subject comparisons for all six subjects.     

On the effects of signaling reinforcer probability and magnitude in delayed matching to sample

Two experiments examined whether postsample signals of reinforcer probability or magnitude affected the accuracy of delayed matching to sample in pigeons. On each trial, red or green choice responses that matched red or green stimuli seen shortly before a variable retention interval were reinforced with wheat access. In Experiment 1, the reinforcer probability was either 0.2 or 1.0 for both red and green responses. Reinforcer probability was signaled by line or cross symbols that appeared after the sample had been presented. In Experiment 2, all correct responses were reinforced, and the signaled reinforcer durations were 1.0 s and 4.5 s. Matching was more accurate when larger or more probable reinforcers were signaled, independently of retention interval duration. Because signals were presented postsample, the effects were not the result of differential attention to the sample.     

Conditional discrimination and equivalence relations: A theoretical analysis of control by negative stimuli

A detailed analysis is presented of the ways in which control by the negative stimulus in two-comparison conditional discriminations may be expected to affect the outcome of tests for the properties of equivalence relations. Control by the negative stimulus should produce the following results: (a) no observable effect on symmetry tests; (b) reflexivity test results should look like “oddity” rather than “identity”; and (c) transitivity tests that involve an odd number of nodes should yield results that are 100% opposite to tests that involve an even number of nodes. The analysis also considers the effects of variation in the type of comparison-stimulus control between and within baseline conditional discriminations. Methods are suggested for experimentally regulating the type of control, and for verifying the predictions that the analysis generates. If suggested experiments continue to support the analysis, investigators who use two-comparison conditional discriminations to study equivalence relations will either have to control explicitly whether the positive or the negative comparison governs their subjects' choices, or they will have to abandon two comparisons and use three or more comparisons instead.     

Fixed-ratio pausing: Joint effects of past reinforcer magnitude and stimuli correlated with upcoming magnitude

Pigeons responded on fixed-ratio schedules ending in small or large reinforcers (grain presentations of different duration) interspersed within each session. In mixed-schedule conditions, the response key was lit with a single color throughout the session, and pausing was directly related to the past reinforcer (longer pauses after large reinforcers than after small ones). In multiple-schedule conditions, different colors accompanied the ratios ending in small and large reinforcers, and pausing was affected by the upcoming reinforcer as well as the past one. Pauses were shorter before large reinforcers than before small ones, but they continued to be longer after large reinforcers than after small ones. The influence of the past reinforcer was modulated by the magnitude of the upcoming reinforcer; in the presence of the stimulus before the small reinforcer, the effect of the past reinforcer was enhanced relative to its effect in the stimulus before the large reinforcer. These results show that pausing between ratios is jointly determined by two competing factors: past conditions of reinforcement and stimuli correlated with upcoming conditions.     

Adventitious control by the location of comparison stimuli in conditional discriminations.

In a conditional discrimination procedure, samples appeared in a center key, and comparisons appeared in two of four outer keys. The location of comparison keys varied from trial to trial. Separate learning curves for each of the six possible pairs of comparison keys were plotted in a signal-detection space, revealing different patterns of progress on each pair. Also, when learned conditional discriminations were disrupted, pairs of keys differed in their patterns of disruption. Varying the location of comparison stimuli among six different pairs of keys had not eliminated key position as a controlling aspect of the stimuli. The variations simply increased the number of stimulus compounds--key position and experimental stimuli--that the subject learned. Plotting conditional-discrimination learning curves in a signal-detection space reveals relations among hits, false alarms, accuracy, and comparison preference that help to define a subject's progress.     

Social influence in pigeons (Columba livia): the role of differential reinforcement

Socially-influenced learning was studied in observer pigeons that observed a demonstrator in an adjacent chamber performing a target response comprising standing on a box and pecking a key 10 times. In Experiment 1 there was no evidence for social learning in the absence of reinforcement of the observer's behavior. When the target response was already established in the observer's repertoire, but was not differentially reinforced in relation to the demonstrator's behavior, rates of extinction were not influenced by the demonstrator's behavior (Experiment 2). Reinforcement of the observer's target response in the presence of the modeled target response, and not in its absence, resulted in control of the observer's responding by the behavior of the demonstrator (Experiments 3 and 4). This control was extended in Experiment 5 to deferred responses that occurred following a delay since the demonstrator's target responses. The acquisition of social influence depended on differential reinforcement of the observer's target response, with the demonstrator's target behavior serving as the explicit discriminative stimulus.     

Delayed stimulus control: recall for single and relational stimuli.

In a discrete-trial symbolic matching-to-sample procedure, pigeons' left-key responses were reinforced following presentation of one center-key sample, and right-key responses were reinforced following presentation of another. Recallability was measured by the difference between log ratios of left to right responses following each sample. In Experiment 1, samples were successively presented same or different wavelengths in the relational discrimination, or individual wavelengths in the single discrimination. The rate at which recallability decreased with increasing delay since sample presentation was the same for single and relational discriminations, but the initial level of performance differed, indicating that the relational discrimination was more difficult. In Experiment 2, recall functions for easy and difficult discriminations between individual wavelengths also differed in levels of initial performance but not in rate of decrement of recallability over time. Recall for stimuli differing in complexity may therefore reflect differences in discrimination difficulty.     

The merger and development of equivalence classes by unreinforced conditional selection of comparison stimuli

Three experiments assessed the likelihood that subjects with histories of equivalence class development would respond conditionally on new discriminations in the absence of differential consequences for responses. In the first two experiments, two groups of subjects with different experimental histories, but whose performances showed four equivalence classes, responded on trials without explicit reinforcement involving samples from two of the classes and comparisons from the other two classes, in a two-choice matching-to-sample format. Subjects consistently selected a particular comparison in the presence of a particular sample. Subsequent tests showed the emergence of equivalence relations between stimuli from classes linked by the unreinforced conditional selections. Subsequently, in Experiment II, the subjects' responses in the conditional selection trials were reinforced if the selection was reversed from that made previously. Although reversed selection was maintained, 2 of the 3 subjects continued to perform on equivalence relation trials according to their original unreinforced selections. In the third experiment, these 2 subjects responded on a series of conditional discriminations involving three new pairs of sample stimuli and one new pair of comparison stimuli. No explicit reinforcement followed responses on any trial in this experiment. Subsequent tests for equivalence between sample stimuli revealed the development of two equivalence classes.