A procedure for generating differential "sample" responding without different exteroceptive stimuli

Sidman (1994, 2000) suggested that responses as well as stimuli can join equivalence classes, a hypothesis difficult to test because differential responding typically requires different stimuli. The present experiments describe a procedure with pigeons that avoids this potential confounding effect. In Experiment 1, spacing two responses 3 s apart (a differential-reinforcement-of-low-rate [DRL] schedule) to a white stimulus on some trials produced food or the comparison stimuli in a matching task, whereas pecking 10 or more times with no temporal restrictions (a fixed-ratio [FR] schedule) produced the same effect on other trials. Completing the alternative (unscheduled) requirement terminated the white stimulus and repeated the trial. Following such errors, pigeons learned to switch to the alternative response pattern on the repeat trials. In addition, the correct response pattern functioned as a conditional cue for comparison choice. In Experiment 2, mixed DRL-FR training was preceded by two-sample/two-alternative matching-to-sample with DRL and FR sample-response requirements. In a subsequent transfer test in which the correct response pattern to white served as the sample, pigeons preferentially chose the comparison previously reinforced following that pattern in the baseline task. This "unsignaled response" procedure may be useful for assessing whether differential responses can be members of acquired equivalence classes.     

Switching from competition to sharing or cooperation at large response requirements: competition requires more responding

Two pairs of high-school students matched-to-sample for money. On each trial, a subject could either respond on one lever to take the matching-to-sample problem himself (taking response) or respond on a second lever to give the problem to his coactor (giving response). The first subject to complete the response requirement determined the distribution of the problem. Competition maximizes the amount of responding over trials, i.e., both subjects make taking responses on each trial. Sharing and cooperation minimize responding: only one subject makes a taking response (sharing) or a giving response (cooperation) on each trial, and the subjects alternate responding such that there is an equitable distribution of responses and reinforcers over trials. Large increases in the fixed-ratio response requirement to distribute problems produced: (1) a switch from competition to sharing or cooperation, (2) the expected concomitant change from inequitable to equitable distributions of reinforcers, and (3) a reduction in the amount of responding for three of the four subjects. Previous animal research has shown that large response requirements may have aversive properties. Switching from competition to sharing or cooperation at large response requirements allows a reduction in responding and, at the same time, a moderate number of reinforcers for each subject.     

Do common elements predict class merger: A test of Sidman's theory of equivalence

The study presented here investigated the effect of common and uncommon elements on class merger as predicted by Sidman in his reconceptualization of stimulus equivalence suggesting that common elements among contingencies can facilitate emergent performances (1994, 1997, 2000). Eight adult participants were exposed to a procedure that arranged for stimulus–reinforcer correlations in Phase 1 and response–reinforcer correlations in Phase 2 of a 3-phase study. In the common element group, the visual images serving as reinforcers were the same in Phase 1 and Phase 2. In the uncommon elements group, the images serving as reinforcers were different in Phases 1 and 2. In Phase 3, participants were given an opportunity to respond but no feedback was programmed. The results showed that participants' responding was well differentiated in the common element group and undifferentiated in the uncommon elements group. These results are predicted by Sidman's revised formulation of the provenance and scope of equivalence relations. Specifically, these data support Sidman's (1994, 1997, 2000) suggestion that elements of a contingency enter into an equivalence class and common elements among contingencies are sufficient to produce class mergers. The findings highlight an emergent simple discrimination and raise some interesting considerations about the definition of equivalence under the new formulation.     

Expansion of Sidman's theory: The inclusion of prompt stimuli in equivalence classes

Stimulus equivalence is defined as the ability to relate stimuli in novel ways after training in which not all of the stimuli had been directly linked to one another. Sidman (2000) suggested all elements of conditional discrimination training contingencies that result in equivalence potentially become class members. Research has demonstrated the inclusion of samples, comparisons, responses, and reinforcers in equivalence classes. Given the evidence that all elements of a conditional discrimination become part of the class, the purpose of this study was to determine if class-specific prompts would also enter into their relevant equivalence classes. Experiment 1 investigated the inclusion of prompts in an equivalence class using abstract stimuli with neurotypical students enrolled in higher education courses. Experiment 2 systematically replicated Experiment 1 using meaningful stimuli and individuals diagnosed with autism spectrum disorder. The results of both experiments demonstrated that class-specific prompts became part of equivalence classes with the other positive elements of the contingency. The results are discussed in terms of class expansion and the potential impact on equivalence-based instruction.     

Equivalence classification by California sea lions using class-specific reinforcers

The ability to group dissimilar stimuli into categories on the basis of common stimulus relations (stimulus equivalence) or common functional relations (functional equivalence) has been convincingly demonstrated in verbally competent subjects. However, there are investigations with verbally limited humans and with nonhuman animals that suggest that the formation and use of classification schemes based on equivalence does not depend on linguistic skills. The present investigation documented the ability of two California sea lions to classify stimuli into functional classes using a simple discrimination reversal procedure. Following the formation of functional classes in this context, the second experiment showed transfer of the relations that emerged between class members to a matching-to-sample procedure. The third experiment demonstrated that the functional classes could be expanded through traditionally defined equivalence relations. In these three experiments, appropriate within-class responding produced class-specific food reinforcers. Experiment 3 addressed the role of these reinforcers in equivalence classification and showed that the class-specific reinforcers were sufficient to relate new stimuli to the functional classes. These findings show that sea lions can form equivalence classes in simple and conditional discrimination procedures, and that class-specific reinforcers can become equivalence class members.     

Effects of compounding drug-related stimuli: escalation of heroin self-administration

Previous experiments have demonstrated that presenting independently established discriminative stimuli in compound can substantially increase operant responding maintained by food reinforcement or shock avoidance. Recently, this phenomenon was also shown to occur with cocaine self-administration. The present study further assessed the generality of these stimulus-compounding effects by systematically replicating them with heroin self-administration. Rats' nose-poke responses produced intravenous heroin (0.025 mg/kg per infusion) on a variable-ratio schedule when either a tone or a light was present. In the absence of these stimuli, responding was not reinforced. Once discriminative control by the tone and light had been established, the stimuli were presented in compound under extinction (with heroin discontinued) or maintenance conditions (with heroin available during test-stimulus presentations). In extinction, the tone-light compound increased responding approximately threefold compared to tone or light alone. Under maintenance conditions, compounding increased heroin intake approximately twofold. These effects closely matched those obtained earlier with cocaine. This consistency across pharmacological classes and across drug and nondrug reinforcers further confirms that (a) self-administered drugs support conditioning and learning in a manner similar to that supported by other reinforcers; and (b) multiple drug-related cues interact in lawful and predictable ways to affect drug seeking and consumption.     

Resurgence of derived stimulus relations.

Resurgence has been shown in human and nonhuman operant behavior, but not in derived relational responses. The present study examined this issue. Twenty-three undergraduates were trained to make conditional discriminations in a three-choice matching-to-sample paradigm. The training resulted in three equivalence classes, each consisting of four arbitrarily configured visual stimuli. The same 12 stimuli were then reorganized, and the conditional discrimination training was repeated such that three new classes were possible. In a subsequent test of derived relations, most subjects showed response patterns that were consistent with the altered conditional discriminations. Subjects were then exposed to conditional discrimination trials under extinction. Most subjects continued to respond consistently with the most recently reinforced conditional discrimination trials. During the next phase, subjects were exposed to symmetry and equivalence trials. Responses consistent with the most recent training produced feedback saying that the responses were incorrect, whereas other responses produced no feedback. Most subjects showed a resurgence of responding that was consistent with their earlier training. Finally, subjects were exposed to conditional discrimination trials carried out in extinction. Most subjects continued to show a resurgence of responding that was consistent with their early training.     

Nodal structure and the partitioning of equivalence classes

By definition, all of the stimuli in an equivalence class have to be functionally interchangeable with each other. The present experiment, however, demonstrated that this was not the case when using post-class-formation dual-option response transfer tests. With college students, two 4-node 6-member equivalence classes with nodal structures of A-->B-->C-->D-->E-->F were produced by training AB, BC, CD, DE, and EF. Then, unique responses were trained to the C and D stimuli in each class. The responses trained to C generalized to B and A, while the responses trained to D generalized to E and F. Thus, each 4-node 6-member equivalence class was bifurcated into two 3-member functional classes: A-->B-->C and D-->E-->F, with class membership precisely predicted by nodal structure. A final emergent relations test documented the intactness of the underlying 4-node 6-member equivalence classes. The coexistence of the interchangeability of stimuli in an equivalence class and the bifurcation of such a class in terms of nodal structure was explained in the following manner. The conditional discriminations that are used to establish a class also imposes a nodal structure on the stimuli in the class. Thus, the stimuli in the class acquire two sets of relational properties. If the format of a test trial allows only one response option per class, responding on those trials will be in accordance with class membership and will not express the effects of nodal distance. If the format of a test trial allows more than one response option per class, responding on those trials will be determined by the nodal structure of the class. Thus, the relational properties expressed by the stimuli in an equivalence class are determined by the discriminative function served by the format of a test trial.     

Self-inhibiting effects of reinforcement

The reinforcers produced by one response reduce the rate of other, concurrently reinforced responses. An analysis of the logical and empirical implications of the relation indicates that one reinforcer must have this effect on responses maintained by other reinforcers even when all reinforcers are produced by the same class of responses. A quantitative expression of the relation leads to a formulation, mathematically equivalent to Herrnstein's (1970), in which the rate of a reinforced response is a joint function of (1) an excitatory effect of the reinforcers produced by that class of responses, and (2) an inhibitory effect of the total reinforcers produced both by that class and by other classes of responses.     

Response elimination: A comparison of four procedures

Four procedures for eliminating an operant response were compared within a multiple schedule. Response reduction was most rapid when reinforcement was provided for a specific alternative response. The decline in responding produced by extinction and differential reinforcement of other behavior was similar. Responding initially increased and then gradually decreased when reinforcers were delivered independently of responding at fixed times. Removal of reinforcement from the alternative-response and DRO procedures did not result in recovery of the target response. However, the shift from response-independent dilivery of reinforcers to extinction caused an initial increase in responding.     

Discrimination and differentiation of response number in stimulus directed pecking of pigeons.

In Experiment 1, autoshaping trials terminated with food only if pigeons emitted more than a target number of responses during a trial in one condition and fewer than a target number in another. The median number of responses per trial shifted in accordance wtih the requirements. The responding of yoked-control birds that received response-independent reinforcers did not vary with the response requirements. In Experiment 2, the number of responses in autoshaping trial became the discriminative stimulus for reinforcement in the second component of a chained schedule. In one condition, responding was reinforced only if the number of responses in the first component was above a target value; in the other condition, responding was reinforced only if the number was below the target value. The distribution of the first-component response numbers did not shift systematically between discrimination conditions, but response rates in the second component indicated that the number of responses in the autoshaping trial was a discriminable property behavior.     

Contiguity and contingency in the acquisition and maintenance of an operant

Three experiments compared the effects of nondifferential and differential reinforcement of response location on a circular dimension. Rats were required to operate a vertical joystick to produce food. When food was delivered immediately after responses, but independent of response location, the spatial concentration of responding was low and no progressive changes were observed. Traditional and percentile schedules of differential reinforcement for response location produced highly reliable acquisition of spatially concentrated responding. Once concentrated responding had been established, nondifferential reinforcement was sufficient to maintain it in some subjects. Since only the differential reinforcement schedules established a contingency with respect to response location, it was concluded that this relationship was necessary for acquisition, but that response-reinforcer contiguity may be sufficient for maintenance. This conclusion is consistent with the view that operant conditioning is a contiguity-based process, but that contingencies are required to produce reliable contiguity between reinforcers and particular responses.     

Class-consistent Differential Reinforcement And Stimulus Class Formation In Pigeons

Match-to-sample training clusters of A1 (sample): B1/B2 (comparisons), A2: B2/B1, B1: A1/A2, B2: A2/A1, B1: C1/C2, B2: C2/C1, C1: B1/B2, and C2: B2/B1 were presented to pigeons with class-consistent differential reinforcement using two dissimilar types of food reinforcers. Distinctive class-consistent response patterns occurred to the samples during the fixed-ratio 5 sample observing response requirement. Subsequent tests, modeled from the equivalence class paradigm demonstrated the emergence (80% class consistent) of the transitive-like A-C and C-A relations for 4 and 2 of 12 pigeons, respectively, and a strong trend (over 70%) for 7 and 6 others, respectively; the emergence of the reflexive-like identity relation when the nonidentical comparison was from the other class; and the disruption of the trained within-class relation with the addition of a reflexive comparison. After directional training of C1: D1/D2 and C2: D2/D1, tests indicated no emergence of the symmetric-like D-C relation or the composite D-B and D-A relations, but the B-D and A-D transitive-like relation occurred with some pigeons. Off-baseline training with class-consistent differential reinforcement contingent on responding to the D stimuli alone produced distinctive responding and, in turn, a trend to D-C symmetric-like control in 4 of 12 pigeons, as well as a shift toward class-consistent control on D-B and D-A test trials. Class-consistent differential reinforcement that produced distinctive sample behavior promoted stimulus control relations like those that circumscribe equivalence class formation. Respondent—operant interactions permit an analysis of the possible enrollment of stimulus values of distinctive responding to the discriminative stimuli forming the stimulus classes via processes corresponding to naming in humans.     

A response-spacing effect: an absence of responding during response-feedback stimuli

In most studies of operant reinforcement a response-feedback stimulus is used which is so brief that the nature of the responding during it is virtually undetectable. The present study investigated the nature of this responding by lengthening an initially brief feedback stimulus. The key-pecking responses of pigeons were maintained by a variable-interval schedule of food reinforcement. Each response produced a brief stimulus light in addition to the usual auditory response feedback. When the duration of the feedback stimulus light was gradually increased, it was found to control a nearly zero rate of responding. The result was a paced, metronomic-like performance in which the pigeon made a single response, paused until the stimulus terminated, and then responded again. As a result, the overall response rate was greatly reduced; the mean interresponse time approximated the stimulus duration. A plausible interpretation is that brief feedback stimuli acquire control over responding because they coincide with few responses and few reinforcers. These findings show that in addition to their known functions as conditioned-reinforcing stimuli and discriminative stimuli, response-feedback stimuli also exert direct stimulus control: responding is reduced during the feedback stimulus itself.     

Equivalence class formation when responding is separated from sample and comparison stimuli: Working memory,priming, and sorting

The experiment determined whether equivalence class formation required overlap of comparison stimuli and responding. Each trial contained a sample first, a single, nonoverlapping comparison second, and a nonoverlapping response-window (RW) third, during which the participant made one of two responses (2R). All 11 participants formed two 3-member ABC equivalence classes using these “trace-stimulus-pairing two-response with response window” (TSP-2R-RW) trials. After adding a fourth stimulus (D) by CD training, ABCD tests showed immediate expansion to 4-member ABCD classes. When 4-member probes (AD, DA, BD, DB, CD, DC) were administered without 3-member probes, many participants showed decrements in class-indicative responding that then resurged to mastery with test repetition. Thus, 3-member probes enhanced class expansion. Class formation occurred for all participants when responding was temporally dissociated from the comparisons. In a matched, contemporaneously published experiment, where responding occurred during comparisons, only 54% of participants formed the classes. Thus, the comparison-response-separation nearly doubled class formation. Additionally, a special post-class-formation sorting test documented the emergence of two explicit equivalence classes. Finally, we noted a 1:1 correspondence for TSP-2R-RW and priming trials. Since priming measures neural substrates of equivalence classes, TSP-2R-RW trials should do the same.     

Within-session Response Patterns On Conjoint Variable-interval Variable-time Schedules

Operant responding often changes within sessions, even when factors such as rate of reinforcement remain constant. The present study was designed to determine whether within-session response patterns are determined by the total number of reinforcers delivered during the session or only by the reinforcers earned by the operant response. Four rats pressed a lever and 3 pigeons pecked a key for food reinforcers delivered by a conjoint variable-interval variable-time schedule. The overall rate of reinforcement of the conjoint schedule varied across conditions from 15 to 480 reinforcers per hour. When fewer than 120 reinforcers were delivered per hour, the within-session patterns of responding on conjoint schedules were similar to those previously observed when subjects received the same total number of reinforcers by responding on simple variable-interval schedules. Response patterns were less similar to those observed on simple variable-interval schedules when the overall rate of reinforcement exceeded 120 reinforcers per hour. These results suggest that response-independent reinforcers can affect the within-session pattern of responding on a response-dependent schedule. The results are incompatible with a response-based explanation of within-session changes in responding (e.g., fatigue), but are consistent with both reinforcer-based (e.g., satiation) and stimulus-based (e.g., habituation) explanations.     

Combining Operant baseline derived Conditioned Excitors and Inhibitors from the Same and Different Incentive Classes: An Investigation of Appetitive-Aversive Interactions

The dynamics of appetitive-aversive interaction theory were assayed in an experiment where excitors and inhibitors from the same and different incentive classes were compounded. Excitatory and inhibitory incentive properties acquired by the discriminative stimuli resulted from the reinforcement differences between components of four-component multiple training schedules, with the influence of competing peripheral responses factored into the design. Rats' barpressing was maintained in tone and in click by food or free-operant shock avoidance; extinction was programmed in click-plus-light and in the simultaneous absence of tone, click, and light. In Test 1, an excitor that occasioned operant responding and an inhibitor that occasioned response cessation were compounded. Here, compounding an inhibitor with an excitor from the same incentive class reduced responding significantly more than did compounding an inhibitor with an excitor from the other incentive class. In Test 2, the compounds consisted of elements that individually occasioned operant responding. Here, compounding stimuli that were excitors from different incentive classes appeared to create reciprocal inhibition that counteracted the additive effects produced when these stimuli were excitors from the same incentive class. Predictions from appetitive-aversive interaction theory and Weiss' two-factor model of stimulus control were confirmed within this experimental design, where all conditioning was a by-product of the behavioural contingencies programmed on the operant baselines.     

RESPONSE-REINFORCER RELATIONSHIPS AND IMPROVED LEARNING IN AUTISTIC CHILDREN

In order to affect more rapid response acquisition for autistic children, researchers have recently begun to investigate the functional relationships of reinforcers to other components of the operant conditioning paradigm. Previous research suggested that functional relationships between target behaviors and reinforcers might be especially effective. For example, locating a reward inside a container might be a more efficient way to teach a child to open the container than by handing the child a reward for opening an empty container. The present experiment assessed, within a multiple baseline design, the possibility of improving autistic children's learning by changing arbitrary response-reinforcer relationships (while holding target behaviors and reinforcers constant) so that the target behaviors became functional (i.e., a direct part of the response chain required for the child to procure the reinforcer). The results showed that: (1) arranging functional response-reinforcer relationships produced immediate improvement in the children's learning, and resulted in rapid acquisition of criterion level responding; and (2) high levels of correct responding initially produced by functional response-reinforcer relationships were continued even when previously ineffective arbitrary response-reinforcer conditions were reinstated. The results are discussed in terms of understanding and improving autistic children's learning.     

Emergence of relations and the essence of learning: a review of Sidman's Equivalence relations and behavior: a research story. Book review

The author reviews and comments on the book Equivalence relations and behavior: a research story by Murray Sidman. Sidman's book reports his research about equivalence relations and competencies in children with mental retardation and how it relates to behavior. Sidman used the idea of stimulus-stimulus relations among features of the environment to develop his theories about equivalence relations. Experimental work with children and animals demonstrated their ability to use equivalence relations to learn new tasks. The subject received feedback and reinforcement for specific choices made during training, then was presented with new choices during testing. Results of the tests indicate that subjects were able to establish relations and retrieve them in different situations.     

Pigeons play the percentages: computation of probability in a bird

The ability to compute probability, previously shown in nonverbal infants, apes, and monkeys, was examined in three experiments with pigeons. After responding to individually presented keys in an operant chamber that delivered reinforcement with varying probabilities, pigeons chose between these keys on probe trials. Pigeons strongly preferred a 75% reinforced key over a 25% reinforced key, even when the total number of reinforcers obtained on each key was equated. When both keys delivered 50% reinforcement, pigeons showed indifference between them, even though three times more reinforcers were obtained on one key than on the other. It is suggested that computation of probability may be common to many classes of animals and may be driven by the need to forage successfully for nutritional food items, mates, and areas with a low density of predators.