Associative interaction: joint control of key pecking by stimulus-reinforcer and response-reinforcer relationships

The joint control of rate of key pecking in pigeons by stimulus-reinforcer and response-reinforcer relationships was studied in the context of a two-component multiple schedule of reinforcement. Food presentation was always associated with one component and extinction with the other. The stimulus-reinforcer relationship was manipulated by varying the relative durations of the two components. In the food-presentation component, a fixed rate of reinforcement, independent of rate of responding, was generated by a schedule referred to as “T*”. One aspect of the response-reinforcer relationship, contiguity, was manipulated by varying the percentage of delayed reinforcers. With the multiple T* extinction schedule, stimulus-reinforcer and response-reinforcer relationships could be varied independently of one another. Rate of key pecking was sensitive to manipulations of both relationships. However, significant differential effects due to either the stimulus-reinforcer or response-reinforcer relationship were obtained only when the other relationship was weak: stimulus-reinforcer and response-reinforcer relationships interacted in the joint control of responding.     

Some implications of a relational principle of reinforcement

A formal statement of a relational principle of reinforcement is developed that makes contact with analyses of choice, interresponse-time distributions, and stimulus control. Some implications for current theoretical and empirical work in the various areas are examined.     

Monotonic weighted power transformations to additivity

A class of monotonic transformations which generalize the power transformation is fit to the independent and dependent variables in multiple regression so that the resulting additive relationship is optimized. This is achieved by minimizing a quadratic fitting criterion with linear inequality constraints on the parameters. A quadratic programming technique which works reliably and quickly in this application is outlined. Some examples of the analysis of artificial and real data are offered.This work was supported by National Research Council of Canada Grant APA 320 to the author.     

Responding in the squirrel monkey under fixed-ratio schedules of stimulus termination

Key pressing was maintained under a fixed-ratio schedule in which electric shock was scheduled for delivery at a fixed time (t seconds) after each stimulus onset, and every n^th response terminated the stimulus and initiated a timeout from shock. Under this procedure, the higher the rate of responding, the briefer the duration of the stimulus presentation and the lower the frequency of shock delivery. The effects of several schedule parameters were studied to determine whether the maintenance of responding was dependent on an inverse relation between response rate and shock frequency. Shock rate and shock frequency were made independent of response rate by decreasing the value of t to 0.5 second and delivering shock only during the first presentation of the stimulus after a fixed time, including stimulus and timeout durations, had elapsed since the previous shock. The experiments showed that shock frequency and response rate are inversely related when t is of relatively long duration compared to the value of the fixed-ratio parameter, but that a decrease in shock rate or frequency due to a high rate of responding is not necessary for the maintenance of responding under a fixed-ratio schedule of stimulus termination.     

General attentiveness effects of discriminative training

Using a design that permitted the simultaneous assessment of intra-, inter-, and extradimensional effects of discriminative training, the generality of discriminative effects that have been said to reflect increases in “general attentiveness” was assessed. Pigeons received either discriminative training with two stimuli correlated with reinforcement and one stimulus correlated with nonreinforcement, or nondifferential reinforcement (control) training. One positive stimulus was part of an intradimensional task and the other was not. After training, generalization tests were conducted to assess stimulus control along several dimensions. Discriminative training resulted in increased control along dimensions of the positive stimulus involved in the intradimensional task, but not along any dimensions of the other positive stimulus. The results suggested that discriminative training leads to increases in attention that are neither so general as suggested by the “general attentiveness” view nor so specific as to be revealed solely by intradimensional effects.     

THE ROLE OF REFERENTIAL SPEECH IN SIGN LEARNING BY MENTALLY RETARDED CHILDREN: A COMPARISON OF TOTAL COMMUNICATION AND SIGN-ALONE TRAINING

We conducted two experiments to assess the role of referential speech during sign training in which the spoken words corresponding to signs were receptively known to the participants. An alternating treatments design was used to compare sign acquisition across two teaching conditions in which referents were presented either with or without the corresponding verbal label. During the first experiment, signs were taught concurrently; during the second experiment, signs within each of the respective conditions were taught in a serial fashion. In both experiments, signs taught by total communication were acquired faster than those taught by sign-alone training.     

Establishing auditory stimulus control over an eight-member equivalence class via conditional discrimination procedures

Two eight-member equivalence classes of visual stimuli were established during three phases of a training program. In Phase 1, two training arrangements were compared. In one, 3 subjects were taught on different trials to select from a single pair of comparison stimuli (A1, A2) in response to eight sample stimuli that were trained in pairs (B1, B2; C1, C2; D1, D2; E1, E2). In the second arrangement, subjects were taught to select from four pairs of comparisons (B1, B2; C1, C2; D3, D2; E2, E2) in response to two samples (A1, A2). Training with the single pair of comparison stimuli resulted in the development of equivalence relations (B1C1, B2C2, D1B1, D2B2, B1E1, B2E2, C1D1, C2D2, C1E1, C2E2, D1E1, D2E2, and their reciprocals) between the sample stimuli without direct training of these relations. In the other training arrangement, these relations among the comparison stimuli developed in the performance of 1 subject only. In Phase 2, three new pairs of stimuli (F1, F2; G1, G2; H1, H2) were substituted for three of the original pairs (B1, B2; C1, C2; D1, D2) and the training arrangements for the groups were reversed. Following training, the performances that showed equivalence relations on the probes in the first phase also showed equivalence relations in the second phase. If such relations did not develop in the first phase, they did not do so in the second phase. In Phase 3, relations between stimuli across the two previous phases (e.g., B1F1, B2F2, B1G1, B2H2, C1F1, etc.) were investigated. The 4 subjects whose performances showed the development of these relations were taught to select one stimulus from each class (E1 and E2) in response to a verbal label (I1 and I2) and then were tested to see if the verbal label controlled responding to the remaining members of the class (e.g., I1A1, I2A2, I1B1, I2B2, etc.). For 3 subjects, this generalized control occurred; for the 4th, generalization occurred only after verbal training with a second pair of visual stimuli (F1 and F2). In retests several months later, these auditory-visual relations were found to be intact or, if not, were recovered without direct training.     

Emergent simple discrimination established by indirect relation to differential consequences

Three experiments examined a discrimination training sequence that led to emergent simple discrimination in human subjects. The experiments differed primarily in their subject populations. Normally capable adults served in the first experiment, preschool children in the second, and mentally retarded adults in the third. In all experiments, subjects learned a simple simultaneous discrimination: When visual stimuli A1 and A2 were displayed together, reinforcers followed selections of A1, the S+, but not A2, the S-. The subjects also learned a conditional discrimination taught with an arbitrary visual-visual matching-to-sample procedure. Comparisons were two additional visual stimuli, B1 and B2, and samples were A1 and A2. Reinforcers followed selections of B1 in the presence of A1 and of B2 in the presence of A2. After the simple-discrimination and conditional-discrimination baselines had been acquired, B1 and B2 were displayed alone (without a sample) on probe trials. Subjects had never been taught explicitly how to respond to such displays. Nonetheless, they almost always selected B1, which was involved in a conditional relation with A1, the stimulus that served as S+ on the simple-discrimination trials. This outcome suggested the formation of stimulus classes during conditional-discrimination training. Through class formation, B1 and B2 had apparently acquired stimulus functions similar to those shown by A1 and A2 on simple-discrimination trials, thereby leading to emergent selections of B1 on the probes.     

The effects of component duration on multiple-schedule performance in closed and open economies.

Pigeons responded on multiple variable-interval variable-interval schedules of reinforcement in an open and a closed economy. Equal duration components were increased in duration while the component rates of reinforcement were held constant, the component schedules were reversed, and component duration was decreased. In the open economy, daily sessions were limited to 1 hr, and subjects were maintained at 80% of their free-feeding weights through supplemental feeding when necessary in their home cages. In the closed economy, subjects were housed in their experimental chambers and no deprivation regimen was enforced. Relative response rate decreased as components were lengthened in the open economy, whereas in the closed economy relative rate increased as components were lengthened. Response proportions overmatched reinforcer proportions to a greater extent at long component durations in the closed economy, but there was no systematic effect of component duration on responding in the open economy.     

Successive independence of multiple-schedule component performances

In three experiments, pigeons' responses were reinforced on two keys in each component of a series of multiple-schedule conditions. In each series, concurrent variable-interval schedules were constant in one component and were varied over conditions in the other component. In the first experiment both components arranged the same, constant total number of reinforcers, in the second the two components arranged constant but different totals, and in the third experiment the total was varied in one component and remained constant in the other. Relative reinforcer rate during the varied component was manipulated over conditions in all three experiments. In all these experiments, response and time allocation in the constant component were invariant when reinforcer ratios varied in the other component, demonstrating independence of behavior allocation in a multiple-schedule component from the relative reinforcer rate for the same alternatives in another component. In the two experiments which maintained constant reinforcer totals in components, sensitivity to reinforcement in the multiple schedules was the same as that in the concurrent schedules arranged during the varied component, with multiple-schedule bias in the experiment in which the totals were unequal.