The development of derived stimulus relations through training in arbitrary-matching sequences

Five-year-old children were taught three-stage sequences of arbitrary matching: A-C, B-C, A-D; A-C, B-D, B-C; or A-C, A-D, B-C. Each stage refers to a sample-comparison relation between stimuli. Unreinforced test probes revealed untrained arbitrary matches (B-D, A-D, and B-D, respectively), derivable by substitution of stimuli with a common sample or comparison function. Additional probes revealed further untrained sample-comparison relations derivable by substitution and identity, including the commuted relations D-B, D-A, and D-B, respectively. These processes may have relevance to conceptual and verbal behavior.     

Reaction times of younger and older men and temporal contingencies of reinforcement

Influences of extended training and temporal contingencies on reaction time were studied in relation to developmental differences. Older and younger men were trained on a chained schedule in which completion of a variable interval produced a terminal link in which reaction time was measured. The reaction-time procedure involved a conditional discrimination with matching to sample in one component and oddity matching in the other. During baseline training, no time limit was placed on the response to the discrimination choice stimuli. Subsequently, increasingly severe time limits were imposed over a series of sessions. Older and younger men showed increased speeds (decreased reaction times) when temporal contingencies were imposed, and these changes were maintained during post-training baseline sessions when there was unlimited time in which to respond. The younger men generally responded faster than the older ones, and age differences were not appreciably reduced during the course of the experiment. The results indicated the feasibility of studying reaction time in human subjects using operant procedures analogous to those developed for the study of nonverbal organisms.     

Concurrent schedules: Spatial separation of response alternatives

Four pigeons were exposed to independent concurrent variable-interval 20-second variable-interval 60-second schedules of reinforcement. A transparent partition was inserted midway between the two response keys. The length of the partition was systematically manipulated. Increasing partition length produced a decrease in changeover rate in Experiment 1. Over-matching was observed with a partition length of 20 centimeters. In Experiment 2 a four-second limited hold was added to the schedules. Increasing partition length produced a decrease in changeover rate that exceeded the decrease observed in Experiment 1. This manipulation produced nearly exclusive choice of the variable-interval 20-second component. The present results, together with results obtained in related research, suggest that deviation from matching is a function of procedural variables that determine the consequences of a changeover response.     

Choice as a function of local versus molar reinforcement contingencies.

Rats were trained on a discrete-trial probability learning task. In Experiment 1, the molar reinforcement probabilities for the two response alternatives were equal, and the local contingencies of reinforcement differentially reinforced a win-stay, lose-shift response pattern. The win-stay portion was learned substantially more easily and appeared from the outset of training, suggesting that its occurrence did not depend upon discrimination of the local contingencies but rather only upon simple strengthening effects of individual reinforcements. Control by both types of local contingencies decreased with increases in the intertrial interval, although some control remained with intertrial intervals as long as 30 s. In Experiment 2, the local contingencies always favored win-shift and lose-shift response patterns but were asymmetrical for the two responses, causing the molar reinforcement rates for the two responses to differ. Some learning of the alternation pattern occurred with short intertrial intervals, although win-stay behavior occurred for some subjects. The local reinforcement contingencies were discriminated poorly with longer intertrial intervals. In the absence of control by the local contingencies, choice proportion was determined by the molar contingencies, as indicated by high exponent values for the generalized matching law with long intertrial intervals, and lower values with short intertrial intervals. The results show that when molar contingencies of reinforcement and local contingencies are in opposition, both may have independent roles. Control by molar contingencies cannot generally be explained by local contingencies.     

Violations of stochastic transitivity on concurrent chains: Implications for theories of choice

The concurrent-chains procedure has been used to measure how choice depends on various aspects of reinforcement, such as its delay and its magnitude. Navarick and Fantino (1972, 1974, 1975) have found that choice in this procedure can violate the condition of stochastic transitivity that is required if a unidimensional scale for reinforcements is to be possible. It is shown in this paper that two simple unidimensional models of choice on concurrent chains can produce violations of stochastic transitivity. It is argued that such violations may result from the complex contingencies of the concurrent-chains procedure.     

CONDITIONAL DISCRIMINATION VS. MATCHING TO SAMPLE: AN EXPANSION OF THE TESTING PARADIGM

A subject's performance under a conditional-discrimination procedure defines conditional relations between stimuli: “If A1, then B1; if A2, then B2.” The procedure may also generate matching to sample. If so, the stimuli will be related not only by conditionality, but by equivalence: A1 and B1 will become equivalent members of one stimulus class, A2 and B2 of another. One paradigm for testing whether a conditional-discrimination procedure has generated equivalence relations uses three sets of stimuli, A, B, and C, three stimuli per set. Subjects learn to select Set-B and Set-C comparisons conditionally upon Set-A samples. Having been explicitly taught six sample-comparison relations, A1B1, A1C1, A2B2, A2C2, A3B3, and A3C3, subjects prove immediately capable of matching the B- and C-stimuli; six new relations emerge (B1C1, B2C2, B3C3, C1B1, C2B2, C3B3). The 12 stimulus relations, six taught and six emergent, define the existence of three three-member stimulus classes, A1B1C1, A2B2C2, and A3B3C3. This paradigm was expanded by introducing three more stimuli (Set D), and teaching eight children not only the AB and AC relations but DC relations also—selecting Set-C comparisons conditionally upon Set-D samples. Six of the children proved immediately capable of matching the B- and D-stimuli to each other. By selecting appropriate Set-B comparisons conditionally upon Set-D samples, and Set-D comparisons conditionally upon Set-B samples, they demonstrated the existence of three four-member stimulus classes, A1B1C1D1, A2B2C2D2, and A3B3C3D3. These larger classes were confirmed by the subjects' success with the prerequisite lower-level conditional relations; they were also able to select Set-D comparisons conditionally upon samples from Sets A and C, and to do the BC and CB matching that defined the original three-member classes. Adding the three DC relations therefore generated 12 more, three each in BD, DB, AD, and CD. Enlarging each class by one member brought about a disproportionate increase in the number of emergent relations. Ancillary oral naming tests suggested that the subject's application of the same name to each stimulus was neither necessary nor sufficient to establish classes of equivalent stimuli.     

Performance of humans in concurrent avoidance/positive-reinforcement schedules

Performance maintained under concurrent schedules consisting of a variable-interval avoidance component and a variable-interval positive-reinforcement component was studied in three human subjects using points exchangeable for money as the reinforcer. The rate of responding in the avoidance component increased, and the rate of responding in the positive-reinforcement component declined, as a function of the frequency of point-losses avoided in the avoidance component. The performance of all three subjects conformed to equations proposed by Herrnstein to describe behavior in concurrent schedules. The logarithms of the ratios of the response rates in the two components, and the logarithms of the ratios of the times spent in the two components, were linearly related to the logarithms of the ratios of the frequency of loss avoidance in the avoidance component to the frequency of reinforcement in the positive-reinforcement component. When a changeover delay of 5.0 sec was imposed, the slopes of the linear functions were close to 1.0 in the case of two subjects, whereas the third subject exhibited significant undermatching. For two subjects the changeover delay was then reduced to 2.0 sec; in both cases the slopes of the linear functions were lower than under the 5.0-sec condition. One subject participated in a third phase, in which no changeover delay was imposed; there was a further reduction in the slopes of the linear functions.     

Stimulus discriminability in free-operant and discrete-trial detection procedures.

Six pigeons were trained to discriminate different light intensities in four experimental procedures. Experiment 1 compared stimulus discriminability in a yes-no signal-detection task with discriminability measures obtained from two free-operant procedures. Discriminability estimates were significantly lower in the detection procedure. Experiment 2 showed this lowered discriminability to be a function of the delay between stimulus presentation and the availability of the choice-response keys in the standard detection task. In addition, reinforcement sensitivity was lowest when correct choice responses were intermittently, rather than continuously, reinforced.     

Concurrent schedule assessment of food preference in cows

Six dairy cows (Bos taurus) were trained on several pairs of concurrent variable-interval schedules with different types of food available on each alternative. The required response was a plate press made by the animal's muzzle. Performance generally replicated that found with other species. The generalized matching law accounted for the preference data, showing that food preference could be quantitatively analyzed as a special case of response bias. The preference functions showed that the response- and time-allocation ratios were not as extreme as obtained reinforcement rate ratios (undermatching).     

Effects of fixed-ratio sample and choice response requirements upon oddity matching

Three pigeons were trained on oddity matching in which either 1, 4, 8, 16, or 32 sample-key observing responses were required to turn off the sample stimuli and turn on the comparison stimuli. Oddity accuracy increased when the observing-response requirement was raised and decreased when the requirement was lowered. Next, while the observing requirement was maintained at one response, the number of responses required to the comparison stimuli was either 1, 4, 8, 16, or 32. Under these conditions, choice was defined as the comparison that first accumulated the required number of responses. In general, increasing the comparison-response requirement decreased accuracy and lowering the comparison requirement increased accuracy. The fixed-ratio observing requirements appeared to facilitate control by stimuli serving an instructional function.