Effects of differences between stimuli, responses, and reinforcer rates on conditional discrimination performance

In a discrete-trial conditional discrimination procedure, 4 pigeons obtained food reinforcers by pecking a key with a short latency on trials signaled by one stimulus and by pecking the same key with a long latency on trials signaled by a second stimulus. The physical difference between the two stimuli and the temporal separation between the latency values required for reinforcement were varied factorially over four sets of conditions, and the ratio of reinforcer rates for short and long latencies was varied within each set of conditions. Stimulus discrimination varied directly with both stimulus and response differences and was unaffected by the reinforcer ratio. Sensitivity to reinforcement, estimated by generalized-matching-law fits to the data within each set of conditions, varied directly with the response difference but inversely with the stimulus difference arranged between sets of conditions. Because variations in stimulus differences, response differences, and reinforcer differences did not have equivalent effects, these findings question the functional equivalence of the three terms of the discriminated operant: antecedent stimuli, behavior, and consequences.     

Discrimination based on response-produced stimuli

This study outlines a simplified operant conditioning procedure for investigating discrimination based on response-produced stimuli. The method, using concurrent schedules of reinforcement, greatly reduced the complexity of the procedures and the number of training sessions necessitated by a recently offered alternative technique. Calculations of Weber’s Constant for discrimination between response-produced stimuli are presented and the relevance for learning theory of empirical studies concerning response-produced stimuli is indicated.     

Fixed-ratio discrimination: effects of response-produced blackouts

For three pigeons, reinforcement depended upon a left side-key response after execution of a fixed ratio 10 on the center key, and upon a right side-key response after fixed ratio 20. Each response during the fixed ratios produced a 0.5-sec blackout. The time between the first and last response in fixed ratio 10 was then equated with the time between the first and last response in fixed ratio 20 by increasing the blackout duration. The accuracy of side-key choice was disrupted, thereby suggesting that time, rather than number of responses, controlled choice responding. When the time between the first and last response was equated during both ratios, asymptotic accuracy was approximately equal to (two birds) or somewhat higher than (one bird) that obtained previously. The results of probes with intermediate fixed ratios and blackouts suggested that control of side-key choice had transferred from the time between the first and last response in ratios to blackout duration.     

Emergent conditional discrimination in children: Matching to compound stimuli

This study reports two experiments that first taught preschool children identity-matching to compound sample and compound comparison stimuli. A compound stimulus consisted of a colour and a form superimposed on one another. Test sessions assessed whether children related the form and colour elements of a particular compound stimulus. The test for this was matching to sample in which an arbitrary conditional discrimination was required. A majority of the children selected the correct colour comparison in the presence of each form sample. The children also showed the reverse sample-comparison relations: they matched form comparisons to the corresponding colour samples, respectively. In the context of these arbitrary relations, new colours were paired with the form elements of the samples (Experiment 1), and new form elements were paired with the colour elements of the comparisons (Experiment 2). Subsequent tests assessed whether the new stimulus elements had control over responding when presented as single samples or comparisons. Test results showed that most subjects were able to relate the new stimulus elements to the corresponding colour and form elements, respectively. The study demonstrated that matching to compound stimuli in training and testing conditionsMaygenerate conditional relations between the individual stimulus elements.     

The differential reinforcement of reward-produced and response-produced stimuli

In two experiments, groups received successive large-reward trials on odd-numbered days and successive small-reward trials on even-numbered days in the same gray alleyway. This produced a discrimination problem in which the memory of large reward (S^L) was reliably discriminative of large reward and the memory of small reward (S^S) was reliably discriminative of small reward. Intertrial interval (ITI) was varied both between and within groups. In the within-groups manipulation, ITI separating S+ trials differed from that separating S- trials. Experimental groups learned the discrimination, running slower to S^S (S- cue) than to S^L (S+ cue), and showed a negative contrast effect, running slower to S- than a small-reward control group. Discrimination was somewhat faster at massed than at spaced trials. The within-groups manipulation of ITI suggested that the effects of ITI were mediated by time-dependent changes in internal cues produced by reward events and by the instrumental response. The control exercised by internal cues was shown to be associative rather than nonassociative, e.g., motivational. Similarities with, and implications for, conventional brightness differential conditioning were discussed.     

Effects of altering outcome expectancies on pigeons' delayed conditional discrimination performance

An outcome-expectancy mediation theory of learning was tested in a series of transfer experiments with pigeons. The principal technique employed was a delayed two-choice conditional discrimination in which the subject's correct choice yielded a food reward on one kind of trial and a feedback tone on the other. According to the theory, this task engenders two-link mediational chains in that each conditional cue controls a particular outcome expectancy (S-E link) and the expectancy, in turn, cues a specific choice response (E-R link). Relative to the hypothetical mediators established by preceding training, transfer problems required either the same mediational chains, the alteration of one link in each chain, or the alteration of both links in both chains for optimal performance. The results of four separate transfer experiments confirmed detailed theoretical predictions, including that of an unusual nonmonotonic transfer effect. The relation of the present theory to earlier mediation theories is discussed.     

Effects of list length and first-trial reward upon concurrent discrimination performance

Rhesus monkeys were given 2304 two-trial object discrimination problems that were presented as members of lists consisting of two, four, or eight problems. The problems within each list were presented concurrently, Trial 1 for all problems in the list being presented before initiation of Trial 2 for any problem. Each problem involved exposure of a single object on Trial 1, which was either rewarded or not rewarded, followed by presentation of the Trial 1 object along with a second object on Trial 2. Performance varied inversely with list length, and this effect became more prominent as a function of training. Performance after Trial 1 nonreward was substantially better than that after Trial 1 reward, and this effect became enhanced both with continued training and with increased list length. The findings were discussed in terms of Bessemer's short-term memory analysis of learning set.     

Signal-detection analyses of conditional discrimination and delayed matching-to-sample performance

Quantitative analyses of stimulus control and reinforcer control in conditional discriminations and delayed matching-to-sample procedures often encounter a problem; it is not clear how to analyze data when subjects have not made errors. The present article examines two common methods for overcoming this problem. Monte Carlo simulations of performance demonstrated that both methods introduced systematic deviations into the results, and that there were genuine risks of drawing misleading conclusions concerning behavioral models of signal detection and animal short-term memory.     

Differential effects of instructions and consequences on human conditional discrimination performance

Two studies evaluated the differential behavioral effects of instructions and feedback in matching-to-sample procedures. In Experiment 1, 20 college students received true or false instructions and trial-by-trial or delayed feedback in three phases. In a fourth, final phase the instructions remained the same, but feedback changed from trial-by-trial to delayed, or from delayed to trial-by-trial. In Experiment 2, half of another 20 participants received true instructions during three phases, followed by false instruction in a fourth phase; the other half of the participants received false instructions during three phases, followed by true instructions in the fourth phase. Feedback sequences were as in Experiment 1. The results of both experiments revealed historical effects of instructions and feedback. Most participants demonstrated strong instructional control, overriding the control by contingencies. These results suggest that the present procedure offers optimal possibilities to make the differential effects of instructions and feedback on human behavior clearly identifiable when conditional discrimination tasks are used.     

Conjoint control of performance in conditional discriminations by successive and simultaneous stimuli.

In a conditional discrimination, reinforcement of pigeons' responses to pairs of simultaneously presented wavelength stimuli depended on the orientation of white lines superimposed on the wavelengths. Over different conditions in Experiment 1, three wavelength differences were combined with two differences between successively presented line orientations. Measures of stimulus discriminability increased with increases in the difference between both orientation and wavelength stimuli. Conditional-discrimination performance was thus conjointly determined by stimulus disparity in the successive and simultaneous discriminations. In Experiment 2, ratios of rates of reinforcement contingent upon the two categories of correct responses were varied over several conditions for difficult and easy discriminations. Ratios of responses to wavelength pairs were sensitive to variations in the reinforcement ratio to a greater extent for the more difficult orientation discrimination than for the easier orientation discrimination. Performance in the conditional discrimination was therefore determined by the interacting effects of stimulus disparity and the relative rates of reinforcement contingent upon the two correct choices. It was concluded that the effect of temporally distant reinforcement on behavior in a prevailing schedule component is attenuated to an extent that depends on similarity of stimuli that delineate the successive components.     

Schedules using noxious stimuli. III. Responding maintained with response-produced electric shocks

Responding was maintained in two squirrel monkeys under several variations of a 10-min fixed-interval schedule of electric shock presentation. The monkeys were first trained under a 2-min variable-interval schedule of food presentation, and then under a concurrent schedule of food presentation and shock presentation. In one monkey, when shocks (12.6 ma) followed each response during the last minute of an 11-min cycle ending with a timeout period, responding was increased during the first 10 min and suppressed during the last minute of each cycle. When the shock schedule was eliminated, both the enhancement and suppression disappeared, and a steady rate of responding was maintained under the variable-interval schedule. When the food schedule was eliminated, the shock schedule maintained a characteristic fixed-interval pattern of responding during the first 10 min, but suppressed responding during the last minute of each cycle. The fixed-interval pattern of responding was maintained when the timeout period was eliminated and when only one shock could occur at the end of the cycle. In the second monkey, responding under the concurrent food and shock schedule was suppressed when responses produced shocks after 3-min. Under an 11-min cycle, responding continued to be maintained at increasing shock intensities. When the food schedule was eliminated, a fixed-interval pattern of responding was maintained under a 10-min schedule of shock presentation (12.6 ma). Whether response-produced electric shocks suppressed responding or maintained responding depended on the schedule of shock presentation.     

Stimulus control during conditional discrimination

Pigeons were used to assess stimulus control during the development of a conditional discrimination. The training consisted of three stages. In Stage 1, key pecks were reinforced in the presence of a white line tilted 40 degrees to the right of vertical on a green background and non-reinforced when the same line appeared on a red background. In Stage 2, key pecks were reinforced when a white vertical line appeared on a red background and were non-reinforced in the presence of a 40 degrees slanted line on a red background. In Stage 3, key pecks were reinforced in the presence of the green background regardless of the line tilt, but were differentially reinforced in the presence of the red background (as in Stage 2). Generalization tests were conducted after each stage of training and consisted of five white lines on backgrounds that were green, red, or dark. The effects of the differential reinforcement contingencies on control by line orientation were restricted to the condition in which the red light appeared and resulted in behavioral control that could be characterized as: if red, pay closer attention to line tilt than if not red.     

Effects of unattended emotional stimuli on color-naming performance

The effect of irrelevant emotional and neutral stimuli on the performance of a color-naming task is examined with two groups of subjects: pilots and bus drivers. It is found that (1) the emotional stimuli disrupt performance in both groups, (2) the decrement in performance is relatively larger in the pilot group, and (3) the effect of the emotional stimuli appears to persist over time.