Overshadowing of a stimulus-reinforcer association by an instrumental response

In two experiments, rats were first exposed to pairings of a clicker and food; they were subsequently, in order to measure the effectiveness of the clicker as a conditioned reinforcer, given the opportunity to press a lever which turned the clicker on. For one group of animals the food originally delivered in the presence of the clicker had been contingent on their performance of an instrumental response (running in a running wheel); for a second the contingency between clicker and food had been purely classical. Although the actual correlation between clicker and food was identical for the two groups, the clicker was a less effective conditioned reinforcer for the first group than for the second. In a third experiment, all animals were initially required to run to obtain food in the presence of the clicker, but one group received additional trials on which food was delivered contingent on running in the absence of the clicker. This group showed less tendency to lever press for the clicker than a second group that had received free food on trials when the clicker was not presented. The results of all three experiments suggest that conditioning to the clicker could be overshadowed if the occurrence of food was more reliably predicted by the execution of an instrumental running response; they thus support the view that instrumental conditioning depends on the establishment of an association between response and reinforcer similar to the association between stimulus and reinforcer underlying classical conditioning.     

Additive and suppressive response summation with a chain schedule

Rats responded in a two-segment (variable-interval variable-interval) chain schedule. In one experiment, three subjects had either clicker, light, or clicker plus light as terminal-segment stimuli. All three responded at the highest rate when clicker plus light were present, thus showing additive summation. For three other subjects, initial-segment stimuli were either clicker, light, or clicker plus light. Two subjects responded at the lowest rate when clicker plus light were present, thus showing suppressive summation. In a second experiment, three subjects had either clicker, light, or neither clicker nor light as terminal-segment stimuli. None of these subjects showed reliable additive summation. Three other subjects had clicker, light, or neither as the initial-segment stimulus, and all three showed suppressive summation. Additive and suppressive summation both can be demonstrated with chain schedules, but stimulus parameters may be major variables in producing the effect.     

Integration of cardiac responses to serial stimuli after Pavlovian conditioning in rats

The expression of cardiac responses to sequences of two sounds was studied in restrained rats following discriminative trace or delay conditioning. Stimuli paired with a tail shock 10 sec later (CS1) elicited conditioned bradycardia. Unpaired or neutral stimuli (CS0) elicited mostly tachycardia. Rats did not learn to suppress responding to nonreinforced sequences with an interval of 6 sec between sounds. Responses to the second stimulus were significantly augmented following a CS1 stimulus, but not following a CS0 stimulus. Real-time summation of simple responses provided a more complete and quantitative prediction of dual responses than did resetting or facilitation. These results extend the time range over which summation may be observed from less than 2 sec to at least 16 sec. They appear to be inconsistent with models involving competition between unitary representations of stimuli in short-term memory and suggest the existence of multiple stimulus traces with independent time courses.     

Stimulus control in the experimental study of cooperation

The cooperative responses of pairs of human subjects were reinforced under several stimulus conditions in two settings designed to require a "social" response, i.e., where at least one of the two persons is responding to the behavior of the other. The first task, designed by Lindsley and Cohen, required individual responses within 0.5 sec of one another for reinforcement. The second (modified) task required a delay of 3 sec between individual responses. To determine dependence of cooperation on social stimuli, rates of cooperative behavior on these tasks were compared in the presence and absence of a stimulus indicating to each subject the other's response and a stimulus which indicated the duration of the timeout after reinforcement. The results indicated that only in the modified task was a high rate of cooperation always contingent upon the presence of the social stimuli.     

Bias functions and operating characteristics of rats discriminating auditory stimuli

Rats were trained to discriminate between two bursts of random noise that differed in intensity. In a two-lever, discrete-trial procedure, correct responses were reinforced with brain stimulation, and incorrect responses produced timeout. Responding was studied as a function of the decibel difference between the stimuli, the probabilities of presenting the stimuli, the relative duration of timeout consequent upon the two types of incorrect responses, and the absolute duration of timeout consequent upon incorrect responses. The results showed that the distribution of responses between the two levers depended upon the stimulus probabilities, but were independent of either the absolute or relative durations of timeout. When the stimulus probabilities were varied, the response probabilities did not match the stimulus probabilities; when the relative durations of timeout were varied, the animals did not obtain the maximum rate of reinforcement per unit time. Instead, the animals distributed their responses so as to obtain the maximum number of reinforcements at each level of discrimination. In addition, the level of discrimination increased as a function of the decibel difference between the stimuli.     

Reaction times of younger and older men: effects of compound samples and a prechoice signal on delayed matching-to-sample performances.

Five younger (18 to 23 yrs) and five older (65 to 73 yrs) men were exposed to a series of immediate and delayed (0 to 15 seconds) matching-to-sample problems. Presentation of the pairs of delayed comparison stimuli was either signaled or unsignaled, and the sample contained either 1, 2, or 3 elements, one of which appeared as the positive stimulus. During initial sessions, unlimited time was available to respond. Subsequently, correct responses were reinforced only if they occurred within a specified time limit. A general finding was slower responding with increased delay and with increased number of sample elements. These effects were reduced when the comparison stimuli were signaled and when time limits were in effect. Errors increased as a function of the manipulations of sample complexity and time limits, but did not change systematically when the delay between sample and comparison stimuli was varied. Although the younger men generally responded more quickly than the older ones, men of both ages showed increased speeds when limits were placed on response time, and these changes were maintained when the temporal contingencies were removed.     

Monkeys (Macaca mulatta and Cebus apella) track, enumerate, and compare multiple sets of moving items

Despite many demonstrations of numerical competence in nonhuman animals, little is known about how well animals enumerate moving stimuli. In this series of experiments, rhesus monkeys (Macaca mulatta) and capuchin monkeys (Cebus apella) performed computerized tasks in which they had to enumerate sets of stimuli. In Experiment 1, rhesus monkeys compared two sets of moving stimuli. Experiment 2 required comparisons of a moving set and a static set. Experiment 3 included human participants and capuchin monkeys to assess all 3 species' performance and to determine whether responding was to the numerical properties of the stimulus sets rather than to some other stimulus property such as cumulative area. Experiment 4 required both monkey species to enumerate subsets of each moving array. In all experiments, monkeys performed above chance levels, and their responses were controlled by the number of items in the arrays as opposed to nonnumerical stimulus dimensions. Rhesus monkeys performed comparably to adult humans when directly compared although capuchin performance was lower.     

Errorless learning of a conditional temporal discrimination

In the present study we extended errorless learning to a conditional temporal discrimination. Pigeons' responses to a left-red key after a 2-s sample and to a right-green key after a 10-s sample were reinforced. There were two groups: One learned the discrimination through trial and error and the other through an errorless learning procedure. Then, both groups were presented with three types of tests. First, they were exposed to intermediate durations between 2 s and 10 s, and given a choice between both keys (stimulus generalization test). Second, a delay from 1 s to 16 s was included between the offset of the sample and the onset of the choice keys (delay test). Finally, pigeons learned a new discrimination in which the stimuli were switched (reversal test). Results showed that pigeons from the Errorless group made significantly fewer errors than those in the Trial-and-Error group. Both groups performed similarly during the stimulus generalization test and the reversal test, but results of the delay test suggested that, on long stimulus trials, responding in the errorless training group was less disrupted by delays.     

Delayed temporal discrimination in pigeons: A comparison of two procedures

A within-subjects comparison was made of pigeons' performance on two temporal discrimination procedures that were signaled by differently colored keylight samples. During stimulus trials, a peck on the key displaying a slanted line was reinforced following short keylight samples, and a peck on the key displaying a horizontal line was reinforced following long keylight samples, regardless of the location of the stimuli on those two choice keys. During position trials, a peck on the left key was reinforced following short keylight samples and a peck on the right key was reinforced following long keylight samples, regardless of which line stimulus appeared on the correct key. Thus, on stimulus trials, the correct choice key could not be discriminated prior to the presentation of the test stimuli, whereas on position trials, the correct choice key could be discriminated during the presentation of the sample stimulus. During Phase 1, with a 0-s delay between sample and choice stimuli, discrimination learning was faster on position trials than on stimulus trials for all 4 birds. During Phase 2, 0-, 0.5-, and 1.0-s delays produced differential loss of stimulus control under the two tasks for 2 birds. Response patterns during the delay intervals provided some evidence for differential mediation of the two delayed discriminations. These between-task differences suggest that the same processes may not mediate performance in each.     

Effects of signaled versus unsignaled delay of reinforcement on choice

Pigeons chose between 5-s and 15-s delay-of-reinforcement alternatives. The first key peck to satisfy the choice schedule began a delay timer, and food was delivered at the end of the interval. Key pecks during the delay interval were measured, but had no scheduled effect. In Experiment 1, signal conditions and choice schedules were varied across conditions. During unsignaled conditions, no stimulus change signaled the beginning of a delay interval. During differential and nondifferential signal conditions, offset of the choice stimuli and onset of a delay stimulus signaled the beginning of a delay interval. During differential signal conditions, different stimuli were correlated with the 5-s and 15-s delays, whereas the same stimulus appeared during both delay durations during nondifferential signal conditions. Pigeons showed similar, extreme levels of preference for the 5-s delay alternative during unsignaled and differentially signaled conditions. Preference levels were reliably lower with nondifferential signals. Experiment 2 assessed preference with two pairs of unsignaled delays in which the ratio of delays was held constant but the absolute duration was increased fourfold. No effect of absolute duration was found. The results highlight the importance of delayed primary reinforcement effects and challenge models of choice that focus solely on conditioned reinforcement.     

Temporal dynamics of unimodal and multimodal feature binding

In two experiments, we studied the temporal dynamics of feature integration with auditory (Experiment 1) and audiovisual (Experiment 2) stimuli and manual responses. Consistent with previous observations, performance was better when the second of two consecutive stimuli shared all or none of the features of the first, rather than when only one of the features overlapped. Comparable partial-overlap costs were obtained for combinations of stimulus features and responses. These effects decreased systematically with increasing time between the two stimulus-and-response events, and the decreased rate was comparable for unimodal and multimodal bindings. General effect size reflected the degree of task relevance of the dimension or modality of the respective feature, but the effects of relevance and of temporal delay did not interact. This suggests that the processing of stimuli on task-relevant sensory modalities and feature dimensions is facilitated by task-specific attentional sets, whereas the temporal dynamics might reflect that bindings “decay” or become more difficult to access over time.     

Memory codes in pigeon short-term memory: Effects of varying the number of sample and comparison stimuli

In a delayed conditional discrimination task, pigeons can remember either some aspect of the conditional stimulus (i.e., they can code retrospectively) or some aspect of the stimulus to which they will respond at the end of the delay (i.e., they can code prospectively). To determine the nature of the memory code, we varied the number of possible sample stimuli (two or four) and the number of possible comparison stimuli (two or four) factorially across groups. Birds in all four groups were initially trained on a zero-delay, conditional discrimination with lines (vertical and horizontal) and/or shapes (circle and triangle), and were then tested with longer delays between sample offset and comparison onset. Acquisition of the conditional discrimination was affected by both the number of sample and comparison stimuli: birds were slower to reach criterion the greater the number in either stimulus set. During delay testing, however, only the number of comparisons affected performance. Overall, retention was poorer with four comparisons than with two. These data provide evidence for prospective coding in pigeon short-term memory.     

Reinforcement of spaced responding in a simultaneous discrimination

Pigeons were exposed to three stimuli simultaneously with responses reinforced according to differential-reinforcement-of-low-rate schedules. Responses to one stimulus (the positive stimulus) that were spaced appropriately resulted in food presentation. The variables manipulated were the time parameter of the schedule (5, 10, 20, 30 sec) and the consequences of responding to the other two stimuli (the negative stimuli). The percentage of the total responses that occurred to each stimulus was independent of the schedule value but was dependent on the consequences of responding to the negative stimuli. If responses to both reset the schedule timer, responding was confined largely to the positive stimulus. If responses to neither had scheduled effects, the birds were more likely to respond to those stimuli. Responding to one negative stimulus could be selectively attenuated by having responses to that stimulus alone reset the timer. With the schedule time value held constant, the absolute rate of responding to the positive stimulus was either stable or decreased with maintained exposure; it did not change as a function of increases or decreases in responding to the negative stimuli. Rather than interacting and affecting each other, responses to the three stimuli were controlled independently by their relation to reinforcement. There was no evidence that responses to the negative stimuli mediated the spacing of responses to the positive stimulus.     

Simon congruency effects based on stimulus and response numerosity

Three choice reaction time experiments documented a Simon-type congruence effect involving the numbers of stimuli and responses. In Experiment 1 the stimulus consisted of one or two high- or low-pitch tones, and participants were required to respond with one or two taps of a response key depending on stimulus pitch. Responses were faster when the number of tones matched the required number of response taps than when these numbers mismatched. Experiment 2 showed that a weaker version of this effect can also be obtained using visual stimuli, and Experiment 3 showed that the analogous effect can even be obtained, albeit very weakly, with bimodal stimuli. There was also evidence that the number of stimuli affected the rate of emitting the two-tap response. These results indicate that stimulus numerosity is processed automatically to the level at which it can affect the selection and possibly the execution of a varying number of responses.     

Simon congruency effects based on stimulus and response numerosity

Three choice reaction time experiments documented a Simon-type congruence effect involving the numbers of stimuli and responses. In Experiment 1 the stimulus consisted of one or two high- or low-pitch tones, and participants were required to respond with one or two taps of a response key depending on stimulus pitch. Responses were faster when the number of tones matched the required number of response taps than when these numbers mismatched. Experiment 2 showed that a weaker version of this effect can also be obtained using visual stimuli, and Experiment 3 showed that the analogous effect can even be obtained, albeit very weakly, with bimodal stimuli. There was also evidence that the number of stimuli affected the rate of emitting the two-tap response. These results indicate that stimulus numerosity is processed automatically to the level at which it can affect the selection and possibly the execution of a varying number of responses.     

GENERALIZATION OF NAMING RESPONSES TO OBJECTS IN THE NATURAL ENVIRONMENT AS A FUNCTION OF TRAINING STIMULUS MODALITY WITH RETARDED CHILDREN

Picture-cards, photographs, and real objects were compared as training stimuli in order to determine which best facilitated the generalization of naming responses learned in a special training room to real objects in the natural environments of four retarded children. The amount of transfer of naming behavior between the three stimulus modes and the average amount of training time required per stimulus mode were also assessed. Three of the four children displayed considerably more generalization to the real objects in the natural environment when they were trained with real objects. The fourth child displayed substantial generalization regardless of the training stimulus mode. No particular training stimulus mode clearly facilitated the transfer of naming responses to other modes or greatly reduced training time. The results of two supplementary procedures conducted with one child showed that: (1) training in several environments facilitated generalization to real objects in the natural environment when real objects were used as training stimuli but not when picture-cards were used, and (2) transfer from picture-cards to real objects was facilitated by training other picture-cards and the real objects portrayed by them at the same time.     

Control of fixation duration in visual search and memory search: another look

In visual search a variable delay (up to 150 msec) between the beginning of each fixation and the onset of a search stimulus reduces the time (oculomotor latency) between stimulus onset and the subject's next saccadic eye movement. Two hypotheses for this effect of stimulus onset delay (SOD) were compared: first, process monitoring, that SOD simply serves as a warning interval to facilitate saccadic responses; and second, preprogramming, that saccades are preprogrammed at short SODs. In the first experiment SOD produced a decline in oculomotor latency in search similar to that seen in previous studies. In the second and third experiments, the size of the memory set in a Sternberg memory search paradigm was varied, or a mask flanking some of the search stimuli was used, to vary the processing time of each stimulus. Partial preprogramming of saccades at short delays would predict that increasing the processing time of individual stimuli would increase oculomotor latency at only short SODs. However, oculomotor latency increased equally at all SODs. In this search task, then, the SODs appeared to facilitate saccade initiation.     

Conditioned inhibition from incomplete reductions in the probability of reinforcement

Five experiments, all using appetitive, discrete trial operant conditioning, studied the properties of a stimulus that signalled a reduction in the probability of reward. Discriminations were trained in which reinforcement was available on 100% of trials signalled by a tone, but only on some occasions when the tone was presented simultaneously with a light. The properties of the light were assessed in summation tests with a clicker. The first two experiments established that if the tone-light compound signalled reinforcement on only 25%, 33% or 50% of trials the light acted as a discriminative inhibitor, suppressing responding maintained by the clicker. In these experiments reinforcement had been available on 86.7% of clicker trials during initial training. Experiments 3, 4 and 5 examined further the properties of the light after animals had been trained on a discrimination where reinforcement was available on 50% of trials signalled by the tone-light compound. The light was evaluated in a summation test with a clicker, which had signalled only a 25% or 15% probability of a reinforcement. In this instance, the light did not suppress the responding maintained by the clicker. Instead, the light acted as an excitatory discriminative stimulus to enhance that responding. This dependence of the properties of the light on the reinforcement history of the clicker poses problems for most contemporary models of inhibitory performance.     

Context specificity of conditioned-reinforcement effects on discrimination acquisition

Pigeons were trained on a series of reversals of a simultaneous form discrimination in which the trial outcomes were separated from the choice responses by an 8-s delay interval. Different conditions were defined by the stimuli occurring during the two halves of the delay interval. Discrimination learning was greatly facilitated by having differential stimuli during the delay following correct versus incorrect choices. When the differential stimuli appeared only at the midpoint of the delay, some facilitation occurred relative to when no different stimuli occurred, but there was substantially less facilitation than when the differential stimuli occurred immediately contingent on choice. A reversed-stimulus condition, in which the stimulus at the onset of the delay following a correct choice was the same as that during the last segment of the delay following an incorrect choice, and the stimulus at the onset of the delay following an incorrect choice was the same as that preceding food during the last segment of the delay following a correct choice, also facilitated discrimination learning relative to the nondifferential stimulus conditions.