The effects upon food-reinforced pecking and treadle-pressing of auditory and visual signals for response-independent food

Seven pigeons whose key-pecking was maintained by food reinforcement on a differential-reinforcement-of-low-rates 12-sec limited-hold 4-sec schedule and 12 other pigeons whose treadle-pressing was maintained by the same schedule received appetitive Pavlovian conditioning trials superimposed upon the instrumental baseline. Half the birds in each group received a tone as the CS, and the other half received a stimulus change on the key. Each CS was 20 sec long, and was immediately followed by 10-sec access to grain. The visual CS markedly facilitated the rate of pecking on the key for the birds whose baseline response was pecking. The visual CS produced auto-shaping of the key-peck and tended to produce suppression of treadle-pressing for the birds whose baseline response was treadle-pressing. The auditory CS produced inconsistent effects across birds regardless of the baseline response. In all cases the conditioned effects extinguished when response-independent food was omitted.     

Transfer of a response controlling stimulus duration across discrimination problems

In the acquisition phase, pigeons learned to peck at a changeover key to shorten the duration of S? but not of S+ presented on the food key in a discrimination problem. In the transfer phase, the significance of S+ and S? was changed through extinction of both, equal reinforcement, or discrimination reversal, while the changeover key was not available. Transfer tests then showed appropriate modification of the changeover response. Similar transfer was demonstrated across orthogonal stimulus dimensions. Further analytic studies showed that this transfer of the changeover response did not depend upon mediation due to differential response rates to the food key. This research strategy enriches the study of the “second learning process” by providing an indicator of stimulus control in all phases of the procedure. Direct transfer between different problems also indicates that discriminative stimuli, although physically dissimilar, have the same “psychological value” for the subject.     

Evaluation of infant vocal conditioning.

The use of the operant conditioning paradigm, as it has been applied to infant social, vocal behavior, reflects a failure to take into account the social nature of human infants over and above the rigid theoretical rationale of the paradigm. It is argued that: (1) the baseline procedure used in operant conditioning studies is methodologically and conceptually invalid; (2) the reinforcing stimulus used in social conditioning studies elicits the very response that it is assigned to reinforce; and (3) the effect of the response-reinforcer relationship is not the reinforcement (strengthening) of vocal response rate.     

The effect of S− on observing behavior

Eight pigeons were run on a one-key, discrete-trials observing procedure. Pecks during a trial produced S⁺ and S^?, colored key lights which signalled whether the trial would end with response-independent grain reinforcement or nonreinforcement. S⁺ and S^? were produced on a VI schedule which began operating at the onset of the trial. In the main experimental condition, only a response preceded by at least 6 sec of nonresponding could produce S^? on nonreinforced trials; any response which satisfied the VI requirement produced S⁺ on reinforced trials. This procedure allowed the birds to produce S⁺ on reinforced trials with or without producing S^? on nonreinforced trials. The subjects learned to produce fewer S^?s over sessions, indicating that S^? had a punishing effect on observing. The results were taken as evidence for the conditioned reinforcement hypothesis of observing and against the uncertainty reduction hypothesis.     

The sensory basis of avoidance responding in the rat : Relative dominance of auditory or visual warning signals and safety signals

Three experiments determined the relative degree of stimulus control exerted by the elements of a compound auditory-visual stimulus when this stimulus was presented in various temporal relationships to a barpress avoidance response. When the compound discriminative stimulus for barpress avoidance responding consisted of onset of white noise and onset of either light or darkness, the white noise always exerted dominant control. When the compound discriminative stimulus consisted of offset of white noise and onset of light, neither element controlled avoidance responding. On the other hand, when a barpress avoidance response produced a compound feedback stimulus consisting of onset of white noise and onset of either light or darkness, the visual element always exerted dominant control. When the compound feedback stimulus consisted of offset of white noise and onset of light, both elements exerted stimulus control.     

Observation and discrimination learning in the rat: Effects of stimulus substitution

Effects of prior observation of modeling performances upon learning simultaneous visual discriminations were studied in nine groups of rats. Stimulus patterns which had been positive (“Cued”) or negative (“Uncued”) for the model animal and novel stimuli were presented. Observers learned faster if discriminations required approach to, rather than avoidance of, the previously positive stimulus. Approach to the negative stimulus was acquired more rapidly only if the second stimulus was novel. Approaches to a substituted new stimulus combined with either of the previously viewed stimulus patterns required nearly twice the training needed for a similar response attachment when both stimuli were novel. Attentional changes appear to underlie the stimulus control exerted over the observer rat in instrumental learning situations.     

Generality of persistence: The role of stimulus and response factors in persistence to punishment

Previous research has shown that intermittent punishment of a response increases its persistence to continuous punishment and that intermittent punishment training in one situation produces persistence to continuous punishment in other situations. Experiment 1 showed that as long as the instrumental response and punishing stimulus were held constant from intermittent to continuous punishment marked differences between these situations had no decremental effect on persistence. Experiment 2 showed that intermittent punishment training of one response resulted in substantial persistence to continuous punishment of a different and apparently incompatible response and that such response change had no more than a marginal effect on persistence. The results were seen as requiring some revision to the traditional conditioning-model interpretation of persistence to punishment.     

Constraints on Pavlovian conditioning of the pigeon: Relative conditioned reinforcing effects of red-light and tone CSs paired with food

Recent Pavlovian conditioning experiments presented all possible CS-US combinations of red-light and tone CSs and food and shock USs to separate groups of pigeons. Pigeons receiving shock USs demonstrated conditioned head raising followed by prancing to both CSs, but CRs were acquired more rapidly to tone than to red light. Although pigeons receiving food USs rapidly acquired a conditioned response of pecking to the red-light CS, there was no evidence of conditioned responding in groups receiving tone-food pairings. This outcome left open the possibility that Pavlovian pairings of tone and food may have resulted in association formation that was not revealed in performance. The present series of experiments attempted to reveal that association, using an indirect method of assessment, conditioned reinforcement. Experiment 1 demonstrated that both red light and tone paired with food became positive conditioned reinforcers, suggesting that an association between tone and food was formed in the same number of Pavlovian conditioning trials that previously failed to yield any direct evidence of conditioning. Experiment 2, which presented fewer conditioning trials, revealed that the tone-food association was formed less rapidly than the red light-food association. Experiment 3 demonstrated that the observed outcomes were not attributable to unconditioned, rather than conditioned, reinforcing effects of the Css.     

Patterning of infant vocal behavior

Three-month-old infants received two consecutive 5-minute periods of adult social stimulation. In both periods the adult talked, smiled, and touched the infant and in a natural manner tried to elicit vocalizations from the infant. In the first period the adult became unresponsive for 5 sec contingent upon each infant vocalization (time-out, negative reinforcement). In the second period the infant received the same number of time-out periods at the same intervals but independently of vocal responding (yoked, noncontingent control). Negative reinforcement did not suppress infant vocal rate, but the contingent withdrawal of social stimulation did cause the infant to pause more frequently between vocal responses. These pauses generally occurred immediately after the contingently, as compared with the noncontingently, delivered time-out period. The infant appears to recognize the difference between contingent and noncontingent stimulation and pauses after the occurrence of the former. Adult social reinforcement changes the pattern and not the rate of infant vocal responding.     

Visual discrimination learning with a 1-min delay of reward

Eight rats were successfully trained in a black-white discrimination with a 1-min delay of reward. The procedure was unusual in that the rat spent the delay outside the apparatus in its home cage. Immediately after the rat responded, whether correctly or incorrectly, it was removed from the choice compartment and placed in its home cage. When the delay ended, it was returned to the startbox. If the preceding response had been correct, the rat received a reward of sugar water; otherwise, it was allowed to make another choice response. Mediation by external cues was excluded because there was no difference in the way the rats were treated after a correct or an incorrect response until the delay interval ended. Mediation by proprioceptive stimuli was excluded because position was an irrelevant cue.     

Stimulus generalization of auto-shaped key-pecking following interdimensional and extradimensional training

In three experiments, groups of pigeons were tested for wavelength generalization of auto-shaped key-pecking following different types of training. In Experiment I, one group received auto-shape trials with a 555-nm CS. Another group received auto-shape trials with a 555-nm CS and a white CS. A third group received auto-shape trials with a 555-nm CS and a white CS, except the white CS was nonreinforced. The third group yielded the sharpest gradient, whereas the second group yielded the flattest gradient. In Experiment II, one group received auto-shape trials with a 555-nm CS. A second group received auto-shape trials with a 555-nm CS and a compound CS consisting of a vertical white line on a 555-nm background. A third group received auto-shape trials with a 555-nm CS and a compound CS, except that the compound was nonreinforced. The third group yielded the sharpest wavelength gradient, whereas the second group yielded the flattest. In Experiment III, exposure differences to 555 nm in Experiment II resulting from differential speeds of auto-shape acquisition were controlled by the use of an ITI manipulation. Amount of exposure to 555 nm was shown not to be responsible for the results of Experiment II.     

Blocking and unblocking of conditioned analgesia

Two experiments with rat subjects assessed the blocking phenomenon using inhibition of responding to painful thermal stimulation as an index of conditioned analgesia established through conditioned stimulus (CS)-shock pairings. In Experiment 1, a group of rats receiving the standard blocking procedure ($\text{A+}\text{AB+}$) showed shorter response latencies during a hot plate test of pain sensitivity in the presence of the added CS than groups of rats receiving various blocking control procedures. Experiment 2 replicated the blocking outcome of Experiment 1 and also demonstrated that the addition of a second shock unconditioned stimulus (US) during the compound conditioning phase attenuated the blocking effect; i.e., unblocking was observed. However, the deletion of a second shock US during compound conditioning in a group that had received two shocks on each trial in the first phase of the experiment failed to result in unblocking. These data extend the associative account of conditioned analgesia to situations involving stimulus selection and the implications for the analysis of aversive learning are discussed.     

Verbal reports of stimulus effects on learning: Introspection revisited

The accuracy of subjects' verbal reports on the respective causal roles of relevant and irrelevant stimulus factors on learning was investigated. In two experiments, university undergraduates learned strings of letters that were either grammatically structured or unstructured (a causal variable) and either color coded or black (a salient but irrelevant variable). Results indicated that subjects reported more causal impact of color than structure on the learnability of lists, despite the fact that the latter variable and not color had an actual effect on learning. It was proposed that verbal reports of stimulus effects on one's own behavior can be regarded as a task in estimates of covariation rather than direct retrieval of memory traces.     

Conditioned-aversive aspects of electric shock

Two experiments were reported in which it was observed that a weak shock became more aversive as a result of appropriate pairing of that stimulus with a stronger shock. The enhanced aversiveness of the weak shock was reflected in Experiment 1 by an apparent increase in the reinforcement provided by response-contingent termination of that shock. In Experiment 2, the weak shock was observed to be more suppressive of a consummatory-response baseline following appropriate pairings of the weak and strong shocks. The results of these studies were discussed in terms of their implications for certain aversive-conditioning situations in which shocks may serve, in part, as conditioned stimuli.     

Establishing discriminative stimulus control within generalized oddity performance,without reinforcement

In two oddity learning studies with children, subjects were reinforced for oddity (or nonoddity) responding on line-tilt or dot numerosity problems. Interposed form and color problems were not reinforced. No instructions to make oddity choices were given. In Experiment I it was found that reinforcement for oddity or nonoddity responding on tilt and numerosity problems produced the corresponding tendency toward oddity or nonoddity performance on these problems and also on the nonreinforced form and color problems. These results show a generalized oddity phenomenon similar to generalized imitation. In Experiment II a third type of nonreinforced problem was presented in this same format: compound stimuli permitting either a color or a form solution. It was found that immediate prior training with nonreinforced form problems, interpolated among the reinforced tilt and numerosity problems, led to form-oddity choices in the compound problems. Similarily, color pretraining produced color-oddity choices. These results show that selective discriminative stimulus control can be obtained in oddity learning, without reinforcement for choices on either of the two dimensions involved.     

Pigeons' performance under differential reinforcement of low rate schedules depends upon the operant

Pigeons were reinforced with grain for pecking a key or depressing a foot treadle according to differential reinforcement of low rate (DRL) schedules. Birds which depressed a treadle performed efficiently on DRL schedules as high as DRL 35-sec; while birds reinforced for keypecking showed low efficiency under DRL 14-sec. While treadle pressing and keypecking differ along a number of dimensions (including force requirement of the operant and differences in temporal distributions of responses), the present results are consistent with an interpretation based on differences in the degree to which these two responses are elicited by periodic presentations of food.     

Distinguishing between social reinforcement and social elicitation

The theoretical, procedural, analytic, and interpretive components of Poulson's (1983, Journal of Experimental Child Psychology, 36, 471–489) study were considered in an effort to clarify the distinction between social reinforcement and social elicitation. Contrary to Poulson's contention, DRO was not, and cannot by definition be, a control for reinforcement. More importantly, the speciestypical, social nature of the infant probably reflects the collaborative influence of elicitation and reinforcement. By carefully unravelling these two interacting processes, future conditioning studies might specially enhance our knowledge of early social development.