Heart rate reactivity during contingency learning in 5‐ to 10‐month‐old at‐risk and non‐risk babies

The study investigated the dynamic relation between contingency learning and heart rate with risk and non‐risk babies 5‐ to 10‐months‐old. Four groups were compared in a two contingency treatments (contingent, yoked) × two risk status design. Concurrent heart rate was monitored during three phases of a contingency learning task (baseline, contingency/stimulation, extinction) and analysis focused on phase transitions. Non‐risk babies presented with contingent stimulation showed an immediate increase in cardiac rate associated with a subsequent response increase to the contingency. Risk infants presented with contingent stimulation showed delayed cardiac reactivity accompanied by a smaller response increase to the contingency. Yoked controls decreased responding in the contingent period with no significant changes in cardiac reactivity at phase transitions. The findings of the study are discussed in relation to individual differences in physiological regulation and to differential sensitization in a contingency learning task.     

Infant Contingency Learning in Different Cultural Contexts

Three‐month‐old Cameroonian Nso farmer and German middle‐class infants were compared regarding learning and retention in a computerized mobile task. Infants achieving a preset learning criterion during reinforcement were tested for immediate and long‐term retention measured in terms of an increased response rate after reinforcement and after a 24‐h delay compared with baseline. It was hypothesized that infants from both cultural communities would acquire the contingency between own motion and mobile movement, as they similarly experience contingent responses in social interactions. Nso infants were assumed to show a higher learning rate related to their advanced gross motor development, whereas German infants were expected to show a higher baseline because of culture‐typical motor handling promoting a high level of activity (i.e. lying supine). Results showed immediate and long‐term retention in infants from both cultural contexts, as well as a higher baseline for German infants. Although the learning rate was higher for Cameroonian infants, logistic regression revealed that learning was not related to gross motor development but depended on the level of baseline response. Thus, contingency learning was shown in different cultural environments, and the level of baseline activity coined by culture‐specific motor handling turned out to influence learning within the mobile task. Copyright © 2012 John Wiley & Sons, Ltd.     

The response-stimulus contingency and reinforcement learning as a context for considering two non-behavior-analytic views of contingency learning

This paper introduces a special section on the contingency. Bower and Watson were invited to present their views of contingency learning in human infants from outside the context of behavior analysis, and Cigales, Marr, and Lattal and Shahan provided commentaries that point out some of the more interesting and controversial aspects of those views from a behavior-analytic perspective. The debate turns on how to conceptualize the response-stimulus contingency of operant learning. The present paper introduces the contingency concept and contingency detection by subjects, as well as research practices in behavior analysis, in a context in which the dependency between infant responding and the presentation of environmental consequences may be disrupted through procedures in which ordinarily consequent events occur before the response or in its absence. These points can relate to and serve as an introduction to the Bower and Watson papers on infant contingency learning as well as to the three commentaries that follow.     

Effects of response variability on the sensitivity of rule-governed behavior

Two experiments examined the relation between response variability and sensitivity to changes in reinforcement contingencies. In Experiment 1, two groups of college students were provided complete instructions regarding a button-pressing task; the instructions stated “press the button 40 times for each point” (exchangeable for money). Two additional groups received incomplete instructions that omitted the pattern of responding required for reinforcement under the same schedule. Sensitivity was tested in one completely instructed and one incompletely instructed group after responding had met a stability criterion, and for the remaining two groups after a short exposure to the original schedule. The three groups of subjects whose responding was completely instructed or who had met the stability criterion showed little variability at the moment of change in the reinforcement schedule. The responding of these three groups also was insensitive to the contingency change. Incompletely instructed short-exposure responding was more variable at the moment of schedule change and was sensitive to the new contingency in four of six cases. In Experiment 2, completely and incompletely instructed responding first met a stability criterion. This was followed by a test that showed no sensitivity to a contingency change. A strategic instruction was then presented that stated variable responding would work best. Five of 6 subjects showed increased variability after this instruction, and all 6 showed sensitivity to contingency change. The findings are discussed from a selectionist perspective that describes response acquisition as a process of variation, selection, and maintenance. From this perspective, sensitivity to contingency changes is described as a function of variables that produce response variability.     

"Turning back the clock" on serial-stimulus sign tracking.

Two experiments examined the effects of a negative (setback) response contingency on key pecking engendered by a changing light-intensity stimulus clock (ramp stimulus) signaling fixed-time 30-s food deliveries. The response contingency specified that responses would immediately decrease the light-intensity value, and, because food was delivered only after the highest intensity value was presented, would delay food delivery by 1 s for each response. The first experiment examined the acquisition and maintenance of responding for a group trained with the contingency in effect and for a group trained on a response-independent schedule with the ramp stimulus prior to introduction of the contingency. The first group acquired low rates of key pecking, and, after considerable exposure to the contingency, those rates were reduced to low levels. The rates of responding for the second group were reduced very rapidly (within four to five trials) after introduction of the setback contingency. For both groups, rates of responding increased for all but 1 bird when the contingency was removed. A second experiment compared the separate effects of each part of the response contingency. One group was exposed only to the stimulus setback (stimulus only), and a second group was exposed only to the delay of the reinforcer (delay only). The stimulus-only group's rates of responding were immediately reduced to moderate levels, but for most of the birds, these rates recovered quickly when the contingency was removed. The delay-only groups's rates decreased after several trials, to very low levels, and recovery of responding took several sessions once the contingency was removed. The results suggest that (a) sign-tracking behavior elicited by an added clock stimulus may be reduced rapidly and persistently when a setback contingency is imposed, and (b) the success of the contingency is due both to response-dependent stimulus change and response-dependent alterations in the frequency of food delivery. The operation of the contingency is compared with the effects of secondary reinforcement and punishment procedures.     

The effect of CS-US contingency variation on GSR and on subjective CS-US relational awareness

Ninety subjects were tested in a single-cue Pavlovian conditioning paradigm involving three groups which differed with regard to the contingency relationship between CS and US (negative contingency, zero contingency, positive contingency). To examine the relationship between conditioned GSR performance and subject’s cognitive beliefs regarding the CS-US relationship, both GSR and CS-US relational learning were constantly measured on a continuous scale over the entire experimental session. The data suggest the independence of autonomic and cognitive responding in the single-cue Pavlovian paradigm.     

EFFECTS OF SPACED RESPONDING DRL ON THE STEREOTYPED BEHAVIOR OF PROFOUNDLY RETARDED PERSONS

Stereotypic responding and social behaviors of three profoundly retarded children were measured before and during application of a DRL contingency for stereotypic responding. A variant of the standard DRL procedure, spaced responding DRL, was used, in which reinforcement is delivered following a response if that response has been separated from the previous response by at least a fixed minimum time interval. Three children were treated by using a reversal design. Results showed that: (a) during baseline sessions, the children engaged in high rates of stereotypic responding and very low rates of appropriate social behavior; and (b) during DRL sessions, appropriate behavior increased markedly as stereotypic responding was reduced. The data suggest that spaced responding DRL may be effective in increasing appropriate social behavior as well as in reducing stereotypic responding.     

DIFFERENTIALLY REINFORCING LOW RATES OF MISBEHAVIOR WITH NORMAL ELEMENTARY SCHOOL CHILDREN1

Effective nonpunitive procedures for reducing counterproductive classroom behaviors are of potential benefit to both students and teachers. A recent strategy for dealing with this class of problem behaviors involves the reinforcement of acceptably low levels of such behavior. The laboratory version of this procedure, called differential reinforcement of low rates of responding (or DRL), provides for a reinforcer to be delivered contingent upon a response that is separated from the last preceding response by a minimum amount of time. To make this procedure more amenable to classroom use, the present authors have modified it so that a reinforcer is delivered if fewer than a specified number of responses occur within a preset time interval (Deitz and Repp, Journal of Applied Behavior Analysis, 1973, 6 , 457–463). Previous studies using this procedure have found it effective in reducing and maintaining low rates of targeted behaviors. However, these effects have been demonstrated with groups of subjects and/or individuals from dependent populations. The present study investigated use of this modified DRL procedure with individual students in normal elementary classrooms. In the first of three studies, “talk-outs” of an 11-yr-old fifth-grade male were reduced when nonexchangeable gold stars were made contingent on two or fewer responses per session. During baseline sessions, an average of 4.45 talkouts were observed per 45-min session. Average responding subsequently fell to 1.83 when the modified DRL contingency was applied, increased to 7.60 during a reversal phase, and dropped again to an average of 1.20 when the contingency was reapplied. In the second study, out-of-seat behavior of a 12-yr-old sixth-grade female was reduced when gold stars were made contingent on two or fewer responses per 45-min class period. Baseline responding averaged 6.10 responses per session. When the contingency was applied, average responding fell to 0.16. During the reversal period, responding increased to an average of 6.00 and fell again, after the contingency was re-introduced to an average of 0.40. In the third study, a reduction in both talking-out and out-of-seat behaviors of another 11-yr-old fifth-grade male was demonstrated with a multiple-baseline design. Using different lengths of baselines, gold stars were made contingent first on a low rate of out-of-seat behavior, and then on a low rate of talk-outs. Out-of-seat responding fell from a baseline average of 7.50 to a treatment average of 1.14. Talk-outs went from a baseline average of 4.66 to a treatment average of 1.14. In all three studies, the modified DRL procedure proved effective with the children and was manageable by the classroom teacher. For the students, nonexchangeable conditioned reinforcers (stars) were sufficient to maintain lowered rates of inappropriate behavior with the modified DRL schedule; there was no need for an elaborate token economy, a process that in many cases may be only a form of behavioral “overkill”. As in other studies investigating DRL schedules, students were not informed of their accumulation of responses; the differential effects of providing or withholding this feedback need to be investigated. Overall, these studies add single-subject replication with normal children to the literature on modified DRL procedures.     

Precurrent contingencies: Behavior reinforced by altering reinforcement probability for other behavior

The present study explored the effects of a precurrent contingency in which one (precurrent) activity increased the reinforcement probability for another (current) activity. Four human subjects responded on a two-key computer mouse. Each right-key press was reinforced (points exchangeable for money) with .02 probability. In one condition (no precurrent contingency), pressing the left key had no scheduled consequence; in another condition (precurrent contingency), pressing the left key increased the reinforcement probability for right-key responding to .08 for 15 s. Initial exposure to the precurrent contingency resulted in acquisition of precurrent left-key responding for 3 subjects, but for the 4th subject a special contingency was required. Right-key responding occurred at a high stable rate across the conditions. Changeovers to left-key responding dropped to near zero when the precurrent contingency was absent and were maintained at enhanced levels when the precurrent contingency was present. Contacts with the left key consisted of short response runs. Right-key responses were more frequently emitted within 15 s of a left-key response when the precurrent contingency was present, an efficient adaptation to the contingency. Continued research on precurrent behavior may produce insights into complex phenomena such as autoclitics and self-control.     

Responding under positive and negative response contingencies in pigeons and crows

Four crows were trained to key peck for food. Then, they were exposed to a positive response contingency that required them to peck the key when it was illuminated briefly (the trial) in order to receive food. This procedure resulted in consistent within-trial pecking. When the contingency changed so that food was presented at the end of a trial when no response occurred, but the trial terminated immediately and food was omitted when a response occurred (negative response contingency), responding decreased markedly. Eight pigeons were studied under the same change in contingencies. These birds varied in their response histories from naive to having several years' experience. The previously naive pigeons also showed rapid declines in responding under the negative contingency; the responding of the birds with extended training histories declined much more slowly. Eventually, however, six of the eight pigeons showed little or no responding under the negative contingency, while they responded consistently when re-exposed to the positive contingency. These findings question the power and the generality of the negative automaintenance phenomenon.     

The Rapid Establishment of Low-Rate Fixed Interval Responding by Humans in a Single Experimental Session

Subjects responding to receive monetary reinforcement on a fixed interval schedule were read instructions containing varying amounts of information regarding the schedule contingencies prior to their participation in the experiment. In addition, some subjects were exposed to an additional response cost contingency for early responding. The results indicate that reliable low-rate fixed interval responding can be rapidly generated in a single 45-minute experimental session when subjects are provided with explicit instructions together with the response cost contingency.

     

Lick-shock contingencies in the rat

Hungry rats were allowed to lick an 8% sucrose solution and then one of four lick-shock contingency conditions was superimposed on the licking baseline. These conditions were: free-operant avoidance, free shock, punishment, and no shock. From highest to lowest response rates, the groups fell in the order-avoidance, no shock, free shock, and punishment. Lick rates adjusted rapidly to introduction and removal of the contingencies. Post-shock responding was lowest in the punishment condition and highest in the free shock condition. No method was found simultaneously to equate shock frequency and separate response rates for the three shock contingency conditions. Only small, or no, reductions in shock rate occurred over sessions under the free-operant avoidance schedule when the shock-shock interval was 10 sec but large reductions occurred when the shock-shock interval was reduced to either 1 or 2 sec.     

Social conditioning and its proper control procedures.

In Expt I, eight infants received response-contingent social stimulation, while another eight infants received response-independent social stimulation. Both groups' vocalization rates similarly increased from baseline to stimulation periods and decreased from stimulation to extinction periods. In Expt II, 12 infants were given continuous social stimulation (elicitation treatment) for one period, and, in a second period, stimulation was withheld for 5 sec contingent upon each vocalization (omission treatment). Response rates were similar for both periods, and rates decreased when social stimulation was removed (mobile treatment). In both studies social stimulation increased vocalization rates and rate of responding was insensitive to the programmed contingency. There were, however, fewer “bursts” of responses with the negative and positive contingencies as compared with response-independent stimulation.     

Best not to bet on the horserace: A comment on Forrin and MacLeod (2017) and a relevant stimulus-response compatibility view of colour-word contingency learning asymmetries

One powerfully robust method for the study of human contingency learning is the colour-word contingency learning paradigm. In this task, participants respond to the print colour of neutral words, each of which is presented most often in one colour. The contingencies between words and colours are learned, as indicated by faster and more accurate responses when words are presented in their expected colour relative to an unexpected colour. In a recent report, Forrin and MacLeod (2017b, Memory & Cognition) asked to what extent this performance (i.e., response time) measure of learning might depend on the relative speed of processing of the word and the colour. With keypress responses, learning effects were comparable when responding to the word and to the colour (contrary to predictions). However, an asymmetry appeared in a second experiment with vocal responses, with a contingency effect only present for colour identification. In a third experiment, the colour was preexposed, and contingency effects were again roughly symmetrical. In their report, they suggested that a simple speed-of-processing (or “horserace”) model might explain when contingency effects are observed in colour and word identification. In the present report, an alternative view is presented. In particular, it is argued that the results are best explained by appealing to the notion of relevant stimulus–response compatibility, which also resolves discrepancies between horserace model predictions and participant results. The article presents simulations with the Parallel Episodic Processing model to demonstrate this case.     

An experimental investigation of the effect of worry on responses to a discrimination learning task

The current study examined the impact of both the tendency to worry (trait worry) and the process of worry (state worry) on subsequent behavioral responding in a schedule discrimination learning task. High and low trait worriers were randomly assigned to a state worry or relaxation incubation condition and completed a test of executive functioning and a dual contingency learning task that utilized neutral discriminative cues over the course of 2 contingency phases. Although state and trait worry did not impact executive functioning, the state worry condition was associated with diminished sensitivity to learning task contingencies over the course of the first contingency learning trials in comparison to the relaxation condition. This relationship was unique to the state worry condition above and beyond shared variance with subjective anxiety level. Results suggest that state worry may lead to a decrement in selective behavioral responding to neutral discriminative cues in the environment. The findings suggest that the process of worry may lead to less adaptive responding to neutral cues and interfere with adaptive behaviors, which may thereby contribute to and maintain anxiety.     

Maternal responsiveness and search for hidden objects and contingency learning by infants

The relationship between maternal responsiveness and infant cognition was examined during two activities: the search for hidden objects and the learning of a contingency rule. Thirty-four mother–infant dyads were observed in a laboratory setting when the infants were 11 months old. The experimental session included three phases: a search for hidden objects (Piagetian tasks), the learning of a contingency rule on a touch screen, and a mother–infant play session using a standardised toy. The results indicated a link between performances in the search and contingency tasks. Moreover, infants who succeeded in both tasks had mothers who displayed higher responsiveness score. The findings are discussed in terms of the infant's detection of relevant stimulus information. © 1998 John Wiley & Sons, Ltd.     

Effects of adults’ contingent responding on infants’ behavior in ambiguous situations

We examined the effect of adults’ contingency in responding to infants’ behavior in an ambiguous situation in two experiments. In Experiment 1, forty-four 12-month-old infants were exposed to an ambiguous toy. An unfamiliar adult responded either contingently or non-contingently to the infant’s bids and then presented the toy and provided positive information. During toy presentation, infants in the non-contingent condition looked less at the experimenter than infants in the contingent condition. In a concluding free-play situation infants in the non-contingent condition played less and tended to touch the toy less. In Experiment 2 (forty-four 12-month-old infants), the parent either responded promptly or with a delay each time the infant made contact initiatives and then presented an ambiguous toy and delivered the positive information. The infants in the non-contingent condition tended to look less at the parent during toy presentation and also tended to play less with the toy during the concluding free-play situation. The findings show that adults’ contingency in responding influences infants’ behavior in ambiguous situations.     

Some effects of response-correlated increases in reinforcer magnitude on human behavior

After training under short or long fixed-interval schedules, humans responded under a modified fixed-interval schedule in which magnitude of reinforcement (X or 2X) was minimally correlated with response frequency. Response frequencies that equaled or exceeded a minimum response criterion were followed by the larger reinforcer at the end of the interval; otherwise, the smaller reinforcer was delivered. The modified schedule alternated with the baseline schedule across conditions. In a control condition, the reinforcer magnitudes produced by control subjects were yoked to those of experimental subjects. Experimental subjects, but not control subjects, showed increased responding. In addition to the baseline and modified fixed-interval schedules used in Experiment 1, subjects in Experiment 2 also responded under a second modified fixed-interval contingency in which increases in reinforcer magnitude were more highly correlated with response frequency. Experimental subjects, but not control subjects, showed increased responding under both procedures. Direct comparison of these two procedures showed that the high-correlation procedure produced greater increases in responding than did the low-correlation procedure.     

Determinants of Response Recovery in Extinction Following Response Elimination

Elimination of autoshaped responding by random or negatively-contingent response-reductive procedures may leave a previously acquired association intact; however, two previous studies suggest that response elimination by backward conditioning may have more permanent effects. In Experiments 1 and 3, the autoshaped responding of pigeons was eliminated by a backward or negative contingency. Although speed of recovery during a subsequent extinction phase was greater following the backward contingency in Experiment 3, level of recovery did not differ as a function of response elimination procedure in either experiment. A possible basis for the discrepancy between the present and previous findings is the contingency arranged between the conditioned and unconditioned stimuli (CS and US, respectively) during forward conditioning. In Experiments 1 and 2, probability of US presentation following the CS (p(US|CS) = 0.4 or 1.0) was varied within (Experiment 1) or between (Experiment 2) groups of birds. In both cases, level of recovery was higher following training under (p(US|CS) = 0.4). The results are consistent with a memory retrieval theory in which unreinforced trials function as a retrieval cue for not responding.     

Stereopsis with opposite contrast contours

The effects of incidental stimuli, defined as visual stimuli not under verbal control, upon a selection task were observed as a function of feedback contingency. Ss judged letter pairs to be valid or invalid completions of preceding letter parts. During the presentation of the letter parts, the response pair or an alternative pair of letters was intermittently presented at a threshold value individually determined for each S. One group of Ss received a light feedback of performance contingent upon responding to the incidental stimuli; whereas a second group received a random noncontingent feedback. The results indicated: (a) both groups responded to the incidental stimuli; (b) feedback contingency had no effect on frequency of responding to the incidental stimuli; (c) frequency of responding to the incidental stimuli remained constant over 32 trials.