Punishment of an extinguishing shock-avoidance response by time-out from positive reinforcement

Two experiments were conducted to determine the effects of punishment by time-out from positive reinforcement on the extinction of discriminated shock-avoidance responding. Subjects were trained initially to bar press for food on an intermittent schedule of reinforcement and, concurrently, to avoid shock at the onset of a warning signal. Experiment I compared avoidance extinction performance under no punishment and when avoidance responding resulted in a 30-sec TO from reinforced appetitive responding. In Exp II, the contingent use of TO punishment was compared with its random, or noncontingent use. The results of both experiments showed that in the absence of punishment, avoidance extinction was characterized by short latencies and nearly 100% avoidance responding. Avoidance responding in extinction was little affected by noncontingent TO punishment. When TO was made contingent upon avoidance responding, however, avoidance latencies immediately increased and the frequency of avoidance responses subsequently decreased to zero.     

ASSESSING THE ROLE OF EFFORT REDUCTION IN THE REINFORCING EFFICACY OF TIMEOUT FROM AVOIDANCE

Rats responded on concurrent schedules of shock‐postponement or deletion (avoidance) and timeout from avoidance. In Experiment 1, 3 rats' responses on one lever postponed shocks for 20 s and responses on a second lever produced a 1‐min timeout according to a variable‐interval 45‐s schedule. Across conditions, a warning signal (white noise) was presented 19.5 s, 16 s, 12 s, 8 s, or 4 s before an impending shock. Raising the duration of the warning signal increased both avoidance and timeout response rates. Timeout responding, although positively correlated with avoidance responding, was not correlated with the prevailing shock rate. In Experiment 2, 3 rats' responses on one lever deleted scheduled shocks according to a variable‐cycle 30‐s schedule and responses on a second lever produced a 2‐min timeout as described above. After this baseline condition, the avoidance lever was removed and noncontingent shocks were delivered at intervals yoked to the receipt of shocks in the baseline sessions. Timeout responding decreased when the avoidance lever was removed, even though the shock‐frequency reduction afforded by the timeout remained constant. These results suggest that a key factor in the reinforcing efficacy of timeout is suspension of the requirement to work to avoid shock, rather than the reduction in shock frequency associated with timeout.     

Signaled Delay of Reinforcement: Effects of Postconditioning Manipulation of Context Associative Strength on Instrumental Performance

Two experiments examined the influence of postconditioning treatments of contextual cues on instrumental responding acquired with a signaled delay of reinforcement schedule. In Experiment 1, mere exposure to the conditioning context after instrumental training resulted in an attenuated response rate during an extinction test. In the second experiment, responding was decreased by exposure to the contextual cues or sessions in which signaled noncontingent reinforcements occurred. The greatest response decrement, however, occurred following unsignaled noncontingent food presentations. The results are discussed with respect to the different roles of contextual cues on operant responding.     

The effects of presession exposure to attention on the results of assessments of attention as a reinforcer

The effects of presession exposure to attention on responding during subsequent assessments of attention as a reinforcer were evaluated across three behavioral assessments. In Experiment 1, a contingent attention assessment condition was preceded by either a noncontingent attention condition (free play) or a contingent escape condition. In Experiment 2, a diverted attention with extinction condition was preceded by either an alone or a free-play condition. In Experiment 3, a two-choice preference assessment was preceded by either 10 min of free play or 10 min of playing alone. In each experiment, the participant responded differentially within the test condition according to the presence or absence of dense schedules of attention immediately prior to that condition. The results of this study show that events occurring immediately prior to an assessment condition can influence behavior within the assessment.     

PROTECTIVE EQUIPMENT AS TREATMENT FOR STEREOTYPIC HAND MOUTHING: SENSORY EXTINCTION OR PUNISHMENT EFFECTS?

We examined the effects of noncontingent and contingent protective equipment as treatment for self-injurious hand mouthing exhibited by 2 individuals with profound mental retardation. Results of a functional analysis assessment revealed that neither subject's self-injury was maintained by social reinforcement: One subject's self-injury was cyclical in nature; the other's occurred during all assessment conditions but most frequently when left alone. In the noncontingent-equipment condition, oven mitts were placed on the individual's hands at the beginning of a session and remained on throughout. In the contingent-equipment condition, the mitts were briefly placed on the individual's hands following occurrences of hand mouthing. For 1 subject, noncontingent mitts produced a large decrease in the rate of hand mouthing and contingent mitts produced similar results following a return to baseline. Hand mouthing was also reduced in the 2nd subject, but this individual was exposed only to the contingent-equipment condition (i.e., there was no prior history with the noncontingent-equipment condition). These results suggest either a punishment or a time-out interpretation rather than an extinction interpretation to account for the behavior-reducing effects of contingent protective equipment on self-injury.     

STIMULUS EFFECTS ON LOCAL PREFERENCE: STIMULUS—RESPONSE CONTINGENCIES,STIMULUS—FOOD PAIRING,AND STIMULUS—FOOD CORRELATION

Four pigeons were trained in a procedure in which concurrent‐schedule food ratios changed unpredictably across seven unsignaled components after 10 food deliveries. Additional green‐key stimulus presentations also occurred on the two alternatives, sometimes in the same ratio as the component food ratio, and sometimes in the inverse ratio. In eight experimental conditions, we varied the contingencies surrounding these additional stimuli: In two conditions, stimulus onset and offset were noncontingent; in another two, stimulus onset was noncontingent, and offset was response contingent. In four conditions, both stimulus onset and offset were contingent, and in two of these conditions the stimulus was simultaneously paired with food delivery. Sensitivity to component food ratios was significantly higher when stimulus onset was response contingent compared to when it was noncontingent. Choice changes following food delivery were similar in all eight conditions. Choice changes following stimuli were smaller than those following food, and directionally were completely determined by the food‐ratio:stimulus‐ratio correlation, not by the stimulus contingency nor by whether the stimulus was paired with food or not. These results support the idea that conditional reinforcers may best be viewed as signals for next‐food location rather than as stimuli that have acquired hedonic value, at least when the signals are differential with respect to future conditions.     

The effects of token procedures on a teacher's social contacts with her students

The effects of a token system on a teacher's rate of social contacts with her students were investigated in a public school kindergarten. A group of six children were observed daily during a 20-min handwriting lesson. The children were divided into two groups (A and B) of three children each. Five conditions were imposed sequentially: (1) baseline without tokens, (2) contingent tokens for Group A, noncontingent tokens for Group B, (3) contingent tokens for Group B, noncontingent tokens for Group A, (4) reinstatement of condition 2, and (5) contingent tokens for both groups. It was consistently observed that the teacher's rate of social contact was higher with the children receiving the contingent tokens than with those who received noncontingent tokens.     

Lever attacking and pressing as a function of conditioning and extinguishing a lever-press avoidance response in rats

Six experimental rats were conditioned to press one of two available levers to avoid shock. The levers registered bites as well as presses. For four of these rats, shock was contingent on lever bites when a specified time period had elapsed after the previous shock. An extinction period, in which only periodic noncontingent shocks were presented, followed avoidance training. Six yoked-control rats received the same sequence of shocks as did the corresponding experimental rats in both the conditioning and extinction phases. All six experimental rats repeatedly bit the avoidance lever. Four bit it more than the nonavoidance lever during conditioning, and five bit it more during extinction. Five of the six experimental rats consistently bit the levers many more times during each session than did their respective control rats, suggesting that avoidance conditioning facilitated lever biting. Rates of lever biting and pressing by all of the experimental rats and by some of the control rats were highest immediately following shock throughout both phases. During later portions of the intervals following shock, characteristic effects of conditioning and extinction were observed. This finding suggests that extinction of avoidance behavior by unavoidable shock presentations can be demonstrated more readily when shock-elicited responding is extricated from the data.     

The influence of response-effect compatibility in a serial reaction time task

Participants performed a serial reaction time task, responding to either asterisks presented at varying screen locations or centrally presented letters. Stimulus presentation followed a fixed second-order conditional sequence. Each keypress in the experimental groups produced a contingent, key-specific tone effect. The critical variation concerned the mapping of tones to keys. In Experiment 1, keypresses in one control condition produced noncontingent tone effects, while in another control condition there were no tone effects. In Experiment 2, three different key-tone mappings were compared to a control condition without tone effects. The results show that tone effects improve serial learning when they are mapped to the response keys contingently and in a highly compatible manner. The results are discussed with reference to an ideomotor mechanism of motor sequence acquisition.     

DOES CONTINGENT REINFORCEMENT STRENGTHEN OPERANT BEHAVIOR?

In Experiment 1, pigeons were trained to peck keys with equal food-reinforcement schedules in components that ended with either noncontingent or contingent transitions to a third component with a five-fold richer schedule. Response rates were higher in the initial component with contingent transitions, but resistance to prefeeding or extinction was not consistently greater. Experiment 2 also included noncontingent or contingent transitions to a signaled period of nonreinforcement. There was no effect of the contingency on transitions to nonreinforcement, but the difference in response rates maintained by contingent versus noncontingent transitions to the richer schedule was replicated. In addition, response rates were higher in components that preceded nonreinforcement than in components that preceded the richer schedule. However, resistance to extinction was greater for noncontingent transitions to the richer schedule than to nonreinforcement, implicating stimulus–reinforcer relations in the determination of resistance to change. Resistance to change was also somewhat greater for noncontingent than for contingent transitions to the richer schedule. The latter result, together with the results of Experiment 1 and related research, suggests that response-contingent reinforcement does not increase resistance to change.     

Continued Longitudinal Rorschach Study of a Child for Years Three to Five

The present study was designed to assess whether induced behavioral similarity is reinforcing and, if so, whether it leads to increased subsequent imitation, or whether the increased imitation is a function of the predictability of the observer's responses. Sixty Dutch school age boys and girls participated. The experiment consisted of a modeling-only condition and three (i.e., contingent, noncontingent, and consistent) imitation conditions. All conditions consisted of 15 or less induction trials and 18 modeling trials. Except for the consistent imitation condition, none of the conditions allowed perfect predictability of the observer's responses during induction trials. The results revealed that the contingent imitation of the children's target response did not cause them to demonstrate that response more often and that it did not lead to increased imitations on subsequent modeling trials. By contrast, increased imitation was observed for the one condition suggesting perfect predictability of the observer's imitations.     

Comparison of contingent and noncontingent access to therapy dogs during academic tasks in children with autism spectrum disorder

This study compared contingent and noncontingent access to therapy dogs during educational tasks for children with autism spectrum disorder using a multielement design. The experimenters assessed whether initial preference for the dog predicted reinforcer efficacy and how preference changed across time. A higher response rate during contingent dog sessions than baseline sessions occurred for 4 out of 5 participants, suggesting that the dog functioned as a reinforcer. One participant engaged in a high rate of responding in both contingent and noncontingent dog conditions. Preference assessments revealed idiosyncrasies, suggesting that further research is needed into the predictive nature of initial preference assessments with animals as part of the stimulus array. The experimenters also analyzed salivary cortisol before and after sessions to determine if learning about the upcoming interaction with a dog reduced salivary cortisol in children. Cortisol was variable across participants, with only some deriving a potential physiological benefit from expecting to interact with the dog.     

THE ROLE OF FEEDBACK IN VOLUNTARY CONTROL OF BLOOD PRESSURE IN INSTRUCTED SUBJECTS1

Forty normal male volunteers were randomly assigned to one of four experimental conditions and instructed to raise and lower their systolic blood pressure. Subjects received either beat-to-beat feedback contingent on pressure changes, noncontingent beat-to-beat feedback, noncontingent feedback presented randomly with respect to the occurrence of each heart beat, or instructions alone. The order of increase and decrease trial blocks was counterbalanced across groups. Subjects receiving contingent feedback were monetarily rewarded for appropriate pressure changes. Subjects receiving noncontingent feedback received rewards and feedback equal to the mean received by the contingent group. Subjects in the instructions-only condition were also paid this bonus but were informed of their earnings only at the conclusion of the experiment. Results indicated that in the presence of instructions, feedback, whether contingent or noncontingent, added little to subjects' ability to control pressure during a single session. Theoretical and clinical implications are discussed.     

Effects of imposed postfeedback delays in programmed instruction

Imposed postfeedback delays promote discrimination training; the present experiments determined whether they also improve performance in programmed instruction. In two experiments, college students completed 45 sets of Holland and Skinner's (1961) programmed text on behavior analysis in a computerized format in a three-component multiple schedule. In Experiment 1, the conditions were (a) no delay between questions, (b) a 10-s delay after each question (noncontingent delay), and (c) a 10-s delay after each question answered incorrectly (contingent delay). Noncontingent delay produced better performance than no delay and contingent delay. To determine whether performance increased in the noncontingent delay condition because subjects studied the material during delay periods, Experiment 2 tested three conditions: (a) no delay between questions, (b) a 10-s delay after each question (noncontingent delay), and (c) a 10-s delay after each question with the screen blank during the delay period. Noncontingent delay produced better performance than no delay, but there was no difference in performance between no delay and noncontingent delay with blank screen. Hence, noncontingent delay improved performance because students used delay periods to study. Furthermore, subjects preferred noncontingent delay to the other conditions, and session time increased only slightly.     

The effect of deprivation level during noncontingent pairings and instrumental learning on subsequent instrumental performance

In Experiment 1, rats received either response-noncontingent pairings of a tone stimulus with food or response-contingent instrumental training during which only responses in the presence of the tone were reinforced. During this training rats were maintained at either 70 or 90% of their growth-adjusted predeprivation body weights. In a subsequent test phase, one-half of the subjects in each training condition were tested under either 70 or 90% body weight. Subjects which had received response-contingent instrumental training under 70% body weight responded significantly faster to presentations of the tone than did 90% body weight-trained subjects, regardless of test deprivation condition. There was no effect of the deprivation level in effect during response-noncontingent pairings. In Experiment 2, rats received noncontingent tone-reward pairings or nonpairings under either 70 or 90% body weight. In a later test phase under 90% body weight, instrumental responding to the tone was significantly faster for subjects which had received the tone-reward pairings. Deprivation level during the pairings again produced no effect. These results support two conclusions. First, the expectancy learning process appears to be relatively independent of deprivation conditions in effect when such learning takes place; and secondly, deprivation conditions in effect during instrumental learning affect the strength of S-R associative bonds formed.     

Suppressive and enhancing effects of footshock on food-reinforced operant responding following septal lesions in rats.

Effect of septal lesions on suppression of an intermittently food-reinforced lever press by contingent and noncontingent footshock was measured. Rats with septal damage maintained higher response rates than did intact animals under both contingent and noncontingent shock. Furthermore, the difference in suppression produced by the contingent and noncontingent conditions was approximately the same for the experimental and control groups. In a second experiment, performance was measured during counter-conditioning in which the correlation between contingent shock and positive reinforcement was varied. Rats with septal lesions responded at higher rates than did controls. When only reinforced responses were punished, this lesion-induced elevation represented an increase above baseline performance without punishment. This finding suggests that the effect of septal damage on appetitive instrumental performance cannot be due solely to a deficit in response inhibition.     

Temporal distributions of responding during discrete-trial omission training in rats

Within-session temporal distributions of responding were investigated in three experiments using rats pressing a lever in a discrete-trial omission procedure. This schedule entailed 60, one-minute trials, and a sucrose solution was made available at the end of each trial in which no lever press occurred. In Experiment I, nonnaive rats acquired and maintained responding during this training. Moreover, the probability of a response during any session showed a strong and reliable tendency to increase from the beginning to the end of the session. These results were replicated in Experiment II, using naive animals. In Experiment III, alterations were made in the training procedure, including elimination of response-contingent and noncontingent stimulus changes. Results indicate that stimulus change may be sufficient to maintain low levels of responding whether or not this change is contingent on responding.     

Interoceptive fear conditioning as a learning model of panic disorder: an experimental evaluation using 20% CO(2)-enriched air in a non-clinical sample

Despite the role afforded interoceptive fear conditioning in etiologic accounts of panic disorder, there are no good experimental demonstrations of such learning in humans. The aim of the present study was to evaluate the interoceptive conditioning account using 20% carbon dioxide (CO(2))-enriched air as an interoceptive conditioned stimulus (CS) (i.e., physiologically inert 5-s exposures) and unconditioned stimulus (US) (i.e., physiologically prepotent 15-s exposures). Healthy participants (N=42) were randomly assigned to one of three conditions: a CS-only, contingent CS-US pairings, or unpaired/non-contingent CS and US presentations. Electrodermal and self-report (e.g., distress, fear) served as indices of conditioned emotional responding. Results showed greater magnitude electrodermal and evaluative fear conditioning in the paired relative to the CS-only condition. The explicitly unpaired condition showed even greater electrodermal and evaluative responding during acquisition, and marked resistance to extinction. The latter results are consistent with the possibility that the unpaired procedure constituted a partial reinforcement procedure in which CO(2) onset was paired with more extended CO(2) exposure on 50% of the trials. Overall, the findings are consistent with contemporary learning theory accounts of panic.     

Response deprivation and reinforcement in applied settings: A preliminary analysis

First-grade children engaged in seatwork behaviors under reinforcement schedules established according to the Premack Principle and the Response Deprivation Hypothesis. Across two experiments, schedules were presented to the children in a counter-balanced fashion which fulfilled the conditions of one, both, or neither of the hypotheses. Duration of on-task math and coloring in Experiment 1 and on-task math and reading in Experiment 2 were the dependent variables. A modified ABA-type withdrawal design, including a condition to control for the noncontingent effects of a schedule, indicated an increase of on-task instrumental responding only in those schedules where the condition of response deprivation was present but not where it was absent, regardless of the probability differential between the instrumental and contingent responses. These results were consistent with laboratory findings supporting the necessity of response deprivation for producing the reinforcement effect in single response, instrumental schedules. However, the results of the control procedure were equivocal so the contribution of the contingent relationship between the responses to the increases in instrumental behavior could not be determined. Nevertheless, these results provided tentative support for the Response Deprivation Hypothesis as a new approach to establishing reinforcement schedules while indicating the need for further research in this area. The possible advantages of this technique for applied use were identified and discussed.     

Combining stimuli signalling response-dependent food and shock

Three rats were exposed to a multiple schedule in which separate presentations of light and tone alternated with periods during which light and tone were absent. In Phase 1, light and tone each signalled identical variable-interval schedules of food delivery. In Phase 2, light and tone signalled separate but concurrent variable-interval schedules of food and shock delivery. In both phases, the absence of light and tone was associated with the differential reinforcement of other behavior. Test presentations of light, tone, and a light-plus-tone combination indicated that in both phases, light-plus-tone controlled higher response rates than either light or tone alone. The combination continued to control enhanced responding even when the test stimuli signalled variable-interval schedules of food and fixed-ratio schedules of shock. In these latter sessions, enhanced control by the combination increased shock frequency with no corresponding change in food frequency. Apparently, the level of behavior controlled by the absence of two single stimuli may be more important than the consequences of responding in determining the effects of combined-stimulus presentations.