The effects of response cost and response restriction on a multiple-response repertoire with humans

In two experiments a multiple-response repertoire of four free-operant responses was developed with university students as subjects using monetary gain as reinforcement. Following baseline, one of the responses was reduced either by making monetary loss contingent upon it (response cost) or by removing it from the repertoire (response restriction). In Experiment 1 a multielement baseline design was employed in which baseline and restriction or response-cost contingencies alternated semirandomly every 3 minutes. In Experiment 2 a reversal design was employed (i.e., baseline, restriction or response cost, then baseline), and each response required a different amount of effort. Both experiments had the following results: (a) The target response decreased substantially; (b) most nontarget responses increased, and the rest remained near their baseline levels; and (c) no support was found for Dunham's hierarchical, most frequent follower, or greatest temporal similarity rules. For several subjects, the least probable responses during baseline increased most, and the most probable responses increased least. Furthermore, in Experiment 2, responses with the lowest frequency of reinforcement increased most (for all 7 subjects), and those with the greatest frequency of reinforcement increased least (for 5 subjects).     

Analysis of response allocation in individuals with multiple forms of stereotyped behavior

Three experiments were conducted to evaluate response allocation of stereotypy during free-operant and restricted-operant conditions. Five children with autism or related developmental disabilities participated in at least one and up to three of the experiments. In Experiment 1, the stereotypic response that emerged as most probable during a free-operant phase was restricted, and response allocation was again evaluated. The results for 3 participants showed that restricting the high-probability response was correlated with covarying reductions in a nontargeted stereotypy. In Experiment 2, the effect of environmental enrichment on response allocation was evaluated. One participant reallocated behavior to appropriate object manipulation, 1 participant showed no change in behavior, and a 3rd participant reallocated behavior to object manipulation only when the putative stimulus products of the object manipulation matched those of stereotypy. In Experiment 3, additional interventions were implemented to promote response reallocation. Results showed that both response restriction and reinforcement for object manipulation decreased stereotypy and increased object manipulation. Collectively, the results of these experiments point to a need for complex evaluations of interventions for stereotypy.     

The operant conditioning of response variability: Free-operant versus discrete-response procedures

The operant conditioning of response variability under free-operant and discrete-response procedures was investigated. Two pigeons received food only if their pattern of four pecks on two response keys differed from the patterns emitted on the two immediately preceding trials. Under the free-operant procedure, the keys remained illuminated and operative throughout each trial. There was little variability in the response patterns that resulted, and the pigeons received fewer than one third of the available reinforcers. Under the discrete-response procedure, a brief timeout period followed each response. Variability increased under this procedure, and the pigeons obtained three fourths of the available reinforcers. Previous successes and failures to produce response variability may have been due to the use or failure to use, respectively, a discrete-response procedure. Respondent effects inherent in the free-operant procedure may encourage the development of response stereotypy and, in turn, prevent the development of response variability.     

The development of functional response units: the role of demarcating stimuli.

An experiment with rats examined the roles of demarcating stimuli and differential reinforcement probability on the development of functional response units. It examined the development of units in a probabilistic, free-operant situation in which the presence of demarcating stimuli was manipulated. In all conditions, behavior became organized into two-response sequences framed by changes in local reinforcement probability. A tone demarcating the beginning and end of contingent response sequences facilitated the development of functional response units, as in chunking, but the same units developed slowly in the absence of the tone. Complex functional response units developed even though reinforcement contigencies remained constant. These findings demonstrate that models of operant learning must include a mechanism for changing the response unit as a function of reinforcement history. Markov models may seem to be a natural technique for modeling response sequences because of their ability to predict individual responses as a function of reinforcement history; however, no class of Markov chain can incorporate changing response units in their predictions.     

Effects of alternative reinforcement on human behavior: the source does matter

Competing theories regarding the effects of delivering periodic response-independent reinforcement (more accurately, response-independent points exchanged for money) on a baseline rate of behavior were evaluated in human subjects. Contiguity theory holds that these events decrease target responding because incompatible behavior is adventitiously strengthened when the point deliveries follow target behavior closely in time. Matching theory holds that response-independent points, like any other alternative reinforcer, should reduce target responding. On this view, temporal contiguity between target responding and response-independent point delivery is unimportant. In our experiment, four different responses (moving a joystick in four different directions) were reinforced with points exchangeable for money according to four independent variable-interval schedules. Different schedules of point delivery were then superimposed on these baselines. When all superimposed point deliveries occurred immediately after one of the four responses (the target response), time allocated to target responding increased. When the superimposed point deliveries could be delivered at any time, time allocated to target responding declined and other behavior increased. When superimposed points could never immediately follow target responses, time allocated to target responding decreased further and other behavior or pausing predominated. The findings underscore the contribution of temporal contiguity in the effects of response-independent deliveries of food, money, points, etc.     

Discrete and continuous measures of dimensional stimulus control

In two sets of experiments, we examined dimensional stimulus control of pigeons' responses to a visual flicker-rate continuum. In the first experiment, responses to a single key were reinforced periodically during stimuli from one half of the stimulus continuum, and responses during other stimuli were extinguished. In the second experiment, two response keys were simultaneously available, with reinforcement for each response alternative associated with different halves of the stimulus continuum. Conditions of the second experiment involved either free-operant or discrete-trial stimulus presentations. Results from these experiments show that positive dimensional contrast appeared in discrimination tasks with one or two response alternatives, but only with free-operant procedures. In addition, discrimination between stimulus classes established by differential reinforcement was assessed as accurately by continuous rate measures as by discrete response choice in the two-alternative situation. The general implication of these experiments is that response rate measures, when properly applied, may reveal sources of variation within stimulus classes, such as dimensional contrast, that are not evident with discrete measures.     

Extinction of responding maintained by timeout from avoidance

The resistance to extinction of lever pressing maintained by timeout from avoidance was examined. Rats were trained under a concurrent schedule in which responses on one lever postponed shock on a free-operant avoidance (Sidman) schedule (response-shock interval = 30 s) and responses on another lever produced 2 min of signaled timeout from avoidance on a variable-ratio 15 schedule. Following extended training (106 to 363 2-hr sessions), two experiments were conducted. In Experiment 1 two different methods of extinction were compared. In one session, all shocks were omitted, and there was some weakening of avoidance but little change in timeout responding. In another session, responding on the timeout lever was ineffective, and under these conditions timeout responding showed rapid extinction. The within-session patterns produced by extinction manipulations were different than the effects of drugs such as morphine, which also reduces timeout responding. In Experiment 2 shock was omitted for many consecutive sessions. Response rates on the avoidance lever declined relatively rapidly, with noticeable reductions within 5 to 10 sessions. Extinction of the timeout lever response was much slower than extinction of avoidance in all 4 rats, and 2 rats continued responding at baseline levels for more than 20 extinction sessions. These results show that lever pressing maintained by negative reinforcement can be highly resistant to extinction. The persistence of responding on the timeout lever after avoidance extinction is not readily explained by current theories.     

A RESPONSE-RESTRICTION ANALYSIS OF STEREOTYPY IN ADOLESCENTS WITH MENTAL RETARDATION: IMPLICATIONS FOR APPLIED BEHAVIOR ANALYSIS

The behavior of 4 adolescents with severe or profound mental retardation was evaluated in the presence of four sets of materials during periods of unstructured leisure activity. Functional engagement with the materials, stereotypic engagement with the materials, stereotypy without interaction with the materials, and other aberrant behaviors were recorded. Across a series of experimental conditions, the number of sets of materials was reduced from four to one by eliminating the set most frequently manipulated in each preceding condition. In the final condition, four sets of materials were again made available for manipulation. The procedures replicated Green and Striefel's (1988) response-restriction analysis of the activity preferences and play behaviors of children with autism. In general, the results of the present experiment replicate those of Green and Striefel in that reallocation of responding was idiosyncratic and unpredictable as sets of materials were removed. Nevertheless, the results provided insight into how responding might be reallocated if it were restricted through behavioral interventions rather than by restriction of access. Thus, the results are discussed with respect to how response-restriction analyses may be useful in identifying topographies of behavior that could be included in differential reinforcement contingencies that are designed to affect stereotypic behavior and in the selection and arrangement of environmental stimuli to minimize the presence of evokers of stereotypy.     

Lick-shock contingencies in the rat

Hungry rats were allowed to lick an 8% sucrose solution and then one of four lick-shock contingency conditions was superimposed on the licking baseline. These conditions were: free-operant avoidance, free shock, punishment, and no shock. From highest to lowest response rates, the groups fell in the order-avoidance, no shock, free shock, and punishment. Lick rates adjusted rapidly to introduction and removal of the contingencies. Post-shock responding was lowest in the punishment condition and highest in the free shock condition. No method was found simultaneously to equate shock frequency and separate response rates for the three shock contingency conditions. Only small, or no, reductions in shock rate occurred over sessions under the free-operant avoidance schedule when the shock-shock interval was 10 sec but large reductions occurred when the shock-shock interval was reduced to either 1 or 2 sec.     

DO INFANTS SHOW GENERALIZED IMITATION OF GESTURES?

Two experiments were conducted to investigate generalized imitation of manual gestures in 1- to 2-year-old infants. In Experiment 1, 6 infants were first trained four baseline matching relations (e.g., when instructed "Do this", to raise their arms after they saw the experimenter do so). Next, four novel gestures that the infants did not match in probe trials were selected as target behaviors during generalized imitation Test 1; models of these gestures were presented on unreinforced matching trials interspersed with intermittently reinforced baseline matching trials. None of the infants matched the target behaviors. To ensure that these behaviors were in the infants' motor skills repertoires, the infants were next trained to produce them, at least once, under stimulus control that did not include an antecedent model of the target behavior. In repeat generalized imitation trials (Test 2), the infants again failed to match the target behaviors. Five infants (3 from Experiment 1) participated in Experiment 2, which was identical to Experiment 1 except that, following generalized imitation Test 1, the motor-skills training was implemented to a higher criterion (21 responses per target behavior), and in a multiple-baseline, across-target-behaviors procedure. In the final generalized imitation test, 1 infant matched one, and another infant matched two target behaviors; the remaining 17 target behaviors still were not matched. The results did not provide convincing evidence of generalized imitation, even though baseline matching was well maintained and the target behaviors were in the infants' motor skills repertoires, raising the question of what are the conditions that reliably give rise to generalized imitation.     

The four free-operant freedoms

This article reviews early free-operant conditioning laboratory research and applications. The seldom-mentioned four free-operant freedoms are described for the first time in detail. Most current behavior analysts do not realize that the freedom to form responses and the freedom to speed responses were crucial steps in designing free-operant operanda in the 1950s. These four freedoms were known by the laboratory researchers of the 1950s to the point that, along with operanda design, Sidman (1960) did not feel the need to detail them in his classic, Tactics of Scientific Research. The dimensions of freedom in the operant were so well understood and accepted in the 1950s that most thought it redundant to use the term free operant. These issues are reviewed in some detail for younger behavior analysts who did not have the opportunity of learning them firsthand.     

Cognitive Response Repertoires to Child Noncompliance by Mothers of Aggressive Boys

Cognitive response repertoires to videotaped child noncompliance episodes were examined in mothers of aggressive (MAs) and nonaggressive 4–6-year-old boys. Mothers provided open-ended solutions to three subtypes of child noncompliance under conditions of time pressure, or after they waited for 15 s to consider alternatives. Solutions were coded as assistance/facilitation, coercion, deference, or explanation/clarification. Compared with controls, MAs offered fewer explanation/clarification responses, more coercive responses, and fewer unique solutions during pressured responding. Two to 6 weeks later, mothers were videotaped while participating with their sons in a challenging block-building task. Maternal responses to the vignettes predicted conflict escalation during block building, even after rates of concurrent and past child noncompliance were partialled out. Implications for parent-training models are considered.     

The elimination of interfering response patterns in lever-press avoidance situations

Lever holding into shock and short-latency responses to shock onset are two response patterns that interfere with avoidance acquisition in free-operant and discriminated avoidance situations. In an attempt to eliminate these patterns, an additional timer disabled the lever for a period slightly longer than shock duration. A free-operant avoidance schedule with a warning stimulus, but without the additional timer, constituted the control condition. The lever-disabling timer was turned on by different events in two experimental conditions: (a) release of the lever at the onset of shock, (b) shock onset. Interfering responses diminished most rapidly, and efficient avoidance behavior appeared earliest, when the lever-disabling timer was turned on by shock onset.     

Effects of sleep deprivation on free-operant avoidance

Two studies examined effects of sleep deprivation on free-operant avoidance by rats. In Experiment 1, a 5-s shock-shock (SS) interval and 20-s response-shock (RS) interval produced baseline performances, which were reestablished after each experimental manipulation. Once baselines were established, animals were exposed to 24, 48, or 96 hr of sleep deprivation and equivalent periods of home cage and food restriction as a control condition. Compared to baseline, sleep deprivation increased response rates by increasing the proportion of brief interresponse times (IRTs); response rates changed little in the control conditions. Percentage of shocks avoided did not systematically change across conditions. In Experiment 2, the RS interval was manipulated (10, 20, and 40 s), while the SS interval (5 s) and level of sleep deprivation (48 hr) were held constant. Across RS intervals, sleep deprivation increased response rates via a shift toward brief IRTs. In addition, sleep deprivation increased the percentage of shocks avoided as an inverse function of RS intervals.     

Conditioning of two-response patterns of key pecking in pigeons

On discrete trials, two response keys were made available to hungry pigeons and food reinforcement depended on the order in which the required two key pecks occurred. In different phases, only one of the four possible two-peck sequences (left-left, left-right, right-left, and right-right) produced food reinforcement. In each case, the pigeons learned to perform the correct two-peck sequence more often than the incorrect sequences. Furthermore, the course of differentiation mastery indicated that both reinforcement history and response-reinforcer contiguity influenced performance. These results reveal that response patterns comprising two instances of the same response left-left and right-right) or instances of two different responses (left-right and right-left) may function as operants, thereby extending the generality of conditioning principles from discrete responses to structured sequences of behavior. These and other results are discussed in terms of contiguity-based and memory-based models of learning.     

Perception of causal relations in humans: Factors affecting judgments of response-outcome contingencies under free-operant procedures

In three experiments, college studients responded to and rated a range of positive, random, and negative response-outcome contingencies presented in free-operant formats. These experiments sought a paradigm that would yield sensitive and unbiased judgments of response-outcome relations and explored the role of time in the judgment of response-outcome covariation. In Experiment 1, the effects of making continuous and discrete responses on subjects' contingency judgments were compared. In Experiment 2, the effects of changing the temporal definition of discrete responses were examined as were the effects of the amount of exposure to contingency problems. In Experiment 3, the effects of temporal regularity in defining response occurrence and nonoccurrence were investigated. In all three experiments, subjects' judgments were strong linear functions of the programmed contingencies between telegraph key operation and the illumination of a brief light. This result shows free-operant scheduling of response-outcome contingencies to be a highly sensitive and unbiased method of investigating causal perception. Additionally, judgment accuracy was found to be higher for males than for females and to improve as the probability of the subject's making a recorded response rose from .00 toward .50. Finally, a correlational analysis of several possible judgment rules supported the conclusion that subjects rated response-outcome relations on the basis of the difference in the probability of an outcome given their having recently made or not made a response.     

ASSESSMENT OF STIMULUS PREFERENCE AND REINFORCER VALUE WITH PROFOUNDLY RETARDED INDIVIDUALS

We evaluated a procedure for identifying potential reinforcers with profoundly retarded individuals. In Experiment 1, six persons were repeatedly exposed to 16 stimuli, and approach behaviors to each stimulus were used to identify preferred and nonpreferred stimuli. In Experiment 2, we examined the reinforcing properties of preferred and nonpreferred stimuli by delivering them contingently on the occurrence of arbitrarily selected responses. Results revealed that the preferred stimulus conditions typically produced higher rates of responding than did either the baseline or the nonpreferred stimulus conditions, suggesting that the procedure can be used to assess reinforcer value for individuals with limited behavioral repertoires.     

Comparisons of two measures of free-operant avoidance under two conditions of response feedback

Lever-pressing responses of 6 rats were studied under a free-operant avoidance procedure, in 6 two-hour sessions. Three of the subjects were given an added visual feedback for each response; they avoided shocks more effectively than the subjects without the feedback. Two different measures of overall performance in free-operant avoidance were applied to the results of the experiment. There was little difference between the measures: both reflected the subjects' performance equally well. Relative merits of the measures and the criteria for selecting one of them were discussed.     

Changes in a multiple-response repertoire during response-contingent punishment and response restriction: Sequential relationships

A multiple-response baseline of four activities was established using gerbils as subjects. When one of the baseline responses was punished (Experiment 1) or restricted (Experiments 2 and 3), only the most probable of the alternative baseline responses increased. The response most likely to follow the punished or restricted responses during baseline sessions was also suppressed during subsequent punishment or response-restriction treatment.     

Acquisition and generative responding following print‐to‐braille construction response training with sighted learners

Previous researchers have taught sighted adults to match braille sample stimuli to print comparisons in a matching‐to‐sample (MTS) format and assessed the emergence of other braille repertoires, such as transcribing and reading braille following this training. Although participants learned to match to sample with braille, they displayed limited emergence of other braille repertoires. Lack of generative responding may have resulted from participants' over‐selective attending to components of compound braille characters during instruction. We taught undergraduates to construct braille characters given a print sample, which required attending to each individual braille symbol, and assessed generative braille responding. Participants met mastery of 378 braille construction responses and demonstrated modestly improved responding compared with previous research.