Some effects of frustration in a free responding operant situation

In several experiments, rats and pigeons were reinforced on a chained schedule which varied in its second component but which always had a variable interval schedule as its first component. Occasionally, the reward which normally followed responding in the second component was omitted. On these frustrative non-reward occasions responding immediately subsequent to non-reward was sometimes elevated and sometimes depressed. The relevance of the elevation and depression effects to behavioural measures of frustration in the double runway was discussed.     

Signal duration and suppression of operant responding by free reinforcement

Pigeons were trained on a VI (variable interval) schedule of food presentation with a superimposed schedule of response-independent food. Substantial suppression of the operant response rate occurred when the free food was presented without a signal. When the free food was preceded by a short (4 sec) signal, the degree of suppression was similar to that with unsignaled free food. But when the signal was lengthened to 12 sec, the degree of suppression was substantially reduced. Experiment 3 assessed the effect of signal duration using a baseline schedule of delayed reinforcement, in which contingent reinforcers were themselves preceded by a signal. The signal preceding the free reinforcers was then either the same as or different from this contingent signal. Signal duration effects occurred only when the two types of signals were different. These differences as a function of signal duration have implications for both “context-blocking” and “comparator” interpretations of the effects of noncontingent reinforcement in both Pavlovian and operant procedures.     

The effects of constant vs varied reinforcer presentation on responding by autistic children

The autistic child's characteristic lack of motivation can create considerable problems for educators. Since there is some evidence that stimulus variation may influence motivation, this study was designed to assess the differential effects of constant vs varied reinforcer presentation. Specifically, two questions were addressed: (1) Would there be any differences in the total number of responses emitted by autistic children when the reinforcer was held constant as opposed to varied; and (2) would there be any differences in the interresponse interval for constant vs varied reinforcer presentation? The results clearly demonstrated that the children in this investigation made significantly more and faster responses when the reinforcer presentation was varied as opposed to constant. The results are discussed in terms of the effects of stimulus variation on satiation and implications for teachers of autistic children.     

Effects of reinforcement rate and reinforcer magnitude on choice behavior of humans

Two experiments with human subjects investigated the effects of rate of reinforcement and reinforcer magnitude upon choice. In Experiment 1, each of five subjects responded on four concurrent variable-interval schedules. In contrast to previous studies using non-human organisms, relative response rate did not closely match relative rate of reinforcement. Discrepancies ranged from 0.03 to 0.43 (mean equal to 0.19). Similar discrepancies were found between relative amount of time spent responding on each schedule and the corresponding relative rates of reinforcement. In Experiment 2, in which reinforcer magnitude was varied for each of five subjects, similar discrepancies ranging from 0.05 to 0.50 (mean equal to 0.21), were found between relative response rate and relative proportion of reinforcers received. In both experiments, changeover rates were lower on the long-interval concurrent schedules than on the short-interval ones. The results suggest that simple application of previous generalizations regarding the effects of reinforcement rate and reinforcer magnitude on choice for variable-interval schedules does not accurately describe human behavior in a simple laboratory situation.     

The effects of satiation and reinforcer develuation on signal-centered behavior in the rat

Two experiments are described which investigate the effects of satiation and reinforcer devaluation on signal-centered behavior in rats. In Experiment 1 lever contacts were established in hungry rats by pairing retractable lever presentations (CS) with response-independent food (UCS). Subsequently, food satiating these subjects significantly reduced the level of CS contact during an extinction test and, in particular, suppressed CS-directed licking and pawing. In Experiment 2 lever contacts which were established by lever-food pairings were suppressed when the food reinforcer was paired with lithium chloride (LiCl) induced illness. In particular, CS-directed licking, sniffing, and orienting were significantly suppressed by these food-LiCl pairings. These results suggest that signal-centered behavior (i) is not simply a manifestation of “conditioned hunger,” (ii) is determined to some extent by the animal's current need state, and (iii) is influenced by the status of specific reinforcer representations.     

The relationship between predictability and problem behavior for students with severe disabilities

Two single-case studies were conducted to examine the extent to which signaled (predictable) and unsignaled (unpredictable) events were associated with changes in the level of problem behavior during instruction. Two students with moderate-to-severe intellectual disabilities and autism participated in the study. Each student was nominated for the study based on a teacher's report that problem behaviors were much more likely when novel or unsignaled events occurred. Functional assessments were conducted with each student and the specific predictability features (signals) associated with low and high levels of problem behavior were identified. Multi-element and reversal designs were employed to examine the extent to which increased predictability was associated with reduced problem behavior. Results supported the use of functional assessment procedures to determine whether signals that provide information about the content, duration, timing, and/or consequences of future events could reduce problem behaviors.     

Effects of choice of stimuli as reinforcement for task responding in reinforcement for task responding in preschoolers with and without developmental disabilities

The effects of choice and no choice of stimuli as reinforcement for task responding were investigated across preschoolers with and without disabilities. Five less preferred stimuli were identified for each participant using a stimulus preference assessment. No differences were found for choice and no-choice conditions when the less preferred stimuli were used as reinforcers.     

Effective instructional procedures for teaching individuals with severe disabilities in motor skills

The purpose was to describe effective instructional procedures used to teach motor skills to individuals with severe disabilities. Five effective instructional procedures supported with experimental data in adapted physical education are identified through the review of literature: (a) response shaping, (b) increasing prompt hierarchy, (c) decreasing prompt hierarchy, (d) constant time delay, and (e) progressive time delay. The characteristics, documentations, guidelines, and recommendations for application of these procedures are described.     

Minimized tolerance to the suppressive effects of CCK8 on operant responding

This study was designed to determine if tolerance to cholecystokinin octapeptide (CCK8) could be prevented or minimized by spacing injections, and if an appetitive operant conditioning paradigm provides a sensitive baseline to test the effects of CCK8. Male Sprague-Dawley rats were trained to press a lever for water according to a fixed-interval 60-sec schedule of reinforcement. After response rate stabilized, rats were given a series of CCK8 (0.04 mg/kg, ip) injections spaced several days apart. The first injection of CCK8 produced complete response suppression during the 30-min test session, while later injections produced partial or complete suppression. Thus, tolerance to CCK8, as measured by operant response rate, may be minimized if injections are appropriately spaced.     

Some effects of response-correlated increases in reinforcer magnitude on human behavior

After training under short or long fixed-interval schedules, humans responded under a modified fixed-interval schedule in which magnitude of reinforcement (X or 2X) was minimally correlated with response frequency. Response frequencies that equaled or exceeded a minimum response criterion were followed by the larger reinforcer at the end of the interval; otherwise, the smaller reinforcer was delivered. The modified schedule alternated with the baseline schedule across conditions. In a control condition, the reinforcer magnitudes produced by control subjects were yoked to those of experimental subjects. Experimental subjects, but not control subjects, showed increased responding. In addition to the baseline and modified fixed-interval schedules used in Experiment 1, subjects in Experiment 2 also responded under a second modified fixed-interval contingency in which increases in reinforcer magnitude were more highly correlated with response frequency. Experimental subjects, but not control subjects, showed increased responding under both procedures. Direct comparison of these two procedures showed that the high-correlation procedure produced greater increases in responding than did the low-correlation procedure.     

On the effects of food deprivation and component reinforcer rates on multiple-schedule performance

Six pigeons were used to investigate the effects of varying body weight and component reinforcer rates in two-component multiple variable-interval variable-interval schedules. In Parts 1 and 3 of the experiment, unequal component reinforcer rates were arranged, and body weights were respectively increased and decreased. At 80% ad lib weight, response-rate ratios were closer to unity than reinforcer-rate ratios, but at 100% or more of ad lib weight, response-rate ratios generally equaled reinforcer-rate ratios. In Part 2, component reinforcer-rate ratios were varied over five conditions with the subjects maintained at 100% or more of their ad lib weights, and response-rate ratios matched reinforcer-rate ratios. The data thus support the empirical finding that response allocation in multiple schedules is a function of deprivation. Although this qualitative result is predicted by three models of multiple-schedule performance, only a model that assumes no direct component interaction adequately describes the data.     

The effects of magnitude and quality of reinforcement on choice responding during play activities

Three boys with autism participated in a study of the effects of magnitude and quality of reinforcement on choice responding. Two concurrent response alternatives were arranged: (a) to play in an area where a peer or sibling was located, or (b) to play in an area where there was no peer or sibling. During one condition, the magnitude (i.e., duration of access to toys) or quality (level of preference) of reinforcement provided for both responses was equal. During the other condition, the magnitude or quality of reinforcement was relatively greater for choosing the play area where the peer or sibling was located than the area where the peer or sibling was not located. Results showed that after repeated exposure to the unequal magnitude or quality condition, the participant increasingly allocated his responses to the play area where the peer or sibling was located. For 2 participants, this pattern of responding was maintained in the subsequent equal magnitude or quality condition. Overall, the analysis suggests that the dimensions of magnitude and quality of reinforcement can be arranged to influence choice responding in favor of playing near a peer or sibling rather than playing alone.     

Vicarious and operant experiences in the etiology of illness behavior: A replication with healthy individuals

The purpose of the present investigation was to replicate a previous study of diabetic patients on the role of parental modeling in the etiology of illness behavior. A random sample of healthy individuals were assigned to an avoidant model (AM) (i.e. parent reported to have avoided work. chores etc. when ill) or non-avoidant model (NAM) group. Subjects subsequently provided retrospective and current information concerning their illness-behavior experiences. The results indicated that individuals with an AM reported more responsibility avoidance when ill currently and as a child compared to the NAM subjects. Additionally. AM subjects reported receiving more positive reinforcement for current illness compared to NAM subjects. It was concluded that the process by which individuals learn to respond to illness may be similar in healthy and chronically-ill individuals but that positive reinforcement for illness may be more likely to be received by healthy individuals during acute illness than by chronically-ill individuals. The present study provides further preliminary support for the learningtheory model of illness behavior.     

Amount of training and cue-evoked taste-reactivity responding in reinforcer devaluation

In two experiments, rats received minimal (16) pairings of one auditory conditioned stimulus (CS) cue with a sucrose reinforcer, and extensive (112) pairings of another auditory CS with that reinforcer. After sucrose was devalued by pairing it with lithium chloride in some rats (Devalue groups) but not others (Maintain groups), taste reactivity (TR) and other responses to unflavored water were assessed in the presence of the auditory CSs alone. The minimally trained CS controlled substantially more evaluative TR responses than the extensively trained CS. Those TR responses were hedonic (positive) in the Maintain groups, but aversive (negative) in the Devalue groups. By contrast, food cup entry and other responses thought not to reflect evaluative taste processing were controlled more by the extensively trained cue. These responses were reduced by sucrose devaluation comparably, regardless of the amount of training. The results suggest rapid changes in the content of learning as conditioning proceeds. Early in training, CSs may be capable of activating preevaluative processing of an absent food reinforcer that includes information about its palatability, but that capability is lost as training proceeds.     

Psychological and educational characteristics of instruction for people with severe disabilities: Interacting systems of responding

This paper presents a behavioral model which proposes that operants are organized and regulated into systems of responding. Multi-operant theory proposes that operants are organized into response systems that interact to adapt behavior to the complexities of the environment. The operant is the interaction between behavior and the environment which includes the conditions under which responses may occur, the class of behavior that is likely to be effective in producing outcomes, and the antecedent conditions that define the context of behavior. A central feature of this theory is that operants within a repertoire are organized into regulated systems of responding. The mechanisms of regulation are themselves operants that are learned and controlled by processes that are the same as those that govern more overt behavior. Operants stand in relationship to each other in coordinated response systems with some operants directly affecting and organizing the performance of other operants. An important implication of the systemic nature of behavioral repertoires is that bringing some aspect of a behavior class under control of new variables may demonstrate a spread throughout the entire operant system depending on past histories linking the classes.deceased     

Suppressive and enhancing effects of footshock on food-reinforced operant responding following septal lesions in rats.

Effect of septal lesions on suppression of an intermittently food-reinforced lever press by contingent and noncontingent footshock was measured. Rats with septal damage maintained higher response rates than did intact animals under both contingent and noncontingent shock. Furthermore, the difference in suppression produced by the contingent and noncontingent conditions was approximately the same for the experimental and control groups. In a second experiment, performance was measured during counter-conditioning in which the correlation between contingent shock and positive reinforcement was varied. Rats with septal lesions responded at higher rates than did controls. When only reinforced responses were punished, this lesion-induced elevation represented an increase above baseline performance without punishment. This finding suggests that the effect of septal damage on appetitive instrumental performance cannot be due solely to a deficit in response inhibition.     

The effects of d-amphetamine on the temporal control of operant responding in rats during a preshock stimulus.

The operant behavior of six rats was maintained by a random-interval schedule of reinforcement. Three-minute periods of noise were superimposed on this behavior, each period ending with the delivery of an unavoidable shock. Overall rates of responding were generally lower during the periods of noise than in its absence (conditioned suppression). These suppressed response rates also exhibited temporal patterning, with responding becoming less frequent as each noise period progressed. The effects of d-amphetamine on this behavioral baseline were then assessed. In four animals the relative response rates during the noise and in its absence suggested that the drug produced a dose-related decrease in the amount of conditioned suppression. However, this effect was often due to a decrease in the rates of responding in the absence of the preshock stimulus, rather than to an increase in response rates during the stimulus. Temporal patterning in response rates during the preshock stimulus was abolished, an effect that was interpreted in terms of rate-dependent effect of d-amphetamine. This study thus extends rate-dependent analyses of the effects of amphetamines to the patterns of operant behavior that occur during a preshock stimulus, and which have been discussed in terms of the disrupting effects of anxiety on operant behavior.     

Effects of reinforcer duration on responding in two-link chained interval schedules

Each of five pigeons was exposed to two or more durations of access to mixed grains on two-link, chained, interval schedules in which both links were identical fixed-interval or variable-interval schedules. Response rates were an increasing function of reinforcer duration for both initial and terminal links. For both types of interval schedules, initial-link response rates were more sensitive to reinforcer duration than were terminal-link response rates. The present results, together with prior ones, suggest that chaining and choice procedures are each sufficient for demonstrating substantial sensitivity of responding to changes in reinforcer duration.