Effects of operant conditioning on the GSR

Each of nine Ss was run for 11 daily sessions. Except for the first (operant level) and last two (extinction) sessions, 500-ohm drops in skin resistance were followed by reinforcement (light). These reinforcement periods lasted 20 min and were preceded by 10-min control periods during which no reinforcement was administered. Although the results showed no evidence for operant conditioning of the GSR, they did indicate that increased emission of GSR's occurred during the reinforcement period. This effect was shown to hold for Ss with low operant levels of GSR's but not for Ss with high operant levels.     

Operant GSR conditioning with cool air reinforcement

Two groups of 20 Ss each were run individually in a soundproof chamber heated to 115 F and humidified to 100%. Ss in the experimental group received brief presentation of cool air contingent upon emitted GSRs during 20 min of acquisition. Control Ss were matched one at a time in operant rate and were yoked one at a time to receive the cool air on a response-independent schedule. Both groups increased significantly in rate of unelicited GSRs during acquisition, with the experimental Ss’ curve rising more rapidly and both groups attaining equivalent terminal levels. During extinction, the groups maintained high levels of responding and did not differ. Examination of basal skin conductance data ruled out an activation hypothesis. In the control Ss, terminal response frequency was significantly correlated with percentage of fortuitous response-contingent reinforcement. It was concluded that both groups were conditioned, with the controls receiving intermittent reinforcement sufficiently often to elevate their responding. The cool air was judged to be an effective reinforcer of unelicited GSRs, perhaps more effective than those used in previous studies.     

Function transfer in human operant experiments: the role of stimulus pairings

Although function transfer often has been studied in complex operant procedures (such as matching to sample), whether operant reinforcement actually produces function transfer in such settings has not been established. The present experiments, with high school students as subjects, suggest that stimulus pairings can promote function transfer in conditions that closely approximate those of matching to sample. In Experiment 1, the subjects showed transfer of operant responding from three geometric figures (C1, C2, C3) to three colored shapes (B1, B2, B3) when the latter were paired with the former. Experiment 2 involved two groups of subjects. In the matching group, subjects matched the colored shapes with the geometric figures; in the yoked group, the shapes were merely paired with the geometric figures, and the schedule of stimulus pairing was yoked to the performance of the subjects in the matching group. Both groups of subjects showed function transfer. Experiment 3 documented function transfer from C stimuli to B stimuli through indirect stimulus pairings (A-B, A-C). In Experiment 4, function transfer was obtained even though the subjects vocalized continuously during the pairing trials, presumably preventing covert verbalization that might mediate transfer effects. Our results are consistent with a Pavlovian account and raise difficulties for current operant theories of function transfer.     

The effect of verbal reinforcement on career choice realism

Twenty-four male undergraduates viewed 102 slides containing occupational titles and stated whether or not each represented a realistic career choice. Each subject was given three trials, with the experimental subjects receiving positive verbal reinforcement on the second trial for realistic responses. (If the choice was congruous with the individual's occupational type, as determined by the Vocational Preference Inventory, it was scored as realistic.) The results of the research revealed a tendency for all subjects to increase in career choice realism as a function of participation in the experiment, with significantly (p < .05) more experimental subjects than control subjects demonstrating an operant pattern of responses. Implications of the findings for counselors were discussed.     

Independence training vs modeling procedures for teaching phone conversation skills to the mentally retarded

Forty-five mildly mentally retarded adults were assessed for deficits in telephone conversational skills. They were ranked on the basis of their pretest scores and matched into triplets on skill level. One member from each of these groups was then randomly assigned to either a no-treatment control group, a modeling condition or independence training—a treatment that incorporated social reinforcement, instructions, performance feedback, modeling, shaping by successive approximations and self-monitoring and evaluation. For the two latter conditions, treatment was provided three times weekly for 2 months in group sessions (N = 5) of 1 hr duration. The dependent variable, conversational skills of subjects was assessed at pretest, posttest and at a 3-month follow-up based on verbal responses that subjects made to nine questions asked by an experimenter and related social responses during a phone call. Independence training proved to be significantly more effective than the other two experimental conditions at posttest and follow-up. In addition, modeling proved to be significantly more effective than the no-treatment controls at both of these assessment points.     

The effects of value confrontation and reinforcement counseling on the career planning attitudes and behavior of adolescent males

An experiment was conducted to compare the relative effectiveness of a value confrontation procedure and a procedure based on verbal operant conditioning in enhancing career development attitudes and increasing the frequency of information-seeking behavior in rural adolescent males. Ninety subjects were identified as internally controlled or externally controlled based on their locus of control scores and then randomly assigned to one of the two experimental treatment groups or a control group. The value confrontation procedure involved developing an awareness of self-dissatisfaction about one's career planning and relating this self-dissatisfaction to the importance one gave to the values logical and responsible. These values had been identified empirically in this study as having a relationship to career planning. The reinforcement counseling treatment involved the interpretation of individual career maturity data followed by the verbal operant conditioning of responses indicative of career maturity. Post tests administered 7 weeks after the treatments showed that the value confrontation procedure resulted in significantly greater frequency of information seeking for internally controlled subjects when compared to the reinforcement counseling and control procedures. No treatment was significant in increasing the maturity level of career development attitudes.     

Control rate of response or reinforcement and amphetamine's effect on behavior.

The roles of control response rate and reinforcement frequency in producing amphetamine's effect on operant behavior were evaluated independently in rats. Two multiple schedules were arranged in which one variable, either response rate or reinforcement frequency, was held constant and the other variable manipulated. A multiple differential-reinforcement-of-low-rate seven-second yoked variable-interval schedule was used to equate reinforcement frequencies at different control response rates between multiple-schedule components. Amphetamine increased responding under the variable-interval component. In contrast, amphetamine decreased responding equivalently between components of a multiple random-ratio schedule that produced similar control response rates at different reinforcement frequencies. The results provide experimental support to the rate-dependency principle that control rate of responding is an important determinant of amphetamine's effect on operant behavior.     

Instrumental performance on negative schedules

Three experiments examined the performance of rats pressing a lever for food reinforcement on a schedule in which high rates of response resulted in lowered rates of reinforcement (i.e. a schedule with a negative component). In Experiment 1, rats responded on a variable interval (VI) schedule with a conjoint component such that every 30 responses a reinforcement programmed by the VI schedule was cancelled. These subjects generally emitted a lower response rate than rats responding on a VI schedule yoked to the former subjects with respect to the delivery of reinforcement, although response rate differences were sometimes not large. Similar response-rate effects were obtained in Experiment 2 using a within-subject yoking procedure. In Experiment 3, reinforced interresponse times were matched on negative and VI schedules yoked in terms of reinforcement rate, and the response rate emitted in these conditions were similar. These results give support to theories of instrumental conditioning that stress the strengthening and shaping properties of reinforcement.     

Interlocking schedules: the relationship between response and time requirements.

Rats were exposed to an interlocking fixed-ratio 150 fixed-interval 5-minute schedule of food reinforcement and then to yoked variable-ratio schedules in which individual ratios corresponded exactly to the ratios of responses to reinforcement obtained on the interlocking schedule. After additional training with the interlocking schedule, the rats were exposed to yoked variable-interval schedules in which intervals corresponded to the intervals between successive reinforcements obtained on the second interlocking schedule. Response rates were highest in the yoked VR condition and lowest in the yoked VI, while intermediate rates characterized the interlocking schedule. Break-run patterns of responding were generated by the interlocking schedule for all subjects, while both the yoked VR and VI schedules produced comparatively stable local rates of responding. These results indicate that responding is sensitive to the interlocking schedule's inverse relationship between reinforcement frequency and responses per reinforcement.     

Orienting reaction habituation in chronic alcoholics

A polygraphic study on resistance to habituation of the somatic (EMG), autonomic (finger plethysmogram, galvanic skin reaction, respiration) and EEG (acoustic-evoked potential and EEG-blocking reaction) components of the orienting reaction elicited by a repetitive auditory stimulus was performed in 67 chronic alcoholics and in 70 matched normal subjects (control group). The study showed a significantly lower resistance to habituation of the orienting reaction in alcoholics than in normal control subjects. The severity of this habituation disturbance depended on the patients’ age, type of alcoholism, alcohol consumption intensity and chronicity, as well as the type of resting EEG.     

Self-selection of standards by children: The relative effectiveness of pupil-selected and teacher-selected standards of performance

This study examines the effects of contingent reinforcement under conditions of pupil-selected and teacher-selected performance standards upon pupils' academic response rates. The academic response rate was measured by the number of correct responses emitted per session. Thirty pupils (15 second-graders and 15 third-graders) were randomly assigned to one of three experimental groups, based on matched triplets. One group worked under pupil-selected standards; the second group worked under standards selected by the experimenter with each pupil yoked to a member of the pupil-selected standards groups. Both groups participated in the calculation of their daily earnings. The third group served as a no-contingency control group. Baseline academic response rates on writing and math tasks were determined. During the experimental sessions reinforcement was provided in the form of points which were later traded for tangible rewards. The pupil-selected standards group showed a significantly greater number of correct responses in the writing and math tasks than the externally selected standards group.     

Positive affect and learning: exploring the “Eureka Effect” in dogs

Animals may experience positive affective states in response to their own achievements. We investigated emotional responses to problem-solving in dogs, separating these from reactions to rewards per se using a yoked control design. We also questioned whether the intensity of reaction would vary with reward type. We examined the response (behavior and heart rate) of dogs as they learned to gain access to different rewards: (1) food (2) human contact, and (3) dog contact. Twelve beagles were assigned to matched pairs, and each dog served as both an experimental and a control animal during different stages of the experiment. We trained all dogs to perform distinct operant tasks and exposed them to additional devices to which they were not trained. Later, dogs were tested in a new context. When acting as an experimental dog, access to the reward was granted immediately upon completion of trained operant tasks. When acting as a control, access to the reward was independent of the dog’s actions and was instead granted after a delay equal to their matched partner’s latency to complete their task. Thus, differences between the two situations could be attributed to experimental dogs having the opportunity to learn to control access to the reward. Experimental dogs showed signs of excitement (e.g., increased tail wagging and activity) in response to their achievements, whereas controls showed signs of frustration (e.g., chewing of the operant device) in response to the unpredictability of the situation. The intensity of emotional response in experimental dogs was influenced by the reward type, i.e., greatest response to food and least to another dog. Our results suggest that dogs react emotionally to problem-solving opportunities and that tail wagging may be a useful indicator of positive affective states in dogs.     

Graded differential reinforcement: Response-dependent reinforcer amount

After key pecking had been autoshaped, six pigeons were exposed to a condition in which the duration of grain availability at the end of an 8-second trial depended on the number of responses emitted during the trial (0.25-second access to grain per response). This procedure, called correlated reinforcement, alternated across conditions with the automaintenance baseline in which the 8-second trial terminated with a constant 2.5-second access to grain. Two control procedures were run; in both, the reinforcer durations were yoked to those obtained in the last correlated session. In the yoked control no responses were required, but in the single-response yoked control at least one response was required to receive the yoked duration. The correlated condition maintained response rates above those produced by the two control conditions. These results may be accounted for by differential reinforcement.     

Methods and findings in an analysis of a vocal operant

The relations among acoustic parameters of a vocal operant were considered and some methods for their measurement are described. Four human subjects (Ss) and one chick were employed in an experiment on the relations among vocal rate, vocal topography, and schedules of reinforcement. The earlier finding that schedules of reinforcement control human and infra-human vocal responding as they do other operants was replicated and extended to the case of variable-interval reinforcement. An analysis of response amplitude, pitch, and duration showed that the mean and variance of these parameters typically increase from CRF to VI, from VI to EXT and, for a second group of Ss, from CRF to EXT. The topography of the chick's vocal response appears to stand in the same relation to reinforcement operations as does the human vocal response.     

Automaintenance without stimulus-change reinforcement: Temporal control of key pecks

Yoked pairs of experimentally naive pigeons were exposed to a modified autoshaping procedure in which key pecking by the leader birds postponed both keylight termination and access to grain for the leader and the follower bird. Key pecking developed and was maintained in all birds and continued through two reversals of roles in the yoked procedure. Although temporal control developed more slowly in follower birds, asymptotic temporal distributions of key pecking were similar for all birds in both leader and follower roles; maximum responding occurred soon after keylight onset and decreased to a minimum prior to reinforcement. Response distributions for both leader and follower birds were described by Killeen's (1975) mathematical model of temporal control. Follower birds received response-independent reinforcement, and the development by these birds of temporal distributions which are minimal immediately prior to reinforcement is without precedent in Pavlovian appetitive conditioning. However, maintenance of key pecking by the leader birds, whose responses postponed both stimulus-change and food reinforcement, supports an interpretation of autoshaped and automaintained key pecking as responding elicited by signaled grain presentation.     

Male versus female Siamese fighting fish as reinforcing stimuli for conspecific males in single- and two-choice operant situations

Two experiments attempted to determine the reinforcing effectiveness of visual exposure to a female versus a male stimulus in male Siamese fighting fish (Betta splendens). This was accomplished by making male or female presentation contingent upon an operant ring swimming response in single- (Experiment 1) and two-choice (Experiment 2) continuous reinforcement operant situations for 1 hr per day. It was found that visual exposure to a female stimulus was behaviorally reinforcing in a way comparable to that typically found in intermale studies. If given a choice, male test subjects were observed to demonstrate a consistent preference for the female as opposed to the male stimulus. The results are discussed in terms of stimulus discrimination and approach-avoidance conflict as differentially elicited by male and female target stimuli.     

Sensitivity and Strength: Effects Of Instructions on Resistance to Change

Several research laboratories have found that instructed behavior can be less sensitive to changes in contingencies than shaped behavior. The current experiment examined whether these differences in sensitivity could be related to resistance to change. Two groups of subjects, who were matched on the basis of an initial disruption assessment, were exposed to a variable-interval 30-s schedule of reinforcement with and without a disrupter. The disrupter was a video presentation of a popular television situation comedy. One group received minimal instructions (MI) that told them only that they could earn points exchangeable for money. Each member of the second group received a complete instruction (CI) that described the topography of the target response that was yoked to a MI subject’s stable baseline response rate. The response rates under the disruption condition for the CI subjects were more resistant to change than the MI subjects in 14 out of 15 disruption sessions. These findings are discussed in terms of resistance to change being increased by instructional conditions like those manipulated and that the procedures used to test disruption provide an additional method to !waluate differences between instructed and contingency-governed behavior.

     

Training cooperation in the Prisoner's Dilemma

Female Ss' choices in two types of mixed-motive game situations were used to select Ss who had predominantly Own Gain and Ss who had predominantly Relative Gain goals. On the basis of simple reward notions, it was predicted that the former but not the latter would change from competitive to cooperative responding in decomposed Prisoner's Dilemma game situations when interacting with a conditionally cooperative other. Corresponding yoked controls were not expected to become cooperative. The availability of social comparison with an outcome which was smaller than the mutually cooperative outcome but larger than the mutually competitive out-come was expected to lead Own Gain Ss to more rapid learning of cooperation but not to affect the responses of corresponding yoked controls or of Relative Gain Ss. A 2 × 2 × 2 × 5 factorial design was used in which the factors were goal orientation (Own Gain vs Relative Gain), strategy of the other (conditionally cooperative vs yoked control), the availability vs unavailability of the social comparison, and trials. The results strongly supported each of the expectations. The results were discussed in terms of how the operation of the reward mechanism would be affected by the operation of some other social psychological processes.     

Analyzing the reinforcement process at the human level: Can application and behavioristic interpretation replace laboratory research?

Critics have questioned the value of human operant conditioning experiments in the study of fundamental processes of reinforcement. Contradictory results from human and animal experiments have been attributed to the complex social and verbal history of the human subject. On these grounds, it has been contended that procedures that mimic those conventionally used with animal subjects represent a "poor analytic preparation" for the explication of reinforcement principles. In defending the use of conventional operant methods for human research, we make three points: (a) Historical variables play a critical role in research on processes of reinforcement, regardless of whether the subjects are humans or animals. (b) Techniques are available for detecting, analyzing, and counteracting such historical and extra-experimental influences; these include long-term observations, steady state designs, and, when variables are not amenable to direct control (e.g., age, gender, species), selection of subjects with common characteristics. (c) Other forms of evidence that might be used to validate conditioning principles-applied behavior analysis and behavioristic interpretation-have inherent limitations and cannot substitute for experimental analysis. We conclude that human operant conditioning experiments are essential for the analysis of the reinforcement process at the human level, but caution that their value depends on the extent to which the traditional methods of the experimental analysis of behavior are properly applied.     

Individualized Behavior Therapy for Alcoholics – Republished Article

A behavior therapy for alcoholism was designed based on the rationale that alcoholic drinking is a discriminated, operant response. Treatment emphasized determining setting events for each subject’s drinking and training equally effective alternative responses to those situations. Seventy male, hospitalized, Gamma alcoholics were assigned to a treatment goal of either nondrinking (N = 30) or controlled drinking (N = 40). Subjects of each group were then randomly assigned to either an experimental group receiving 17 behavioral treatment sessions or a control group receiving only conventional treatment. Treatment of experimental groups differed only in drinking behaviors allowed during sessions and electric shock avoidance schedules. Nondrinker experimental subjects shaped to abstinence, while controlled drinker experimental subjects practiced appropriate drinking behaviors with little shaping, a result attributed to instructions. Follow-up measuring drinking and other behaviors found that experimental subjects functioned significantly better after discharge than control subjects, regardless of treatment goal. Successful experimental subjects could apply treatment principles to setting events not considered during treatment, suggesting the occurrence of rule learning. Results are discussed as evidence that some “alcoholics” can acquire and maintain controlled drinking behaviors. Traditional treatment of alcoholics may be handicapped by unvalidated beliefs concerning the nature of the disorder.