Instructed versus shaped human verbal behavior: Interactions with nonverbal responding

Undergraduate students' presses on left and right buttons occasionally made available points exchangeable for money. Blue lights over the buttons were correlated with multiple random-ratio random-interval components; usually, the random-ratio schedule was assigned to the left button and the random-interval to the right. During interruptions on the multiple schedule, students filled out sentence-completion guess sheets (e.g., The way to earn points with the left button is to...). For different groups, guesses were shaped with differential points also worth money (e.g., successive approximations to “press fast” for the left button), or were instructed (e.g., Write “press slowly” for the left button), or were simply collected. Control of rate of pressing by guesses was examined in individual cases by reversing shaped or instructed guesses, by instructing pressing rates, and/or by reversing multiple-schedule contingencies. Shaped guesses produced guess-consistent pressing even when guessed rates opposed those characteristic of the contingencies (e.g., slow random-ratio and fast random-interval rates), whereas guesses and rates of pressing rarely corresponded after unsuccessful shaping of guesses or when guessing had no differential consequences. Instructed guesses and pressing were inconsistently related. In other words, when verbal responses were shaped (contingency-governed), they controlled nonverbal responding. When they were instructed (rule-governed), their control of nonverbal responding was inconsistent: the verbal behavior sometimes controlled, sometimes was controlled by, and sometimes was independent of the nonverbal behavior.     

Uninstructed human responding: Sensitivity of low-rate performance to schedule contingencies

College students' presses on a telegraph key occasionally turned on a light in the presence of which button presses produced points later exchangeable for money. Initially, responding was maintained by low-rate contingencies superimposed on either random-interval or random-ratio schedules. Later, the low-rate contingencies were relaxed. Low-rate key pressing had been established for some students by shaping and for others by demonstration and written instructions. After the low-rate contingencies were relaxed, higher response rates generally did not increase point earnings with random-interval scheduling, but did so with random-ratio scheduling. In both cases, shaped responding usually increased, and instructed responding usually continued at an unchanged low rate. The insensitivity of instructed responding typically occurred despite contact with the contingencies. The differential sensitivity to schedule contingencies of shaped responding relative to instructed responding is consistent with the different properties of contingency-governed and rule-governed behavior and is not rate-dependent.     

Uninstructed human responding: sensitivity to ratio and interval contingencies

College students' presses on a telegraph key were occasionally reinforced by light onsets in the presence of which button presses (consummatory responses) produced points later exchangeable for money. One student's key presses were reinforced according to a variable-ratio schedule; key presses of another student in a separate room were reinforced according to a variable-interval schedule yoked to the interreinforcement intervals produced by the first student. Instructions described the operation of the reinforcement button, but did not mention the telegraph key; instead, key pressing was established by shaping. Performances were comparable to those of infrahuman organisms: variable-ratio key-pressing rates were higher than yoked variable-interval rates. With some yoked pairs, schedule effects occurred so rapidly that rate reversals produced by schedule reversals were demonstrable within one session. But sensitivity to these contingencies was not reliably obtained with other pairs for whom an experimenter demonstrated key pressing or for whom the reinforcer included automatic point deliveries instead of points produced by button presses. A second experiment with uninstructed responding demonstrated sensitivity to fixed-interval contingencies. These findings clarify prior failures to demonstrate human sensitivity to schedule contingencies: human responding is maximally sensitive to these contingencies when instructions are minimized and the reinforcer requires a consummatory response.     

Effects of pairing stimuli with reinforcement on multiple schedule performance of children

A nonsense word was paired with reinforcement to determine if pairing affected emission of a response that produced the word in the signalled absence of reinforcement. Children were trained on a multiple schedule that consisted of a reinforcement component, conditioned reinforcement component, and control component, each set of contingencies being signalled by a different colored light. In the primary reinforcement component, lever presses produced reinforcers which, in some phases, were paired with a word. In the other two components, lever presses were not reinforced and a button was made accessible. Button presses in the conditioned reinforcement component produced the word to be (or being) paired, e.g., "yafeh", while button presses in the control component produced another word, e.g., "grunch". Button pressing increased when one of the words was being paired and decreased when pairing was discontinued, but directly related rate changes occurred also in the control component. The order of components was shown to be a contributing variable.     

Human operant performance: Sensitivity and pseudosensitivity to contingencies

Undergraduates' button presses occasionally produced points exchangeable for money. Left and right buttons were initially correlated with multiple random-ratio (RR) and random-interval (RI) components, respectively. During interruptions of the multiple schedule, students filled out sentence-completion guess sheets describing the schedules, and points were contingent upon the accuracy of guesses. To test for sensitivity to schedule contingencies, schedule components were repeatedly reversed between the two buttons. Pressing rates were consistently higher in ratio than in interval components even when feedback for guesses was discontinued, demonstrating sensitivity to the difference between ratio and interval contingencies. The question was whether this sensitivity was based directly on the contingencies or whether it was rule-governed. For two students, when multiple RR RI schedules were changed to multiple RI RI schedules, rates became low in both components of the multiple RI RI schedule; however, subsequent prevention of point deliveries for the first few responses in any component produced high rates in that component. For a third student, response rates became higher in the RI component that provided the lower rate of reinforcement. In each case, performance was inconsistent with typical effects of the respective schedules with nonhuman organisms; it was therefore plausible to conclude that the apparently contingency-governed performances were instead rule-governed.     

A procedure for studying the within-session onset of human drug discrimination.

The purpose of the present study was to develop a procedure for measuring the within-session onset of human drug discrimination. During daily sessions, under double-blind conditions, caffeine-abstinent adults ingested a letter-coded capsule containing 178 mg caffeine or placebo. Trials were presented at 30-s intervals, beginning immediately after drug ingestion and continuing for 60 min. On each trial, subjects could guess which of their two letter-coded drugs they had received by pressing a left button (for one drug) or right button (for the other drug); subjects could also press a center "no guess" button instead of guessing. Each trial ended after one button press. After each session, subjects were told which drug they had received. Subjects earned one point (worth $0.10 per point) for each correct guess. Subjects lost either 0, 1, or 10 points for each incorrect guess; the point-loss contingencies were varied in random order across sessions. Discrimination earnings accumulated across all sessions. The point-loss contingencies decreased random responding and delayed the discrimination time course. Overall, this procedure provided an orderly and relatively continuous measure of the within-session onset of drug discrimination and should have a range of applications in understanding the human behavioral pharmacology of drugs.     

Operant modulation of low-level attributes of rule-governed behavior by nonverbal contingencies

A low-level and nonsalient attribute of behavior (i.e., speed of pressing) was subjected to differential nonverbal operant reinforcement when rules governed a high-level attribute of that behavior (i.e., counting by means of key presses). Unknown to the subjects, reinforcers depended on reduced (slow group) or increased (fast group) speed of pressing rather than on the correct number of presses. The reinforced attribute was modulated according to the arranged speed contingencies independently of the instructed task and independently of subjects' awareness of the critical contingency. A control group receiving random reinforcers demonstrated no systematic speed changes. Possible mechanisms related to behavior changes of this type were examined and discussed, and it was concluded that the behavior changes observed in this situation could be attributed to operant conditioning. The results substantiate the assumption that nonverbal operant contingencies may modulate low-level and nonsalient attributes of rule-governed behavior.     

Omission Learning after Instrumental Pretraining

Hungry rats were pretrained to press two levers on a concurrent schedule for food pellets. Following either limited or extended pretraining, presentations of a sucrose solution were programmed on a random time schedule while the animals continued pressing on a concurrent schedule for food pellets. Presses on one of the levers-the omission lever-postponed deliveries of the sucrose solution scheduled to occur within a fixed period of time following the press, whereas presses on the other, control lever had no effect on the random time contingency. The animals pressed less frequently on the omission lever than on the control lever following limited pretraining but failed to discriminate between the two levers following extended pretraining. The insensitivity to the omission contingency produced by extended pretraining was due to either the number of presses performed during the initial training or the number of reinforced presses, rather than the number of reinforcers received. Finally, the insensitivity of performance on the omission lever to sucrose devaluation suggests that adaptation tothis negative contingency was mediated by an inhibitory stimulus-response association.     

Isolated teenagers, cooperative learning, and the training of social skills

The effects of individual and group contingencies on the achievement and social integration of isolated, learning-disabled students were studied. Five socially isolated and withdrawn eighth-grade students in foreign-language and math classes were subjects. The choice of working alone or in a group with no academic contingency (i.e., bonus points) was compared with working in cooperative learning groups with a group-academic contingency (i.e., bonus points), a group-academic contingency with social-skills training, and a group-academic contingency in combination with a social-skills contingency (i.e., bonus points). The results indicated that the combination of group-academic and social-skills contingencies produced in the socially isolated and withdrawn students the highest rates of appropriate social interaction with peers, acceptance and liking by peers, positive attitudes toward the subject area, and achievement.     

A comparison of isolated and synthesized contingencies in functional analyses

Recently, researchers have compared the utility of isolated versus synthesized contingencies in functional analysis (FA) methodology (e.g., Fisher et al., 2016; Slaton et al., 2017). A limitation of these studies is that there were other differences across FA methodologies (e.g., design, contingency) that did not allow for isolation of the influence of isolated versus synthesized contingencies. Therefore, the current study compared outcomes of FAs that involved isolated versus synthesized contingencies for problem behavior of 5 children while controlling for these other differences across FAs (Experiment 1). Next, the current study compared the effects of interventions based on the functions identified in the isolated and synthesized contingencies for each participant (Experiment 2). Results indicated isolated contingency FAs produced differentiated responding for 1 or both functions for all 5 participants, and there were little to no differences between treatments informed by isolated and synthesized contingency FAs.     

Effects of reinforcing preselected approximations on the topography of the rat's bar press

The effects of different shaping approximations on the topography of the rat's bar press were investigated in two experiments. Behavior was classified into discrete components, and changes in components and their sequential organization were analyzed. Experiment 1 examined response form early in training and found that specific components reinforced during shaping were incorporated into press sequences. Experiment 2 investigated how response form changed when a shaping contingency was relaxed later in training. Two topographies were selected for reinforcement, and both appeared in the press sequences of all subjects by the end of shaping. Subsequently, all variations of bar pressing were reinforced, and neither topography was necessary to satisfy the contingency. Although the frequency of the topographies reinforced during shaping declined for 3 of 4 subjects during this phase, the most frequent press sequence for 2 rats at the end of training included both unnecessary topographies. Variability in press topographies declined when all emitted variants were reinforced. However, all subjects emitted novel response forms throughout training. The results demonstrate that specific response-reinforcer contingencies influence response form by modulating component availability and organization.     

PROCEDURAL VARIATIONS IN GROUP CONTINGENCIES: EFFECTS ON CHILDREN'S ACADEMIC AND SOCIAL BEHAVIORS

There has been little research on the effects of the many procedural variables in applied group contingencies. In the present study, an individualized contingency and three group contingencies with different “responder” criteria (e.g., reward based on the group average, reward based on the work of a designated, low-achieving student, or reward based on the work of a randomly selected student) were applied to the academic work of primary grade children in a learning disabilities classroom. Group social interaction during each contingency was measured systematically. Although there were large individual differences in students' academic and social responses to the different contingencies, some consistent effects were observed. Two of the four low-achieving target students did their best academic work during the group contingency which focused on their performance as a designated responder. This type of contingency also produced high levels of positive social interaction in three of four groups of children observed.     

Shaping of rule-governed behaviour

Over an experimental session of 80 trials, subjects counted brief auditory stimuli ("clicks") in stimulus presentation periods and indicated the number counted by pressing a key the corresponding number of times in subsequent response periods. "Correct" answers resulted in feedback. Unknown to the subjects, the feedback criterion was based on speed of pressing rather than on the correct number of presses. Speed of pressing was modified by response consequences when feedback was made dependent on pressing faster or slower than baseline speed. Modification of speed occurred independently of rules and without the subjects' ability to describe contingency or response requirements. The results suggest that non-verbal contingencies may have a shaping effect on non-salient and non-described attributes of rule-governed behaviour, and it is argued that this may be an important control mechanism of low-level behavioural attributes that are unlikely to be guided by verbal discriminative stimuli.     

Interpersonal contingencies: Performance differences and cost-effectiveness

Three reinforcement contingencies were compared with regard to performance differences and cost-effectiveness (i.e., responses per unit reinforcer). Pairs of college students were studied under individual, cooperative, or competitive contingencies using a concurrent setting that included one of these three contingencies as one alternative and a lower paying individual contingency as the other alternative. With the individual and the cooperative contingencies, overall response rates were typically high; under competitive contingencies the overall response rates were substantially lower. Subjects responded at very high rates when competing, but chose not to compete most of the time. Competition and cooperation produced the most cost-effective responding, assessed as the number of responses made per $.01 of reinforcer. High overall rates of competitive responding were obtained when the contests were longer and the lower paying alternative contingency was not available.     

Judgment of contingency in depressed and nondepressed students: sadder but wiser?

How are humans' subjective judgments of contingencies related to objective contingencies? Work in social psychology and human contingency learning predicts that the greater the frequency of desired outcomes, the greater people's judgments of contingency will be. Second, the learned helplessness theory of depression provides both a strong and a weak prediction concerning the linkage between subjective and objective contingencies. According to the strong prediction, depressed individuals should underestimate the degree of contingency between their responses and outcomes relative to the objective degree of contingency. According to the weak prediction, depressed individuals merely should judge that there is a smaller degree of contingency between their responses and outcomes than nondepressed individuals should. In addition, the present investigation deduced a new strong prediction from the helplessness theory: Nondepressed individuals should overestimate the degree of contingency between their responses and outcomes relative to the objective degree of contingency. In the experiments, depressed and nondepressed students were present with one of a series of problems varying in the actual degree of contingency. In each problem, subjects estimated the degree of contingency between their responses (pressing or not pressing a button) and an environmental outcome (onset of a green light). Performance on a behavioral task and estimates of the conditional probability of green light onset associated with the two response alternatives provided additional measures for assessing beliefs about contingencies. Depressed students' judgments of contingency were surprisingly accurate in all four experiments. Nondepressed students, on the other hand, overestimated the degree of contingency between their responses and outcomes when noncontingent outcomes were frequent and/or desired and underestimated the degree of contingency when contingent outcomes were undesired. Thus, predictions derived from social psychology concerning the linkage between subjective and objective contingencies were confirmed for nondepressed students but not for depressed students. Further, the predictions of helplessness theory received, at best, minimal support. The learned helplessness and self-serving motivational bias hypotheses are evaluated as explanations of the results. In addition, parallels are drawn between the present results and phenomena in cognitive psychology, social psychology, and animal learning. Finally, implications for cognitive illusions in normal people, appetitive helplessness, judgment of contingency between stimuli, and learning theory are discussed.     

Reinforcement of human observing behavior by a stimulue correlated with extinction or increased effort

Young men pulled a plunger on mixed and multiple schedules in which periods of variable-interval monetary reinforcement alternated irregularly with periods of extinction (Experiment 1), or in which reinforcement was contingent on different degrees of effort in the two alternating components (Experiment 2). In the baseline conditions, the pair of stimuli correlated with the schedule components could be obtained intermittently by pressing either of two observing keys. In the main conditions, pressing one of the keys continued to produce both discriminative stimuli as appropriate. Pressing the other key produced only the stimulus correlated with variable-interval reinforcement or reduced effort; presses on this key were ineffective during periods of extinction or increased effort. In both experiments, key presses producing both stimuli occurred at higher rates than key presses producing only one, demonstrating enhancement of observing behavior by a stimulus correlated with the less favorable of two contingencies. A control experiment showed that stimulus change alone was not an important factor in the maintenance of the behavior. These findings suggest that negative as well as positive stimuli may play a role in the conditioned reinforcement of human behavior.     

Comparing Locomotion With Lever-press Travel In An Operant Simulation Of Foraging

An operant model of foraging was studied. Rats searched for food by pressing on the left lever, the patch, which provided one, two, or eight reinforcers before extinction (i.e., zero reinforcers). Obtaining each reinforcer lowered the probability of receiving another reinforcer, simulating patch depletion. Rats traveled to another patch by pressing the right lever, which restored reinforcer availability to the left lever. Travel requirement changed by varying the probability of reset for presses on the right lever; in one condition, additional locomotion was required. That is, rats ran 260 cm from the left to the right lever, made one response on the right lever, and ran back to a fresh patch on the left lever. Another condition added three hurdles to the 260-cm path. The lever-pressing and simple locomotion conditions generated equivalent travel times. Adding the hurdles produced longer times in patches than did the lever-pressing and simple locomotion requirements. The results contradict some models of optimal foraging but are in keeping with McNair's (1982) optimal giving-up time model and add to the growing body of evidence that different environments may produce different foraging strategies.