Instructed versus shaped human verbal behavior: Interactions with nonverbal responding

Undergraduate students' presses on left and right buttons occasionally made available points exchangeable for money. Blue lights over the buttons were correlated with multiple random-ratio random-interval components; usually, the random-ratio schedule was assigned to the left button and the random-interval to the right. During interruptions on the multiple schedule, students filled out sentence-completion guess sheets (e.g., The way to earn points with the left button is to...). For different groups, guesses were shaped with differential points also worth money (e.g., successive approximations to “press fast” for the left button), or were instructed (e.g., Write “press slowly” for the left button), or were simply collected. Control of rate of pressing by guesses was examined in individual cases by reversing shaped or instructed guesses, by instructing pressing rates, and/or by reversing multiple-schedule contingencies. Shaped guesses produced guess-consistent pressing even when guessed rates opposed those characteristic of the contingencies (e.g., slow random-ratio and fast random-interval rates), whereas guesses and rates of pressing rarely corresponded after unsuccessful shaping of guesses or when guessing had no differential consequences. Instructed guesses and pressing were inconsistently related. In other words, when verbal responses were shaped (contingency-governed), they controlled nonverbal responding. When they were instructed (rule-governed), their control of nonverbal responding was inconsistent: the verbal behavior sometimes controlled, sometimes was controlled by, and sometimes was independent of the nonverbal behavior.     

Effects of pairing stimuli with reinforcement on multiple schedule performance of children

A nonsense word was paired with reinforcement to determine if pairing affected emission of a response that produced the word in the signalled absence of reinforcement. Children were trained on a multiple schedule that consisted of a reinforcement component, conditioned reinforcement component, and control component, each set of contingencies being signalled by a different colored light. In the primary reinforcement component, lever presses produced reinforcers which, in some phases, were paired with a word. In the other two components, lever presses were not reinforced and a button was made accessible. Button presses in the conditioned reinforcement component produced the word to be (or being) paired, e.g., "yafeh", while button presses in the control component produced another word, e.g., "grunch". Button pressing increased when one of the words was being paired and decreased when pairing was discontinued, but directly related rate changes occurred also in the control component. The order of components was shown to be a contributing variable.     

Shaping of rule-governed behaviour

Over an experimental session of 80 trials, subjects counted brief auditory stimuli ("clicks") in stimulus presentation periods and indicated the number counted by pressing a key the corresponding number of times in subsequent response periods. "Correct" answers resulted in feedback. Unknown to the subjects, the feedback criterion was based on speed of pressing rather than on the correct number of presses. Speed of pressing was modified by response consequences when feedback was made dependent on pressing faster or slower than baseline speed. Modification of speed occurred independently of rules and without the subjects' ability to describe contingency or response requirements. The results suggest that non-verbal contingencies may have a shaping effect on non-salient and non-described attributes of rule-governed behaviour, and it is argued that this may be an important control mechanism of low-level behavioural attributes that are unlikely to be guided by verbal discriminative stimuli.     

Comparing Locomotion With Lever-press Travel In An Operant Simulation Of Foraging

An operant model of foraging was studied. Rats searched for food by pressing on the left lever, the patch, which provided one, two, or eight reinforcers before extinction (i.e., zero reinforcers). Obtaining each reinforcer lowered the probability of receiving another reinforcer, simulating patch depletion. Rats traveled to another patch by pressing the right lever, which restored reinforcer availability to the left lever. Travel requirement changed by varying the probability of reset for presses on the right lever; in one condition, additional locomotion was required. That is, rats ran 260 cm from the left to the right lever, made one response on the right lever, and ran back to a fresh patch on the left lever. Another condition added three hurdles to the 260-cm path. The lever-pressing and simple locomotion conditions generated equivalent travel times. Adding the hurdles produced longer times in patches than did the lever-pressing and simple locomotion requirements. The results contradict some models of optimal foraging but are in keeping with McNair's (1982) optimal giving-up time model and add to the growing body of evidence that different environments may produce different foraging strategies.     

Time-based and count-based measurement of preference

Rats' pressing on two levers was reinforced according to two independent variable-interval schedules that were varied during the experiment. Since the levers were connected directly to the programming equipment, bypassing the standard pulseformers, reinforcement could occur while a lever was held down. Although the time a lever was pressed might, therefore, have varied independently of number of presses, these two measures covaried substantially, because the average duration of the presses remained roughly constant. This rough invariance may have resulted from the rats' tendency to make bursts of brief presses (i.e., to jiggle the levers), even though the contingencies encouraged holding. When duration did vary, presses on the two levers tended to vary together. As a result, relative time spent pressing corresponded closely to relative number of presses. Both of these measures conformed well to the matching law. Absolute behavioral frequency at a lever, measured either way, varied directly with proportion of reinforcement for that lever, in accordance with the generalized version of the matching law. Number of presses seemed, on balance, to be a slightly more reliable measure than pressing time. The substantial interchangeability may prove more significant than the slight disparity, however, because it supports the notion that all behavior can be measured on a common scale of time.     

The effect of type of behavior on behavior change caused by type of upcoming food substance

Previous research suggests that rats will decrease their consumption of a low-valued substance if a high-valued one will soon be available (anticipatory contrast), but will increase their rate of operant responding for a low-valued substance if a high-valued one will soon be available (positive induction). The present experiments tested whether rats would increase their operant rate of licking or lever pressing for 1% liquid-sucrose reinforcement when 32% sucrose reinforcement was upcoming in the same session. Results indicated that upcoming 32% sucrose increased rates of lever pressing for 1% sucrose, but did not produce similar increases in rates of licking. In fact, upcoming 32% sucrose significantly reduced lick rates in Experiment 2. The present results suggest that the different changes in behavior may be linked to the specific response that the subjects must engage in to obtain the reward (i.e., licking vs. lever pressing), and not to the function of the behavior (i.e., consummatory vs. operant) or to how frequently the substances are available (i.e., continuously vs. intermittently).     

Response–reinforcer contiguity versus response-rate–reinforcer-rate covariance in rats' lever pressing: Support for a multiscale view

The multiscale molar view sees behavior as a flow, like a river, extended in time. Matching theory expresses the way activities compete for time. Relative time taken by any activity depends on relative induction. The present experiment tested matching theory applied to concurrent contingent and noncontingent food. As adjunctive activities that compete with operant activity, we recorded hopper head entries and presses on a lever near the food hopper that had no programmed consequences. Eight naïve rats were first exposed to a variable-time 60 s schedule, which across conditions was gradually transformed into a variable-interval 60 s schedule by increasing the proportion of food that was delivered contingent on pressing a lever far from the hopper. Another group of 4 rats that had been trained to press a lever near a food hopper were introduced in the second condition, in which one food delivery was contingent on far-lever pressing. We found induction following a power function to describe pressing on the far lever (operant activity). Matching theory combined with power-function induction also accounted for adjunctive activity. Results with single contingent food deliveries provided little support for the molecular view that behavior consists of discrete responses “strengthened” by immediately following reinforcers.     

Is induction produced by upcoming food-pellet reinforcement the outcome of an increase in overall activity or in operant responding?

Researchers have demonstrated that rats reliably increase their rates of pressing a lever for 1% liquid-sucrose reinforcement if they will soon have the opportunity to press a lever for food-pellet reinforcement. In the present experiments, the authors investigated if this increase in response rates occurred because the upcoming food pellets produced an increase in all behaviors (i.e., general arousal) or an increase in only the specific operant response (i.e., lever pressing). The results of Experiments 1 and 2 showed that the appearance of induction in rats' lever pressing for 1% sucrose reinforcement when food-pellet reinforcement was upcoming did not coincide with increases in the frequency of running in a wheel or making a nonreinforced nose-poke response. On the other hand, in Experiment 3, the authors found the appearance of induction coincided with increase nonreinforced lever presses on an adjacent lever. These results shed doubt on the idea that induction is a result of a general increase in all activity, and suggest instead that the increase in responding that occurs during induction is limited to the operant response.     

Orbital prefrontal cortex and guidance of instrumental behavior of rats by visuospatial stimuli predicting reward magnitude

The orbital prefrontal cortex (OPFC) is part of a circuitry mediating the perception of reward and the initiation of adaptive behavioral responses. We investigated whether the OPFC is involved in guidance of the speed of instrumental behavior by visuospatial stimuli predictive of different reward magnitudes. Unoperated rats, sham-lesioned rats, and rats with bilateral lesions of the OPFC by N-methyl-D-aspartate (NMDA) were trained in a visuospatial discrimination task. The task required a lever press on the illuminated lever of two available to obtain a food reward. Different reward magnitudes were permanently assigned to lever presses to respective sides of the operant chamber; that is, responses to one lever (e.g., the left one) were always rewarded with one pellet and responses to the other lever with five pellets. On each trial, the position of the illuminated lever was pseudorandomly determined in advance. Results revealed that OPFC lesions did not impair acquisition of the task, as the speed of conditioned responses was significantly shorter with expectancy of a high reward magnitude. In addition, during reversal, shift and reshift of lever position–reward magnitude contingencies and under extinction conditions, performance of the OPFC-lesioned and control groups did not differ. It is concluded that the OPFC in rats might not be critical for adapting behavioral responses to changes of stimulus–reward magnitude contingencies signaled by visuospatial cues.     

Differential acquisition of lever pressing in inbred and outbred mice: comparison of one-lever and two-lever procedures and correlation with differences in locomotor activity

Recent progress in mouse genetics has led to an increased interest in developing procedures for assessing mouse behavior, but relatively few of the behavioral procedures developed involve positively reinforced operant behavior. When operant methods are used, nose poking, not lever pressing, is the target response. In the current study differential acquisition of milk-reinforced lever pressing was observed in five inbred strains (C57BL/6J, DBA/2J, 129X1/SvJ, C3H/HeJ, and BALB/cJ) and one outbred stock (CD-1) of mice. Regardless of whether one or two levers (an "operative" and "inoperative" lever) were in the operant chamber, a concomitant variable-time fixed-ratio schedule of milk reinforcement established lever pressing in the majority of mice within two 120-min sessions. Substantial differences in lever pressing were observed across mice and between procedures. Adding an inoperative lever retarded acquisition in C57BL/6J, DBA/2J, 129X1/SvJ, and C3H/HeJ mice, but not in CD-1 and BALB/cJ mice. Locomotor activity was positively correlated with number of lever presses in both procedures. Analyses of durations of the subcomponents (e.g., time to move from hopper to lever) of operant behavior revealed further differences among the six types of mice. Together, the data suggest that appetitively reinforced lever pressing can be acquired rapidly in mice and that a combination of procedural, behavioral, and genetic variables contributes to this acquisition.     

A CLASSIFICATION SCHEME OF SOCIAL CONDITIONS OF REINFORCEMENT WITHIN GROUP OPERANT SYSTEMS1

Many different reinforcement contingencies are found in group operant systems, such as token economies and point systems. Some systems use group contingencies in which the reinforcement of any one participant may depend on the behavior of some other group member. Other programs are individual, in that participants earn reinforcers dependent only on their own behavior. The various possible arrangements of people and their response requirements are labelled “social conditions of reinforcement” in this paper. Previous attempts at classification have failed to categorize the variety of social conditions of reinforcement. In addition, some conditions that may produce behaviorally different effects have not been separated. The present paper classifies the social conditions of reinforcement found in applied programs in a three-dimensional scheme. The efficacy of the three major dimensions—reinforcing agent, recipient response requirement, and group response requirement—is supported by clinical and research data. The reinforcing agent dimension refers to the person(s) who dispenses reinforcers to group members. This major dimension is further subdivided: one or several agents may be either designated or nondesignated. Recipients are the group members who receive reinforcement. This dimension is also subdivided: one or several recipients in a social condition of reinforcement may obtain reinforcers either contingently or noncontingently. The group response requirement is a criterion that must be satisfied before any group participant is eligible for reinforcement. Some systems have no group requirement, and others have a group requirement that must be met by some designated or nondesignated participant(s). Supportive references and examples are given in the explanation of each dimension and subdimension. The behavioral impact of the various categories is emphasized. For all major dimensions, applied implications and research suggestions are discussed. Concluding remarks center on the utility of the present scheme, the classification of operant procedures other than positive reinforcement, and both theoretical and applied issues requiring further study (e.g., the long-term effects of participation in group contingencies).     

Revisiting the picture-superiority effect in symbolic comparisons: do pictures provide privileged access?

In 4 experiments, symbolic comparisons were investigated to test semantic-memory retrieval accounts espousing processing advantages for picture over word stimuli. In Experiment 1, participants judged pairs of animal names or pictures by responding to questions probing concrete or abstract attributes (texture or size, ferocity or intelligence). Per pair, attributes were salient or nonsalient concerning their prerated relevance to animals being compared. Distance (near or far) between attribute magnitudes was also varied. Pictures did not significantly speed responding relative to words across all other variables. Advantages were found forfar attribute magnitudes (i.e., the distance effect) and salient attributes. The distance effect was much less for salient than nonsalient concrete-attribute comparisons. These results were consistently found in additional experiments with increased statistical power to detect modality effects. Our findings argue against dual-coding and some common-code accounts of conceptual attribute processing, urging reexamination of the assumption that pictures confer privileged access to long-term knowledge.     

Probabilistic numerical discrimination in mice

Previous studies showed that both human and non-human animals can discriminate between different quantities (i.e., time intervals, numerosities) with a limited level of precision due to their endogenous/representational uncertainty. In addition, other studies have shown that subjects can modulate their temporal categorization responses adaptively by incorporating information gathered regarding probabilistic contingencies into their time-based decisions. Despite the psychophysical similarities between the interval timing and nonverbal counting functions, the sensitivity of count-based decisions to probabilistic information remains an unanswered question. In the current study, we investigated whether exogenous probabilistic information can be integrated into numerosity-based judgments by mice. In the task employed in this study, reward was presented either after few (i.e., 10) or many (i.e., 20) lever presses, the last of which had to be emitted on the lever associated with the corresponding trial type. In order to investigate the effect of probabilistic information on performance in this task, we manipulated the relative frequency of different trial types across different experimental conditions. We evaluated the behavioral performance of the animals under models that differed in terms of their assumptions regarding the cost of responding (e.g., logarithmically increasing vs. no response cost). Our results showed for the first time that mice could adaptively modulate their count-based decisions based on the experienced probabilistic contingencies in directions predicted by optimality.     

Response acquisition under targeted percentile schedules: a continuing quandary for molar models of operant behavior.

The number of responses rats made in a "run" of consecutive left-lever presses, prior to a trial-ending right-lever press, was differentiated using a targeted percentile procedure. Under the nondifferential baseline, reinforcement was provided with a probability of .33 at the end of a trial, irrespective of the run on that trial. Most of the 30 subjects made short runs under these conditions, with the mean for the group around three. A targeted percentile schedule was next used to differentiate run length around the target value of 12. The current run was reinforced if it was nearer the target than 67% of those runs in the last 24 trials that were on the same side of the target as the current run. Programming reinforcement in this way held overall reinforcement probability per trial constant at .33 while providing reinforcement differentially with respect to runs more closely approximating the target of 12. The mean run for the group under this procedure increased to approximately 10. Runs approaching the target length were acquired even though differentiated responding produced the same probability of reinforcement per trial, decreased the probability of reinforcement per response, did not increase overall reinforcement rate, and generally substantially reduced it (i.e., in only a few instances did response rate increase sufficiently to compensate for the increase in the number of responses per trial). Models of behavior predicated solely on molar reinforcement contingencies all predict that runs should remain short throughout this experiment, because such runs promote both the most frequent reinforcement and the greatest reinforcement per press. To the contrary, 29 of 30 subjects emitted runs in the vicinity of the target, driving down reinforcement rate while greatly increasing the number of presses per pellet. These results illustrate the powerful effects of local reinforcement contingencies in changing behavior, and in doing so underscore a need for more dynamic quantitative formulations of operant behavior to supplement or supplant the currently prevalent static ones.     

Individual behavior, culture, and social change

The principle of operant selection is examined as a prototype of cultural selection, and the role of the social environment is suggested as the critical element in the emergence of cultural phenomena. Operant contingencies are compared to cultural selection contingencies, designated as metacontingencies. Both of these types of contingency relations result in evolving lineages of recurrences that can become increasingly complex in the number and organization of their elements. In addition to its role in the recurring interlocking behavioral contingencies that constitute cultural organization, operant behavior plays another role in cultures. Although the operants of individuals are functionally independent of one another, the behavior of each person may contribute to a cumulative effect that is relevant to the well-being of many people. Similarly, the outcomes of metacontingencies may also contribute to a cumulative effect. The relation between independently evolving operant lineages, or between independently evolving cultural lineages, and their cumulative effect is identified as a macrocontingency. Macrocontingencies do not involve cultural-level selection per se. Effective cultural engineering requires identifying the macrocontingencies that produce less than desirable effects and altering the relevant operant contingencies or metacontingencies to produce change in the cumulative effects.     

Contingent reinforcement of lowered blood-alcohol levels in an outpatient chronic alcoholic

Recently. the proposition that alcohol abuse is an operant behavior and thus functionally related to its consequences has been investigated under experimental conditions. In controlled laboratory settings, in which inpatient chronic alcoholics are allowed access to alcoholic beverages, alcohol consumption has been markedly altered via operant strategies. Monetary rewards (Cohen et al., 1971), the opportunity to participate in an enriched environment (Cohen et al., 1971). and visits to a girlfriend (Bigelow et al., 1973) have been used as reinforcers for decreased drinking.Other investigators (Sulzer, 1965; Miller, 1972: Hunt and Azrin, 1973) have successfully applied similar contingency management techniques to alcoholics in the natural environment. However, failure to control for the influence of extraneous therapeutic variables (e.g., attention-placebo factors, job counseling) together with reliance on self-report measures of drinking behavior seriously limit the conclusiveness of these results. Objective assessment is particularly essential with operant techniques since consequent events must be systematically scheduled upon the occurrence or non-occurrence of drinking. Documentation of drinking in the natural environment is a difficult task since the alcoholic frequently consumes alcohol when he is alone. In lieu of direct observation, blood alcohol concentrations are an obvious means of objective assessment. Such data are most conveniently obtained via breath tests similar to the ones that law enforcement officers utilize to identify intoxicated motorists.The purpose of the present study was to investigate the influence of reinforcement contingencies on lowering blood alcohol concentrations obtained in an alcoholic's natural environment.     

Evaluation of the rate of problem behavior maintained by different reinforcers across preference assessments

The rates of problem behavior maintained by different reinforcers were evaluated across 3 preference assessment formats (i.e., paired stimulus, multiple-stimulus without replacement, and free operant). The experimenter administered each assessment format 5 times in a random order for 7 children with developmental disabilities whose problem behavior was maintained by attention, tangible items, or escape. Results demonstrated different effects related to the occurrence of problem behavior, suggesting an interaction between function of problem behavior and assessment format. Implications for practitioners are discussed with respect to assessing preferences of individuals with developmental disabilities who exhibit problem behavior.     

Response Stereotypy in Humans Maintained by Response-Contingent Events

The present study examined stereotyped behaviors developed during human performances that were generated by response-dependent intermittent schedules of reinforcement. Thirty university students were assigned to either fixed-interval 30-s or fixed-ratio 30-s schedules in which points or monetary reinforcers were produced only by presses on the number keys of a 41-key computer keyboard. Behavior patterns developed by all subjects were classified into four categories: optimal, random, unique, and general stereotypes. The general stereotypes category was further subdivided into five idiosyncratic types: connection, order, shift, repeat, and restriction. Analysis of the data demonstrated the role of contiguity: Whatever behavior happened to precede reinforcers was repeated even though reinforcers did not depend on that behavior. These findings support the argument that much of idiosyncratic and stereotyped human behavior is produced and maintained by contingencies of reinforcement, rather than schedule-induced or adjunctive behavior.