Rate and temporal pattern of key pecking under autoshaping and omission schedules of reinforcement

The role of response-reinforcer contiguity on autoshaped key pecking in pigeons was studied by scheduling response-dependent nonreinforcement at the beginning or the end of brief (8-sec) discrete trials. Schedules that permitted chance conjunctions of key pecking and food sustained high rates of responding, whereas those that prevented the occurrence of key peck-food intervals shorter than 4 sec sustained low response rates. In addition, selective reinforcement schedules supported accelerating or decelerating rates of responding within individual trials. These effects were traceable to response-reinforcer (operant), but not stimulus-reinforcer (respondent) factors.     

Choice, time allocation, and response rate during stimulus generalization

Six pigeons were trained to discriminate between two noise intensities using a procedure that assessed choice, time allocation, and response rate simultaneously and independently. Responses on the left or right key (R1 or R2) were respectively correct in the presence of two different intensities, S1 and S2. After a correct response, reinforcement became available for pecks on the center key. Reinforcement density for R1¦S1 relative to R2¦S2 was varied across experimental conditions. Generalization tests followed extensive training at each condition. As a function of stimulus intensity, proportions of initial choices of R2, of time spent in R2-initiated components, and of center-key responses emitted in R2-initiated components all yielded sigmoidal gradients of similar slope, which shifted slightly in location when relative reinforcement density changed. Changeovers were maximal where initial choice proportions approximated 0.5. Gradients relating the absolute number of center-key responses to stimulus intensity were also roughly sigmoidal, but were more sensitive to changes in reinforcement density. Gradients of momentary response rate also depended on reinforcement density. During training, large but transitory shifts in choice responding occurred when reinforcement density changed, while differences in momentary response rate developed slowly, suggesting separate control of choice and response rate by the contingencies of reinforcement.     

Self-reinforcement

Self-reinforcement in operant situations generally refers to those arrangements in which the subject delivers to himself a consequence, contingent on his behavior. However, it is noted that the definition of all other types of reinforcement make its delivery contingent on the subject's behavior. What is actually at issue is the agent who defines whether or not the response required for reinforcement has been met. In self-reinforcement, the subject himself defines this. In the laboratory, this requirement is machine-defined; in school examinations, it is teacher-defined; and in many clinical self-control situations, it is also independently defined. A reinforcement contingency presupposes such independence, absent in self-reinforcement. Implications for research and practice are discussed and alternative formulations are offered.     

A comparison of frequency, interval, and time-sampling methods of data collection

Data representing high, medium, and low response rates in constant and nonconstant patterns were generated by electromechanical equipment to determine whether the same data collected by time-sampling, interval recording, and frequency recording would be represented similarly by each method. Results indicated: (1) that time-sampling provided an extremely inaccurate estimate of responding, and (2) that interval recording accurately represented responding of low and medium rates, but grossly underestimated high-rate responding.     

The effects of instructions, incentive, and feedback on a community problem: dormitory noise

A reinforcement system utilizing instructions, modelling, feedback, and group reinforcement was employed in an attempt to reduce disruptive noise on three university residence halls. A fourth hall received the same treatment program without the reinforcement component. Noise scores were determined by recording the number of discrete noise occurrences over a criterion decibel level. On all four residential floors, noise scores during treatment conditions were lower than initial and final baseline levels. Additionally, periods of noise reduction corresponded to the changing criterion multiple-baseline and reversal designs utilized. Pre- and posttreatment questionnaire responses from the three reinforcement floors paralleled changes in objective noise data. At posttreatment, residents reported less noise disturbance of study and sleep and more control over the noise situation and floor problems in general. These results indicated that a comprehensive behavior-modification treatment package was effective in reducing disruptive noise in university residence halls. Difficulties in data collection and anomalies in the data are discussed. Future directions for field-based behavior-modification research are outlined.     

THE EFFECTIVENESS OF REINFORCEMENT,RESPONSE COST,AND MIXED PROGRAMS ON CLASSROOM BEHAVIORS1

Six elementary school children served as subjects in an experiment comparing the relative effectiveness of (1) token reinforcement, in which children received tokens for attending and for correct arithmetic performance; (2) response cost, in which children received “free” tokens at the start of a period but lost them for inattention and for arithmetic performance below a specified level; and (3) a combination of both token reinforcement and response cost. During training, the six subjects received all three procedures in counterbalanced sequence. The effects of the three procedures were assessed by a within-subject comparison divided into three phases: (i) baseline, (ii) training, (iii) withdrawal of tokens. Introduction of the three token procedures markedly increased the two dependent measures. However, there were no differences across the procedures in the amount of change produced in either attending behavior or arithmetic performance. During baseline, the subjects averaged 29% attending behavior and 6.4 correct problems. These levels increased to 85% for attending behavior and 11.4 correct problems for arithmetic performance during training. Removal of all token procedures significantly decreased attending behavior (to an average of 65%), but produced a nonsignificant reduction in arithmetic performance (to an average of 7.6 correct problems). There was evidence that this lack of differential effects of the three token procedures was not due to an inability to discriminate among them. Furthermore, the subjects were evenly divided in their preference for the three procedures.     

Force and rate relations in responding during variable-interval reinforcement

Four rats responded on one-minute variable-interval schedules with several variations in peak-force of response required for food reinforcement. Measures of peak force and rate were taken for the responses, which were the downward exertions of force against a static force-transducing operandum. The analysis distinguished responses, a generic class of measured behavior, from criterion responses, an operationally specified subclass required for reinforcement. Absolute rate of response showed no systematic change, but the rate of responses meeting a newly required criterion of peak-force invariably increased through changes in the absolute rate of response, the relative-frequency distributions of peak force, or some combination of both. The relative frequency of responses meeting an elevated force criterion during variable-interval reinforcement exceeded that maintained with the same criterion with continuous reinforcement. The requirement of more effortful responding for reinforcement does not necessarily reduce response rate. Conformity of the behavior to the requirement for reinforcement is the salient effect.     

Positive reinforcement and the elimination of reinforced responses

Key pecking was maintained on a fixed-interval schedule while either a differential-reinforcement-of-not-responding or a fixed-time schedule was imposed simultaneously. The lower the time parameter of the not-responding schedule, the lower was the response rate. Similar effects occurred with the fixed-time schedule, if the pigeons had experience with reinforcement for not responding. Otherwise the effects were less orderly, to the extent that rate could reach maximum with the lowest-valued fixed-time schedule. The not-responding and the response-independent schedules had similar effects on rate in experienced pigeons only when the time parameter or nominal frequency of food presentation was considered. When considered in terms of obtained frequency of food presentation, reinforcement of not responding produced larger decrements in rate than did the fixed-time schedule.     

Stimulus control of differential-reinforcement-of-low-rate responding

Five pigeons were given single-stimulus training on an 8-sec differential-reinforcement-of-low-rate schedule followed by steady-state generalization training using 12 wavelength stimuli. Three birds had a high percentage of reinforced responses on the training schedule and flat generalization gradients of total responses. The birds with fewer reinforced responses had much steeper generalization gradients. Generalization gradients plotted as a function of both stimulus wavelength and interresponse time showed that for most birds, stimulus control was restricted to responses with long interresponse times. Responses with very short interresponse times were not under stimulus control and there was some evidence of inhibitory control of short interresponse times. Interresponse-times-per-opportunity functions, plotted as a function of stimulus wavelength, showed that stimulus wavelength controlled the temporal distribution of responses, rather than the overall rate of response. The data indicate that the differential-reinforcement-of-low-rate schedule generates several response categories that are controlled in different ways by wavelength and time-correlated stimuli, and that averaging responses regardless of interresponse-time length obscures this control.     

Alternative response training, differential reinforcement of other behavior, and extinction in squirrel monkeys (Saimiri sciureus)

In Experiment I, (a) extinction, (b) extinction plus reinforcement of a discrete alternative response, and (c) differential reinforcement of other behavior were each correlated with a different stimulus in a three-component multiple schedule. The alternative-response procedure more rapidly and completely suppressed behavior than did differential reinforcement of other behavior. Differential reinforcement of other behavior was slightly more effective than extinction alone. In Experiment II, reinforcement of specific alternative behavior during extinction and differential reinforcement of other behavior were used in two components, while one component continued to provide reinforcement for the original response. Once again, the alternative-response procedure was most effective in reducing responding as long as it remained in effect. However, the responding partially recovered when reinforcement for competing behavior was discontinued. In general, responding was less readily reduced by differential reinforcement of other behavior than by the specific alternative-response procedure.