A CLASSIFICATION SCHEME OF SOCIAL CONDITIONS OF REINFORCEMENT WITHIN GROUP OPERANT SYSTEMS1

Many different reinforcement contingencies are found in group operant systems, such as token economies and point systems. Some systems use group contingencies in which the reinforcement of any one participant may depend on the behavior of some other group member. Other programs are individual, in that participants earn reinforcers dependent only on their own behavior. The various possible arrangements of people and their response requirements are labelled “social conditions of reinforcement” in this paper. Previous attempts at classification have failed to categorize the variety of social conditions of reinforcement. In addition, some conditions that may produce behaviorally different effects have not been separated. The present paper classifies the social conditions of reinforcement found in applied programs in a three-dimensional scheme. The efficacy of the three major dimensions—reinforcing agent, recipient response requirement, and group response requirement—is supported by clinical and research data. The reinforcing agent dimension refers to the person(s) who dispenses reinforcers to group members. This major dimension is further subdivided: one or several agents may be either designated or nondesignated. Recipients are the group members who receive reinforcement. This dimension is also subdivided: one or several recipients in a social condition of reinforcement may obtain reinforcers either contingently or noncontingently. The group response requirement is a criterion that must be satisfied before any group participant is eligible for reinforcement. Some systems have no group requirement, and others have a group requirement that must be met by some designated or nondesignated participant(s). Supportive references and examples are given in the explanation of each dimension and subdimension. The behavioral impact of the various categories is emphasized. For all major dimensions, applied implications and research suggestions are discussed. Concluding remarks center on the utility of the present scheme, the classification of operant procedures other than positive reinforcement, and both theoretical and applied issues requiring further study (e.g., the long-term effects of participation in group contingencies).     

MODIFICATION OF ACTIVITY LEVEL THROUGH BIOFEEDBACK AND OPERANT CONDITIONING1

The biomotometer, an electronic device that simultaneously measures activity and provides auditory feedback to the subject, was used in combination with material reinforcers in two experiments attempting to modify activity level in children. In the first study the activity level of an 11-year-old highly active boy was decreased below mean baseline during conditioning in a classroom setting. His level of activity returned to baseline when feedback was withdrawn. In the second study, activity level of a 10-year-old hypoactive boy was increased over mean baseline level during conditioning in a free-play setting, and returned to slightly below baseline during five extinction trials. Results of these studies indicate that the biomotometer is a useful instrument for modification of activity level.     

The matching law in and within groups of rats

In each of the two experiments, a group of five rats lived in a complex maze containing four small single-lever operant chambers. In two of these chambers, food was available on variable-interval schedules of reinforcement. In Experiment I, nine combinations of variable intervals were used, and the aggregate lever-pressing rates (by the five rats together) were studied. The log ratio of the rates in the two chambers was linearly related to the log ratio of the reinforcement rates in them; this is an instance of Herrnstein's matching law, as generalized by Baum. Summing over the two food chambers, food consumption decreased, and response output increased, as the time required to earn each pellet increased. In Experiment II, the behavior of individual rats was observed by time-sampling on selected days, while different variable-interval schedules were arranged in the two chambers where food was available. Individual lever-pressing rates for the rats were obtained, and their median bore the same “matching” relationship to the reinforcement rates as the group aggregate in Experiment I. There were differences between the rats in their distribution of time and responses between the two food chambers; these differences were correlated with differences in the proportions of reinforcements the rats obtained from each chamber.     

Acquisition of a spatially defined operant with delayed reinforcement.

Two experiments investigated the role of an immediate, response-produced auditory stimulus during acquisition, via delayed reinforcement, of a response selected to control for possible unprogrammed, operandum-related sources of response feedback. Experimentally naive rats were exposed to a delayed-food reinforcement condition, specifically a tandem fixed-ratio 1 differential-reinforcement-of-other-behavior 30-s schedule. The response was defined as breaking a photocell beam located near the ceiling at the rear of the operant conditioning chamber. In Experiment 1, rates of photobeam breaking by each rat increased from near zero, regardless of the presence or absence of a tone that immediately followed the response initiating the delay interval. Though not essential, the tone facilitated response acquisition and resulted in more efficient response patterns at stability. Experiment 2 demonstrated that photobeam-breaking response rates under the delayed reinforcement contingency exceeded those in a preceding baseline condition in which no food was delivered. In addition, upon introduction of the delayed reinforcement procedure, correspondence between response patterns and the requirements of the reinforcement schedule increased over baseline levels in the absence of a food contingency. Together with a previous report of Lattal and Gleeson (1990), the present results suggest that response acquisition with delayed reinforcement is a robust phenomenon that may not depend on a mechanically defined response or an immediate external stimulus change to mediate the temporal gap between response and reinforcer.     

Resurgence as Choice in Context: Treatment duration and on/off alternative reinforcement

Resurgence as Choice (RaC) is a quantitative theory suggesting that an increase in an extinguished target behavior with subsequent extinction of an alternative behavior (i.e., resurgence) is governed by the same processes as choice more generally. We present data from an experiment with rats examining a range of treatment durations with alternative reinforcement plus extinction and demonstrate that increases in treatment duration produce small but reliable decreases in resurgence. Although RaC predicted the relation between target responding and treatment duration, the model failed in other respects. First, contrary to predictions, the present experiment also replicated previous findings that exposure to cycling on/off alternative reinforcement reduces resurgence. Second, RaC did a poor job simultaneously accounting for target and alternative behaviors across conditions. We present a revised model incorporating a role for more local signaling effects of reinforcer deliveries or their absence on response allocation. Such signaling effects are suggested to impact response allocation above and beyond the values of the target and alternative behaviors as longer-term repositories of experience. The new model provides an excellent account of the data and can be viewed as an integration of RaC and a quantitative approximation of some aspects of Context Theory.     

Safe periods both explain and need explaining.

Dinsmoor's (2001) stress on the response‐produced safe period as a reinforcer for avoidance behavior is a positive contribution, even though several questions about such safe periods remain to be answered.     

Effects of treatment‐integrity failures on a response‐cost procedure

Effects of incorrect or partial implementation (poor treatment integrity) on response cost are largely unknown. We evaluated reduced treatment integrity during response cost on rates of 2 concurrently available responses. College students earned points by clicking on either a black circle or a red circle on a computer screen. Experiment 1 compared 2 types of treatment‐integrity failures (omission and commission errors) across 2 levels of integrity (20% and 50%). Compared to 100% integrity conditions, omission errors did not suppress responding to the same extent, and commission errors reduced target responding but also decreased rates of alternative behavior. Experiment 2 compared the effects of 20% and 50% omission errors within subjects. Implementation at 50% integrity adequately suppressed responding, but treatment effects were lost at 20% integrity. There may be a critical level at which response cost must be implemented to suppress responding, which has important implications for application.     

The temporal structure of goal-directed and habitual operant behavior

Operant behavior can reflect the influence of goal-directed and habitual processes. These can be distinguished by changes to response rate following devaluation of the reinforcing outcome. Whether a response is goal directed or habitual depends on whether devaluation affects response rate. Response rate can be decomposed into frequencies of bouts and pauses by analyzing the distribution of interresponse times. This study sought to characterize goal-directed and habitual behaviors in terms of bout-initiation rate, within-bout response rate, bout length, and bout duration. Data were taken from three published studies that compared sensitivity to devaluation following brief and extended training with variable-interval schedules. Analyses focused on goal-directed and habitual responding, a comparison of a habitual response to a similarly trained response that had been converted back to goal-directed status after a surprising event, and a demonstration of contextual control of habit and goal direction in the same subjects. Across experiments and despite responses being clearly distinguished as goal directed and habitual by total response rate, analyses of bout-initiation rate, within-bout rate, bout length, and bout duration did not reveal a pattern that distinguished goal-directed from habitual responding.     

Using behavioral economics to optimize safer undergraduate late-night transportation

Many universities sponsor student-oriented transit services that could reduce alcohol-induced risks but only if services adequately anticipate and adapt to student needs. Human choice data offer an optimal foundation for planning and executing late-night transit services. In this simulated choice experiment, respondents opted to either (a) wait an escalating delay for a free university-sponsored “safe” option, (b) pay an escalating fee for an on-demand rideshare service, or (c) pick a free, immediately available “unsafe” option (e.g., ride with an alcohol-impaired driver). Behavioral-economic nonlinear models of averaged-choice data describe preference across arrangements. Best-fit metrics indicate adequate sensitivity to contextual factors (i.e., wait time, preceding late-night activity). At short delays, students preferred the free transit option. As delays extend beyond 30 min, most students preferred competing alternatives. These data depict a policy-relevant delay threshold to better safeguard undergraduate student safety.     

The Project Method of Teaching Psychology: A Rejoinder to Dr. Cason

Unlike word frequency counts—e.g., Thorndike and Lorge—or nonsense syllable norms, the total number of different words scaled in extant norms with free associations is limited, although some words were repeatedly scaled. In order to remedy this situation and broaden the word pool for future research, a new norm for 48 words was obtained by means of free associations in the present study (N = 58 men and women undergraduate students in psychology). Discrete normative free associations were procured for 10 words for the first time by the current norm. For the words previously scaled, whereas there were some noticeable differences, overall substantial consistency was observed between the present and earlier results. Further, a survey of previously available word association norms disclosed useful information and interesting trends in this field.