Suboptimal choice in a percentage-reinforcement procedure: effects of signal condition and terminal-link length.

Pigeons' choice between reliable (100%) and unreliable (50%) reinforcement was studied using a concurrent-chains procedure. Initial links were fixed-ratio 1 schedules, and terminal links were equal fixed-time schedules. The duration of the terminal links was varied across conditions. The terminal link on the reliable side always ended in food; the terminal link on the unreliable side ended with food 50% of the time and otherwise with blackout. Different stimuli present during the 50% terminal links signaled food or blackout outcomes under signaled conditions but were uncorrelated with outcomes under unsignaled conditions. In signaled conditions, most pigeons displayed a nearly exclusive preference for the 100% alternative when terminal links were short (5 or 10 s), but with terminal links of 30 s or longer, preference for the 100% alternative was sharply reduced (often to below .5). In unsignaled conditions, most pigeons showed extreme preference for the 100% alternative with either short (5 s) or longer (30 s) terminal links. Thus, pigeons' choice between reliable and unreliable reinforcement is influenced by both the signal conditions on the unreliable alternative and the duration of the terminal-link delay. With a long delay and signaled outcomes, many pigeons display a suboptimal tendency to choose the unreliable side.     

“DO I HAVE TO BE GOOD ALL DAY?” THE TIMING OF DELAYED REINFORCEMENT AS A FACTOR IN GENERALIZATION

Delayed reinforcement, sometimes delivered just after the setting in which the critical behavior had occurred (Early), and sometimes delivered only after several further settings had been encountered (Late), was used to improve a variety of behaviors in seven preschool children, and to control their generalization. Performance of those behaviors was measured in two classroom settings: the Contingent setting, within which performance of the specified behavior determined the later (Early or Late) reinforcement, and the Generalization setting, in which there were no experimental contingencies, immediate or delayed, for the performance of the same behavior. Performances by all children in the Contingent setting were controlled by delayed reinforcement, whether Early or Late. All children showed consistent generalization from the Contingent setting to the Generalization setting during the Late condition, when reinforcement was delivered at the end of the school day. Generalization did not occur during the Early condition, when reinforcement was provided immediately after the Contingent setting (prior to the Generalization setting), unless that condition had been preceded by a Late condition (as it was for S₆ and S₇). The results suggest that the Late timing of delayed reinforcement was an effective and efficient generalization-promotion technique for performances that did not generalize spontaneously.     

An interresponse time analysis of variable-ratio punishment

An interresponse time analysis was used to study the effects of variable-ratio punishment schedules on the temporal pattern of reinforced responding. Twelve pigeons responded on a baseline variable-interval schedule of food reinforcement. A variable-ratio ten schedule of electric shock punishment was then introduced. The shock intensity was systematically increased to the highest intensity at which responding could be maintained. At this intensity, the mean variable-ratio value was increased and then decreased. Variable-ratio punishment resulted in an increased relative frequency of very short unreinforced interresponse times (response bursting). Increased response bursting accounted for instances of response rate facilitation. In addition, shock was followed by interresponse times of decreasing mean length over the first several responses after shock.     

On the exponent in the "generalized" matching equation

A power function equation between ratios of behavior and ratios of reinforcement rates has been called a generalized form of Herrnstein's (1961) matching law, even without a formal relationship having been shown between the two equations. The present work uses a functional relationship to prove that when ratios of reinforcement are not equivalent to ratios of behavior, and the transform leading to this inequality is consistent for every pair of reinforcement rates, the result is a power function relationship between response and reinforcement ratios. The label “generalized matching equation” for the power function equation is thus validated formally.     

Generalization peak shift in rats under conditions of positive reinforcement and avoidance

Rats were trained to discriminate between two click frequencies. One frequency was associated with either variable-interval food reinforcement (Experiment 1) or free-operant avoidance (Experiment 2). The other frequency was associated with the absence of food in Experiment 1 and the absence of shock in Experiment 2. On a click frequency generalization test, the rats in both experiments showed positive peak shift with the shape of the relative gradients being very similar. This is the first reported instance of peak shift in rats when responding was maintained by an avoidance contingency. Nondifferentially trained controls showed that this shift was due exclusively to associative processes, with nonassociative stimulus factors in themselves apparently making no contribution to increased rates at particular stimulus values. These results show the comparability of appetitive and aversive control and support the position that gradient differences do not result from approach versus avoidance per se.     

Relationship between response rate and reinforcement frequency in variable-interval schedules: III. The effect of d-amphetamine.

Four rats were exposed to variable-interval schedules specifying a range of different reinforcement frequencies. The effects of two doses of d-amphetamine (1.6 and 3.2 mumol/kg) upon performance maintained under each schedule were examined. In the case of each rat, the response rates observed under control conditions (no injection or injection of the vehicle alone) were increasing, negatively accelerated functions of reinforcement frequency, the data conforming closely to Herrnstein's (1970) equation. In each rat, d-amphetamine (3.2 mumol/kg) significantly reduced the value of the constant Rmax, which expresses the theoretical maximum response rate. In each rat, the value of KH, which expresses the reinforcement frequency needed to obtain the half-maximal response rate, was also reduced, although this only achieved statistical significance in the case of one rat. When the proportional change in response rate in the presence of the drug was plotted against the response rate under control conditions on double logarithmic co-ordinates, linear functions of negative slope were obtained; in each rat the slope was steeper and the value of the control response rate at which d-amphetamine exerted no effect was lower in the case of the higher dose (3.2 mumol/kg) than in the case of the lower dose (1.6 mumol/kg).     

Reduction of shock duration as negative reinforcement in free-operant avoidance

Rats were trained on a free-operant procedure in which shock duration was controlled by responses within a limited range of interresponse times. Shocks of 1.6-mA intensity occurred randomly with average density of 10 shocks per minute. As long as interresponse times were 15 seconds or less, any shocks received were at the briefer of two durations (.3 second). Whenever interresponse times exceeded 15 seconds, any shocks received were at the longer duration (1.0 second). For six of eight animals, avoidance responding developed quickly and reached levels of better than 90%. Four yoked animals stopped responding within the first few sessions. Shock duration reduction without change in shock probability or intensity was sufficient for the acquisition and maintenance of avoidance responding.     

Shaping the location of a pigeon's peck: effect of rate and size of shaping steps.

For several pigeons, pecking at particular locations within a ten-inch-wide response area was reinforced by grain presentations. The reinforced locations changed systematically to "shape" response location back and forth across the area. The rate and size of these shifts in reinforced locations were varied in both between-subject and within-subject comparisons to evaluate the influence of these variables on the shaping process. Larger step sizes produced larger shifts in location for all sizes inspected, with all sizes from .5 to 3.0 inches effective in shaping behavior. More rapid steps were approximately as effective as slower steps for all rates of shift inspected from 25 reinforcers to 400 reinforcers per step. These data suggest that shaping peck location proceeds most efficiently with rapid, relatively large shifts in criterion performance.     

THE EFFECTS OF TOKEN REINFORCEMENT ON THE BEHAVIOR OF DELINQUENTS IN COTTAGE SETTINGS1

A token economy designed to modify the behavior of 125 adolescent males committed to a state correctional institution was implemented in the boys' cottages, focusing on social behavior (peer interaction), rule following, and task completion. The program was sequentially introduced in a multiple-baseline design in three independent cottages; a fourth group served as a comparison cottage. Appropriate behavior increased when the token program was introduced in each cottage. Data were collected for 14 months. Thus, the long-term effects of initial behavior change were assessed.     

A PERFORMANCE-BASED LOTTERY TO IMPROVE RESIDENTIAL CARE AND TRAINING BY INSTITUTIONAL STAFF

Two experiments were conducted on four units of a residential facility for the multiply-handicapped retarded in an attempt to improve daily care and training services. Experiment I compared the effects of two procedures in maintaining the work performance of attendants, using an A-B design on two units. One procedure consisted of implementing specific staff-resident assignments, the other consisted of allowing attendants who had met performance criteria to be eligible for a weekly lottery in which they could win the opportunity to rearrange their days off for the following week. Results showed that the lottery was a more effective procedure as measured by the per cent of time attendants engaged in predefined target behaviors, and by their frequency of task completion in several areas of resident care. Experiment II replicated and extended these results to the area of work quality on two additional units, using a multiple-baseline design. The performance lottery was found to be an effective economical procedure that could be implemented by supervisory staff on a large scale.