Time allocation in concurrent schedules: the effect of signalled reinforcement

The responses of five pigeons were reinforced on concurrent variable-interval variable-interval reinforcement schedules in which changeover key responses changed the stimulus and reinforcement schedules associated with the food key. While the reinforcement availability in one component remained unchanged throughout the experiment, the reinforcement availability in the other component was, during several conditions, signalled by the onset of an additional discriminative stimulus. During unsignalled conditions, both the relative frequency of responding and the relative time spent in each component approximated the obtained relative reinforcement frequency in each component. The effect of signalling reinforcer availability in one component was to (1) reduce responding in the signalled component to near-zero levels, and (2) increase the relative time in the unsignalled component, without a corresponding increase in the obtained relative reinforcement frequency. The magnitude of the increase in relative time in the unsignalled component decreased as the overall frequency of reinforcement increased. This deviation in the matching relation between relative time and the obtained relative reinforcement frequency was eliminated if the overall reinforcement frequency was increased before the signal was introduced and then, without removing the signal, gradually reduced.     

Response and time allocation in concurrent second-order schedules

Six pigeons were trained on two-key concurrent variable-interval schedules in which the required response was the completion of a fixed number of key pecks. When the required number of pecks was equal on the two keys, response- and time-allocation ratios under-matched obtained reinforcement rate ratios. A similar result was found when the required number of pecks was unequal, except that performance, measured in response terms, was biased to the shorter required number of pecks and was less sensitive to reinforcement-rate changes. No such differences were found in the data on time spent responding. When the variable-interval schedules were kept constant and the required numbers of pecks were systematically varied, response ratios changed inversely with the ratio of the required number of pecks, but time-allocation ratios varied directly with the same independent variable. Thus, on response measures, pigeons “prefer” the schedule with the smaller peck requirement, but on time measures they “prefer” the schedule with the larger peck requirement. This finding is inconsistent with a commonsense notion of choice, which sees response and time-allocation measures as equivalent.     

Preference for reinforcers under progressive- and fixed-ratio schedules: a comparison of single and concurrent arrangements

Progressive-ratio (PR) schedules were used to identify the break point (i.e., the last schedule value completed) for 2 reinforcers under single and concurrent schedules. After the respective break points were established, the same reinforcers were presented under concurrent fixed-ratio (FR) schedules that were yoked to the break points obtained with the PR schedules. Results suggested that the participants responded more for the high-preference item than for the low-preference item, regardless of the presentation arrangement (single or concurrent presentations). This pattern of responding was maintained when the reinforcers were presented under dissimilar FR schedules. The results suggest that responding for differentially preferred stimuli may vary as a function of differences in schedule requirements.     

Interaction of reinforcement schedules, a behavioral prosthesis, and work-related behavior in adults with mental retardation

The effects of variable-interval (VI) and fixed-ratio (FR) schedules of reinforcement for work-related behavior and an organizer for the work materials (behavioral prosthesis) were evaluated with 3 adults with severe or profound mental retardation. The participants had been recommended for study because of high rates of off-task and aberrant behavior in their daily vocational training programs. For 2 participants, VI and FR schedules resulted in the same outcome: more aberrant behavior than on-task and off-task behavior combined. The FR schedule nearly eliminated emission of aberrant and off-task behavior by the 3rd participant. Combining the behavioral prosthesis with FR reinforcement (FR+O) increased the proportion of time spent in on-task behavior by all participants under certain FR schedule parameters. Second-by-second analyses of the observation records revealed that FR schedules reduced off-task and aberrant behavior during work sequences (i.e., ratio runs), and FR+O led to a further reduction of these behaviors during postreinforcement pauses. Overall, the results show how organizer and schedule parameters can be adjusted to produce an optimized balance between productivity and reinforcement while undesirable behavior is minimized.     

Sensitivity to reinforcement in concurrent arithmetic and exponential schedules

The generalized matching law states that the logarithm of the ratio of responses emitted or time spent responding in concurrent variable-interval schedules is a linear function of the logarithm of the ratio of reinforcements obtained. The slope of this relation, sensitivity to reinforcement, varies about 1.0 but has been shown to be different when obtained in different laboratories. The present paper analyzed the results from 18 experiments on concurrent variable-interval schedule performance and showed that response-allocation sensitivity to reinforcement was significantly smaller when arithmetic, rather than exponential, progressions were used to produce variable-interval schedules. There were no differences in time-allocation sensitivity between the two methods of constructing variable-interval schedules. Since the two laboratories have consistently used different methods for constructing variable-interval schedules, the differences in obtained sensitivities to reinforcement are explained. The reanalysis suggests that animals may be sensitive to differences in the distribution of reinforcements in time.     

Neurochemical changes correlated with behavior maintained under fixed-interval and fixed-ratio schedules of reinforcement.

Key pecking of 4 pigeons was maintained under a multiple 3-min fixed-interval, 30-response fixed-ratio schedule of food presentation. Only one schedule was in effect during an experimental session, and each was correlated with a different keylight stimulus and location (left vs. right). The different schedule components alternated across days or weeks. Cerebrospinal fluid was collected from chronically implanted intracerebroventricular cannulae following sessions with the different schedules, as well as following sessions in which reinforcement was withheld (extinction), when response-independent food was delivered, and when the experimental chamber was dark and there were no scheduled events. Metabolites of the neurotransmitters serotonin, norepinephrine, and dopamine were assayed in cerebrospinal fluid using high-performance liquid chromatography with electrochemical detection. Compared to the fixed-ratio condition, responding maintained under the fixed-interval schedule resulted in consistently higher levels of the serotonin metabolite 5-hydroxyindoleacetic acid and of the dopamine metabolite homovanillic acid in all pigeons. Levels of 3-methoxy-4-hydroxyphenylethylene glycol, a metabolite of norepinephrine, and dihydroxyphenylacetic acid, another dopamine metabolite, were also higher in 3 of the 4 pigeons following exposure to the fixed-interval schedules when compared to levels of these metabolites after exposure to the fixed-ratio schedule. Extinction of fixed-ratio responding resulted in large increases in 5-hydroxyindoleacetic acid compared to levels of this metabolite under the fixed-ratio schedule, whereas this serotonin metabolite decreased during extinction of responding under the fixed-interval schedule. Control procedures suggested that the neurochemical changes were not related to the rate of responding but were a function of the specific experimental conditions. Distinctive neurochemical changes that accompany schedule-controlled responding show the sensitivity of the neurochemical environment to behavioral contingencies and demonstrate further the profound impact that such contingencies have on biobehavioral processes.     

Oral self-administration of pentobarbital by rhesus monkeys: relative reinforcing effects under concurrent fixed-ratio schedules.

During daily 3-hr sessions, orally delivered pentobarbital solutions and water, or two separate pentobarbital solutions, were concurrently available to rhesus monkeys according to fixed-ratio schedules of mouth contacts with a spout. First water, and then each of four "comparison-concentration" pentobarbital solutions (0.0625, 0.25, 1, and 4 mg/mL), was successively available from one spout for a block of sessions under a fixed-ratio-64 (three monkeys) or fixed-ratio-16 (one monkey) schedule. Under an identically sized fixed-ratio schedule, deliveries of a "standard-concentration" pentobarbital solution were concurrently available from a second spout. The concentration of the standard solution remained unchanged throughout testing of the series of comparison solutions. Each of three pentobarbital concentrations (4, 1, and 0.25 mg/mL) in turn served as the standard concentration. Within each pair of concurrently available solutions, the higher drug concentration maintained more behavior than the lower concentration. Thus when monkeys were provided with concurrent access to different pentobarbital concentrations, relative reinforcing effects were directly related to drug concentration. Further, the amount of behavior maintained by a particular drug concentration was dependent on the concentration of the concurrently available drug solution. Thus, the relative effectiveness of a reinforcer in maintaining behavior is a function of both the reinforcer's magnitude and the availability of alternative reinforcers in the environment.     

Choice between sequences of fixed-ratio schedules: effects of ratio values and probability of food delivery.

Pigeons were exposed to schedules of food delivery that consisted of two sequential fixed ratios. When alternative sequences provided two food deliveries per 50 responses, the schedule with the shorter initial fixed-ratio value was consistently preferred. Progressively reducing from 1.0 to .25 the probability of food delivery following completion of the second fixed ratio of the sequence with the shorter initial fixed ratio did not reduce preference for this sequence. Moreover, the sequence with the shorter initial fixed ratio also was preferred when the probability of food delivery following completion of the initial ratio in that sequence was progressively reduced from 1.0 to .5, although preference shifted to the alternative when the probability was reduced to 0. These findings suggest that the length of the initial fixed ratio was a primary determinant of choice. Subsequent manipulations demonstrated, however, that when the initial fixed ratios of the two alternatives were equal, changes in the ratio value and probability of food delivery following completion of the second fixed ratio lawfully affected choice.     

Matching and maximizing with concurrent ratio-interval schedules.

Animals exposed to standard concurrent variable-ratio variable-interval schedules could maximize overall reinforcement rate if, in responding, they showed a strong response bias toward the variable-ratio schedule. Tests with the standard schedules have failed to find such a bias and have been widely cited as evidence against maximization as an explanation of animal choice behavior. However, those experiments were confounded in that the value of leisure (behavior other than the instrumental response) partially offsets the value of reinforcement. The present experiment provides another such test using a concurrent procedure in which the confounding effects of leisure were mostly eliminated while the critical aspects of the concurrent variable-ratio variable-interval contingency were maintained: Responding in one component advanced only its ratio schedule while responding in the other component advanced both ratio schedules. The bias toward the latter component predicted by maximization theory was found.     

Using concurrent reinforcement schedules and prompts to produce varied manding: A replication of Seaver and Bourret (2020)

Deficits in social communication and restricted, repetitive patterns of behavior or interests are displayed by individuals with autism spectrum disorder (ASD; American Psychiatric Association, 2013). Given this, individuals with ASD may engage with a limited variety of reinforcers. Treatments designed to modify the distribution of manding may allow individuals to contact a broad array of reinforcers that could improve the quality of life for individuals with ASD (Seaver & Bourret, 2020). The purpose of the current study was to replicate the results of Seaver and Bourret (2020) by evaluating the effects of manipulating concurrent schedules of reinforcement, alone and with prompts, on the rates of target manding in three boys with ASD, aged 7–9 years, in the United Arab Emirates. All three participants showed increased target manding following intervention. The findings support the use of concurrent reinforcement schedules and prompts as an effective intervention to produce varied manding.     

Resistance to reinforcement change in multiple and concurrent schedules assessed in transition and at steady state

Behavioral momentum theory relates resistance to change of responding in a multiple-schedule component to the total reinforcement obtained in that component, regardless of how the reinforcers are produced. Four pigeons responded in a series of multiple-schedule conditions in which a variable-interval 40-s schedule arranged reinforcers for pecking in one component and a variable-interval 360-s schedule arranged them in the other. In addition, responses on a second key were reinforced according to variable-interval schedules that were equal in the two components. In different parts of the experiment, responding was disrupted by changing the rate of reinforcement on the second key or by delivering response-independent food during a blackout separating the two components. Consistent with momentum theory, responding on the first key in Part 1 changed more in the component with the lower reinforcement total when it was disrupted by changes in the rate of reinforcement on the second key. However, responding on the second key changed more in the component with the higher reinforcement total. In Parts 2 and 3, responding was disrupted with free food presented during intercomponent blackouts, with extinction (Part 2) or variable-interval 80-s reinforcement (Part 3) arranged on the second key. Here, resistance to change was greater for the component with greater overall reinforcement. Failures of momentum theory to predict short-term differences in resistance to change occurred with disruptors that caused greater change between steady states for the richer component. Consistency of effects across disruptors may yet be found if short-term effects of disruptors are assessed relative to the extent of change observed after prolonged exposure.     

Extended pausing by humans on multiple fixed-ratio schedules with varied reinforcer magnitude and response requirements

We conducted three experiments to reproduce and extend Perone and Courtney's (1992) study of pausing at the beginning of fixed-ratio schedules. In a multiple schedule with unequal amounts of food across two components, they found that pigeons paused longest in the component associated with the smaller amount of food (the lean component), but only when it was preceded by the rich component. In our studies, adults with mild intellectual disabilities responded on a touch-sensitive computer monitor to produce money. In Experiment 1, the multiple-schedule components differed in both response requirement and reinforcer magnitude (i.e., the rich component required fewer responses and produced more money than the lean component). Effects shown with pigeons were reproduced in all 7 participants. In Experiment 2, we removed the stimuli that signaled the two schedule components, and participants' extended pausing was eliminated. In Experiment 3, to assess sensitivity to reinforcer magnitude versus fixed-ratio size, we presented conditions with equal ratio sizes but disparate magnitudes and conditions with equal magnitudes but disparate ratio sizes. Sensitivity to these manipulations was idiosyncratic. The present experiments obtained schedule control in verbally competent human participants and, despite procedural differences, we reproduced findings with animal participants. We showed that pausing is jointly determined by past conditions of reinforcement and stimuli correlated with upcoming conditions.     

Well-being of mothers of children with mental retardation: An evaluation of the Double ABCX model in a cross-cultural context

The present study was designed to compare the psychological well-being of mothers of children with mental retardation in the USA and Korea. The Double ABCX model of stress proposed by McCubbin and Patterson (1983) was evaluated for the two national groups. Thirty-eight American and 40 Korean mothers participated in the home-visit interview. The path models in the present study partially supported the ABCX model, but different path models for the two national groups provided important explanations for the well-being of mothers from the two nations. The cause of stress for the American mothers was specific to the individual variables. For Korean mothers, cultural values that carry social influence were more strongly associated with their attitudes towards the child and their experience of stress.     

Community-based instruction for independent meal preparation by adults with profound mental retardation

Three adults with profound mental retardation and very limited reading skills were transitioned to community living after spending more than 20 years in a residential facility. Community-based instruction was used to teach them to independently prepare meals. Directed rehearsal and prompting procedures were used to teach them those meal preparation skills that they were unable to perform independently. We present assessment, training and followup data on the preparation of a dessert by the three participants. Following an assessment on the steps needed to prepare the dessert, training was introduced in a multiple baseline across subjects design. Results showed that the participants were able to independently prepare the dessert in up to 21 pre-training and training sessions. Monthly followup for six months showed that they were able to independently prepare the dessert in various community settings of their choice.     

Teaching simple addition to children with mental retardation using a microcomputer

Computer assisted instruction (CAI) was used for improving the efficiency of simple addition (single-digit without carrying) computation in three children with mental retardation. The training program, conducted on a portable personal computer, consisted of demonstrations and repetitive practices on simple addition presented in a vertical format. A number of behavioral instruction techniques such as direct feedback, corrective demonstration, verbal association, and token reinforcement were also included. To evaluate the effects of the CAI package, a multiple-baseline across subjects design with followup was employed. Results showed that performances of children improved with training and were maintained at 1-week, 4-week, and 12-week followups. Generalization of the learned skills was evident when children were assessed on a paper-and-pencil addition test in a vertical format. The skills were also transferable, with initial prompting, to a computerized addition test in a horizontal format. These findings reaffirmed the applicability of CAI and behavioral techniques for teaching math skills to children with mental retardation.     

Choice in transition: Replication and extension to preschool children in a naturalistic setting

This study replicated previous basic research into the dynamics of choice and extended this analysis to children's behavior in a naturalistic setting. Two preschoolers with disabilities were observed interacting with their teachers at baseline and during an experimental analysis involving four pairs of concurrent variable‐interval schedules of adult attention implemented by an experimenter. Each child was exposed to four experimental phases in which the relative reinforcer rates for on‐ and off‐task behavior were 10:1, 1:1, 1:10, and reversed back to 10:1. The 10:1 phase was designed to mimic the same schedules and types of adult attention observed at baseline. We used the generalized matching equation to model steady‐state behavior at the end of the transition phases and to evaluate changes in sensitivity at various points throughout the phases. Choice in transition was evaluated by plotting log behavior ratios by session, cumulated time on‐ and off‐task and cumulated attention for on‐ and off‐task behavior by session, and interreinforcer behavior ratios following different sequences of the first four reinforcer deliveries. The generalized matching equation accounted for a large proportion of variance in steady‐state responding, sensitivity values increased steadily throughout the phases, patterns of choice in transition were similar to those reported in basic research, and interreinforcer preference generally shifted toward the just‐reinforced alternative. These findings are consistent with previous basic research and support the generality of the dynamics of choice to children's on‐ and off‐task behavior reinforced by adult attention.     

Evaluation of a sexual abuse prevention program for adults with mental retardation.

Programs to teach sexual abuse prevention skills to persons with mental retardation have rarely been evaluated empirically, and typical evaluations are limited to assessment of the participants' knowledge rather than their performance of specific skills. In the present study, 6 adult women with mental retardation were trained in sexual abuse prevention, and performance was assessed using four separate measures: pretests and posttests of knowledge, verbal report, role play, and naturalistic probes. All women learned the skills but failed to exhibit them to criterion during the probes. We discuss the implications for further training and assessment of sexual abuse prevention skills.     

Assessing choice-making and preference in adults with profound mental retardation across community and center-based settings

We examined choice and preference in four adults with profound mental retardation within the context of a community-based and center-based location. Prior to the preference analysis, an independent selecting response was empirically assessed and validated for each adult. Results of the preference analysis showed that in the community site there was a higher cumulative frequency of choice-making responses towards beverages for all participants, and an indication of beverage preference for two of the four participants. Conversely, in the center-based setting, there were fewer responses made towards the beverages, and no indication of preference for any of the four adults. These results remained consistent during maintenance checks at 2, 4, 6, and 8 weeks post-intervention.     

Rate-decreasing effects of the atypical neuroleptic risperidone attenuated by conditions of reinforcement in a woman with mental retardation

Effects of two doses of risperidone on the performance of a matching task under tangible reinforcement and nonreinforcement conditions were measured in a woman with mental retardation. In both conditions, time to complete the task increased and response rates decreased under two doses of risperidone. Accuracy was generally unchanged. These changes were much smaller in the tangible reinforcement condition; thus, reinforcement seemed to protect performance from the rate-decreasing effects of risperidone.     

Self-control in children with autism: response allocation during delays to reinforcement.

This study examined the use of a progressive‐delay schedule of reinforcement to increase self‐control and decrease disruptive behavior in children with autism. When initially given the choice between an immediate smaller reinforcer and a larger delayed reinforcer, all participants chose the smaller reinforcer. When access to the larger reinforcer required either no activity or engaging in a concurrent task during the delay, all participants demonstrated both self‐control and preference for a response requirement. Disruptive behavior decreased during delays that required a concurrent task compared to sessions without an activity requirement.