Preference for unreliable reinforcement in children with mental retardation: the role of conditioned reinforcement

We examined the effects of conditioned reinforcement on children's choice between reliable (100%) and unreliable (50%) reinforcement under various stimulus conditions in a concurrent-chains procedure. The study was conducted across three experiments. Experiments 1 and 2 were conducted under conditions similar to basic laboratory work and consisted of participants selecting from one of two black boxes (placed on a table) that were correlated with different reinforcement schedules. In Experiment 3, we assessed a participant's preference for unreliable reinforcement during conditions in which the target responses were aggression and mands. Results of the three experiments showed that the participants preferred unreliable reinforcement under certain conditions. Findings are discussed regarding the role of specific stimuli (i.e., items correlated with a reinforcement schedule, adult reactions) as conditioned reinforcers and how they may influence children's preference for a response (e.g., aggression, self-injury) that produces reinforcement on a leaner schedule than a socially desirable response (e.g., mands).     

The effects of delayed physical prompts and reinforcement on infant sign language acquisition

Researchers and clinicians have recommended that sign language be taught to typically developing children during their first 2 years of life; however, existing research does not provide adequate information regarding appropriate methods of sign training. We used delayed physical prompting and reinforcement to teach manual signs to 3 children between the ages of 6 and 13 months. Data were collected on the occurrence of prompted and independent signs as well as crying. Sign training was successful in producing independent signing in all 3 children in under 4 hr of training per child.     

Effects of reinforcer probability, delay, and response requirements on the choices of rats and pigeons: possible species differences

In Experiment 1 with rats, a left lever press led to a 5-s delay and then a possible reinforcer. A right lever press led to an adjusting delay and then a certain reinforcer. This delay was adjusted over trials to estimate an indifference point, or a delay at which the two alternatives were chosen about equally often. Indifference points increased as the probability of reinforcement for the left lever decreased. In some conditions with a 20% chance of food, a light above the left lever was lit during the 5-s delay on all trials, but in other conditions, the light was only lit on those trials that ended with food. Unlike previous results with pigeons, the presence or absence of the delay light on no-food trials had no effect on the rats' indifference points. In other conditions, the rats showed less preference for the 20% alternative when the time between trials was longer. In Experiment 2 with rats, fixed-interval schedules were used instead of simple delays, and the presence or absence of the fixed-interval requirement on no-food trials had no effect on the indifference points. In Experiment 3 with rats and Experiment 4 with pigeons, the animals chose between a fixed-ratio 8 schedule that led to food on 33% of the trials and an adjusting-ratio schedule with food on 100% of the trials. Surprisingly, the rats showed less preference for the 33% alternative in conditions in which the ratio requirement was omitted on no-food trials. For the pigeons, the presence or absence of the ratio requirement on no-food trials had little effect. The results suggest that there may be differences between rats and pigeons in how they respond in choice situations involving delayed and probabilistic reinforcers.     

Effects of Interspersing Additional Brief Math Problems on Student Performance and Perception of Math Assignments: Getting Students to Prefer to Do More Work

Three experiments were conducted to assess the effects of the interspersing procedure on students' mathematics performance, perceptions of mathematics assignments, and preference for mathematics assignments when more work was added. In Experiment I, college students worked computation problems from two assignments. The control assignment contained 15 three-digit by two-digit problems (3 × 2) and the experimental assignments contained 18 3 × 2 problems and 6 additional interspersed one-digit by one-digit problems (1 × 1). Students then rated the assignments and chose one for homework. Results showed significantly more students preferred (i.e., chose it for homework) the experimental assignment with the additional target (i.e., 3 × 2) and interspersed problems. Furthermore, significantly more students rated this experiment as requiring less effort and being less difficult. Moreover, students' mathematics performance was not affected by the procedure. Experiment II strengthened the internal validity by showing that students did not prefer the experimental assignment because it contained more target problems. Experiment III showed that the interspersing procedure was not powerful enough to extend findings beyond the 20% level (i.e., 40 and 60% more conditions). Results showed how the interspersing procedure could be used to encourage students to choose to do more target computation tasks. Discussion focuses on the applied value of the interspersing procedure and plausible causal mechanisms that may account for current and past findings related to student choice and interspersing brief tasks.     

TIME DELAY: A TECHNIQUE TO INCREASE LANGUAGE USE AND FACILITATE GENERALIZATION IN RETARDED CHILDREN

Institutional breakfast-serving procedures were manipulated to assess what effect changes in that aspect of the environment would have on requests for food. During baseline, six severely retarded children were required to pick up their food trays and return to their seats. The first manipulation, delaying the giving of the food tray for 15 seconds, served as a cue to evoke meal requests by three of the six children. Two of the remaining three required a model of an appropriate meal request (i.e., “Tray, please.”) at the end of the 15-second delay before they began requesting their meals. To evoke meal requests from the sixth child, an intensive training procedure, consisting of massed trials of delay and modeling, was required. Three different probes were administered to assess generalization across the people serving the meals, across mealtimes, and across both people and mealtimes. Typically, generalized responding in these new situations could be prompted by use of the 15-second delay procedure. Functional aspects of the delay procedure and its potential usefulness for evoking speech and facilitating generalization are discussed.     

Choice in a "self-control" paradigm: effects of a fading procedure

Pigeons chose between an immediate 2-second reinforcer (access to grain) and a 6-second reinforcer delayed 6 seconds. The four pigeons in the control group were exposed to this condition initially. The four experimental subjects first received a condition where both reinforcers were delayed 6 seconds. The small reinforcer delay was then gradually reduced to zero over more than 11,000 trials. Control subjects almost never chose the large delayed reinforcer. Experimental subjects chose the large delayed reinforcer significantly more often. Two experimental subjects showed preference for the large reinforcer even when the consequences for pecking the two keys were switched. The results indicate that fading procedures can lead to increased “self-control” in pigeons in a choice between a large delayed reinforcer and a small immediate reinforcer.     

Performance of rats under concurrent variable-interval schedules of negative reinforcement

The behavior of rats under concurrent variable-interval schedules of negative reinforcement was examined. A single one-minute variable-interval programmer determined the availability of 30-second timeouts from electric shock. These were assigned to one or the other of the two component schedules with a probability of 0 to 1.0. The response requirement for the component schedules was standing to the right or left of the center of the experimental chamber. With a six-second changeover delay, the relative time spent under one component schedule varied directly and linearly with the relative number of timeouts earned under that component schedule. The absolute number of changeovers was highest when a similar number of timeouts was earned under each component schedule, and lowest when all or nearly all timeouts were earned under one component schedule. In general, these relations are similar to those reported with concurrent variable-interval schedules of positive reinforcement.     

Effects on choice of reinforcement delay and conditioned reinforcement

Pigeons chose between fixed-interval schedules of different durations presented in the terminal links of concurrent-chains schedules. The pair of schedules was always in the ratio of 2:1, but the absolute duration of the fixed intervals varied. In one set of conditions, the different terminal-link schedules were associated with different keylight stimuli (cued conditions). In a second set of conditions, the different terminal-link schedules were associated with the same stimulus (uncued conditions). Results from the cued conditions replicated previous findings that preference for the shorter fixed-interval schedule increased with fixed-interval duration. Preferences in the uncued conditions were lower than in the corresponding cued conditions but also increased with fixed-interval length. In addition, the degree of control under the uncued conditions was correlated with the extent to which the schedule during the terminal link was discriminated immediately upon entry into the terminal link. The pattern of results in both conditions was inconsistent with the notion that choice behavior matches relative immediacy of reinforcement. Reanalysis of previous evidence for matching (Chung and Herrnstein, 1967) showed that matching in fact did not occur, as the preferences of their subjects for the shorter of two delays also increased with the absolute size of the delays.     

Local response-rate constancy on concurrent variable-interval schedules of reinforcement

Concurrent variable-interval schedules were arranged with a main key that alternated in color and schedule assignment, along with a changeover key on which a small fixed ratio was required to changeover. Acceptable matching was observed with pigeons in two replications, but there was a tendency toward overmatching. Local response rates were found to differ for unequal schedules of a concurrent pair: local response rate was greater for the variable-interval schedule with the smaller average interreinforcement interval, but qualifications based on an interresponse-time analysis were discussed. In a second experiment, two 3-minute variable-interval schedules were arranged concurrently, and the experimental variable was the changeover procedure: either a changeover delay was incurred by each changeover or a small fixed ratio on a changeover key was required to complete a changeover. Changeover delays of 2 and 5 seconds were compared with a fixed-ratio changeover of five responses. The response output on the main key (associated with the variable-interval schedules) was greater when a changeover delay was arranged than when a fixed ratio was required to changeover. A detailed analysis of stripchart records showed that a 2-second delay generated an increased response rate for 3 seconds after a changeover, while the fixed-ratio requirement generated an increased rate during the first second only, followed by a depressed response rate for 2 seconds.