DIFFERENTIAL REINFORCEMENT OF CORRECT RESPONSES TO PROBES AND PROMPTS IN PICTURE-NAME TRAINING WITH SEVERELY RETARDED CHILDREN

A systematic sequence of prompt and probe trials was used to teach picture names to three severely retarded children. On prompt trials the experimenter presented a picture and said the picture name for the child to imitate; on probe trials the experimenter did not name the picture. A procedure whereby correct responses to prompts and probes were nondifferentially reinforced was compared with procedures whereby correct responses to prompts and probes were differentially reinforced according to separate and independent schedules of primary reinforcement. In Phase 1, correct responses to prompts and probes were reinforced nondifferentially on a fixed ratio (FR) 6 or 8 schedule; in Phase 2, correct responses to prompts were reinforced on the FR schedule and correct responses to probes were reinforced on an FR schedule of the same value; in Phase 3, correct responses to prompts were reinforced on the FR schedule and correct responses to probes were reinforced on a continuous reinforcement (CRF; every correct response reinforced) schedule; in Phase 4, correct responses to prompts were reinforced on a CRF schedule and correct responses to probes were reinforced on the FR schedule; in Phase 5, a reversal to the conditions of Phase 3 was conducted. For all three children, the FR schedule for correct responses to prompts combined with the CRF schedule for correct responses to probes (Phases 3 and 5) generated the highest number of correct responses to probes, the highest accuracy (correct responses relative to correct responses plus errors) on probe trials, and the highest rate of learning to name pictures.     

Some discriminative properties of fixed ratio performance in the pigeon

The discriminative control over a spatial choice response exercised by prior behavior was studied using a procedure involving discrete exposures to a two-member chained schedule. The initial member (red key) was either a smaller or larger fixed ratio (Mix FR:FR), the completion of which produced, after a 1-sec delay, two white response keys. If the larger FR had been completed as the initial chain member, a single peck on the right white key was reinforced; after the smaller FR, a peck on the left white key was reinforced. Frequencies of unreinforced responses (S(Delta) responses) were determined with several pairs of red-key FRs: 95-5, 75-25, 65-35, 60-40, 58-42 and 50-50. The S(Delta) response frequencies were low through the FR pair 65-35; sharp increases were obtained with pairs 60-40 and 58-42. Later, curves analogous to stimulus generalization functions were obtained using a probe procedure. Finally, the delay interval between completion of a red-key FR and the white-key choice response was manipulated: results were variable, but S(Delta) response frequencies tended to increase with increasing delays.     

A Comparison of Error-Correction Procedures Within Audio–Visual Conditional Discrimination Training

Children with autism spectrum disorders (ASD) often emit errors during the establishment of conditional discriminations. These children may not respond to more traditional error-correction procedures, such as least-to-most prompting. In this study, we compared two other types of error-correction procedures, namely embedding an identity-matching task as a differential observing response (DOR; Fisher et al. in J Appl Behav Anal 40:489–499, 2007) compared with a second-order fixed ratio 3/fixed ratio 1 (FR3 FR1) schedule with response cost procedure (Fisher et al. in J Appl Behav Anal 47:738–748, 2014). Results garnered from a multiple baseline design with embedded adapted alternating treatment design components demonstrated that the identity-matching/DOR procedure lead to superior acquisition of conditional discriminations for two boys with ASD. These findings suggest that for audio-conditional discrimination training, the identity-matching/DOR method may be more effective over the second-order FR3 FR1 with response cost approach.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.     

Some effects of methylphenidate on stimulus control of ratio avoidance behavior in the rat

After exposure to an avoidance schedule which included a warning signal, a rat was placed on a multiple schedule in which the first component was the same as before, i.e., a single response reset the response-shock interval, delaying shock, and the second component differed only in that four bar-presses were required to postpone shock. A fixed ratio requirement of four responses (FR 4) generated behavior resembling a fixed ratio requirement of one response (FR 1) since responding was controlled by the warning signal but more shocks were received. At a dosage of 2 mg/kg, methylphenidate given intraperitoneally decreased shock frequency during FR 4 periods while FR 1 behavior was not affected; at 4 mg/kg, stimulus control of avoidance responding was impaired during both components. Results at 4 mg/kg were partially confirmed by two animals exposed to an FR 4 avoidance schedule which included a warning signal but with different parameters. Response distributions showed that methylphenidate increased response rates in the absence of the warning signal, i.e., stimulus control of ratio-avoidance behavior was impaired although the increased response rates reduced shock frequency. One hour later responses again occurred more frequently during the signal than in its absence but shocks were less frequent than during control (non-drug) periods.     

Post-reinforcement pauses and response rate of monkeys on a two-hand fixed-ratio schedule

Fixed-ratio behavior of monkeys was analyzed separately for two hands. While one hand responded on the fixed-ratio schedule the other performed a holding response and the function of the hands changed in alternate ratio runs. After performance was stable on the fixed ratio (70 responses, two monkeys; 100 responses, two monkeys, 120 responses, two monkeys) 90 sessions of further training equalized post-reinforcement pauses and the mean interresponse time of the two hands. Hand preference in reaching for food remained unchanged. Then, the fixed-ratio requirement was changed (a) in small sequential steps, (b) in two large steps, and, (c) within sessions alternating two runs at a high ratio with two runs at a low ratio. The mean duration of post-reinforcement pauses was correlated with a fixed ratio maintained throughout a session but single pauses were neither controlled by the immediately preceding nor by the following ratio run when a cue to its length was available. The mean interresponse time was insensitive to changes in fixed ratio. The fixed-ratio performance was generally similar to that of pigeons and rats.     

Cognitive demands of error processing

This study used a dual-task methodology to assess attention demands associated with error processing during an anticipation-timing task. A difference was predicted in attention demands during feedback on trials with correct responses and errors. This was addressed by requiring participants to respond to a probe reaction-time stimulus after augmented feedback presentation. 16 participants (8 men, 8 women) completed two phases, the reaction time task only and the anticipation-timing task with the probe RT task. False feedback indicating error and a financial reward manipulation were used to increase relevance of errors. Data supported the hypothesis that error processing is associated with higher cognitive demands than processing feedback denoting a correct response. Individuals responded with quicker probe reaction times during presentation of feedback on correct trials than on error trials. These results are discussed with respect to the cognitive processes which might occur during error processing and their role in motor learning.     

A procedure for generating differential "sample" responding without different exteroceptive stimuli

Sidman (1994, 2000) suggested that responses as well as stimuli can join equivalence classes, a hypothesis difficult to test because differential responding typically requires different stimuli. The present experiments describe a procedure with pigeons that avoids this potential confounding effect. In Experiment 1, spacing two responses 3 s apart (a differential-reinforcement-of-low-rate [DRL] schedule) to a white stimulus on some trials produced food or the comparison stimuli in a matching task, whereas pecking 10 or more times with no temporal restrictions (a fixed-ratio [FR] schedule) produced the same effect on other trials. Completing the alternative (unscheduled) requirement terminated the white stimulus and repeated the trial. Following such errors, pigeons learned to switch to the alternative response pattern on the repeat trials. In addition, the correct response pattern functioned as a conditional cue for comparison choice. In Experiment 2, mixed DRL-FR training was preceded by two-sample/two-alternative matching-to-sample with DRL and FR sample-response requirements. In a subsequent transfer test in which the correct response pattern to white served as the sample, pigeons preferentially chose the comparison previously reinforced following that pattern in the baseline task. This "unsignaled response" procedure may be useful for assessing whether differential responses can be members of acquired equivalence classes.     

Observational learning in monkeys

Observer monkeys were housed next to demonstrator monkeys that were conditioned to respond on a multiple reinforcement schedule whose components were fixed-ratio 32, variable-interval 3-min, and extinction 5-min followed by an additional 30 sec of extinction during which every response started a new 30-sec interval. After observational periods from 113 to 210 hr long, during which observers could not perform the response and were given no extrinsic reinforcers, their first-response latencies to fixed ratio and variable interval were as short as the demonstrators; and their rates of responding were well above pre-observational baseline levels. About 8 hr later, a temporal pattern of responding appropriate to the multiple schedule emerged, including non-emission of responses during extinction. Controls lacking the chance to observe did not develop typically patterned responding after 60 hr in one case and, in two other cases, after 80 hr during which, on two occasions, every one of 50 responses was reinforced. In a second experiment, the stimulus lights associated with fixed ratio and variable interval were presented simultaneously. Subjects chose one of the schedules by responding to one of the levers beneath the lights. All subjects initially chose fixed ratio. Seeing the demonstrators switch to variable interval, due to increases in the fixed-ratio requirement, had no effect upon observers, which continued to choose fixed ratio.     

Matching-to-sample accuracy on fixed-ratio schedules.

Pigeons performing on a matching-to-sample procedure were exposed to six fixed-ratio (FR) schedules (FR 1, 5, 10, 20, 40, and 60) of food reinforcement for correct matching responses. During both a correction and a noncorrection procedure without an intertrial interval (ITI), matching accuracy was lower on FR 1 and FR 60 than at intermediate ratios. With the FR 1 schedule, both a 5-sec and a 25-sec ITI resulted in higher matching accuracy than without an ITI; accuracy, with an ITI, was fairly constant for ratios of 1 to 20 but declined at higher ratios. The results suggest that the presence or absence of an ITI in matching to sample may account for inconsistencies obtained in earlier studies of the relationship of matching accuracy to ratio size.     

Predictability,controllability, and inoculation against learned helplessness

Nondepressed human subjects were divided into seven groups. On a series of discrimination problems, a helplessness group received insoluble problems, a solvable group received contingent feedback, and a no treatment control group received no feedback. For two other groups insoluble problems were preceded by success feedback on a different task presented according to a fixed ratio (FR) or variable ratio (VR) schedule of reinforcement. Two control groups received either FR or VR schedules of success but were not examined on the discrimination problems. All groups were tested for escape/avoidance performance on a human shuttle box. Both FR and VR schedules produced an inoculation against learned helplessness; escape performance by the helplessness group was significantly worse than that of FR and VR inoculation groups. These latter groups performed similar to the solvable and three control groups. Significantly worse than that of FR and VR inoculation groups. These latter groups performed similar to the solvable and three control groups. Significantly fewer subjects in the VR inoculation group exhibited avoidance responses than their counterparts in the FR inoculation group. despite similar escape performance. The findings indicate that learned helplessness can be prevented in humans and suggest different sources of interference produced by unpredictable and uncontrollable events.     

An interval scale of saturation for the pigeon

Pigeons were required to discriminate between “identical” vs. “different” pairs of lights in a yes/no signal-detection task with a symmetrical payoff matrix. If the two lights projected on the two halves of the bipartite field constituting the center response key in a three-key chamber were identical in wavelength composition, then a single peck on the left key was reinforced with food. If the two lights differed in wavelength composition, then right-key pecks were reinforced. Each pigeon experienced all possible pairs (55) of 11 lights having the same dominant hue (630 nm) but differing in colorimetric purity. The percentage of correct responses was taken as a measure of the dissimilarity between the two lights constituting a pair. The rank-order information available in these dissimilarity measures was used to determine an interval scale of saturation in the pigeon. Saturation was found to be linearly related to colorimetric purity.     

Cocaine and food as reinforcers: effects of reinforcer magnitude and response requirement under second-order fixed-ratio and progressive-ratio schedules.

Reinforcer magnitude and fixed-ratio requirement were varied under two second-order schedules. Under one, the first sequence of a fixed number of responses completed after the lapse of a 10-min fixed interval produced reinforcement. Under the second, a second-order progressive-ratio schedule, the fixed number of responses increased after each reinforcement. Either cocaine (0 to 300 micrograms/kg/inj) or food (0 to 5,700 mg/delivery) reinforcers were delivered. Under some conditions, a 2-s illumination of stimulus lights occurred on completion of each ratio sequence. Under the second-order schedule, as cocaine dose or amount of food increased, rates of responding increased; at the highest values, rates of responding decreased. Increases in the ratio requirement from 10 to 170 responses minimally decreased overall response rates. Under the second-order progressive-ratio schedule, increases in dose of cocaine or amount of food increased rates of responding; at the highest amounts of food, rates of responding decreased but response rates at the highest dose of cocaine remained relatively high. The highest ratio requirement that was completed (breaking point) depended on the dose of cocaine but was less dependent on the amount of food. Removing brief-stimulus presentations had a greater effect on completion of ratio requirements with cocaine compared to food.     

INFLUENCES ON COCAINE TOLERANCE ASSESSED UNDER A MULTIPLE CONJUNCTIVE SCHEDULE OF REINFORCEMENT

Under multiple schedules of reinforcement, previous research has generally observed tolerance to the rate‐decreasing effects of cocaine that has been dependent on schedule‐parameter size in the context of fixed‐ratio (FR) schedules, but not under the context of fixed‐interval (FI) schedules of reinforcement. The current experiment examined the effects of cocaine on key‐pecking responses of White Carneau pigeons maintained under a three‐component multiple conjunctive FI (10 s, 30 s, & 120 s) FR (5 responses) schedule of food presentation. Dose‐effect curves representing the effects of presession cocaine on responding were assessed in the context of (1) acute administration of cocaine (2) chronic administration of cocaine and (3) daily administration of saline. Chronic administration of cocaine generally resulted in tolerance to the response‐rate decreasing effects of cocaine, and that tolerance was generally independent of relative FI value, as measured by changes in ED50 values. Daily administration of saline decreased ED50 values to those observed when cocaine was administered acutely. The results show that adding a FR requirement to FI schedules is not sufficient to produce schedule‐parameter‐specific tolerance. Tolerance to cocaine was generally independent of FI‐parameter under the present conjunctive schedules, indicating that a ratio requirement, per se, is not sufficient for tolerance to be dependent on FI parameter.     

A comparison of two types of extinction following fixed-ratio training

Five groups of pigeons were food reinforced on various schedules. Half of each group were extinguished in the normal manner; the others were presented with a stimulus change, previously paired with reinforcement, each time they completed their respective fixed ratios. Response rate in training was an increasing negatively accelerated function of the FR. Increasing the FR produced transitory rate changes, the amount of which yielded a quantitative index of ratio strain. Cumulative records of extinction performance revealed that the stimulus change exerted discriminative control by maintaining the cohesiveness of FR response units. Nevertheless, neither the absolute number of extinction responses nor extinction response units differed appreciably for the two extinction procedures.     

Effects of timeout on a discrimination between fixed-ratio schedules

A discrimination was established between two fixed-ratio schedules of reinforcement. In one, fixed ratio 25, the reinforcer was delivered on the twenty-fifth response; on the other, fixed ratio 50, the fiftieth response was reinforced. In the first component of a chain, either fixed ratio 25 or fixed ratio 50 was randomly programmed on the center key of a three-key pigeon box. Reinforcement of a single peck on the side key was contingent upon discriminating which schedule had just been completed on the center key. During test trials, a timeout was introduced after the first response on fixed ratio 25 and after either the first or twenty sixth response on fixed ratio 50. When the timeout followed the first response on fixed ratio 25 and fixed ratio 50, the accuracy of the discrimination was unaffected. When the timeout followed the first response on fixed ratio 25 and the twenty sixth response on fixed ratio 50, the accuracy of the discrimination decreased rapidly to chance as a function of the duration of the timeout. The loss of discrimination was primarily due to errors after fixed ratio 50 was completed. The timeout appears to weaken the control over the choice response by the response-produced stimuli which preceded the timeout. The results are consistent with the interpretation that the discrimination between fixed ratio 25 and fixed ratio 50 is maintained by chaining of response-produced stimuli within the ratio cycle.     

Cooperative responding in rats: II. Performance on fixed-ratio schedules of mutual reinforcement

Coordinated responses of 5 dyads of rats were investigated under fixed-ratio (FR) schedules of mutual water reinforcement. Coordinated responding was defined as 2 consecutive lever-presses, 1 from each of 2 rats, occurring <.5 s apart. In the FR schedules, each coordinated episode was defined as 1 response in the FR sequence. The size of FR schedules was parametrically manipulated assuming the values of FR 1, 6, 12, 18, 24, 30, 50, and 9, in this order. Each FR remained in effect until responding reached stability. Under all conditions, pairs of rats received access to water simultaneously (mutual reinforcement). Rates and proportions of coordinated responding showed a bitonic inverted U-shaped function of ratio size. Postreinforcement pauses increased systematically as the interreinforcement interval increased. Local rates and proportions increased as a function of response location within ratios. Results of a control condition with relaxed temporal constraints for mutual reinforcement showed decreases in rates and proportion of coordinated responses, suggesting that the coordinated responses were controlled by the mutual reinforcement contingencies. The present experiment showed that coordinated responding is quantitatively affected by 3 properties of FR schedules: response requirement, reinforcement rates, and proximity to reinforcement.     

A COMPARISON OF THE EFFECTS OF FIXED AND VARIABLE RATIO SCHEDULES OF REINFORCEMENT ON THE BEHAVIOR OF DEAF CHILDREN

The performance of all five students in an adjustment class for deaf children was compared under fixed and variable ratio schedules of reinforcement. During the fixed ratio (FR) condition, students earned checks if they were attentive and did not engage in disruptive behavior. These checks could be exchanged for the opportunity to draw a prize from a grab bag. During the variable ratio (VR) condition, they earned a draw from the grab bag according to a variable ratio schedule with a mean ratio equal to the value of the preceding FR schedule. During the VR condition, students visually attended more and engaged in disruptive behavior less often than during the FR condition. The number of math problems completed per minute was also higher during the VR condition although no specific consequences were applied to math performance.     

The effect of drugs on a fixed-ratio performance suppressed by a pre–time-out stimulus,

Pecking was reinforced by a fixed-ratio schedule with food, and responses during a red light produced a time out. If the bird did not respond during the red light, the light terminated and the bird could complete the FR schedule of positive reinforcement uninterrupted. The bird stopped responding during the red light sufficiently to avoid most of the possible time outs. In general, the pre–time-out stimulus suppressed responding more when the FR schedule was large than when it was small. The occurrence of the pre–time-out stimulus in the fixed ratio produced FR strain and extreme curvature atypical of normal fixed ratios of this size. Amobarbital, pentobarbital, chlorpromazine, and d-amphetamine injected when the FR performance was strained by the pre–time-out procedure produced marked increases in responding. The drug administration lowered the rate of responding only at larger doses; and then this occurred predominantly just after the injection.     

Perspective-taking ability in bilingual children: Extending advantages in executive control to spatial reasoning

Monolingual and bilingual 8-year-olds performed a computerized spatial perspective-taking task. Children were asked to decide how an observer saw a four-block array from one of three different positions (90°, 180°, and 270° counter-clockwise from the child's position) by selecting one of four responses – the correct response, the egocentric error, an incorrect choice in which the array was correct but in the wrong orientation for the viewer, and an incorrect choice in which the array included an internal spatial error. All children performed similarly on background measures, including fluid intelligence, but bilingual children were more accurate than monolingual children in calculating the observer's view across all three positions, with no differences in the pattern of errors committed by the two language groups. The results are discussed in terms of the effect of bilingualism on modifying performance in a complex spatial task that has implications for academic achievement.