A fixed interval schedule in which the interval is initiated by a response

The fixed interval schedule described requires the animal to initiate every time interval by making a response on a bar other than the one on which it is reinforced. This response, R_A, demarcates the postreinforcement pause (S^R-R_A interval) from the fixed interval pause (R_A-R_B interval) so that these pauses may be measured separately. Twelve rats and three monkeys, working in two-bar Skinner boxes, were trained and stabilized on this schedule. The resulting performances, presented for individual animals, are analyzed in terms of (1) the relative frequencies with which the animal waits various lengths of time between consecutive responses, (2) the relative frequencies with which various rates of responding appear, (3) the change in response rate throughout the fixed interval, (4) the average length of the postreinforcement pause, (5) the relative frequencies with which the animal waits different lengths of time between the R_A and the first R_B, and (6) the average inter-response time as a function of the rank order in the fixed interval of the inter-response time. The joint interpretation of the several measures taken leads to the following conclusions: 1. The probability of an R_B increases throughout the fixed interval. 2. The increase is discontinuous at the first R_B, at which point the probability increases sharply. 3. The frequency distributions of R_A-R_B pauses exhibit three discrete types of behavior with no intermediate cases. 4. The (main) mode of R_A-R_B interval length usually occurs just below the fixed interval requirement.     

Impaired short temporal interval discrimination in a dyslexic adult

The ability to discriminate short temporal intervals was examined in a dyslexic adult (E.C.) and six matched controls. Listeners had to decide whether the second interval was shorter or longer than a standard (target) interval. Each interval was defined as the silent duration between two successive brief tones. Eight target intervals were used, ranging from 100 to 1,200 ms in duration. At each target interval, the differential threshold (DL) for duration was assessed, with the use of an adaptive psychophysical procedure. The results show that E.C.'s differential threshold values were much larger than those of controls. Moreover, the slope estimates covering the duration range from 100 to 800 ms indicated that in comparison to controls, E.C.'s differential threshold increased dramatically as the target duration increased. Thus her timing impairment becomes more pronounced with increasing duration. This timing deficit is consistent with other studies that have found temporal processing deficits associated with dyslexia.     

Effects of schedule of reinforcement on a pentobarbital discrimination in rats.

The purpose of this study was to determine the effects of the schedule of reinforcement on a pentobarbital discrimination in rats. Five rats were trained to discriminate 10 mg/kg pentobarbital from saline under a multiple fixed-interval 180-s fixed-ratio 20 schedule of reinforcement. During both saline and pentobarbital training sessions, subjects emitted a higher percentage of correct responses under the fixed-ratio component as compared to the fixed-interval component of the multiple schedule. Determination of the pentobarbital dose-response curve under the fixed-ratio component resulted in a steep curve characterized by responding on the saline lever at low doses and on the drug lever at higher doses. Under the fixed-interval component, a graded dose-effect curve was produced, with considerable responding on both levers after intermediate doses of pentobarbital. The administration of phencyclidine and MK-801 resulted in an intermediate level of drug-lever responding for some subjects. Administration of d-amphetamine resulted in saline (nondrug) appropriate responding. The results of this study demonstrate that the schedule of reinforcement is a determinant of drug stimulus control, just as it is a determinant of other drug effects.     

Effects of variations in the temporal distribution of reinforcements on interval schedule performance

Pigeons were exposed to variable-interval and fixed-interval schedules and schedules approximating variable-interval and fixed-interval schedules. The probabilities of the variable-interval and fixed-interval components in a mixed fixed-interval variable-interval schedule in Experiment I and the minimum and maximum interreinforcement intervals in Experiment II in a variable-interval schedule were manipulated to create intermediate schedule contingencies and contingencies approximating simple variable-interval or fixed-interval contingencies. Maximal control by time as defined by quantitative indices of the temporal pattern of response occurred as fixed-interval contingencies were approximated and minimal control occurred as variable-interval contingencies were approximated. Changes in the temporal pattern of response were systematically related to changes in the temporal distribution of reinforcements with both procedural definitions for manipulating the temporal distribution of reinforcements.     

Effects of pre-operant running and sucrose concentration on operant wheel running on a fixed interval schedule of reinforcement

Prior research proposed that temporal control over the pattern of operant wheel running on a fixed interval (FI) schedule of sucrose reinforcement is a function of automatic reinforcement generated by wheel running and the experimentally arranged sucrose reinforcement. Two experiments were conducted to assess this prediction. In the first experiment, rats ran for different durations (0, 30, 60, and 180 min) prior to a session of operant wheel running on a FI 120-s schedule. In the second experiment, the concentration of sucrose reinforcement on a FI 180-s schedule was varied across values of 0, 5, 15, and 25%. In Experiment 1, as the duration of pre-operant running increased, the postreinforcement pause before initiation of running lengthened while wheel revolutions in the latter part of the FI interval increased. In Experiment 2, wheel revolutions markedly increased then decreased to a plateau early in the FI interval. Neither manipulation increased temporal control of the pattern of wheel running. Instead, results indicate that operant wheel running is regulated by automatic reinforcement generated by wheel activity and an adjunctive pattern of running induced by the temporal presentation of sucrose. Furthermore, the findings question whether the sucrose contingency regulates wheel running as a reinforcing consequence.     

The contribution of an added counter to a fixed-ratio schedule

Although previous research showed that a visual counter increased the rate of responding on a large fixed-ratio schedule, a theoretical analysis of the factors responsible for fixed-ratio performance suggests that the primary control by number of responses since reinforcement is to weaken the performance. The present experiment employed a multiple schedule in which the same fixed-ratio value alternated with and without an added counter. It tested the hypothesis that the differential reinforcement of high-rate responding masked the attenuation of the fixed-ratio performance from the unoptimal discriminative control produced by the fixed relation between number of responses and reinforcement. In the present experiment the postreinforcement pause was consistently longer in the components with the added counter, while running rates remained comparable between the components of the multiple schedule. Both components of the multiple schedule involved differential reinforcement of high-rate responding while only the components with the added counter amplified the discriminative control by number of pecks since reinforcement.     

Drug discrimination under a concurrent schedule.

Three pigeons were trained to discriminate a 5.0 mg/kg dose of pentobarbital from saline under a two-key concurrent schedule with responding on the key associated with the presession injection, under both stimulus conditions, producing four times as many reinforcers as responding on the other key. This concurrent schedule resulted in approximately 70% responding to the higher reinforcement key under the pentobarbital stimulus and approximately 30% responding to that key under the saline stimulus. During testing, then, the pigeons were able to dose-dependently emit higher (>70%) or lower (<30%) values than were established under the control conditions. Dose-response curves were determined for pentobarbital (twice), methamphetamine, phencyclidine, chlordiazepoxide, and the combination of pentobarbital and the barbiturate antagonist bemegride. The results obtained with pentobarbital and chlordiazepoxide showed that, as the dose increased, pentobarbital-appropriate responding also increased. Methamphetamine produced relatively flat dose--response curves, whereas phencyclidine administration produced inconsistent effects on responding. The combination of the training dose of pentobarbital with increasing doses of bemegride produced a decrease in pentobarbital-appropriate responding. The results also showed that the dose-response curves for pentobarbital and chlordiazepoxide, instead of being all or none, were graded functions of the drug dose.     

Intertrial interval as a contextual stimulus: further analysis of a novel asymmetry in temporal discrimination learning

Four experiments investigated discrimination learning when the duration of the intertrial interval (ITI) signaled whether or not the next conditional stimulus (CS) would be paired with food pellets. Rats received presentations of a 10-s CS separated half the time by long ITIs and half the time by short ITIs. When the long ITI signaled that the CS would be reinforced and the short interval signaled that it would not be (Long+/Short-), rats learned the discrimination readily. However, when the short ITI signaled that the CS would be reinforced and the long interval signaled that it would not (Short+/Long-), discrimination learning was much slower. Experiment 1 compared Long+/Short- and Short+/Long- discrimination learning with 16-min/4-min or 4-min/1-min ITI combinations. Experiment 2 found no evidence that Short+/Long- learning is inferior because the temporal cue corresponding to the short interval is ambiguous. Experiment 3 found no evidence that Short+/Long- learning is poor because the end of a long ITI signals a substantial reduction in delay to the next reinforcer. Long+/Short- learning may be faster than Short+/Long-because elapsing time involves exposure to a sequence of hypothetical stimulus elements (e.g., A then B), and feature-positive discriminations (AB+/A-) are learned quicker than feature-negative discriminations (A+/AB-). Consistent with this view, Experiment 4 found a robust feature-positive effect when sequentially presented CSs played the role of elements A and B.     

Drug discrimination under a concurrent fixed-interval fixed-interval schedule.

Pigeons were trained to discriminate 5.0 mg/kg pentobarbital from saline under a concurrent fixed-interval (FI) FI schedule of food presentation on which, after pentobarbital administration, responses on one key were reinforced with food under an FI 60-s component and responses on the other key were reinforced under an FI 240-s component. After saline administration, the schedule contingencies on the two keys were reversed. After both pentobarbital and saline, pigeons responded more frequently on the key on which responses had been programmed to produce the reinforcer under the FI 60 component of the concurrent schedule. The schedule was changed to concurrent FI 150 FI 150 s for drug-substitution tests. In each bird, increasing doses of pentobarbital, ethanol, and chlordiazepoxide produced increases in the proportion of responses on the key on which responses had been reinforced under the FI 60 component after pentobarbital administration during training sessions. The proportion of responses on that key was slightly lower for ethanol than for chlordiazepoxide and pentobarbital. At a dose of pentobarbital higher than the training dose, responding decreased on the key that had been reinforced under the FI 60 component during training sessions. Phencyclidine produced less responding on the key programmed under the FI 60-s component than did pentobarbital. Methamphetamine produced responding primarily on the key on which responses had been reinforced under the FI 60-s component after saline administration.     

Drug discrimination under a concurrent fixed-ratio fixed-ratio schedule.

Pigeons were trained to discriminate 5.0 mg/kg pentobarbital from saline under a two-key concurrent fixed-ratio 10 fixed-ratio 40 schedule of food presentation, in which the fixed-ratio component with the lower response requirement was programmed to reinforce responding on one key after drug administration (pentobarbital-biased key) and on the other key after saline administration (saline-biased key). After responding stabilized, pigeons averaged 98% of their responses on the pentobarbital-biased key during training sessions preceded by pentobarbital, and they averaged 90% of their responses on the saline-biased key during training sessions preceded by saline. In test sessions preceded by doses of pentobarbital, chlordiazepoxide, or ethanol, pigeons switched from responding on the saline-biased key at low doses to responding on the pentobarbital-biased key at higher doses (the dose-response curve was quantal). High doses of phencyclidine produced responding on both keys, whereas pigeons responded almost exclusively on the saline-biased key after all doses of methamphetamine. These and previous experiments using concurrent reinforcement schedules to study drug discrimination illustrate that the schedule of reinforcement is an important determinant of the shape of dose-effect curves in drug-discrimination experiments.     

Errorless learning of a conditional temporal discrimination

In the present study we extended errorless learning to a conditional temporal discrimination. Pigeons' responses to a left-red key after a 2-s sample and to a right-green key after a 10-s sample were reinforced. There were two groups: One learned the discrimination through trial and error and the other through an errorless learning procedure. Then, both groups were presented with three types of tests. First, they were exposed to intermediate durations between 2 s and 10 s, and given a choice between both keys (stimulus generalization test). Second, a delay from 1 s to 16 s was included between the offset of the sample and the onset of the choice keys (delay test). Finally, pigeons learned a new discrimination in which the stimuli were switched (reversal test). Results showed that pigeons from the Errorless group made significantly fewer errors than those in the Trial-and-Error group. Both groups performed similarly during the stimulus generalization test and the reversal test, but results of the delay test suggested that, on long stimulus trials, responding in the errorless training group was less disrupted by delays.     

The contribution of disengagement to temporal discriminability

The present study examines the idea that time-based forgetting of outdated information can lead to better memory of currently relevant information. This was done using the visual arrays task, along with a between-subjects manipulation of both the retention interval (1?s vs. 4?s) and the time between two trials (1?s vs. 4?s). Consistent with prior work [Shipstead, Z., &; Engle, R. W. (2013). Interference within the focus of attention: Working memory tasks reflect more than temporary maintenance. Journal of Experimental Psychology: Learning, Memory, and Cognition, 39, 277–289; Experiment 1], longer retention intervals did not lead to diminished memory of currently relevant information. However, we did find that longer periods of time between two trials improved memory for currently relevant information. This replicates findings that indicate proactive interference affects visual arrays performance and extends previous findings to show that reduction of proactive interference can occur in a time-dependent manner.     

Cognitive processing impairments in a supra-second temporal discrimination task in rats with cerebellar lesion

The role of interpositus nuclei (IN) in timing in the sub-second range is well supported in eyeblink conditioning studies. Timing impairments shown in the seconds range in patients with intermediate cerebellar lesion, and known intermediate cerebellar cortex projection to IN raise the question of a possible involvement of IN in timing in the supra-second range as well. To address this question, we tested rats (Sprague-Dawley) given bilateral lesions of IN with Colchicine in a 2- vs. 8-s temporal discrimination task, followed by three daily sessions of a temporal bisection tests with five added intermediate non-reinforced durations. IN lesioned rats showed normal acquisition of the temporal discrimination, but a transient impairment of temporal sensitivity during the bisection tests. In addition, their response latencies suggested a different behavioral strategy from that of control animals. Our results indicate that the IN of the cerebellum may not be critically involved in temporal processing in the 2–8 s range, but may play a role in the cognitive processes that access temporal information in the mediation of choice behavior.     

Delayed reinforcement versus reinforcement after a fixed interval

When interreinforcement intervals were equated, pigeons demonstrated little or no preference between reinforcement after a delay interval and reinforcement presented on a fixed-interval schedule. The small preferences sometimes found for the fixed interval (a) were considerably smaller than when the delay and fixed intervals differed in duration, and (b) were caused by the absence of light during the delay. These results suggest that the effects of delayed reinforcement on prior responding can be reproduced by imposing a temporally equal fixed-interval schedule in place of the delay; and, therefore, that the time between a response and reinforcement controls the probability of that response, whether other responses intervene or not.     

Reward magnitude effects on temporal discrimination

Changes in reward magnitude or value have been reported to produce effects on timing behavior, which have been attributed to changes in the speed of an internal pacemaker in some instances and to attentional factors in other cases. The present experiments therefore aimed to clarify the effects of reward magnitude on timing processes. In Experiment 1, rats were trained to discriminate a short (2 s) vs. a long (8 s) signal followed by testing with intermediate durations. Then, the reward on short or long trials was increased from 1 to 4 pellets in separate groups. Experiment 2 measured the effect of different reward magnitudes associated with the short vs. long signals throughout training. Finally, Experiment 3 controlled for satiety effects during the reward magnitude manipulation phase. A general flattening of the psychophysical function was evident in all three experiments, suggesting that unequal reward magnitudes may disrupt attention to duration.