Effects of a DRL contingency added to a fixed-interval reinforcement schedule

Following 30 days of reinforcement for the bar press response of two white rats on 30-sec fixed-interval (FI), a DRL component was added so that a minimal interresponse time (IRT) for the reinforced response, in addition to the FI variable, was necessary for reinforcement. Marked control over response rate by the superimposed DRL requirement was demonstrated by an inverse hyperbolic function as the DRL component was increased from 1 to 24 sec within the constant 30-sec FI interval. Interresponse time and post-reinforcement (post-S^R) “break” distributions taken at one experimental point (DRL = 24 sec) suggested that a more precise temporal discrimination was initiated by an S^R than by a response, since the relative frequency of a sequence of two reinforced responses appeared greater than that of a sequence of a non-reinforced response followed by a reinforced one. This latter finding was confirmed with new animals in a follow-up experiment employing a conventional 24-sec DRL schedule.     

The distribution of observing responses in a mixed FI-FR schedule,

In Exp I, three pigeons were trained on an observing response procedure where observing responses produced a stimulus correlated either with FI or with FR. Stimulus duration was 30 sec. During FR, the subjects completed the ratio before the stimulus terminated. During FI, the subjects usually observed the stimulus only once. Observing responses occurred immediately after food reinforcement. In Exp II, stimulus duration was shortened to 5 sec and the FR for food was increased. The results were similar to those of Exp 1. During most FIs and FRs, only one observing response occurred. The results of both experiments could be interpreted in a response competition framework. Immediately after food reinforcement, observing behavior is strong. When behavior on the food key begins it competes with further observing behavior.     

The effect of multiple S periods on responding on a fixed-interval schedule: IV. Effect of continuous S with only short S probes

Pigeons were studied under FI 500 sec in which an S^Δ was present throughout the interval except during the terminal 50-sec segment and one earlier 50-sec segment. Very little responding occurred during the presence of S^Δ. The rate of responding in the earlier 50-sec S^D segments was lower than in the terminal S^D segment. There was a clear trend for the rate of responding in the earlier S^D segment to be progressively higher the later it occurred in the course of the FI 500 sec. This trend was shown roughly to parallel the increasing rate of responding in a conventional FI 500 sec with no interruption by S^Δ. Since the changing tendency to respond through the FI survives massive disruption by S^Δ, it is concluded that the control of responding through the FI does not require continuous mediating behavior. It is suggested that it is the decaying retroactive influence of the reinforcer on responses that occurred longer and longer before the reinforcer occurred which produces the familiar scalloped pattern of responding under FI schedules.     

The value hypothesis and acquisition of preference in concurrent chains

Experiment 1 compared the acquisition of initial- and terminal-link responding in concurrent chains. The terminal-link schedules were fixed interval (FI) 10 sec and FI 20 sec, but some presentations were analogous to no-food trials in the peak procedure, lasting 60 sec with no reinforcement delivery. Pigeons completed a series of reversals in which the schedules signaled by the terminal-link stimuli (red and green on the center key) were changed. Acquisition of temporal control of terminal-link responding (as measured by peak location on no-food trials) was more rapid than acquisition of preference in the initial links. Experiment 2 compared acquisition in concurrent chains, using the typical procedure in which the terminal-link schedules are changed with a novel arrangement in which the initial-link key assignments were changed while the terminal-link schedules remained the same. Acquisition of preference was faster in the latter condition, in which the terminal-link stimulus-reinforcer relations were preserved. These experiments provide the first acquisition data that support the view that initial-link preference is determined by the values of the terminal-link stimuli.     

Role of nonreinforcement in the fixed-interval performance of pigeons

Fixed-interval (FI) schedules have been used extensively to study timing abilities. In FI schedules, animals typically show higher response rates immediately after nonreinforced (N) cycles rather than reinforced (R) cycles (the reinforcement-omission effect), and they exhibit the highest rate approximately at the time when the reinforcer is scheduled to occur (peak performance). The present experiments were designed to determine the extent to which factors other than timing contribute significantly to these two learning phenomena. Pigeons were trained in an FI 16-sec schedule in which half the cycles were R and half were N. When successive cycles were separated by a 2-sec interval, responding early in the FI interval was higher after an N cycle than after an R cycle. This reinforcement-omission effect was eliminated when the interval between cycles was increased to 12 sec, because of an increase in performance after R cycles. In addition, timing of the 16-sec interval was assessed by interpolating 32-sec test cycles (all N cycles) at two rates—either 1 test cycle every other session, or 25 test cycles per session. Peak performance, presumably indexing the animal’s ability to time the 16-sec interval, emerged only with 25 test cycles per day, but not with 1 test cycle every other day, despite extensive training with the target, 16-sec-long interval. These results suggest that transient demotivation and time-based discrimination contribute significantly to the reinforcement-omission effect and peak performance, respectively.     

The relations among measures of performance on fixed-interval schedules

Quantitative measures of the performances of seven rats and two pigeons under FI schedules of reinforcement were obtained. For the rats (under FI 2 and FI 100 sec) the mean response rate and two measures of the temporal distribution of responses within the interval (quarter-life and an Index of Curvature) were computed for individual intervals. The measures of curvature were highly correlated with each other, whereas the response rate was only moderately correlated with either of them. Similar results were found for comparisons of the same measures on a session-by-session basis. The performances of the pigeons (under FI 10) were analyzed to yield response rate, quarter-life and elapsed time to the first, fifth and tenth response. Response rate was only moderately correlated with quarter-life, whereas quarter-life and time to the fifth or tenth response were highly correlated. Measures of temporal distribution based on an average of the intervals of a daily session were highly similar to the means of those measures calculated from the individual intervals.     

FI length and performance on an FI FR chain schedule of reinforcement

In a chained FI FR schedule, manipulating the length of the FI component produced changes confined almost entirely to the FI performance; increasing the interval length increased the total number of responses emitted per reinforcement. The configuration of the fixed-interval scallop was clearly modified as the interval length was increased, with the larger intervals becoming flatter (i.e., a larger proportion of the total responses earlier in an interval). Measurement of the postreinforcement pause is suggested as a possible indicator of fixed-interval scalloping.     

Reinforcement omission on fixed-interval schedules

Experiments with pigeons and rats showed that: (1) When a brief blackout was presented in lieu of reinforcement at the end of 25% of intervals on a fixed-interval 2-min schedule, response rate was reliably and persistently higher during the following 2-min intervals (omission effect). This effect was largely due to a decrease in time to first response after reinforcement omission. (2) When blackout duration was varied, within sessions, over the range 2 to 32 sec, time to first response was inversely related to the duration of the preceding blackout, for pigeons, and for rats during the first few sessions after the transition from FI 2-min to FI 2-min with reinforcement omission. Post-blackout pause was independent of blackout duration for rats at asymptote. These results were interpreted in terms of differential depressive effects of reinforcement and blackout on subsequent responding.     

A comparison of two models for performance under fixed interval schedules of reinforcement

Two models are proposed for responding under fixed-interval schedules of reinforcement. The first model is a Poisson model and seems suitable for situations in which responding produces a classical “FI scallop”. A second model is then developed to describe “break and run” performance, which is also known to occur under some Fixed Interval schedules. The models do not however give any indication of the circumstances under which a particular mode of responding should arise. A comparison of the models to a small set of data collected from rats performing under an FI 60 sec schedule indicates that for the data considered, the second model (a State model) produced by far the best fit.     

Effects of pre-operant running and sucrose concentration on operant wheel running on a fixed interval schedule of reinforcement

Prior research proposed that temporal control over the pattern of operant wheel running on a fixed interval (FI) schedule of sucrose reinforcement is a function of automatic reinforcement generated by wheel running and the experimentally arranged sucrose reinforcement. Two experiments were conducted to assess this prediction. In the first experiment, rats ran for different durations (0, 30, 60, and 180 min) prior to a session of operant wheel running on a FI 120-s schedule. In the second experiment, the concentration of sucrose reinforcement on a FI 180-s schedule was varied across values of 0, 5, 15, and 25%. In Experiment 1, as the duration of pre-operant running increased, the postreinforcement pause before initiation of running lengthened while wheel revolutions in the latter part of the FI interval increased. In Experiment 2, wheel revolutions markedly increased then decreased to a plateau early in the FI interval. Neither manipulation increased temporal control of the pattern of wheel running. Instead, results indicate that operant wheel running is regulated by automatic reinforcement generated by wheel activity and an adjunctive pattern of running induced by the temporal presentation of sucrose. Furthermore, the findings question whether the sucrose contingency regulates wheel running as a reinforcing consequence.     

The Probability of Small Schedule Values and Preference for Random-Interval Schedules

Preference for working on variable schedules and temporal discrimination were simultaneously examined in two experiments using a discrete-trial, concurrent-chains arrangement with fixed interval (FI) and random interval (RI) terminal links. The random schedule was generated by first sampling a probability distribution after the programmed delay to reinforcement on the FI schedule had elapsed, and thus the RI never produced a component schedule value shorter than the FI and maintained a rate of reinforcement half that of the FI. Despite these features, the FI was not strongly preferred. The probability of obtaining the smallest programmed delay to reinforcement on the RI schedule was manipulated in Experiment 1, and the interaction of this probability and initial link length was examined in Experiment 2. As the probability of obtaining small values in the RI increased, preference for the schedule increased while the discriminated time of reinforcer availability in the terminal link decreased. Both of these effects were attenuated by lengthening the initial links. The results support the view that in addition to the delay to reinforcement, the probability of obtaining a short delay is an important choice-affecting variable that likely contributes to the robust preferences for variable, as opposed to fixed, schedules of reinforcement.     

Chained and tandem scheduling with children

Children 4 to 7 yr in age were reinforced with trinkets and pennies on chained and tandem schedules. The schedules used were chain DRL FR, chain DRO FR, chain FI FR, tand FI FR, and tand DRO FR. Chain DRL FR and chain DRO FR schedules almost always produced strong schedule and stimulus control, but chain FI FR schedules rarely did if additional techniques were not used. Strong control was produced with chain FI FR schedules, however, if: (a) the FR component was increased in size; (b) schedule and stimulus control was first established with chain DRL FR or chain DRO FR schedules before shifting to the chain FI FR; or (c) an external clock was attached to the FI. Tand FI FR schedules never produced regular or repeatable patterns of responding when additional procedures were not used. Rate patterns resembling those of chain FI FR schedules were produced by tand FI FR schedules, however, if: (a) an external clock was attached to the FI component or (b) control was established by means of tand DRO FR schedules before the tand FI FR was used. Stimulus control was found to be exercised by specific visual stimuli, change of stimuli, and schedule order. Control exercised by schedule order was probably mediated by the child's own behavior which had assumed discriminative stimulus properties.     

Some effects of fixed-interval duration on response rate in a two-component chain schedule

In Exp. I three pigeons were trained on a two-component chain schedule. Responding on a 1-min variable-interval schedule in the initial component led to a sequence of two fixed-interval schedules in the terminal component. The rate of reinforcement in the terminal component was kept constant while the values of the two fixed intervals were varied. Three combinations of fixed-interval schedules were studied, FI 0.25, FI 1.75 (minutes) or FI 1.00, FI 1.00, or FI 1.75, FI 0.25. The rate for each subject declined in the initial component as the value of the first fixed interval was increased. Experiment II was conducted to assess the role of the second fixed-interval schedule in the terminal component in determining the rate of responding in the initial component. For each chain schedule the rate of responding in the initial component was determined both with and without the second of the sequence of fixed intervals. In all three cases the rate of responding in the initial component decreased when the second fixed interval was removed. Increasing the first fixed interval in Exp. I had a greater effect on variable-interval performance than did the removal of the second fixed interval in Exp. II.     

Drug discrimination under two concurrent fixed-interval fixed-interval schedules

Pigeons were trained to discriminate 5.0 mg/kg pentobarbital from saline under a two-key concurrent fixed-interval (FI) 100-s FI 200-s schedule of food presentation, and later tinder a concurrent FI 40-s FI 80-s schedule, in which the FI component with the shorter time requirement reinforced responding on one key after drug administration (pentobarbital-biased key) and on the other key after saline administration (saline-biased key). After responding stabilized under the concurrent FI 100-s FI 200-s schedule, pigeons earned an average of 66% (after pentobarbital) to 68% (after saline) of their reinforcers for responding under the FI 100-s component of the concurrent schedule. These birds made an average of 70% of their responses on both the pentobarbital-biased key after the training dose of pentobarbital and the saline-biased key after saline. After responding stabilized under the concurrent FI 40-s FI 80-s schedule, pigeons earned an average of 67% of their reinforcers for responding under the FI 40 component after both saline and the training dose of pentobarbital. These birds made an average of 75% of their responses on the pentobarbital-biased key after the training dose of pentobarbital, but only 55% of their responses on the saline-biased key after saline. In test sessions preceded by doses of pentobarbital, chlordiazepoxide, ethanol, phencyclidine, or methamphetamine, the dose-response curves were similar under these two concurrent schedules. Pentobarbital, chlordiazepoxide, and ethanol produced dose-dependent increases in responding on the pentobarbital-biased key as the doses increased. For some birds, at the highest doses of these drugs, the dose-response curve turned over. Increasing doses of phencyclidine produced increased responding on the pentobarbital-biased key in some, but not all, birds. After methamphetamine, responding was largely confined to the saline-biased key. These data show that pigeons can perform drug discriminations under concurrent schedules in which the reinforcement frequency under the schedule components differs only by a factor of two, and that when other drugs are substituted for the training drugs they produce dose-response curves similar to the curves produced by these drugs under other concurrent interval schedules.     

Adjustment to College and Perceptions of Faculty Incivility

This study assessed the relationships between adjustment and maladjustment to college life and faculty incivility (FI). Two FI constructs were used: Active FI and passive FI. The first includes serious incivilities, such as personal comments or verbal attacks against students; the second pertains to more subtle incivilities, such as inadequate communications and avoidance. Two scales were administered to 744 undergraduate college students: The College Adjustment Test (CAT), and the Perceived Faculty Incivility Scale (PFIS). A paired-samples t-test result showed a significantly higher mean result for the passive FI compared with active FI. In addition path model results showed that those who reported higher levels of uncivil encounters in the classroom have also reported an increase in their negative emotional level of adjustment to college life; whereas decreased levels of FI incivility encounters were associated with increased perceptions of adjustment to college. An additional path analysis result has associated maladjustment with passive FI only. Implications of these findings and directions for future research are discussed.     

Rate-dependent effect of methylphenidate(Ritalin) on fixed-interval behavior in rats

The behavioral effects of 1.0–18.0 mg/kg methylphenidate (Ritalin) injections on leverpressing reinforced under a fixed-interval (FI) 60-sec schedule for water in Mäll-Wistar rats were studied. Effets of methylphenidate were dose-dependent: it increased response rates early in the FI 60-sec adn reduced the higher response rates later in the FI, without changing the average response rate. There was no systematic effect of the drug upon locomotor activity. The local response-rate change during the FI 60-sec are in accord with the rate-dependency hypothesis (Dews, 1958). the bidirectional response-rate changes withing the FI explain why methylphenidate did not affect the average response rate.     

Hear it playing low and slow: How pitch level differentially influences time perception

Variations in both pitch and time are important in conveying meaning through speech and music, however, research is scant on perceptual interactions between these two domains. Using an ordinal comparison procedure, we explored how different pitch levels of flanker tones influenced the perceived duration of empty interstimulus intervals (ISIs). Participants heard monotonic, isochronous tone sequences (ISIs of 300, 600, or 1200 ms) composed of either one or five standard ISIs flanked by 500 Hz tones, followed by a final interval (FI) flanked by tones of either the same (500 Hz), higher (625 Hz), or lower (400 Hz) pitch. The FI varied in duration around the standard ISI duration. Participants were asked to determine if the FI was longer or shorter in duration than the preceding intervals. We found that an increase in FI flanker tone pitch level led to the underestimation of FI durations while a decrease in FI flanker tone pitch led to the overestimation of FI durations. The magnitude of these pitch-level effects decreased as the duration of the standard interval was increased, suggesting that the effect was driven by differences in mode-switch latencies to start/stop timing. Temporal context (One vs. Five Standard ISIs) did not have a consistent effect on performance. We propose that the interaction between pitch and time may have important consequences in understanding the ways in which meaning and emotion are communicated.     

Multiple fixed-interval schedules: transient contrast and temporal inhibition

Pigeons were exposed to four cycles per session of a multiple schedule in which each cycle involved twelve 60-sec fixed intervals followed by four 180-sec intervals [(12 FI 60-sec)(4 FI 180-sec) schedule]. Post-reinforcement pauses were shorter during the first few short intervals of each cycle than during later short intervals, and increased over the four long intervals of each cycle (positive and negative transient contrast). A (12 FI 15-sec)(4 FI 45-sec) schedule showed similar results. These two schedules differed in some other respects indicating effects of absolute FI duration on stimulus control. Differences in contrast properties between both these procedures and multiple variable-interval schedules were related to the pause-producing property of reinforcement on FI (temporal inhibition). Behavior under two other multiple fixed-interval schedules—(2 FI 360-sec)(1 FI 720-sec) and (3 FI 360-sec)(1 FI 720-sec)—differed in certain respects from both the (12 FI x-sec)(4 FI 3x-sec) schedules. These differences may be related to differences in the number of successive fixed intervals within a component (run length).     

Choice and amount of reinforcement in rats

Rats were exposed to concurrent-chains schedules in which the terminal links were equal, fixed-interval (FI) schedules terminating in one or a varying number of food pellets. In most rats, choice proportions for the larger reinforcer increased with increases in reinforcer amount (e.g., from one to five food pellets). When log response ratios were plotted against log reinforcer amount ratios, the results indicated that the effects of reinforcer amount depended on the length of fixed-interval terminal links, by showing that rats undermatched their response ratios to reinforcer amount ratios with the shorter terminal links (FI 5 s, Experiment 1), whereas they overmatched with the longer terminal links (FI 20 s, Experiment 2). These results demonstrated that the manipulation of FI terminal-link schedules affected the sensitivity of choice to reinforcer amount, and are consistent with the previous findings that choice proportions for the larger of two reinforcers (one vs three food pellets) increased with increases in the length of FI terminal-link schedules.