Preference for mixed versus constant delays of reinforcement: Effect of probability of the short, mixed delay

Preference for mixed versus constant delays of reinforcement was studied with a concurrent-chain procedure. Lever pressing by rats in concurrently available variable-interval 60-second initial links occasionally produced mutually exclusive terminal-link reinforcement delays. A constant delay of reinforcement (either 15 seconds or 30 seconds) composed one terminal link and mixed delays (.2 second and twice the value of the constant delay) were arranged in the other terminal link. The proportion of .2-second delays in the mixed-delay terminal link took on values of 0, .1, .25, .5, .75, .9, and 1.0 over experimental conditions. Based on relative rates of responding in the initial links, preference for the mixed delays was a negatively accelerated function of the proportion of short, mixed delays. Three of five rats preferred the mixed delays to the constant delays when the proportion of short, mixed delays was .1 or higher, and all five rats preferred the mixed delays when the proportion of short, mixed delays was .25 or higher. Neither Squires and Fantino's (1971) delay-reduction model of choice nor a model based on the harmonic mean reinforcement delay provided a close estimate of choice proportions over the range of short-delay proportions studied. The delay-reduction model underestimated choice for the mixed delays at low and intermediate proportions of short delays, and the harmonic-mean-delay model overestimated choice for the mixed delays at intermediate and high proportions of short delays.     

Concurrent schedules: Spatial separation of response alternatives

Four pigeons were exposed to independent concurrent variable-interval 20-second variable-interval 60-second schedules of reinforcement. A transparent partition was inserted midway between the two response keys. The length of the partition was systematically manipulated. Increasing partition length produced a decrease in changeover rate in Experiment 1. Over-matching was observed with a partition length of 20 centimeters. In Experiment 2 a four-second limited hold was added to the schedules. Increasing partition length produced a decrease in changeover rate that exceeded the decrease observed in Experiment 1. This manipulation produced nearly exclusive choice of the variable-interval 20-second component. The present results, together with results obtained in related research, suggest that deviation from matching is a function of procedural variables that determine the consequences of a changeover response.     

Subjective probability and delay.

Human subjects indicated their preference between a hypothetical $1,000 reward available with various probabilities or delays and a certain reward of variable amount available immediately. The function relating the amount of the certain-immediate reward subjectively equivalent to the delayed $1,000 reward had the same general shape (hyperbolic) as the function found by Mazur (1987) to describe pigeons' delay discounting. The function relating the certain-immediate amount of money subjectively equivalent to the probabilistic $1,000 reward was also hyperbolic, provided that the stated probability was transformed to odds against winning. In a second experiment, when human subjects chose between a delayed $1,000 reward and a probabilistic $1,000 reward, delay was proportional to the same odds-against transformation of the probability to which it was subjectively equivalent.     

Violations of stochastic transitivity on concurrent chains: Implications for theories of choice

The concurrent-chains procedure has been used to measure how choice depends on various aspects of reinforcement, such as its delay and its magnitude. Navarick and Fantino (1972, 1974, 1975) have found that choice in this procedure can violate the condition of stochastic transitivity that is required if a unidimensional scale for reinforcements is to be possible. It is shown in this paper that two simple unidimensional models of choice on concurrent chains can produce violations of stochastic transitivity. It is argued that such violations may result from the complex contingencies of the concurrent-chains procedure.     

The interaction between stimulus and reinforcer control on remembering.

In a symbolic matching-to-sample task, 6 pigeons obtained food by pecking a red side key when the brighter of two white lights had been presented on the center key and by pecking a green side key when the dimmer of two white lights had been presented on the center key. Across Part 1 and Parts 6 to 10, the delay between sample-stimulus presentation and the availability of the choice keys was varied between 0 s and 25 s. Across Parts 1 to 5, the delay between the emission of a correct choice and the delivery of a reinforcer was varied between 0 s and 30 s. Although increasing both types of delay decreased stimulus discriminability, lengthening the stimulus-choice delay produced a greater decrement in choice accuracy than did lengthening the choice-reinforcer delay. Additionally, the relative reinforcer rate for correct choice was varied across both types of delay. The sensitivity of behavior to the distribution of reinforcers decreased as discriminability decreased under both procedures. These data are consistent with the view, based on the generalized matching law, that sample stimuli and reinforcers interact in their control over remembering.     

Performance of humans in concurrent avoidance/positive-reinforcement schedules

Performance maintained under concurrent schedules consisting of a variable-interval avoidance component and a variable-interval positive-reinforcement component was studied in three human subjects using points exchangeable for money as the reinforcer. The rate of responding in the avoidance component increased, and the rate of responding in the positive-reinforcement component declined, as a function of the frequency of point-losses avoided in the avoidance component. The performance of all three subjects conformed to equations proposed by Herrnstein to describe behavior in concurrent schedules. The logarithms of the ratios of the response rates in the two components, and the logarithms of the ratios of the times spent in the two components, were linearly related to the logarithms of the ratios of the frequency of loss avoidance in the avoidance component to the frequency of reinforcement in the positive-reinforcement component. When a changeover delay of 5.0 sec was imposed, the slopes of the linear functions were close to 1.0 in the case of two subjects, whereas the third subject exhibited significant undermatching. For two subjects the changeover delay was then reduced to 2.0 sec; in both cases the slopes of the linear functions were lower than under the 5.0-sec condition. One subject participated in a third phase, in which no changeover delay was imposed; there was a further reduction in the slopes of the linear functions.     

Concurrent schedules: a quantitative relation between changeover behavior and its consequences

Data from several published experiments on concurrent variable-interval schedules were analyzed with respect to the effects of changeover delay on the time spent responding on a schedule before changing to an alternate schedule: i.e., the interchangeover time. Interchangeover time increases as the duration of the changeover delay increases, and the present analysis shows that a power function describes the relation. The power relation applied in spite of numerous differences in the experiments: different variable-interval schedules for the concurrent pairs; equal or unequal reinforcement rates for the schedules of the concurrent pairs; different durations of the changeover delay; response-dependent or response-independent reinforcers; pigeons or rats as subjects; different reinforcers. A power function also described the data in experiments where the changeover incurred a timeout, where a fixed ratio was required to changeover, and also when asymmetrical changeover delays were used.     

Food deliveries during the pause on fixed-interval schedules

Pigeons were trained on fixed-interval schedules of food delivery. In Experiments I and II, the fixed interval was initiated by the previous fixed-interval reinforcer; in Experiment III, the fixed interval was initiated by the first key peck following the preceding fixed-interval reinforcer (a chain fixed-ratio one, fixed-interval schedule). During the postreinforcement pause, variable-time schedules delivered food independent of any specific response. Rate of food delivery during the pause had only small effects on pause duration in Experiments I and II. In Experiment III, however, pause duration increased systematically with the rate of food delivery during the pause. These data suggest that the momentary proximity to reinforcement delivered via the fixed-interval schedule exerts potent control over pause termination. Additional analysis revealed that pause termination was unaffected by the intermittent delivery of food during the pause. Such data suggest that the temporal control by fixed-interval schedules is highly resistant to interference.     

Providing noncontingent,alternative, functional reinforcers during delays following functional communication training

Functional Communication Training (FCT) involves arranging extinction for problem behavior and reinforcement for a more desirable, functionally equivalent, communicative response (FCR). Although effective under ideal arrangements, the introduction of delays to reinforcement following the FCR can result in increased problem behavior. Austin and Tiger (2015) showed that for individuals whose problem behavior was sensitive to multiple sources of reinforcement, providing access to alternative, functional reinforcers during delays mitigated this increase in problem behavior during delay fading. The current study replicated the procedures of Austin and Tiger with 2 individuals displaying multiply controlled problem behavior. Providing alternative functional reinforcers reduced problem behavior during 10-min delays for both participants without requiring delay fading.     

Stability of developmental status and risk of impairment at 24 and 36 months in late preterm infants

BackgroundFew studies investigated whether late preterm infants might have developmental delays in several domains in early life and how stable the lag in developmental status might be.AimWe aimed to examine the stability of potential delays across developmental domains at 24 and 36 months of age in late preterm (34°-36⁶ weeks) and term (≥37 weeks) children and whether the risk of delays remained high at 36 months.Study design, subjects, and outcome measureWe conducted a prospective cohort analysis of the children of pregnant women participating in the Vitamin Antenatal Asthma Reduction Trial (VDAART). 652 children who were prospectively followed up and had parent-completed Ages Stages Questionnaires (ASQ-3) questionnaires at both 24 and 36 months were analyzed to assess their domain-specific developmental status.Results6.61 % (42/635) of children had a late preterm birth. Developmental delays were stable between 24 and 36 months on all 5 domains for the children born preterm and on 4/5 domains for those born at term. The developmental domains with the status stability at 24 and 36 months in both late preterm and term children were the gross motor, communication, personal-social skills, and problem-solving. Late preterm children compared with term children remained at higher risk of delays at 36 months for gross motor, communication, and problem-solving skills (aOR = 4.54, 95 %CI: 1.81−10.79; aOR = 8.60, 95 %CI: 3.10−23.28 and aOR = 3.80, 95 %CI: 1.58−8.73, respectively).ConclusionLate preterm birth is associated with suboptimal development and stability in several domains at both 24 and 36 months and compared with term birth, requiring early monitoring and assessment of the developmental lag to avoid potential long-term implications.