Run length, visit duration, and reinforcers per visit in concurrent performance

The contingencies in each alternative of concurrent procedures consist of reinforcement for staying and reinforcement for switching. For the stay contingency, behavior directed at one alternative earns and obtains reinforcers. For the switch contingency, behavior directed at one alternative earns reinforcers but behavior directed at the other alternative obtains them. In Experiment 1, responses on the main lever, in S1, incremented stay and switch schedules and obtained a stay reinforcer when it became available. Responses on the switch lever changed S1 to S2 and obtained switch reinforcers when available. In S2, neither responses on the main lever nor on the switch lever were reinforced, but a switch response changed S2 to S1. Run lengths and visit durations were a function of the ratio of the scheduled probabilities of reinforcement (staying/switching). From run lengths and visit durations, traditional concurrent performance was synthesized, and that synthesized performance was consistent with the generalized matching law. Experiment 2 replicated and extended this analysis to concurrent variable-interval schedules. The synthesized results challenge any theory of matching that requires a comparison among the alternatives.     

Effects of reinforcement rate and delay on the acquisition of lever pressing by rats.

The acquisition of lever pressing by naive rats, in the absence of shaping, was studied as a function of different rates and unsignaled delays of reinforcement. Groups of 3 rats were each exposed to tandem schedules that differed in either the first or the second component. First-component schedules were either continuous reinforcement or random-interval 15, 30, 60 or 120 s; second-component schedules were fixed-time 0, 1, 3, 6, 12, or 24 s. Rate of responding was low under continuous immediate reinforcement and higher under random-interval 15 s. Random interval 30-s and 60-s schedules produced lower rates that were similar to each other. Random-interval 120 s controlled the lowest rate in the immediate-reinforcement condition. Adding a constant 12-s delay to each of the first-component schedule parameters controlled lower response rates that did not vary systematically with reinforcement rate. The continuous and random-interval 60-s schedules of immediate reinforcement controlled higher global and first-component response rates than did the same schedules combined with longer delays, and first-component rates showed some graded effects of delay duration. In addition, the same schedules controlled higher second-component response rates in combination with a 1-s delay than in combination with longer delays. These results were related to those from previous studies on acquisition with delayed reinforcement as well as to those from similar reinforcement procedures used during steady-state responding.     

Stability of heartbeat interval distributions in chronic high altitude hypoxia

Recent studies of nonlinear dynamics of the long-term variability of heart rate have identified nontrivial long-range correlations and scale-invariant power-law characteristics (1/f noise) that were remarkably consistent between individuals and were unrelated to external or environmental stimuli (Meyer et al., 1998a). The present analysis of complex nonstationary heartbeat patterns is based on the sequential application of the wavelet transform for elimination of local polynomial nonstationary behavior and an analytic signal approach by use of the Hilbert transform (Cumulative Variation Amplitude Analysis). The effects of chronic high altitude hypoxia on the distributions and scaling functions of cardiac intervals over 24 hr epochs and 4 hr day/nighttime subepochs were determined from serial heartbeat interval time series of digitized 24 hr ambulatory ECGs recorded in 9 healthy subjects (mean age 34 yrs) at sea level and during a sojourn at high altitude (5,050 m) for 34 days (Ev-K2-CNR Pyramid Laboratory, Sagarmatha National Park, Nepal). The results suggest that there exists a hidden, potentially universal, common structure in the heterogeneous time series. A common scaling function with a stable Gamma distribution defines the probability density of the amplitudes of the fluctuations in the heartbeat interval time series of individual subjects. The appropriately rescaled distributions of normal subjects at sea level demonstrated stable Gamma scaling consistent with a single scaled plot (data collapse). Longitudinal assessment of the rescaled distributions of the 24 hr recordings of individual subjects showed that the stability of the distributions was unaffected by the subject’s exposure to a hypobaric (hypoxic) environment. The rescaled distributions of 4 hr subepochs showed similar scaling behavior with a stable Gamma distribution indicating that the common structure was unequivocally applicable to both day and night phases and, furthermore, did not undergo systematic changes in response to high altitude. In contrast, a single function stable over a wide range of time scales was not observed in patients with congestive heart failure or patients after cardiac transplantation. The functional form of the scaling in normal subjects would seem to be attributable to the underlying nonlinear dynamics of cardiac control. The results suggest that the observed Gamma scaling of the distributions in healthy subjects constitutes an intrinsic dynamical property of normal heart function that would not undergo early readjustment or late acclimatization to extrinsic environmental physiological stress, e.g., chronic hypoxia.     

The momentum of compliance

Compliance with demanding requests that are normally ineffective may be increased by presenting a series of easy or high-probability (high-p) requests before the more demanding requests. Mace and his colleagues have discussed the effectiveness of the high-p procedure in relation to behavioral momentum—the tendency for behavior, once initiated and reinforced, to persist in the face of a challenge. The high-p procedure differs in several ways from that employed in laboratory research on momentum, and the methods and findings of basic research may not be relevant to applied work on compliance. This article reviews some laboratory procedures used in research on behavioral momentum, summarizes the major findings of that research, and discusses its relevance to the high-p procedure and its outcomes. Increased compliance with demanding requests following the high-p procedure can be understood in relation to the procedures and findings of basic research, but some questions arise in the process of translating research into application via the metaphor of momentum. These questions suggest some new directions for both experimental and applied behavior analysis.     

Response-dependent prechoice effects on foraging-related choice

Three experiments explored the influence of prechoice events on pigeons' preference. In two of three studies, a fixed-interval 200-second prechoice period preceded the initial links of a concurrent chain in which outcomes differed either (a) in terms of the delay to food or (b) in terms of amount of food and delay to food. In Experiment 3, the prechoice period preceded the initial links that provided a choice between a small single food presentation and two identical, more delayed food presentations. In all three cases, obtained choice proportions did not vary as a function of prechoice duration. These results suggest that a local-contextual view adequately describes the foraging context; they also have implications for the appropriate formulation of the delay-reduction theory of conditioned reinforcement and rate-maximizing views of optimal foraging theory.     

Assessing preference for reinforcers using demand curves, work-rate functions, and expansion paths

Much research has focused on the effects of environmental variability on foraging decisions. However, the general pattern of preference for variability in delay to reward and aversion to variability in amount of reward remains unexplained a either a mechanistic or a functional level. Starlings' preferences between a fixed and a variable option were studied in two treatments, A and D. The fixed option was the same in both treatments (20-s fixed-interval delay, five units food). In Treatment A the variable option gave two equiprobable amounts of food (20-s delay, three or seven units) and in D it gave two equiprobable delays to food (2.5-s or 60.5-s delays, five units). In both treatments the programmed ratio [amount/(intertrial interval+latency+delay)] in the fixed option equaled the arithmetic mean of the two possible ratios in the variable option (ITI = 40 s, latency = 1 s). The variable option was strongly preferred in Treatment D and was weakly avoided in Treatment A. These results are discussed in the light of two theoretical models, a form of constrained rate maximization and a version of scalar expectancy theory. The latter accommodates more of the data and is based on independently verifiable assumptions, including Weber's law.     

ALTERNATIVE REINFORCEMENT INCREASES RESISTANCE TO CHANGE: PAVLOVIAN OR OPERANT CONTINGENCIES?

Two multiple-schedule experiments with pigeons examined the effect of adding food reinforcement from an alternative source on the resistance of the reinforced response (target response) to the decremental effects of satiation and extinction. In Experiment 1, key pecks were reinforced by food in two components according to variable-interval schedules and, in some conditions, food was delivered according to variable-time schedules in one of the components. The rate of key pecking in a component was negatively related to the proportion of reinforcers from the alternative (variable-time) source. Resistance to satiation and extinction, in contrast, was positively related to the overall rate of reinforcement in the component. Experiment 2 was conceptually similar except that the alternative reinforcers were contingent on a specific concurrent response. Again, the rate of the target response varied as a function of its relative reinforcement, but its resistance to satiation and extinction varied directly with the overall rate of reinforcement in the component stimulus regardless of its relative reinforcement. Together the results of the two experiments suggest that the relative reinforcement of a response (the operant contingency) determines its rate, whereas the stimulus-reinforcement contingency (a Pavlovian contingency) determines its resistance to change.     

Sensitivity of time allocation to an overall reinforcer rate feedback function in concurrent interval schedules

Six pigeons were trained on concurrent variable-interval schedules in which feedback functions arranged that the overall reinforcer rate either (a) was independent of preference, (b) decreased with increasing absolute preference, or (c) increased with increasing absolute preference. In Experiment 1, the reinforcer rate in an interreinforcement interval was determined by the absolute time-allocation ratio in the previous interval. When arranged reinforcer ratios were varied, there was no evidence of control over preference by overall reinforcer rate. In Experiment 2, the feedback function arranged that reinforcer rates were an inverse function of absolute preference, and window durations were fixed times. In Phase 1, using schedules that provided a four-to-one reinforcer ratio, the window duration was decreased from 20 s to 5 s over four conditions. Then, in Phases 2 and 3, the arranged reinforcer ratios were varied. In Phase 2, the reinforcer rate in the current 5-s time window was determined by preference in the previous 5-s window, and in Phase 3, the window durations were 20 s. Again, there was no indication of control by obtained overall reinforcer rate. These data call into question theories that suggest that the process underlying matching is one of maximizing overall reinforcer rates, or that preference in concurrent aperiodic schedules is controlled to any extent by overall reinforcer rate. They also question the notion that concurrent-schedule preference is controlled by molecular maximizing.     

Discrete and continuous measures of dimensional stimulus control

In two sets of experiments, we examined dimensional stimulus control of pigeons' responses to a visual flicker-rate continuum. In the first experiment, responses to a single key were reinforced periodically during stimuli from one half of the stimulus continuum, and responses during other stimuli were extinguished. In the second experiment, two response keys were simultaneously available, with reinforcement for each response alternative associated with different halves of the stimulus continuum. Conditions of the second experiment involved either free-operant or discrete-trial stimulus presentations. Results from these experiments show that positive dimensional contrast appeared in discrimination tasks with one or two response alternatives, but only with free-operant procedures. In addition, discrimination between stimulus classes established by differential reinforcement was assessed as accurately by continuous rate measures as by discrete response choice in the two-alternative situation. The general implication of these experiments is that response rate measures, when properly applied, may reveal sources of variation within stimulus classes, such as dimensional contrast, that are not evident with discrete measures.     

Chlordiazepoxide effects on ethanol self-administration: dependence on concurrent conditions.

Experiments examined the effects of acute doses of chlordiazepoxide upon ethanol self-administration in the rat. A concurrent-schedule procedure was used that employed choice between ethanol (5%) and a second fluid (either water or a 1% sucrose solution). When ethanol and water were the available fluids, chlordiazepoxide at doses of 15 and 20 mg/kg reduced ethanol-reinforced responding and intake, with a greater reduction occurring at the 20 mg/kg dose. However, when ethanol and sucrose were concurrently available, in many rats only the 20 mg/kg dose of chlordiazepoxide reduced ethanol-reinforced responding. The differences in dose response function occurred in most animals without large changes in the baseline ethanol-reinforced responding across the two concurrent conditions. Thus the dose-effect curve relating chlordiazepoxide and ethanol self-administration can be altered, dependent upon the nature of the concurrently available reinforcers.