On the distinction between open and closed economies.

Open and closed economies have been assumed to produce opposite relations between responding and the programmed density of reward (the amount of reward divided by its cost). Experimental procedures that are treated as open economies typically dissociate responding and total reward by providing supplemental income outside the experimental session; procedures construed as closed economies do not. In an open economy responding is assumed to be directly related to reward density, whereas in a closed economy responding is assumed to be inversely related to reward density. In contrast to this predicted correlation between response-reward relations and type of economy, behavior regulation theory predicts both direct and inverse relations in both open and closed economies. Specifically, responding should be a bitonic function of reward density regardless of the type of economy and is dependent only on the ratio of the schedule terms rather than on their absolute size. These predictions were tested by four experiments in which pigeons' key pecking produced food on fixed-ratio and variable-interval schedules over a range of reward magnitudes and under several open- and closed-economy procedures. The results better supported the behavior regulation view by showing a general bitonic function between key pecking and food density in all conditions. In most cases, the absolute size of the schedule requirement and the magnitude of reward had no effect; equal ratios of these terms produced approximately equal responding.     

Choice, relative reinforcer duration, and the changeover ratio

Relative reinforcer duration was varied in concurrent schedules with a fixed-ratio four changeover requirement. The schedule in effect after each reinforcer was randomly chosen. For all three pigeons, relative response rates overmatched relative reinforcer durations. Time allocation was less extreme and, on the average, matched relative reinforcer duration. In a subsequent manipulation, the level of preference was shown to depend on the size of the changeover requirement. These results are similar to those from related unequal reinforcement-frequency procedures.     

Autoshaped key pecking maintained by access to a social space.

When four experimentally naive pigeons were exposed to occasional forward pairings of a keylight followed by a doorlight (that signaled access to a large social space), all subjects began to peck the lit key. In a second experiment, where the keylight either preceded the presentation of the doorlight or was presented independently of it, key pecking was maintained only in the former circumstance. The unconditioned stimulus in these experiments--arrival in the social space--did not elicit pecking. Hence, the conditioned response of key pecking and the unconditioned response of entering the social space differed. This demonstration of autoshaping with a social-space unconditioned stimulus argues against a stimulus-substitution account of the findings.     

Confirmation of linear system theory prediction: Rate of change of Herrnstein's kappa as a function of response-force requirement

Four human subjects worked on all combinations of five variable-interval schedules and five reinforcer magnitudes (¢/reinforcer) in each of two phases of the experiment. In one phase the force requirement on the operandum was low (1 or 11 N) and in the other it was high (25 or 146 N). Estimates of Herrnstein's κ were obtained at each reinforcer magnitude. The results were: (1) response rate was more sensitive to changes in reinforcement rate at the high than at the low force requirement, (2) κ increased from the beginning to the end of the magnitude range for all subjects at both force requirements, (3) the reciprocal of κ was a linear function of the reciprocal of reinforcer magnitude for seven of the eight data sets, and (4) the rate of change of κ was greater at the high than at the low force requirement by an order of magnitude or more. The second and third findings confirm predictions made by linear system theory, and replicate the results of an earlier experiment (McDowell & Wood, 1984). The fourth finding confirms a further prediction of the theory and supports the theory's interpretation of conflicting data on the constancy of Herrnstein's κ.     

Reinforcer pathology II: Reward magnitude,reward delay,and demand for alcohol collectively relate to college students' alcohol related problems

The reinforcer pathologies model of addiction posits that two characteristic patterns of operant behavior characterize addiction. Specifically, individuals suffering from addiction have elevated levels of behavioral economic demand for their substances of abuse and have an elevated tendency to devalue delayed rewards (reflected in high delay discounting rates). Prior research has demonstrated that these behavioral economic markers are significant predictors of many of college students' alcohol-related problems. Delay discounting, however, is a complex behavioral performance likely undergirded by multiple behavioral processes. Emerging analytical approaches have isolated the role of participants' sensitivity to changes in reinforcer magnitude and changes in reinforcer delay. The current study uses these analytic approaches to compare participants' discounting of money versus alcohol, and to build regression models that leverage these new insights to predict a wider range of college students' alcohol related problems. Using these techniques, we were able to 1) demonstrate that individuals differed in their sensitivity to magnitudes of alcohol versus money, but not sensitivity to delays to those commodities and 2) that we could use our behavioral economic measures to predict a range of students' alcohol related problems.     

Response–reinforcer dependency and resistance to change

The effects of the response–reinforcer dependency on resistance to change were studied in three experiments with rats. In Experiment 1, lever pressing produced reinforcers at similar rates after variable interreinforcer intervals in each component of a two‐component multiple schedule. Across conditions, in the fixed component, all reinforcers were response‐dependent; in the alternative component, the percentage of response‐dependent reinforcers was 100, 50 (i.e., 50% response‐dependent and 50% response‐independent) or 10% (i.e., 10% response‐dependent and 90% response‐independent). Resistance to extinction was greater in the alternative than in the fixed component when the dependency in the former was 10%, but was similar between components when this dependency was 100 or 50%. In Experiment 2, a three‐component multiple schedule was used. The dependency was 100% in one component and 10% in the other two. The 10% components differed on how reinforcers were programmed. In one component, as in Experiment 1, a reinforcer had to be collected before the scheduling of other response‐dependent or independent reinforcers. In the other component, response‐dependent and ‐independent reinforcers were programmed by superimposing a variable‐time schedule on an independent variable‐interval schedule. Regardless of the procedure used to program the dependency, resistance to extinction was greater in the 10% components than in the 100% component. These results were replicated in Experiment 3 in which, instead of extinction, VT schedules replaced the baseline schedules in each multiple‐schedule component during the test. We argue that the relative change in dependency from Baseline to Test, which is greater when baseline dependencies are high rather than low, could account for the differential resistance to change in the present experiments. The inconsistencies in results across the present and previous experiments suggest that the effects of dependency on resistance to change are not well understood. Additional systematic analyses are important to further understand the effects of the response–reinforcer relation on resistance to change and to the development of a more comprehensive theory of behavioral persistence.     

Further evaluation of the accuracy of reinforcer surveys: a systematic replication

The present report evaluates the accuracy of a reinforcer survey by comparing the survey results to the results of subsequent reinforcer assessments for 20 children using a concurrent-operants arrangement to assess relative reinforcer preference. Total accuracy for the survey was determined to be approximately 57%. The results provide a systematic replication of Northup et al. (1996) with a much larger sample of children. A need for the development of more accurate and comprehensive reinforcer assessment methods for verbal children is discussed.     

Preference for unreliable reinforcement in children with mental retardation: the role of conditioned reinforcement

We examined the effects of conditioned reinforcement on children's choice between reliable (100%) and unreliable (50%) reinforcement under various stimulus conditions in a concurrent-chains procedure. The study was conducted across three experiments. Experiments 1 and 2 were conducted under conditions similar to basic laboratory work and consisted of participants selecting from one of two black boxes (placed on a table) that were correlated with different reinforcement schedules. In Experiment 3, we assessed a participant's preference for unreliable reinforcement during conditions in which the target responses were aggression and mands. Results of the three experiments showed that the participants preferred unreliable reinforcement under certain conditions. Findings are discussed regarding the role of specific stimuli (i.e., items correlated with a reinforcement schedule, adult reactions) as conditioned reinforcers and how they may influence children's preference for a response (e.g., aggression, self-injury) that produces reinforcement on a leaner schedule than a socially desirable response (e.g., mands).     

Reinforcer control and human signal-detection performance

Eight humans participated in a two-choice signal-detection task in which stimulus disparity was varied over four levels. Two procedures arranged asymmetrical numbers of reinforcers received for correct left- and right-key responses (the reinforcer ratio). The controlled procedure ensured that the obtained reinforcer ratio remained constant over changes in stimulus disparity, irrespective of subjects' performances. In the uncontrolled procedure, the asymmetrical reinforcer ratio could covary with subjects' performances. The receiver operating characteristic (ROC) patterns obtained from the controlled procedure approximated isobias functions predicted by criterion location measures of bias. The uncontrolled procedure produced variable ROC patterns that were somewhat like the isobias predictions made by likelihood ratio measures of bias; however, the obtained reinforcer ratio became more extreme as discriminability decreased. The obtained pattern of bias was directly related to the obtained reinforcer ratio. This research indicates that criterion location measures seem to be preferable indices of response bias.     

Time and rate measures in choice transitions

Three experiments with pigeons studied the relation between time and rate measures of behavior under conditions of changing preference. Experiment 1 studied a concurrent chain schedule with random-interval initial links and fixed-interval terminal links; Experiment 2 studied a multiple chained random-interval fixed-interval schedule; and Experiment 3 studied simple concurrent random-interval random-interval schedules. In Experiment 1, and to a lesser extent in the other two experiments, session-average initial-link wait-time differences were linearly related to session-average response-rate differences. In Experiment 1, and to a lesser extent in Experiment 3, ratios of session-average initial-link wait times and response rates were related by a power function. The weaker relations between wait and response measures in Experiment 2 appear to be due to the absence of competition between responses. In Experiments 1 and 2, initial-link changes lagged behind terminal-link changes. These findings may have implications for the relations between fixed- and variable-interval procedures and suggest that more attention should be paid to temporal measures in studies of free-operant choice.