Economic concepts for the analysis of behavior

A review of the relationship between schedule of reinforcement, response rate, and choice suggests that certain unifying concepts from economics can contribute to a more complete science of behavior. Four points are made: 1) a behavioral experiment is an economic system and its characteristics—open or closed—can strongly determine the results; 2) reinforcers can be distinguished by a functional property called elasticity; 3) reinforcers may interact as complements as well as substitutes; 4) no simple choice rule, such as strict matching, can account for all choice behavior.     

Response rate and changeover performance on concurrent variable-interval schedules

Six pigeons were exposed to variable-interval schedules arranged on one, two, three, and four response keys. The reinforcement rate was also varied across conditions. Numbers of responses, the time spent responding, the number of reinforcements, and the number of changeovers between keys were recorded. Response rates on each key were an increasing function of reinforcement rate on that key and a decreasing function of the reinforcement rate on other keys. Response and time-allocation ratios under-matched ratios of obtained reinforcements. Three sets of equations were developed to express changeover rate as a function of response rate, time allocation, and reinforcement rate respectively. These functions were then applied to a broad range of experiments in the literature in order to test their generality. Further expressions were developed to account for changeover rates reported in experiments where changeover delays were varied.     

Effect of variable-interval punishment on the behavior of humans in variable-interval schedules of monetary reinforcement

One male and three female human subjects pressed a button for monetary reinforcement under a range of variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtraction of money) according to a variable-interval 170-second schedule. In the absence of punishment, the rate of responding was an increasing negatively accelerated function of reinforcement frequency, as predicted by Herrnstein's equation. The effect of the punishment schedule was to suppress responding under lower frequencies of reinforcement; responding under higher reinforcement frequencies was much less affected. This was reflected in an increase in the value of K_H (the constant expressing the reinforcement frequency corresponding to the half-maximal response rate), whereas there was no significant change in the value of R_max (the constant expressing the maximum response rate). Previous results had shown that variable-ratio punishment resulted in a change in the values of both constants (Bradshaw, Szabadi, and Bevan, 1977). The results of the present study were consistent with the concept that the suppressive effects of punishment on responding depend on the nature of the punishment schedule.     

Evaluating the impact of adaptive signal control technology on driver stress and behavior using real-world experimental data

While the operational and crash reduction benefits of adaptive signal control technology (ASCT) have long been investigated, the impact of this technology on driver behavior and stress is still uncertain. This study evaluated the impact of ASCT on driver behavior and stress in a real-world environment. Participants travelled through two arterial corridors, one equipped with ASCT and the other having traditional time-of-day coordinated signals. Driver stress was measured using a heart rate detector and a perceived stress scale while driver behavior was examined using vehicular trajectory data. Overall, driving behavior improved on the ASCT as compared to the non-ASCT corridor, as indicated by higher speeds and a fewer number of stops on the ASCT corridor relative to the non-ASCT corridor. Repeated measures ANOVA showed a statistically significant reduction in driver heart rate by −10 beats per minute over the ASCT corridor. A similar trend was observed for drivers’ perceived stress, analyzed by Wilcoxon sign ranked test. Driving behavior also showed significant improvement with ASCT presence, and speed was found to be negatively correlated with stress. Furthermore, the participants’ speed was controlled by the two systems i.e. ASCT and non-ASCT as expected. This study provides a significant proof of concept that ASCT can create positive improvements in driver stress and behavior that can be further investigated in the future.     

Effect of punishment on human variable-interval performance

Three female human subjects pressed a button for monetary reinforcement in a range of variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtracting money) according to a variable-ratio 34 schedule. In the absence of punishment, rate of responding was an increasing negatively accelerated function of reinforcement frequency; the relationship between response rate and reinforcement frequency conformed to Herrnstein's equation. The effect of the punishment schedule was to suppress responding at all frequencies of reinforcement. This was reflected in a change in the values of both constants in Herrnstein's equation: the value of the theoretical maximum response-rate parameter was reduced, while the parameter describing the reinforcement frequency corresponding to the half-maximal response rate was increased.     

Aftereffects of reinforcement on variable-ratio schedules

On each of variable-ratio 10, 40, and 80 schedules of reinforcement, when rats' lever-pressing rates were stable, the concentration of a liquid reinforcer was varied within sessions. The duration of the postreinforcement pause was an increasing function of the reinforcer concentration, this effect being more marked the higher the schedule parameter. The running rate, calculated by excluding the postreinforcement pause, was unaffected by concentration. The duration of the postreinforcement pause increased with the schedule parameter, but the proportion of the interreinforcement interval taken up by the pause decreased. Consequently, the overall response rate was an increasing function of the schedule parameter; i.e., it was inversely related to reinforcement frequency, contrary to the law of effect. The running rate, however, decreased with the reinforcement frequency, in accord with the law of effect. When 50% of reinforcements were randomly omitted, the postomission pause was shorter than the postreinforcement pause, but the running rate of responses was not affected.     

The magnitude-of-reinforcement function in closed and open economies.

It has been hypothesized that the magnitude-of-reinforcement effect may differ in closed and open experimental economies. We determined the relationship between magnitude of reinforcement and response rate in three feeding conditions: a closed economy in which total intake was unrestricted, a closed economy in which total intake was restricted so as to maintain body weight at 85% of free-feeding weight, and a traditional open economy in which subjects received food outside the experimental session. In the closed economies, regardless of body weight, the rats responded faster for smaller pellets and when the fixed ratio for pellets was higher. In the open economy, there was no reliable effect of pellet size or pellet cost on response rate. It is concluded that although there are circumstances in which response rate is an immediate function of the parameters of reinforcement, rate is not necessarily a measure of response strength. Response rate may instead, or additionally, contribute to a strategy of reducing the costs associated with resource utilization.     

Run length, visit duration, and reinforcers per visit in concurrent performance

The contingencies in each alternative of concurrent procedures consist of reinforcement for staying and reinforcement for switching. For the stay contingency, behavior directed at one alternative earns and obtains reinforcers. For the switch contingency, behavior directed at one alternative earns reinforcers but behavior directed at the other alternative obtains them. In Experiment 1, responses on the main lever, in S1, incremented stay and switch schedules and obtained a stay reinforcer when it became available. Responses on the switch lever changed S1 to S2 and obtained switch reinforcers when available. In S2, neither responses on the main lever nor on the switch lever were reinforced, but a switch response changed S2 to S1. Run lengths and visit durations were a function of the ratio of the scheduled probabilities of reinforcement (staying/switching). From run lengths and visit durations, traditional concurrent performance was synthesized, and that synthesized performance was consistent with the generalized matching law. Experiment 2 replicated and extended this analysis to concurrent variable-interval schedules. The synthesized results challenge any theory of matching that requires a comparison among the alternatives.     

Response-dependent prechoice effects on foraging-related choice

Three experiments explored the influence of prechoice events on pigeons' preference. In two of three studies, a fixed-interval 200-second prechoice period preceded the initial links of a concurrent chain in which outcomes differed either (a) in terms of the delay to food or (b) in terms of amount of food and delay to food. In Experiment 3, the prechoice period preceded the initial links that provided a choice between a small single food presentation and two identical, more delayed food presentations. In all three cases, obtained choice proportions did not vary as a function of prechoice duration. These results suggest that a local-contextual view adequately describes the foraging context; they also have implications for the appropriate formulation of the delay-reduction theory of conditioned reinforcement and rate-maximizing views of optimal foraging theory.     

Impaired verbal short-term memory in Down syndrome reflects a capacity limitation rather than atypically rapid forgetting

Individuals with Down syndrome suffer from relatively poor verbal short-term memory. Recent work has indicated that this deficit is not caused by problems of audition, speech, or articulatory rehearsal within the phonological loop component of Baddeley and Hitch's working memory model. Given this, two experiments were conducted to investigate whether abnormally rapid decay underlies the deficit. In a first experiment, we attempted to vary the time available for decay using a modified serial recall procedure that had both verbal and visuospatial conditions. No evidence was found to suggest that forgetting is abnormally rapid in phonological memory in Down syndrome, but a selective phonological memory deficit was indicated. A second experiment further investigated possible problems of decay in phonological memory, restricted to item information. The results indicated that individuals with Down syndrome do not show atypically rapid item forgetting from phonological memory but may have a limited-capacity verbal short-term memory system.