Time allocation on concurrent schedules with asymmetrical response requirements

Pigeons were trained on concurrent schedules in which key pecking was required by both schedules (concurrent variable-interval variable-interval schedules) and on concurrent schedules in which key pecking was required by only one of the schedules (concurrent variable-interval variable-time schedules). The distribution of reinforcements was systematically varied with both types of concurrent schedules. The distribution of time between the schedules depended on the reinforcement distribution and was independent of the symmetry of the response requirement. The relation between time and reinforcement distributions appears to be invariant over a wide range of manipulations of responding maintained by concurrent schedules.     

Choice, time allocation, and response rate during stimulus generalization

Six pigeons were trained to discriminate between two noise intensities using a procedure that assessed choice, time allocation, and response rate simultaneously and independently. Responses on the left or right key (R1 or R2) were respectively correct in the presence of two different intensities, S1 and S2. After a correct response, reinforcement became available for pecks on the center key. Reinforcement density for R1¦S1 relative to R2¦S2 was varied across experimental conditions. Generalization tests followed extensive training at each condition. As a function of stimulus intensity, proportions of initial choices of R2, of time spent in R2-initiated components, and of center-key responses emitted in R2-initiated components all yielded sigmoidal gradients of similar slope, which shifted slightly in location when relative reinforcement density changed. Changeovers were maximal where initial choice proportions approximated 0.5. Gradients relating the absolute number of center-key responses to stimulus intensity were also roughly sigmoidal, but were more sensitive to changes in reinforcement density. Gradients of momentary response rate also depended on reinforcement density. During training, large but transitory shifts in choice responding occurred when reinforcement density changed, while differences in momentary response rate developed slowly, suggesting separate control of choice and response rate by the contingencies of reinforcement.     

Time allocation and negative reinforcement

Pigeons' standing on one or the other side of a chamber was reinforced with timeout from electric shock on two concurrent variable-interval schedules. For two pigeons, the ratio of time spent on the left to time spent on the right approximately matched the ratio of timeouts obtained on the left to timeouts obtained on the right. The data of two other birds deviated from this relation, although in opposite directions. Overall, the results suggest that reduction in rate of electric shock plays a role in behavioral allocation analogous to that played by rate of positive reinforcement. It appears possible to describe aversive control and positive control within the same conceptual framework—that provided by the matching relation.     

Time allocation in human vigilance

Three human subjects detected unpredictable signals by pressing either of two telegraph keys. The relative frequencies with which detections occurred for the two alternatives were varied. The procedure included a changeover delay and response cost for letting go of a key. All subjects matched the relative time spent holding each key to the relative number of detections for that key, in conformity with the matching law. One subject's performance, which at first deviated from the relation, came into conformity with it when response cost was increased. Another subject's performance approximated matching more closely when the changeover delay was increased. The results confirm and extend the notions that choice consists in time allocation and that all behavior can be measured on the common scale of time.     

Time, rate, and conditioning

The authors draw together and develop previous timing models for a broad range of conditioning phenomena to reveal their common conceptual foundations: First, conditioning depends on the learning of the temporal intervals between events and the reciprocals of these intervals, the rates of event occurrence. Second, remembered intervals and rates translate into observed behavior through decision processes whose structure is adapted to noise in the decision variables. The noise and the uncertainties consequent on it have both subjective and objective origins. A third feature of these models is their timescale invariance, which the authors argue is a very important property evident in the available experimental data. This conceptual framework is similar to the psychophysical conceptual framework in which contemporary models of sensory processing are rooted. The authors contrast it with the associative conceptual framework.     

Time and rate measures in choice transitions

Three experiments with pigeons studied the relation between time and rate measures of behavior under conditions of changing preference. Experiment 1 studied a concurrent chain schedule with random-interval initial links and fixed-interval terminal links; Experiment 2 studied a multiple chained random-interval fixed-interval schedule; and Experiment 3 studied simple concurrent random-interval random-interval schedules. In Experiment 1, and to a lesser extent in the other two experiments, session-average initial-link wait-time differences were linearly related to session-average response-rate differences. In Experiment 1, and to a lesser extent in Experiment 3, ratios of session-average initial-link wait times and response rates were related by a power function. The weaker relations between wait and response measures in Experiment 2 appear to be due to the absence of competition between responses. In Experiments 1 and 2, initial-link changes lagged behind terminal-link changes. These findings may have implications for the relations between fixed- and variable-interval procedures and suggest that more attention should be paid to temporal measures in studies of free-operant choice.     

Time allocation, religious observance, and illness in Mayan horticulturalists

Analysis of individual differences in religious observance in a Belizean community showed that the most religious (pastors and church workers) reported more illnesses, and that there was no tendency for the religiously observant to restrict their interactions to family or extended family. Instead, the most religiously observant tended to have community roles that widened their social contact: religion did not aid isolation - thus violating a key assumption of the parasite-stress theory of sociality.     

Random fluctuations of response rate

A simple model for fluctuating interresponse times is developed and studied. It involves a mechanism that generates regularly spaced excitations, each of which can trigger off a response after a random delay. The excitations are not observable, but their periodicity is reflected in a regular patterning of responses. The probability distribution of the time between responses is derived and its properties are analyzed. Several limiting cases are also examined.This paper was completed while the writer was a visiting summer scientist at the Lincoln Laboratory, Lexington, Mass.     

The structure of response rate

Interresponse time distributions of the terminal rate under fixed-interval and fixed-ratio schedules were examined, using data from three rats in each case. By means of a sequential analysis, the overall interresponse time distributions were separated into orderly components. Consideration of the component distributions suggested that multiple determinants of rate act in succession, not simultaneously, and that probability of reinforcement has an important effect on the probability of occurrence of interresponse times.     

Time allocation in concurrent schedules: the effect of signalled reinforcement

The responses of five pigeons were reinforced on concurrent variable-interval variable-interval reinforcement schedules in which changeover key responses changed the stimulus and reinforcement schedules associated with the food key. While the reinforcement availability in one component remained unchanged throughout the experiment, the reinforcement availability in the other component was, during several conditions, signalled by the onset of an additional discriminative stimulus. During unsignalled conditions, both the relative frequency of responding and the relative time spent in each component approximated the obtained relative reinforcement frequency in each component. The effect of signalling reinforcer availability in one component was to (1) reduce responding in the signalled component to near-zero levels, and (2) increase the relative time in the unsignalled component, without a corresponding increase in the obtained relative reinforcement frequency. The magnitude of the increase in relative time in the unsignalled component decreased as the overall frequency of reinforcement increased. This deviation in the matching relation between relative time and the obtained relative reinforcement frequency was eliminated if the overall reinforcement frequency was increased before the signal was introduced and then, without removing the signal, gradually reduced.     

Effects of effort on response rate

Pigeons were trained to peck for food reinforcement, and the minimum effective force for a peck was varied. In a single-key situation, the response rate was unaffected up to a certain force value, beyond which increments caused a proportional decrement in response rate. Transient enhancement and suppression effects were observed following a change in the force requirement. A change from a high force requirement to a low force requirement resulted in a temporary enhancement of response rate above the stable performance level, whereas a change from a low to a high requirement produced a temporary suppression of the rate below the stable rate. In a two-key situation, the response rate on a key with a given force remained unaffected by the force requirement on the other key. When the rate of response was plotted against the required force, the resultant function was remarkably similar to that obtained from the single-key experiment. When the rates of reinforcement on the two keys differed, the decrement in response rate produced by an increase in the force requirement was proportionally greater on the key with the lower rate of reinforcement.     

Delay or rate of food delivery as determiners of response rate

Pigeons were confronted with two keys: a green food key and a white changeover key. Food became available for a peck to the green key after variable intervals of time (mean = 113 seconds). A single peck on the changeover key changed the color of the food key to red for a fixed period of time during which the timing of the variable-interval schedule in green was suspended and the switching option eliminated and after which the conditions associated with green were reinstated. In Experiment 1 a single food presentation was obtainable during each red-key period after a minimum delay timed from the switch. This delay and the duration of the red-key period were held constant during a condition but varied between conditions (delay = 2.5, 7.5, 15, or 30 seconds; red-period duration = 30, 60, 120, 240, or 480 seconds). In Experiment 2 additional food presentations were scheduled during a 240-second red-key period with the delay to the first food delivery held constant at 30 seconds, and the delays to later food deliveries varied over conditions. Considering the data from both experiments, the rate of switching to red was a decreasing function of the delay to the first food, the delay to the second food, and perhaps the delay to the third food after a switch. There was no clear evidence that the rate of food in the red-key period made an independent contribution. The ordering of response rates among conditions was consistent with the view that each food presentation after a response adds an incremental effect to the rate of the response and that each food presentation's contribution is a decreasing function of its delay timed from the response.     

Effects of reinforcement history on response rate and response pattern in periodic reinforcement

Several researchers have suggested that conditioning history may have long-term effects on fixed-interval performances of rats. To test this idea and to identify possible factors involved in temporal control development, groups of rats initially were exposed to different reinforcement schedules: continuous, fixed-time, and random-interval. Afterwards, half of the rats in each group were studied on a fixed-interval 30-s schedule of reinforcement and the other half on a fixed-interval 90-s schedule of reinforcement. No evidence of long-term effects attributable to conditioning history on either response output or response patterning was found; history effects were transitory. Different tendencies in trajectory across sessions were observed for measures of early and late responding within the interreinforcer interval, suggesting that temporal control is the result of two separate processes: one involved in response output and the other in time allocation of responding and not responding.     

Feedback functions, optimization, and the relation of response rate to reinforcer rate

The present experiment arranged a series of inverted U-shaped feedback functions relating reinforcer rate to response rate to test whether responding was consistent with an optimization account or with a one-to-one relation of response rate to reinforcer rate such as linear system theory's rate equation or Herrnstein's hyperbola. Reinforcer rate was arranged according to a quadratic equation with a maximum at a unique response rate. The experiment consisted of two phases, during which 6 Long Evans rats lever pressed for food. In the first phase of the experiment, the rats responded on six fixed-interval-plus-quadratic-feedback schedules, and in the second phase the rats responded on three variable-interval-plus-quadratic-feedback schedules. Responding in both phases was inconsistent with a one-to-one relation of response rate to reinforcer rate. Instead, different response rates were obtained at equivalent reinforcer rates. Responding did vary directly with the vertex of the feedback function in both phases, a finding consistent with optimization of reinforcer rate. The present results suggest that the feedback function relating reinforcer rate to response rate imposed by a reinforcement schedule can be an important determinant of behavior. Furthermore, the present experiment illustrates the benefit of arranging feedback functions to investigate assumptions about the variables that control schedule performance.     

Strategies for attention allocation in multiple input, multiple response tasks

9 tasks involving multiple inputs and multiple responses were administered. The tasks involved monitoring, shadowing, and ignoring, in all combinations, monaural and dichotic meassages. Miss rates were compared to determine the effect of adding additional demands to different tasks. Results suggested that, when a demand was added to a task, attention was allocated away primarily from those demands already receiving the greatest amounts of attention, to accommodate the new demand. When the new demand drew attention toward a channel, those demands already receiving the least amounts of attention gained the largest amounts. There were several exceptions to these trends, suggesting that the total amount of effort available for allocation was apparently an important variable. The implication of the results for research in attention was discussed.     

Differential reinstatement predicted by preextinction response rate

Reinstatement refers to the recovery of previously extinguished responding by the responseindependent delivery of a stimulus that was a reinforcer in training. Two experiments were conducted to examine relative reinstatement following the training of differential preextinction response rates, either with equal (Experiment 1) or unequal (Experiment 2) preextinction reinforcement rates. In Experiment 1, each of 3 pigeons first pecked at relatively high rates in the tandem variable-time 117-sec fixed-interval 3-sec component of a multiple schedule and at lower rates in a separate tandem variableinterval 117-sec fixed-time 3-sec component. Reinforcement rates were equal between components. Pecking then was extinguished in each component, before being reinstated under a multiple variabletime 120-sec variable-time 120-sec schedule. Greater reinstatement occurred in the component previously correlated with higher rates of pecking. In Experiment 2, in an initial condition, the mean rate of lever pressing for one group of 8 rats was significantly higher under a fixed-ratio 3 schedule than for another group of 8 rats under a fixed-ratio 1 schedule. Mean reinforcement rate was significantly higher for the group exposed to the fixed-ratio 1 schedule. For each group, lever pressing then was extinguished, before being reinstated under a variable-time 30-sec schedule. Significantly greater mean reinstatement occurred for the group previously exposed to the fixed-ratio 3 schedule. These results suggest that differential reinstatement may be predicted by preextinction response rate, perhaps independently of preextinction reinforcement rate.     

Assessing potency of high- and low-preference reinforcers with respect to response rate and response patterns

Previous research has suggested that the availability of high-preference stimuli may override the reinforcing efficacy of concurrently available low-preference stimuli under relatively low schedule requirements (e.g., fixed-ratio 1 schedule). It is unknown if similar effects would be obtained under higher schedule requirements. Thus, the current study compared high-preference and low-preference reinforcers under progressively increasing schedule requirements. Results for 3 of the 4 participants indicated that high-preference stimuli maintained responding under higher schedule requirements relative to low-preference stimuli. For 1 participant, high-preference and low-preference stimuli were demonstrated to be equally effective reinforcers under increasing schedule requirements. Implications with respect to rate of performance and response patterns are discussed.