Some parameters affecting the distributional properties of operant-level running in rats

Six adult female albino rats were subjected to operations known to increase the frequency of wheel-running. Operations included limited access to wheel, food deprivation, and protracted maintenance on a 24-hr feeding schedule. A distributional analysis of response duration, burst duration, and inter-burst interval showed that the increased frequency in all cases arose mainly from a shortening of the interval between successive bursts. Only short-term food deprivation produced any notable increase in burst length, and even here changes in both speed of the individual responses and in number of responses per burst were slight compared to changes in inter-burst interval.     

A two-phase model account of aversive classical conditioning performance in humans and rabbits

A two-phase model was applied to classical conditioning performance in man and rabbits. During phase 1, response probability remained constant. During phase 2, response probability generally increased, although one operator was sufficient for a majority of Ss and two operators were required for a minority of Ss. The latter Ss exhibited increases in responding after a CR trial and decreases in responding after a non-CR trial. The pattern of parameters was similar for man and rabbits. In man, increases in UCS intensity resulted in a decrease in the duration of phase 1 and an increase in the limit of the operators for those Ss requiring more than a single operator to describe performance during phase 2. The value of employing a model to describe the data and understand the effects of independent variable manipulation was discussed.     

Comparison of reinforcement and punishment functions produced by the same contingent event in the same subjects

The same event, forced running, was used to reinforce the lever-pressing of six rats in one component of a multiple schedule and to punish their drinking in another component. When the durations of running were converted to probabilities that Ss would not be running at t + n sec, given that the run gegan at t = 0 sec, both reinforcement and punishment were found to be linear (inverse) functions of the probability of not-running. A high concordance (0.90) between slopes of the reinforcement and punishment functions indicated that individual Ss were either sensitive to both reinforcement and punishment or sensitive to neither.     

Schedule constraint on the average drink burst and the regulation of wheel running and drinking in rats

Two experiments compared predictions of a molar-pattern model and a general molar behavior regulation model by requiring rats to wheel run for access to water. In both experiments schedule parameters constrained the baseline average burst length of drinking without constraining total drinking. Five levels of schedule constraint were imposed on time spent per drinking burst (Experiment 1) or the number of drinks per burst (Experiment 2). The results of both experiments supported the general molar behavior regulation view but not the molar-pattern model by showing no increase in total wheel running and no decrease in total drinking under schedule constraint. However, both experiments also showed local effects of drink burst constraint, including a direct relation between the degree of constraint and the local rate of drinking, and an approximation of the temporal distribution of baseline drinking under all degrees of schedule constraint. Most local changes support the view that rats defend the baseline temporal distribution of responding under schedule constraint, though some changes appear related to disruption of local response pattern characteristics.     

Aftereffects of reinforcement on variable-ratio schedules

On each of variable-ratio 10, 40, and 80 schedules of reinforcement, when rats' lever-pressing rates were stable, the concentration of a liquid reinforcer was varied within sessions. The duration of the postreinforcement pause was an increasing function of the reinforcer concentration, this effect being more marked the higher the schedule parameter. The running rate, calculated by excluding the postreinforcement pause, was unaffected by concentration. The duration of the postreinforcement pause increased with the schedule parameter, but the proportion of the interreinforcement interval taken up by the pause decreased. Consequently, the overall response rate was an increasing function of the schedule parameter; i.e., it was inversely related to reinforcement frequency, contrary to the law of effect. The running rate, however, decreased with the reinforcement frequency, in accord with the law of effect. When 50% of reinforcements were randomly omitted, the postomission pause was shorter than the postreinforcement pause, but the running rate of responses was not affected.     

Effects of pre-operant running and sucrose concentration on operant wheel running on a fixed interval schedule of reinforcement

Prior research proposed that temporal control over the pattern of operant wheel running on a fixed interval (FI) schedule of sucrose reinforcement is a function of automatic reinforcement generated by wheel running and the experimentally arranged sucrose reinforcement. Two experiments were conducted to assess this prediction. In the first experiment, rats ran for different durations (0, 30, 60, and 180 min) prior to a session of operant wheel running on a FI 120-s schedule. In the second experiment, the concentration of sucrose reinforcement on a FI 180-s schedule was varied across values of 0, 5, 15, and 25%. In Experiment 1, as the duration of pre-operant running increased, the postreinforcement pause before initiation of running lengthened while wheel revolutions in the latter part of the FI interval increased. In Experiment 2, wheel revolutions markedly increased then decreased to a plateau early in the FI interval. Neither manipulation increased temporal control of the pattern of wheel running. Instead, results indicate that operant wheel running is regulated by automatic reinforcement generated by wheel activity and an adjunctive pattern of running induced by the temporal presentation of sucrose. Furthermore, the findings question whether the sucrose contingency regulates wheel running as a reinforcing consequence.     

Choice in the repeated-gambles experiment

Humans chose 10 times between two roulette wheels projected on a monitor. During the first trial, the left wheel provided a hypothetical $100 with p = .94, and the right wheel provided $250 with p = .39. A titration procedure adjusted the probability of a $250 win across trials to permit estimation of an indifference point between alternatives. In Experiment 1, intertrial-interval duration (25 vs. 90 s) and whether sessions began with an intertrial interval or a trial were varied in a 2 × 2 design in this risky-choice procedure. Risk aversion (preference for the $100 wheel) increased with intertrial interval but was unaffected by whether sessions began with a trial or an intertrial interval. In Experiment 2, all sessions began with a trial, and subjects were informed that the experiment ended after 10 trials. Intertrial-interval duration had no effect on choice. In Experiment 3, intertrial-interval duration and whether subjects were given $10 or $10,000 before beginning were varied among four groups in a 2 × 2 design. In all other ways, the procedure was unchanged from Experiment 2. Intertrial interval had no effect on choice, but the $10,000 groups showed less risk aversion than the $10 groups. These results can be explained more readily in terms of Kahneman and Tversky's (1984) notion of “framing of the prospect” than in terms of Rachlin, Logue, Gibbon, and Frankel's (1986) behavioral account of risky choice.     

On the discriminative control of concurrent responses: the relations among response frequency, latency, and topography in auditory generalization

Human subjects were used in a study of auditory generalization following multiple-response discrimination training. The relations observed among stimulus intensity, response probability, and response latency were invariant with respect to whether the two vocal responses conditioned were topographically discrete, as in one experiment, or topographically continuous, as in another. The major findings were:

1. The probabilities associated with a specific response were maximal over several stimulus values at the extreme ends of the continuum, then dropped sharply at stimuli intermediate to the initial S^D's as the probability of the alternative response increased.

2. Overall response latency was inversely related to the relative frequency of the two responses at each stimulus value. When the two responses were most nearly equal in probability, latencies were maximal; when one response had close to unit or zero probability, latencies were minimal.

3. Analysis of the latencies of the two responses, taken separately, revealed: (a) an increase in latency as the difference between the test stimulus and the initial S^D increased; (b) a sharp discontinuity in the latency gradient and reversal in trend at intermediate stimulus intensities; and (c) at a given stimulus value, latencies associated with the stochastically dominant response were consistently shorter than those of the nondominant response.

4. No changes in response topography (fundamental frequency) were correlated with the characteristic changes in probability and latency during stimulus generalization.

     

Deprivation and satiation: The interrelations between food and wheel running

Two experiments were designed to assess whether depriving rats of food would increase the reinforcement effectiveness of wheel running (Experiment 1) and whether satiation for wheel running would decrease the reinforcement effectiveness of food (Experiment 2). In Experiment 1, a progressive-ratio schedule was used to measure the reinforcement effectiveness of wheel running when rats were deprived or not deprived of food. Completion of a fixed number of lever presses released a brake on a running wheel for 60 s, and the response requirement was systematically increased until the rat stopped pressing or until 8 hr had elapsed. The ratio value reached (and the total number of lever presses) was an inverted-U function of food deprivation (percentage body weight). In Experiment 2, when wheel running preceded test sessions, fewer food-reinforced lever presses were maintained by the progressive-ratio schedule, and responding occurred at a lower rate on a variable-interval schedule. An interpretation of these results is that deprivation or satiation with respect to one event (such as food) alters the reinforcement effectiveness of a different event (such as access to wheel running).     

ON THE INABILITY OF INTERVAL TIME SAMPLING TO REFLECT FREQUENCY OF OCCURRENCE DATA1

Interval time sampling yields the result, percentage of intervals scored. It is rudimentary to note that this measure per se does not constitute a response dimension. It is a useful behavioral measure, therefore, only to the extent that it accurately reflects the nature and degree of the fundamental dimensions from which it is drawn i.e., frequency and duration. The correspondence between scored intervals and response duration is fairly well understood (Journal of Applied Behavior Analysis, 1975, 8 , 463–469; 1977, 10 , 325–332). This study determined the correspondence between scored intervals and response frequency. Eleven, 30-minute experimental sessions that differed along the variables of frequency of occurrence and time per response (the average length of a response per session) were computer simulated. In the first group of four sessions, the frequencies were 45, 100, 150, and 300; in these sessions, all responses ranged from one to three seconds. In the second group of four sessions, the frequencies were 31, 61, 101, and 152; in these sessions, all responses ranged from three to nine seconds. In the last group of three sessions, the frequencies were 25, 34, and 50; here, all responses ranged from nine to 27 seconds. The response distribution within the above ranges was rectangular, with each whole second represented once. The responses were selected by a random number generator, and on each trial every number in the distribution had an equal probability of occurrence. These provisions produced a linear pattern of responding. The time per response in the three groups of sessions were 2, 6, and 18 seconds. For all sessions, event recordings were made and analyzed. The analysis consisted of using partial interval time sampling to determine the percentage of intervals scored; this total was subdivided into intervals containing (1) single responses, (2) multiple responses, (3) continuing responses, and (4) response initiations or terminations. The analysis was performed when the length of the observation interval was 5, 10, 20, 30, 60, and 120 seconds. An additional session drawn from a study that contained real-life data was subjected to this same analysis. The most significant results were derived by finding the ratio of scored intervals containing single responses to the total intervals scored. If every scored interval contained a single response, this ratio would equal 1.0; if no scored interval contained a single response, the ratio would be 0.0. It can be seen that this ratio is an objective expression of the validity of interval time sampling as a measure of response frequency. Of 66 data points (11 sessions × six observation lengths per session), only five were equal to or greater than 0.80. These five points were all found in just two sessions (f = 45, 100). A validity index of less than 0.50 was observed in 49 of the 66 points. Also, the validity index increased, peaked, and then decreased within sessions as the length of the observation interval was increased. The results from the real-life session were in close agreement with those obtained from the simulations. The importance of these and previous findings lies in the demonstration that changes in scored intervals need not represent true behavior change. The data indicate that there are many combinations of behavioral frequency and duration where interval time sampling cannot produce valid measurement results.     

Information search and the effects of failure: A test of complexity theory

The effects of increasing failure and the structural complexity of decision-making teams on four aspects of information search and utilization were examined. Twenty-four structurally homogeneous dyads and 12 unselected control dyads served as Ss in a complex experimental simulation running for six 30-min periods. Information load was held constant at 7 inputs per period. The proportion of failure inputs was sequentially increased from 1:7 in period 1 through 6:7 in period 6. Dyads in the control condition were not exposed to failure. It was found that structurally simple Ss engaged in more delegated information search than complex Ss. Self-initiated information search initially increased, then remained fairly constant at higher proportions of failure. Contrary to expectations, no differences were found between simple and complex Ss in self-initiated search. Complex dyads exceeded simple dyads on two measures of information utilization. The number of search moves used in integrative decisions produced an inverted U-shaped curve with optimal levels at moderate proportions of failure. Efficiency of information utilization showed a general decrease as failure increased. The data produced limited support for complexity theory and did support, where applicable, the information search theories of Lanzetta and Feather.     

Intercurrent and reinforced behavior under multiple spaced-responding schedules

Lever pressing in rats was reinforced with food under a multiple spaced-responding schedule. A lever, food cup, and drinking tube were mounted in a running wheel so that lever pressing, running, and licking could be recorded. Running and licking had no scheduled consequences. Lever pressing was reinforced under a multiple schedule with three spaced-responding components and an extinction component. Each component was associated with a different auditory stimulus. Spaced-responding components reinforced only lever presses terminating interresponse times equal to or greater than 10, 20, or 60 sec, respectively. Rates of lever pressing, reinforcement, and licking all decreased as schedule parameter increased. Efficiency of spaced responding, as measured by reinforcements per response, also decreased. Rate of wheel running either increased or increased and then decreased with increasing schedule parameter. Individual running rates differed substantially. Neither licking nor running rate correlated with individual differences in efficiency. Analysis of conditional probabilities among the several response classes showed that, as the schedule requirement increased, the probability of running after a lever press increased and the probability of licking after a lever press decreased. After reinforcement, one subject always pressed the lever next. In the other subjects, the conditional probability of lever pressing, given reinforcement, increased while the probability of licking, given reinforcement, decreased with increasing schedule requirement. Results are discussed in relation to the concepts of schedule-induced and mediating behavior.     

Rate differential reinforcement in monkey manipulation

A set of four manipulanda were presented to four Cebus monkeys, individually, and later in pairs. Step 1 provided an estimate of each S's probability of operating each item, while Step 2 determined whether pairing the items would disturb the ordinal relations among individual response probabilities. Both procedures provided information necessary for testing the assumption that a reinforcer is simply a contingent response whose independent probability of occurrence is greater than that of the associated instrumental response. Step 3 tested this assumption by again presenting pairs of items, but with one locked and its operation made contingent upon operation of the free item of the pair. The four Ss differed markedly in the extent to which the items produced different independent response probabilities, and correspondingly, in the extent to which the contingent pairs subsequently produced reinforcement. Confirmation of the present assumptions came primarily from one S, which differed substantially on the individual items, and showed five cases of reinforcement, all in the predicted direction. Further, reinforcement was shown by an increase in both contingency and extinction sessions. Finally, the response of intermediate probability reinforced the response of least, but not the one of greatest, probability, indicating that a reinforcer cannot be identified absolutely, but only relative to the base response.     

Diversity and substitutability of adjunctive activities under fixed-interval schedules of food reinforcement

Six rats received food contingent on pressing a lever on fixed-ratio 1, fixed-interval 30-second, and fixed-interval 60-second schedules, with concurrent access to a drinking spout, a running wheel, and a block of wood. Drinking, running, and chewing were monitored automatically, and these and other activities were observed directly during selected sessions. Because all sessions ended after delivery of 60 pellets, total time available for activities other than eating increased over the three schedules. Time spent contacting the lever and visiting the food tray increased in proportion to total available time, whereas the time spent in other activities changed in a complex manner such that drinking was the dominant adjunctive behavior in the 30-second condition, and running or chewing the dominant adjunctive behavior in five of six rats in the 60-second condition. General activity and grooming also occupied significant amounts of time. In a subsequent part of the experiment, running and chewing were prevented, and the majority of other activities, especially drinking and grooming, increased. The results show that (a) FI schedules of food reinforcement are accompanied by a wide variety of adjunctive activities; (b) the preferred activity differs according to the schedule duration; and (c) the extent to which activities substitute for one another is limited by the tendency for different activities to occupy different parts of the interreinforcement interval.     

Responding time: A response equivalent to inspection time

A response equivalent to ‘inspection time’ (IT) was developed using a reaction time task in which Ss were required to respond as quickly and accurately as possible to whichever one of two lights appeared on each of a number of trials. The appearance of the lights was followed on all trials by a backward mask. IT was estimated for each S as the shortest duration between the onsets of the light and the backward mask at which the S could respond accurately on virtually every trial. An estimate of ‘responding time’ was then made by setting the duration between the stimulus onset and the mask to each S's individual IT and gradually reducing the time between trials so that Ss had less and less time in which to respond correctly. Responding time was taken to be the shortest such interval at which the S could respond accurately on virtually every trial. This measure was found to be reliable although quantitatively different estimates were obtained using two different methods of presenting the stimulus trials. Responding time was longer for a group of lower-intelligence Ss than for a group of higher-intelligence Ss and the measure was also found to correlate with measured intelligence in the former group. However, it did not itself correlate significantly with IT suggesting that responding time and IT may be measuring different underlying processes.     

Alternative reinforcement effects on fixed-interval performance

Pigeons' key pecks were reinforced with food on a fixed-interval schedule. Food also was available at variable time periods either independently of responding or for not key pecking (a differential-reinforcement-of-other-behavior schedule). The latter condition arranged reinforcement following the first pause of t seconds after it became available according to a variable-time schedule. This schedule allowed separation of the effects of pause requirements ≤ five-seconds and reinforcement frequency. The time spent pausing increased as the duration of the pause required for reinforcement increased from 0 to 30 seconds and as the frequency of reinforcement for pausing increased from 0 to 2 reinforcers per minute. Key pecking was more evenly distributed within each fixed interval with shorter required pauses and with more frequent reinforcement for pausing. The results complement those obtained with other concurrent schedules in which the same operant response was reinforced in both components.     

Effects of a coactor's prediction on latencies to predict and indentify stimuli

On each of 300 trials E's confederate (C) verbalized which of two stimuli would occur; then S made a prediction. Following each presentation, S and C pulled a trigger to identify the stimulus. Two latencies were measured: the interval between C's and S's prediction (prediction time), and the interval between stimulus presentation and S's identification response (choice RT). Prediction times were significantly shorter when S's prediction agreed rather than disagreed with C's prediction, when S's preceding prediction was correct rather than incorrect, and when S was female rather than male. Choice RT was influenced by distributions of C's stimulus predictions and C's prediction outcomes in directions supporting an expectancy model.     

The effects of active choice,shock duration,shock experience,and probability on the choice between immediate and delayed shock

The choice between immediate and delayed shock was investigated in three experiments with college students. Some Ss were required to choose between a longer-duration shock immediately and a shorter-duration shock later. Immediate, as opposed to delayed, choices were more frequent when: (a) Ss were required to choose the immediate or the delayed shock in contrast to other procedures in which Ss were required to choose immediate shock or passively wait for automatic shock to occur, (b) the duration of the immediate shock was reduced, (c) the S was given prior experience with shock, and (d) the probability of the immediate shock was reduced. Under some circumstances, shock delay and anxiety increased the frequency of immediate choices.     

Two-key concurrent responding: response-reinforcement dependencies and blackouts

Two-key concurrent responding was maintained for three pigeons by a single variable-interval 1-minute schedule of reinforcement in conjunction with a random number generator that assigned feeder operations between keys with equal probability. The duration of blackouts was varied between keys when each response initiated a blackout, and grain arranged by the variable-interval schedule was automatically presented after a blackout (Exp. I). In Exp. II every key peck, except for those that produced grain, initiated a blackout, and grain was dependent upon a response following a blackout. For each pigeon in Exp. I and for one pigeon in Exp. II, the relative frequency of responding on a key approximated, i.e., matched, the relative reciprocal of the duration of the blackout interval on that key. In a third experiment, blackouts scheduled on a variable-interval were of equal duration on the two keys. For one key, grain automatically followed each blackout; for the other key, grain was dependent upon a response and never followed a blackout. The relative frequency of responding on the former key, i.e., the delay key, better approximated the negative exponential function obtained by Chung (1965) than the matching function predicted by Chung and Herrnstein (1967).