Delay or rate of food delivery as determiners of response rate

Pigeons were confronted with two keys: a green food key and a white changeover key. Food became available for a peck to the green key after variable intervals of time (mean = 113 seconds). A single peck on the changeover key changed the color of the food key to red for a fixed period of time during which the timing of the variable-interval schedule in green was suspended and the switching option eliminated and after which the conditions associated with green were reinstated. In Experiment 1 a single food presentation was obtainable during each red-key period after a minimum delay timed from the switch. This delay and the duration of the red-key period were held constant during a condition but varied between conditions (delay = 2.5, 7.5, 15, or 30 seconds; red-period duration = 30, 60, 120, 240, or 480 seconds). In Experiment 2 additional food presentations were scheduled during a 240-second red-key period with the delay to the first food delivery held constant at 30 seconds, and the delays to later food deliveries varied over conditions. Considering the data from both experiments, the rate of switching to red was a decreasing function of the delay to the first food, the delay to the second food, and perhaps the delay to the third food after a switch. There was no clear evidence that the rate of food in the red-key period made an independent contribution. The ordering of response rates among conditions was consistent with the view that each food presentation after a response adds an incremental effect to the rate of the response and that each food presentation's contribution is a decreasing function of its delay timed from the response.     

Dynamic equilibrium on a cyclic-interval schedule with a ramp

Five human subjects pressed a panel for money on a cyclic-interval schedule that arranged recurring periods of linearly increasing reinforcement rates (ramps). Response rate versus time functions for all subjects showed recurring periods of linearly increasing response rates. The responding of four of the five subjects was in phase with the reinforcement input. The remaining subject showed a two-minute phase shift. These results suggest that organisms may act like simple amplifiers on cyclic-interval schedules, that is, the form of the input signal is not changed by the organism, but is returned with amplification. By analogy with the variable-interval case, the controlling variable on cyclic-interval schedules with rate ramps may be the constant reinforcement acceleration that is arranged by the schedule.     

Economic substitutability of electrical brain stimulation, food, and water.

Concurrent variable-ratio schedules of electrical brain stimulation, food, and water were paired in various combinations as reinforcement of rats' lever presses. Relative prices of the concurrent reinforcers were varied by changing the ratio of the response requirements on the two levers. Economic substitutability, measured by the sensitivity of response ratio to changes in relative price, was highest with brain stimulation reinforcement of presses on both levers and lowest with food reinforcement of presses on one lever and water reinforcement of presses on the other. Substitutability with brain stimulation reinforcement of presses on one lever and either food or water reinforcement for presses on the other was about as high as with brain stimulation for presses on both levers. Electrical brain stimulation for rats may thus serve as an economic substitute for two reinforcers, neither of which is substitutable for the other.     

Sensory superstition on multiple interval schedules.

Pigeons were exposed to multiple schedules in which an irregular repeating sequence of five stimulus components was correlated with the same reinforcement schedule throughout. Stable, idiosyncratic, response-rate differences developed across components. Components were rank-ordered by response rate; an approximately linear relation was found between rank order and the deviation of mean response rate from the overall mean rate. Nonzero slopes of this line were found for multiple fixed-interval and variable-time schedules and for multiple variable-interval schedules both when number of reinforcements was the same in all components and when it varied. The steepest function slopes were found in the variable schedules with relatively long interfood intervals and relatively short component durations. When just one stimulus was correlated with all components of a multiple variable-interval schedule, the slope of the line was close to zero. The results suggest that food-rate differences may be induced initially by different reactions to the stimuli and subsequently maintained by food.     

Foraging in a simulated natural environment: There's a rat loose in the lab

Rats were required to earn their food in a large room having nine boxes placed in it, each of which contained food buried in sand. In different phases of the experiment the amount of time allowed for foraging, the amount of food available in each food patch, and the location of the different available amounts were varied. The rats exhaustively sampled all patches each session but seemed to have fairly strong preferences for certain locations over others. If position preferences were for patches containing small amounts of food, the sensitivity to amount available was increased so that when location was compensated for, a pattern of optimal foraging was evident. The importance of environmental constraints in producing optimal behavior and the relation of the observed behavior to laboratory findings are discussed.     

Perception of autonomic reactions and actual heart rate in phobic patients

The relationship between perceived physiological arousal and actual heart-rate reactions was studied in two behavioral test situations. The subjects were 70 phobic patients (34 social phobics and 36 claustrophobics) who were given the general form of the Autonomic Perception Questionnaire about 1 month before the respective behavioral test and the specific form immediately after the test. The results showed significant correlations between APQ and actual heart rate for the social phobics, while the picture was more complicated for the claustrophobics. The implications of these results are discussed.This research was supported by Grant 05452 from the Swedish Medical Research Council.     

Effects of food deprivation and reinforcement magnitude on conditioned suppression

In Experiment I, the responding of rats lever pressing on a variable-interval schedule for sucrose solution was partially suppressed by a variable duration conditioned stimulus followed by shock. When food deprivation was increased, response rates during and before the conditioned stimulus increased monotonically. Varying the concentration of sucrose across blocks of sessions or from session to session in a semi-random sequence had little effect on response rates either before or during the conditioned stimulus. With a fixed sequence of increasing concentrations across a five-session block, increased concentration produced much more rapid increases in response rates before than during the conditioned stimulus. In Experiment II, rats were presented with the same sequence of increasing concentrations across a five-session block. When tested at 80% body weight, response rates increased rapidly as concentration increased, but at 100%, body-weight rates increased only slightly. The effect of a change in body weight in Experiment II thus mimicked the effect of the conditioned stimulus in the latter part of Experiment I. These findings support the view that the effect of a pre-aversive conditioned stimulus is similar to that of a change in food deprivation, but unlike that of a change in reinforcement magnitude.     

The effects of instructions, incentive, and feedback on a community problem: dormitory noise

A reinforcement system utilizing instructions, modelling, feedback, and group reinforcement was employed in an attempt to reduce disruptive noise on three university residence halls. A fourth hall received the same treatment program without the reinforcement component. Noise scores were determined by recording the number of discrete noise occurrences over a criterion decibel level. On all four residential floors, noise scores during treatment conditions were lower than initial and final baseline levels. Additionally, periods of noise reduction corresponded to the changing criterion multiple-baseline and reversal designs utilized. Pre- and posttreatment questionnaire responses from the three reinforcement floors paralleled changes in objective noise data. At posttreatment, residents reported less noise disturbance of study and sleep and more control over the noise situation and floor problems in general. These results indicated that a comprehensive behavior-modification treatment package was effective in reducing disruptive noise in university residence halls. Difficulties in data collection and anomalies in the data are discussed. Future directions for field-based behavior-modification research are outlined.     

Effects of two teacher-presentation rates on off-task behavior, answering correctly, and participation

Off-task behavior, correct answering, and participation during beginning reading instruction were recorded for two low-achieving first-grade children during two different rates of teacher presentation. A slow-rate presentation (A) was compared with a fast-rate presentation (B) in an ABABAB design. In slow-rate presentation, there was a delay between the children's response and introduction of the next task. In fast-rate presentation, there was no delay. A new teacher taught during the final AB phases, which allowed for a brief replication. Both teachers were reminded on a fixed-interval 90-sec schedule throughout all phases of the experiment to praise the subjects, thus preventing a confounding of social praise and rate of teacher presentation. Fast-rate presentation was accompanied by a lower per cent occurrence of off-task behavior for both Subjects 1 and 2. For Subject 1, correct answering and participation were more frequent during all three fast-rate phases. For Subject 2, correct answering and participation were more frequent during the fast-rate phases after the first reversal.     

A comparison of the key-peck and treadle-press operants in the pigeon: differential-reinforcement-of-low-rate schedule of reinforcement

Key pecking and treadle pressing in pigeons were compared under concurrent (key-treadle) and single-operant differential-reinforcement-of-low-rate schedules of food reinforcement ranging from 5 to 60 sec (concurrent procedure) or 5 to 120 sec (single-operant procedure). Under both procedures, the two operants followed the same general law: decreasing response rate and reinforcement rate and increasing number of responses per reinforcement as a function of increasing schedule interval. High correlations were found between key pecking and treadle pressing for the measures of response rate, reinforcement rate, and responses per reinforcement. Regression equations allowed the prediction of treadle pressing from key pecking. More bursting occurred in responding to the key, and key pecking showed a more precise temporal discrimination than treadle pressing. A test for sequential dependencies between key and treadle responses showed significant dependencies not only under the concurrent procedure but also in data created artificially by merging key and treadle sequences from different pigeons under the concurrent procedure and from the same pigeon under the single-operant procedure. It seems likely that the sequential dependencies found were due to the independent action of the schedule on each operant and that behavioral dependencies did not occur with the concurrent training procedure. The key-peck operant does not appear to have any special qualities that preclude its use in discovering general laws of behavior, at least under the differential-reinforcement-of-low-rate schedule. The usefulness of the key peck in other situations requires direct experimental study.