How western scrub-jays (Aphelocoma californica) select a nut: effects of the number of options, variation in nut size, and social competition among foragers

Western scrub-jays (Aphelocoma californica) often visually assess and handle several whole (unshelled) peanuts before selecting one to transport and cache; this behavior is a search for a preferred heavy nut. I repeatedly video-taped individually identifiable jays as they landed on a feeding platform and chose from presentations of peanuts that varied in the number of items or in the distribution of sizes. I examined how differences among these presentations and a bird’s social status affected the amount of assessment and the economic consequences of choice. I also examined the specific patterns of handling peanuts, called sampling, to quantify the degree to which sampling sequences were typified by repeated comparisons among sampled peanuts (retrospective sampling), or sequential assessment and rejection of peanuts (prospective sampling). Peanut assessment was more extensive and prospective when there were many options from which to choose than when there were few. Peanut assessment was more extensive and retrospective when options were similar in size than when they varied. Scrub-jays were more likely to make repeated comparisons immediately before selecting a peanut than elsewhere in a sampling sequence. Subordinate scrub-jays, who were at the greatest risk of pre-emption by competitors, assessed peanuts less extensively and were more prospective in their sampling than dominants. Unless peanuts were very similar in size, jays were more accurate at selecting a high-quality peanut and achieved a higher rate of food storage than if they had not assessed. These results show that scrub-jays can adaptively modify how they search to improve their rate of food storage, and also suggest some of the specific search tactics used by jays when assessing peanuts. Received: 26 April 1999 / Accepted after revision: 10 October 1999     

Leaving patches: effects of economy, deprivation, and session duration

Three pigeons pecked keys for food reinforcers in a laboratory analogue of foraging in patches. Half the patches contained food (were prey patches). In prey patches, pecks to one key occasionally produced a reinforcer, followed by a fixed travel time and then the start of a new patch. Pecks to another key were exit responses, and immediately produced travel time and then a new patch. Travel time was varied from 0.25 to 16 s at each of three session durations: 1, 4, and 23.5 hr. This part of the experiment arranged a closed economy, in that the only source of food was reinforcers obtained in prey patches. In another part, food deprivation was manipulated by varying postsession feeding so as to maintain the subjects' body weights at percentages ranging from 85% to 95% of their ad lib weights, in 1-hr sessions with a travel time of 12 s. This was an open economy. Patch residence time, defined as the time between the start of a patch and an exit response, increased with increasing travel time, and consistently exceeded times predicted by an optimal foraging model, supporting previously published results. However, residence times also increased with increasing session duration and, in longer sessions, consistently exceeded previously reported residence times in comparable open-economy conditions. Residence times were not systematically affected by deprivation levels. In sum, the results show that the long residence times obtained in long closed-economy sessions should probably be attributed to session duration rather than to economy or deprivation. This conclusion is hard to reconcile with previous interpretations of longer-than-optimal residence times but is consistent with, in economic terms, a predicted shift in consumption towards a preferred commodity when income is increased.     

Insulin, exercise, and dietary effects upon behavioral thermoregulation in albino rats

The objectives of this exploratory research were to assess the effects of insulin preparations (Humulin-regular and NPH) on operant behavior reinforced by schedules of microwave radiation in a cold environment and to measure changes in this thermoregulatory behavior as a function of exercise and food deprivation. Eight albino rats were conditioned to regulate their thermal environment with 6-sec. exposures of microwave (MW) radiation (SAR = 0.34 Watts/kg/(mW/cm2) under FR-1 and FR-10 schedules. Regular-insulin and NPH-insulin sessions were administered alternately with saline-control sessions for 8-hr. durations. Exercise in an activity wheel and 48 hr. of food deprivation (diet) were additional independent variables used to alter thermoregulation. Three randomized-block analysis of variance designs with repeated measures showed that insulin preparations resulted in a suppression of operant responding for heat, yet food deprivation increased rates of microwave responding. These data are interpreted in terms of functional relationships between ambient temperature changes, core body temperature, blood glucose fluctuations, and operant behavior.     

Behavioral contrast and the automaintained key peck

In two experiments behavioral contrast was demonstrated during discrimination training in a positive automaintenance procedure. During the baseline condition in each experiment, a key was transilluminated for eight seconds by one of two colors (CS) following a variable intertrial interval signaled by a dark key. Keylight transillumination terminated with a response-independent food presentation. In the first experiment, food was eliminated during one CS for up to fifty sessions. After reinstatement of food following each CS, the discrimination was reversed. Six of the eight subjects showed positive behavioral contrast, i.e., response rates increased during the CS associated with food as they decreased during the CS associated with no food. The effect was replicated in Experiment II, but it did not occur when both the food and its associated CS were eliminated. These results were comparable to those obtained with operant discrimination training procedures (behavioral contrast) and with Pavlovian discrimination training. The results suggest that additivity theories of behavioral contrast may be insufficient to account for these data.     

Operant hoarding: a new paradigm for the study of self-control.

In the first of four experiments, rats were exposed to a modified multiple continuous reinforcement-extinction schedule during 15-min daily sessions. In one condition (saves condition) with the cuelight on, a single lever press produced a food pellet, briefly extinguished the cuelight, and started a clock. Saves (additional lever presses with interresponse times less than 1 s) produced an additional food pellet, briefly extinguished the cuelight, and restarted the interresponse time clock. The cuelight was extinguished 1 s after the last lever press and remained off during a 10-s period of extinction, during which no food pellets were delivered. In the other condition (savings account condition), the contingencies were the same except that the cuelight was extinguished and was not reilluminated after the initial lever press, and the delivery of all food pellets in the reinforcement component was delayed until the onset of extinction. In both conditions, rats made saves, but mean saves (total saves divided by the number of reinforcement components) were slightly reduced in the savings account condition. In Experiment 2, using six equally spaced 15-min sessions per day on alternate days, saves were either followed immediately with food and brief cuelight offset (saves condition) or were not reinforced at all. Mean saves were much greater when saves were reinforced. In Experiment 3, during 5-min daily sessions, saves earned a single pellet (savings account condition) or a number of pellets equal to the ordinal number of the lever press (interest condition). Rats made fewer mean saves, with little change in the food rate, when saves earned interest. In Experiment 4, the rats earned all their food in the operant situation during 24 daily 5-min sessions, these separated by 55-min intersession intervals during which no food was available; otherwise, the conditions were the same as in Experiment 3. In Experiment 4, the shift to interest for saves led to an increase in mean daily mean saves (total daily mean saves divided by the number of daily sessions) as well as to an increase in the number of food pellets delivered in each session. The results are discussed in terms of self-control and behavioral economics.     

Towards mouse models of perseveration: a heritable component in extinction of operant behavior in fourteen standard and recombinant inbred mouse lines

Extinction of instrumental responses is an essential skill for adaptive behavior such as foraging. So far, only few studies have focused on extinction following appetitive conditioning in mice. We studied extinction of appetitive operant lever-press behavior in six standard inbred mouse strains (A/J, C3H/HeJ, C57BL/6J, DBA/2J, BALB/cByJ and NOD/Ltj) and eight recombinant inbred mouse lines. From the response rates at the end of operant and extinction training we computed an extinction index, with higher values indicating better capability to omit behavioral responding in absence of reward. This index varied highly across the mouse lines tested, and the variability was partially due to a significant heritable component of 12.6%.To further characterize the relationship between operant learning and extinction, we calculated the slope of the time course of extinction across sessions. While many strains showed a considerable capacity to omit responding when lever pressing was no longer rewarded, we found a few lines showing an abnormally high perseveration in lever press behavior, showing no decay in response scores over extinction sessions.No correlation was found between operant and extinction response scores, suggesting that appetitive operant learning and extinction learning are dissociable, a finding in line with previous studies indicating that these forms of learning are dependent on different brain areas. These data shed light on the heritable basis of extinction learning and may help develop animal models of addictive habits and other perseverative disorders, such as compulsive food seeking and eating.     

Within-session meal-size effects on induced drinking.

As a control for the effects of session duration and hunger on the relation between food magnitude and induced drinking, four food-deprived rats were exposed to a variable-time 50-s schedule of food delivery in which the size of each food delivery varied randomly within sessions. Food-related behavior and schedule-induced drinking per opportunity were examined as functions of meal size and postfood time. All rats showed an inverted-U-shaped relation between drinking per opportunity and meal size. This relation was caused by variation in the percentage of intervals that contained drinking and by variation in the number of drinking bouts per interval, rather than by bout duration or by the amount of drinking within those intervals that actually contained drinking. Head-in-feeder time increased linearly with meal size. Schedule-induced drinking was entrained by food delivery in 3 of 4 subjects; the entrainment was due to regulation of the starting time of each drinking bout rather than to regulation of bout duration.     

How does the ecological foraging behavior of desert kangaroo rats (Dipodomys deserti) relate to their behavior on radial mazes?

Experiment 1 showed that laboratory-reared desert kangaroo rats, like domestic Norway rats, efficiently search for food on a radial arm maze (RAM) by avoiding revisiting arms within a trial. By placing an RAM on the floor so the animals could approach food from any direction, Experiment 2 tested whether efficient search by kangaroo rats was based on tactics of distance minimizing, central-place foraging, trail following, or meandering. In contrast to the dominant trail-following tactic of domestic Norway rats (Hoffman, Timberlake, Leffel, & Gont, 1999), kangaroo rats tended to distance minimize, whether maze arms were present or not. Experiment 3 indicated that kangaroo rats treated a floor configuration of eight food cups as two patches of four, based on beeline travel between patches and meandering within them. We conclude that similar performance in an elevated RAM by different species can be based on different tactics, and we suggest that a laboratory apparatus can be used to cast light on niche-related mechanisms.     

Kurz- und Langzeitbehandlung in der Verhaltenstherapie

In Germany, short and long-term psychotherapy are the two established forms for providing basic outpatient cognitive behavior therapy. The goal of the current study is to describe and discuss empirical evidence for these two structural forms; therefore, results from randomized controlled trials are presented and their implications related to the optimal number of therapy sessions are described. Furthermore, important results of naturalistic process outcome research are outlined. Additionally, the individual needs of patients for specific numbers of sessions are described based on data from the Association of Statutory Health Insurance Physicians. The results of randomized controlled trials generally showed strong empirical evidence for the efficacy of short-term cognitive behavior therapy of 7–20 sessions in patients with simple diagnoses; however, there is less empirical evidence in relation to the general efficacy and differential indications for long-term behavior therapy. These study results are supported by data from 200,000 patients receiving outpatient treatment in the German healthcare system. In two thirds of these patients, less than 25 sessions were sufficient to achieve subjectively adequate clinical improvement; however, approximately 10?% of the patients needed more than 60 therapy sessions. Empirical evidence concerning outcomes of long-term therapy with such a high number of sessions is scarce. Future research should address this research gap in order to identify empirically-based individual adaptation rules concerning the optimal number of treatment sessions in long-term therapy.     

Cue-exposure therapy to decrease alcohol craving in virtual environment.

During abstinence from alcohol, craving is elicited by the cues and contexts previously associated with alcohol, which contribute to relapse. To prevent the craving and relapse experienced by alcoholics, cue-exposure therapy (CET) has been used to extinguish the association between alcohol and alcohol-related cues and contexts. This study applied CET, using a virtual reality (VR) system, to eight members of an Alcoholics Anonymous group for eight sessions. Cues and contexts most likely to elicit an urge to drink were selected through a preliminary survey in order to compose VR-CET scenarios: a glass, a bottle, food, and a bar were judged to be the most tempting for people in alcohol dependence and abstinence. Using these cues and contexts, a Japanese-style pub and a western bar were created. Each session was administered for 30 minutes by a psychiatrist and included an introduction, immersion, VR navigation, interviews about feelings, and self-report questionnaires about cravings. The eight sessions consisted of initial and closing sessions and person-, object-, and situation-focused sessions. As a result, a reduction in cue-elicited craving after VR-CET was reported. A mean score of 15.75 (SD = 10.91) on the Alcohol Urge Questionnaire in the first session decreased to 11.50 (SD = 5.76) in the final session. This study suggests that using virtual reality can enhance the effectiveness of CET.     

Limits to preference and the sensitivity of choice to rate and amount of food

Studies of choice holding food‐amount ratio constant while varying food‐rate ratio within sessions showed that local changes in preference depend on relative amount of food. The present study investigated whether sensitivity of choice to food‐rate ratio and sensitivity to food‐amount ratio are independent of one another when food‐rate ratios are varied across sessions and food‐amount ratios are varied within sessions. Food deliveries for rats’ presses on the left and right levers were scheduled according to three different food‐rate ratios of 1:1, 9:1, and 1:9; each food‐rate ratio lasted for 106 sessions and was arranged independently of seven food‐amount ratios (7:1, 6:2, 5:3, 4:4, 3:5, 2:6, and 1:7 food pellets) occurring within sessions in random sequence. Each amount ratio lasted for 10 food deliveries and was separated from another by a 60‐s blackout. Sensitivity to rate ratio was high (1.0) across food deliveries. Sensitivity to amount ratio was low when food rates were equal across alternatives, but was high when rate ratio and amount ratio opposed one another. When rate ratio and amount ratio went in the same direction, choice ratio reached an elevenfold limit which reduced sensitivity to approximately zero. We conclude that three factors affect sensitivity to amount: (1) the limit to preference, (2) the equal effect on preference of amounts greater than four pellets, and (3) the absence of differential effects of switches in amount in the equal‐rates (1:1) condition. Taken together, these findings indicate that rate and amount only sometimes combine independently as additive variables to determine preference when amount ratios vary frequently within sessions.     

Some effects of reduction in reinforcement magnitude in a monetary economy with hospitalized alcoholics

A 25% reduction in reinforcement magnitude (RIRM) of money paid to residents of an alcoholic rehabilitation program emphasizing the learning of behavior theory and its applications, was instituted to determine the effects on response rates on six classes of behavior—class attendance, desensitizing sessions, completion of desensitization hierarchies, tests on written material, and ward therapeutic and non-therapeutic activities. The effects of the RIRM condition on the behavior of eight subjects were compared with the behavior of ten subjects who spent a comparable amount of time in the program but were not subjected to the experimental condition (RIRM). The RIRM resulted in a reduction in rate of response on two classes of behavior and an increase in the response rate of a third. The three remaining classes of behavior were not significantly affected, although two of these three showed trends toward a decrease in response rate. Results are discussed in terms of altered response costs, accessory 'or intrinsic rewards. response switching, and individual differences.     

Foraging in a simulated natural environment: There's a rat loose in the lab

Rats were required to earn their food in a large room having nine boxes placed in it, each of which contained food buried in sand. In different phases of the experiment the amount of time allowed for foraging, the amount of food available in each food patch, and the location of the different available amounts were varied. The rats exhaustively sampled all patches each session but seemed to have fairly strong preferences for certain locations over others. If position preferences were for patches containing small amounts of food, the sensitivity to amount available was increased so that when location was compensated for, a pattern of optimal foraging was evident. The importance of environmental constraints in producing optimal behavior and the relation of the observed behavior to laboratory findings are discussed.     

Reinforcing efficacy of food on performance during pre- and postmeal sessions

Assessments were conducted to identify preferred foods for 9 adults with severe to profound mental retardation. Subsequently, the reinforcing effects of each participant's most highly preferred food were evaluated during sessions conducted before and after lunch. Results showed that 4 participants' response rates were higher during premeal sessions than during postmeal sessions. By contrast, pre- and postmeal response rates were indistinguishable for the other 5 participants. These results indicate that the reinforcing efficacy of food may (but does not necessarily) diminish following meals and suggest that the influence of meal schedules should be examined on an individual basis when food is used as reinforcement during training sessions.     

INDIRECT FACILITATION OF ON-TASK BEHAVIOR PRODUCED BY CONTINGENT FREE-TIME FOR ACADEMIC PRODUCTIVITY1

This study investigated the relationship between on-task behavior and the academic performance of three low achieving and disruptive children in an elementary school special-education class. A number of researchers have postulated that the direct elimination of off-task or disruptive behavior is a necessary prior requirement when increases in academic performance are sought in special-education classrooms composed of low achievers with below-average socioeconomic environments. The present research program investigated this issue and measured the incidence of on-task behavior and its relationship to changes in the performance of a variety of academic tasks brought about by the opportunity to engage in daily free-time activities. Three children from a class of eight “educably mentally handicapped” students were chosen as target subjects, as their repertoires seemed to be especially defective. These children were observed by the first author for 90-minute sessions three days a week, and data regarding on-task behavior were obtained by the use of an interval recording technique. In conjunction with the teacher, the first author also monitored the academic performance of the children in six structured activities—answer completion from boardwork instructions, task completion from handout assignments, comprehension of reading assignments and vocabulary recognition, accuracy of direction-following to audiotaped instructions, quality of copied handwriting, and the matching of appropriate phonetic sounds to pictured objects and situations. Following baseline sessions during which both on-task and academic performance was measured, several experimental sessions were conducted during which free-time was given noncontingently. During these sessions, no reliable changes in student performance were observed. Subsequently, the teacher and experimenters defined a specified percentage of correct completion of each of the six categories of skill performance as necessary for the achievement of the free-time reinforcer, during each experimental session. As a result, both the academic productivity and the on-task measures of behavior were observed to increase, even though reinforcement was not directly contingent upon on-task behavior. The subsequent reinstitution of noncontingent free-time was followed by lower rates of both output and on-task behavior. The final reintroduction of contingent free-time for academic productivity again produced substantial increases in both work accomplished correctly and on-task behavior. Corresponding increases in productivity were noted for most nontarget children as well. While the present investigation has shown a high correspondence between productivity and on-task behavior, we must keep in mind that on-task behavior can be defined in many different ways. It remains possible that differences in the degree of correlation between outcome measures and the topography of “work” activity may relate to the degree to which the specific on-task behaviors measured are actually required for the outcome behavior. The failure of many researchers to identify a direct relationship between “appearances” and output may be inherently a measurement problem.     

Stock optimizing: maximizing reinforcers per session on a variable-interval schedule.

In Experiment 1, 2 monkeys earned their daily food ration by pressing a key that delivered food according to a variable-interval 3-min schedule. In Phases 1 and 4, sessions ended after 3 hr. In Phases 2 and 3, sessions ended after a fixed number of responses that reduced food intake and body weights from levels during Phases 1 and 4. Monkeys responded at higher rates and emitted more responses per food delivery when the food earned in a session was reduced. In Experiment 2, monkeys earned their daily food ration by depositing tokens into the response panel. Deposits delivered food according to a variable-interval 3-min schedule. When the token supply was unlimited (Phases 1, 3, and 5), sessions ended after 3 hr. In Phases 2 and 4, sessions ended after 150 tokens were deposited, resulting in a decrease in food intake and body weight. Both monkeys responded at lower rates and emitted fewer responses per food delivery when the food earned in a session was reduced. Experiment 1's results are consistent with a strength account, according to which the phases that reduced body weights increased food's value and therefore increased subjects' response rates. The results of Experiment 2 are consistent with an optimizing strategy, because lowering response rates when food is restricted defends body weight on variable-interval schedules. These contrasting results may be attributed to the discriminability of the contingency between response number and the end of a session being greater in Experiment 2 than in Experiment 1. In consequence, subjects lowered their response rates in order to increase the number of reinforcers per session (stock optimizing).     

Motivational properties of spaced food presentation in hungry rats: Long-lasting effects on drinking and eating

Hungry rats were given 60 food pellets either at spaced intervals or massed in one or two presentations, or no food, followed by a consumption test in the home cage. Drinking was higher after spaced food sessions than after massed food or no food sessions (Experiments 1, 2, 3, and 5) and higher after the presentation of standard food pellets than after quinine-flavored pellets (Experiment 2). An effect of spacing was found even with a delay of 1 hr between the end of the food session and the drinking test (Experiment 3). Spaced food presentation also produced an increase in the consumption of quinine-flavored food pellets after the end of the session (Experiment 4). These results suggest that the enhancement of behavior caused by intermittent reinforcement cannot be attributed entirely to the short-term eliciting effects of the reinforcer or to its thirst-inducing properties.     

Transfer of effort across behaviors

A series of experiments investigated the effects of required force and number of responses per reinforcer upon the subsequent performance of a second behavior. In the first experiment, a group of rats required to complete five round trips in an alley per food pellet subsequently bar-pressed for food at a greater rate than a group rewarded for each round trip or a control group that did not receive the alley experience. In the second experiment, a group required to apply a 70-g bar-press force subsequently shuttled for food at a greater rate than a group required merely to touch the lever or a control group that did not undergo the lever-press manipulation. The third experiment found that the force effect persisted across all five test sessions and was attributable to differences both in response speed and interresponse time. The fourth experiment found that both the necessary bar-press force and number of bar presses per reward affected subsequent shuttling in extinction. Two alternative interpretations of these results were compared: (a) the degree of accustomed effort per reinforcer becomes a generalized component of instrumental behavior or (b) high effort increases the habituation frustration-produced disruptive responses.     

Persistence of acquired behavioral control in the context of imprinting

Newly hatched Khaki Campbell ducklings (Anas platyrhynchos domesticus) were exposed to a moving object that immediately suppressed distress vocalizations occurring in a novel environment. The static visual and auditory features of this object acquired the ability to suppress distress vocalizations after eight 20-min sessions of exposure to the object in motion. The acquired suppressive properties of these features were found to persist throughout thirty 20-min sessions given over 10 days. During these sessions, the ducklings were continually exposed to the static features in the absence of visual movement. In a second experiment, the ability of these features in the absence of visual movement. In a second experiment, the ability of these features to serve as reinforcement for a pecking response was shown to persist for up to 56 hr. In one duckling, presentations of the static visual features did not maintain pecking behavior. However, it was shown that pecking responses could be re-instated in this duckling by introducing novel stimuli to the environment.     

The economics of daily consumption controlling food- and water-reinforced responding

In the first experiment, two rhesus monkeys earned their entire ration of food and water during daily sessions with no provisions to ensure constant daily intakes. Two variable-interval schedules of food presentations were concurrent with one variable-interval schedule of water presentations; the maximum rate of food presentations arranged by one food schedule was varied. As the rate of food presentations was increased, the absolute level of responding on the two food schedules combined decreased, while responding on the water schedule increased. The preference for the variable food schedule compared to the other food schedule approximately matched the proportion of reinforcers obtained from it. The preference for the variable food schedule compared to the water schedule did not match, but greatly decreased, as the proportion of reinforcers from the food schedule increased. When Experiment I was replicated, with provisions to ensure constant daily intakes of food and water (Experiment II), the absolute response rates under the two food schedules combined and under the water schedule no longer changed with increases in the rate of food during the sessions. On the other hand, choice between the two food schedules remained proportional to the distribution of obtained food pellets. These results were interpreted as indicating that behavior to obtain nonsubstitutable commodities, such as food and water, is strongly controlled by the economic conditions of daily consumption, while choice between substitutable commodities is independent of these factors.