Latent inhibition of US signal value.

Three experiments with rats examined the effects of preexposure to an unconditioned stimulus (US; a single food pellet) on the subsequent ability of that US to effectively signal the delivery of three food pellets during a US-US conditioning procedure. In Experiment 1, latent inhibition (LI) rats showed attenuated conditioning, compared to control (C) rats, when a single food pellet, delivered 10 minutes into a session, was followed by three additional pellets. In preexposure, one pellet had been delivered 10 minutes into each session (in group LI), or placed into the magazine at the beginning of each session (in group C). Experiment 2 showed that this effect was evident when the conditions of preexposure matched those of conditioning for group C, and Experiment 3 showed that the difference between groups LI and C was not a product of context conditioning, or latent inhibition to the noise of the feeder in group LI. Implications of these results for theories of latent inhibition are considered.     

Pigeons are attracted to a perceived gain without an actual gain

Reference dependence refers to the reduced value of a reward that is less than expected, or the added value of a reward that is greater than expected. There is evidence that when pigeons are offered an alternative that has 1 pellet versus an alternative that has 2 pellets, but one of the two pellets offered will be removed, the pigeons prefer the originally presented 1 pellet (loss aversion). In the present research, we tested for the opposite effect (gain attraction). In Experiments 1 and 2, pigeons could choose between 2 pellets, each one on a distinctive background. If they chose the optimal alternative, they received a second pellet. In Experiment 2, the second pellet obtained was the one not initially chosen (a task sometimes referred to as the ephemeral reward task). Pigeons learned to choose optimally in both experiments. In Experiment 3, we tested the pigeons for reference dependence. Pigeons were given an alternative that offered them one pellet or two pellets, if they chose the one-pellet alternative, they received an additional pellet, and if they chose the two-pellet alternative, they received the two pellets. In keeping with the reference dependence hypothesis, the pigeons preferred the 1-pellet alternative that gave them an extra pellet. These effects are related to similar findings with humans, including the endowment effect.

     

Reliable operant apparatus for fish: Audio stimulus generator, response button, and pellet-dispensing nipple

As part of ongoing research into the ability of koi to categorize complex auditory stimuli, we have had to develop novel apparatus. The stimulus generator presents sound from two CD drives under computer control through a new underwater speaker. The operant manipulandum is a horizontal button that eliminates spurious triggering by water turbulence and problematic response topographies. The button’s design has also been adapted for use by tilapia in an aquacultural food-preference study. The feeder uses a nipple to dispense food pellets reliably under water. In this paper, the apparatus is described in detail. Also discussed are methodological issues related to its design, as well as its usage in a pilot study in which koi learned to discriminate music from silence by using a single manipulandum with food reinforcement.     

Food and cocaine self-administration by baboons: effects of alternatives.

The effects of the availability of an alternative reinforcer on responding maintained by food pellets or drug solutions were examined in 8 adult male baboons (Papio hamadrayas anubis). During daily 23-hr experimental sessions, baboons had access to both food pellets and fluid under a two-choice procedure, in which the response requirement, under a fixed-ratio schedule, differed for the two commodities. There were no restrictions on access to water, which was continuously available from a spout at the rear of each cage. In Experiment 1, the fixed-ratio requirement, or cost, for fluid delivery remained constant while the fixed-ratio requirement for pellets was changed every 2 or 3 days when (a) no fluid, (b) a dilute dextrose vehicle, (c) 0.008 mg/kg per delivery cocaine, (d) 0.016 mg/kg per delivery cocaine, or (e) 0.032 mg/kg per delivery cocaine was available concurrently. In Experiment 1, progressively increasing the response requirement for pellets decreased pellet intake, but for 4 baboons pellet intake at maximum pellet cost was lower when cocaine, compared to the vehicle, was available. Increasing the response requirement for pellets had variable effects on vehicle intake. However, increasing the response requirement for pellets increased intake of at least one dose of cocaine to a greater extent than vehicle in all 8 baboons. Thus, cocaine could be considered a more effective economic substitute than vehicle for pellets. Experiment 2 systematically varied the order in which the response requirements for a pellet delivery were presented and added a control condition in which cocaine doses, yoked to the amount self-administered, were given three times during the session by the experimenter. Again, pellet intake at maximal pellet cost was lower when cocaine, compared to the vehicle, was available. In contrast, experimenter-given cocaine doses did not alter responding maintained by pellets. Thus, the effects of self-administered cocaine on responding maintained by food pellets differed from the effects of experimenter-given cocaine on responding maintained by food pellets.     

Transfer of persistence to the acquisition of a new behaviour

Two experiments tested whether the degree of effort required for the reinforcement of one behaviour would affect the acquisition of a second behaviour. In the first experiment, rats were placed in a conditioning chamber and: (a) were required to press a lever for food pellets on a fixed ratio schedule, (b) received free presentation of the pellets, or (c) did not receive pellets. Next, all rats were rewarded for a new behaviour, round trips across the length of a runway. As predicted, the fixed-ratio group had the greatest shuttle rate. In the second experiment, two groups were required to press a lever, and the number of presses per pellet was varied. For two other groups not required to press the lever, the amount of food presented per approach to the feeder was varied. The greater required number of lever presses and the lesser number of pellets per approach to the feeder produced the higher subsequent shuttle rates. Two alternative explanations were compared: the degree of accustomed effort per reinforcer becomes a learned component of behaviour, or high effort increases the habituation of frustration-produced disruptive responses.     

Resurgence and alternative‐reinforcer magnitude

Resurgence is defined as an increase in the frequency of a previously reinforced target response when an alternative source of reinforcement is suspended. Despite an extensive body of research examining factors that affect resurgence, the effects of alternative‐reinforcer magnitude have not been examined. Thus, the present experiments aimed to fill this gap in the literature. In Experiment 1, rats pressed levers for single‐pellet reinforcers during Phase 1. In Phase 2, target‐lever pressing was extinguished, and alternative‐lever pressing produced either five‐pellet, one‐pellet, or no alternative reinforcement. In Phase 3, alternative reinforcement was suspended to test for resurgence. Five‐pellet alternative reinforcement produced faster elimination and greater resurgence of target‐lever pressing than one‐pellet alternative reinforcement. In Experiment 2, effects of decreasing alternative‐reinforcer magnitude on resurgence were examined. Rats pressed levers and pulled chains for six‐pellet reinforcers during Phases 1 and 2, respectively. In Phase 3, alternative reinforcement was decreased to three pellets for one group, one pellet for a second group, and suspended altogether for a third group. Shifting from six‐pellet to one‐pellet alternative reinforcement produced as much resurgence as suspending alternative reinforcement altogether, while shifting from six pellets to three pellets did not produce resurgence. These results suggest that alternative‐reinforcer magnitude has effects on elimination and resurgence of target behavior that are similar to those of alternative‐reinforcer rate. Thus, both suppression of target behavior during alternative reinforcement and resurgence when conditions of alternative reinforcement are altered may be related to variables that affect the value of the alternative‐reinforcement source.     

Net Amount of Food Affects Autoshaped Response Rate, Response Latency, and Gape Amplitude in Pigeons

The contribution of net amount of food to conditioned response strength and topography was assessed in four pigeons under autoshaping contingencies. In each session, under one baseline phase and three replication phases, three trial types were presented sequentially: One conditioned stimulus (keylight) signaled one small pellet, another signaled one large pellet, and a third signaled seven small pellets which were weight-matched to one large pellet. Five dependent variables were response rates and latencies based on the occurrence of both keyswitch closures and gapes (beak openings) and gape amplitudes. In result, net amount of food, not pellet diameter or number, affected all dependent variables. Notably, gape amplitudes elicited by the seven-small pellet keylights were larger than the gape amplutides elicited by the one-small pellet keylights even though the gape amplitudes elicited by both unconditioned stimuli (one or seven pellets) were equally small. This mismatch between conditioned and unconditioned responses is incompatible with stimulus substitution accounts but is compatible with an associative strength account. Furthermore, the changes in the dependent variables were most likely determined by Pavlovian and not by inadvertent operant contingencies. The findings demonstrate that an analysis of classical conditioning benefits from the inclusion of topographical measures.     

Relative sensitivity to reinforcer amount and delay in a self-control choice situation.

Rats were exposed to concurrent-chains schedules in which a single variable-interval schedule arranged entry into one of two terminal-link delay periods (fixed-interval schedules). The shorter delay ended with the delivery of a single food pellet; the longer day ended with a larger number of food pellets (two under some conditions and six under others). In Experiment 1, the terminal-link delays were selected so that under all conditions the ratio of delays would exactly equal the ratio of the number of pellets. But the absolute duration of the delays differed across conditions. In one condition, for example, rats chose between one pellet delayed 5 s and six pellets delayed 30 s; in another condition rats chose between one pellet delayed 10 s and six pellets delayed 60 s. The generalized matching law predicts indifference between the two alternatives, assuming that the sensitivity parameters for amount and delay of reinforcement are equal. The rats' choices were, in fact, close to indifference except when the choice was between one pellet delayed 5 s and six pellets delayed 30 s. That deviation from indifference suggests that the sensitivities to amount and delay differ from each other depending on the durations of the delays. In Experiment 2, rats chose between one pellet following a 5-s delay and six pellets following a delay that was systematically increased over sessions to find a point of indifference. Indifference was achieved when the delay to the six pellets was approximately 55 s. These results are consistent with the possibility that the relative sensitivities to amount and delay differ as a function of the delays.     

Visual Reinforcement Signals Interfere with the Effects of Reinforcer Magnitude Manipulations

Three experiments examined the effect of reinforcement magnitude on free-operant response rates. In Experiment 1, rats that received four food pellets responded faster than rats that received one pellet on a variable ratio 30 schedule. However, when the food hopper was illuminated during reinforcer delivery, there was no difference between the rates of response produced by the two magnitudes of reward. In Experiment 2, there was no difference in response rates emitted by rats receiving either one or four pellets of food as reward on a random interval (RI) 60-s schedule. In Experiment 3, rats responding on an RI 30-s schedule did so at a lower rate with four pellets as reinforcement than with one pellet. This effect was abolished by the illumination of the food hopper during reinforcement delivery. These results indicate that the influence of magnitude is obscured by manipulations which signal the delivery of reinforcement.     

Context modulation of US signal value

Context modulation of unconditioned stimulus (US) signal value was examined in two experiments. In Experiment 1, rats showed significantly more magazine entries after a single food pellet US in Context A (in which three additional pellets shortly followed) than in Context B (in which the delivery of three additional pellets was delayed). Experiment 2 replicated this effect and showed that any differences in contextual associative strength at the time the single food pellet was delivered did not importantly contribute to context modulation. Implications for theories of occasion setting and context modulation are considered.     

The impact of chewing gum resistance on immediate free recall

Although the facilitative effects of chewing gum on free recall have proved contentious (e.g., Tucha, Mecklinger, Maier, Hammerl, & Lange, 2004; Wilkinson, Scholey, & Wesnes, 2002), there are strong physiological grounds, for example, increased cerebral activity and blood flow following the act of mastication, to suppose facilitation. The present study manipulated resistance to mastication, that is, chewing four pellets versus one pellet of gum, with the assumption that increased resistance will accentuate cerebral activity and blood flow. Additionally, chewing rate was recorded for all participants. In a within‐participants design, participants performed a series of immediate free recall tasks while chewing gum at learning (one or four pellets) and recall (one or four pellets). Increased chewing resistance was not associated with increased memory performance, despite consistent chewing rates for both the one and four pellet conditions at both learning and recall. However, a pattern of recall consistent with context‐dependent memory was observed. Here, participants who chewed the equivalent number of gum pellets at both learning and recall experienced significantly superior word recall compared to those conditions where the number of gum pellets differed.     

Food and amphetamine self-administration by baboons: effects of alternatives.

The effects of the availability of an alternative reinforcer on responding maintained by food pellets or fluid solutions were examined in 6 adult male baboons (Papio cynocephalus anubis). During daily 23-hr experimental sessions, baboons had concurrent access to both food pellets and fluid, with responding maintained under fixed-ratio schedules of reinforcement that varied between the two commodities. The fixed-ratio requirement, or cost, for pellets was increased when (a) no fluid, (b) a dilute dextrose vehicle, (c) 0.002 mg/kg d-amphetamine, or (d) 0.004 mg/kg d-amphetamine was available. When given nonrestricted concurrent access to food pellets and amphetamine at minimal cost (FR 2), baboons self-administered sufficient amphetamine to decrease pellet intake. Increasing the response requirement for pellets decreased pellet intake at a similar rate regardless of the available fluid and increased fluid intake in a variable manner among baboons such that there were no statistically significant increases in fluid intake. In contrast, when access to pellets was restricted to 70% of maximal intake under nonrestricted conditions, increasing pellet cost decreased pellet intake and increased fluid intake more rapidly when the high amphetamine dose was available. Thus, amphetamine was more effective as an economic substitute for pellets when access to pellets was restricted. The response cost for vehicle and both amphetamine concentrations was increased when baboons had nonrestricted and restricted access to pellets. Increasing the response requirement for fluid delivery decreased intake of all three fluids similarly under both pellet-access conditions. The results indicate that substitution between commodities with minimal commonalities can be studied under controlled laboratory conditions and is dependent upon reinforcement schedule and commodity restrictions.     

The opponent-process theory of motivation: VIII. Quantitative and qualitative manipulations of food both modulate adjunctive behavior

The present studies extend the opponent-process theory of acquired motivation to the schedule-induced polydipsia paradigm and more generally to adjunctive behavior. The theory suggests that manipulations of the quality and the size of the pellet presented on an intermittent schedule should be important modulators of polydipsia. In Experiment 1, presenting animals with preferred, less preferred, or least preferred food pellets on a fixed-time 120-sec schedule resulted in progressively lower levels of water intake. In Experiment 2, the quality and size of the pellet were manipulated factorially. These variables were found to interact in the control of both the development and maintenance of schedule-induced drinking. Thus, predictions from the opponent-process theory were supported by these findings.     

Quinine pellets as an inferior good and a Giffen good in rats.

In Experiment 1, 4 rats earned their daily food ration by choosing between two levers. One lever delivered two regular and one quinine-adulterated food pellets, and the other delivered two regular and four quinine pellets. A 20-s intertrial interval separated successive choices. Sessions began with 10 forced trials during which only one lever, selected with p = .5 and cued by a light above it, could deliver its reinforcer. Forced trials were followed by 30 or 150 trials, depending on the condition, during which choices to either lever could be reinforced. Over this range, absolute choice of the four-quinine, two-regular-pellet lever was inversely related to the number of free-choice trials, establishing this reinforcer as an inferior good. In Condition 1 of Experiment 2, the prior design was altered in two ways: (a) one lever delivered four quinine pellets, and the other lever delivered one standard pellet; and (b) sessions ended after 140 free-choice trials. When the number of free-choice trials was reduced to 100 (Condition 2), all 3 rats increased their preference for quinine pellets, confirming their status as an inferior good. In the next several conditions, the number of quinine pellets provided for selecting its associated lever was varied between three and four. Preference for the quinine-pellet alternative was inversely related to the number of pellets it provided, a result defining it as a Giffen good. These findings are not accommodated readily by extant choice models and complicate the search for a unitary model of choice.     

The magnitude-of-reinforcement function in closed and open economies.

It has been hypothesized that the magnitude-of-reinforcement effect may differ in closed and open experimental economies. We determined the relationship between magnitude of reinforcement and response rate in three feeding conditions: a closed economy in which total intake was unrestricted, a closed economy in which total intake was restricted so as to maintain body weight at 85% of free-feeding weight, and a traditional open economy in which subjects received food outside the experimental session. In the closed economies, regardless of body weight, the rats responded faster for smaller pellets and when the fixed ratio for pellets was higher. In the open economy, there was no reliable effect of pellet size or pellet cost on response rate. It is concluded that although there are circumstances in which response rate is an immediate function of the parameters of reinforcement, rate is not necessarily a measure of response strength. Response rate may instead, or additionally, contribute to a strategy of reducing the costs associated with resource utilization.     

An automatic pellet dispenser for precise control of feeding topography in granivorous birds

Design and construction of an automatic pellet dispenser for granivorous birds are described. The dispenser permits rapid pneumatic delivery of pellets (five pellets per second maximum) to one controlled position and does not interfere with simultaneous electrophysiological recording. In addition, the device continuously indicates presence or absence of a pellet in the delivery position. This automatic dispenser proved very effective in our studies of stereotyped topographies of feeding in granivorous birds, such as pigeons and chickens.     

The Heuristic and Motivational Value of Video Reinforcement

Four rhesus monkeys (Macaca mulatta) were tested on joystick-based computer tasks in which they could choose to be reinforced either with pellets-only or with pellets + video. A variety of videotapes were used to reinforce task performance. The monkeys significantly preferred to be rewarded with a pellet and 10 s of a blank screen than a pellet plus 10 s of videotape. When they did choose to see videotaped images, however, they were significantly more likely to view video of themselves than video of their roommate or of unfamiliar conspecifics. These data support earlier findings of individual differences in preference for video reinforcement, and have clear implications for the study of face-recognition and self-recognition by nonhuman primates.     

Superordinate categorization via learned stimulus equivalence: quantity of reinforcement, hedonic value, and the nature of the mediator

Three experiments examined superordinate categorization via stimulus equivalence training in pigeons. Experiment 1 established superordinate categories by association with a common number of food pellet reinforcers, plus it established generalization to novel photographic stimuli. Experiment 2 documented generalization of choice responding from stimuli signaling different numbers of food pellets to stimuli signaling different delays to food reinforcement. Experiment 3 indicated that different numbers of food pellets did not substitute as discriminative stimuli for the photographic stimuli with which the food pellets had been paired. The collective results suggest that the effective mediator of superordinate categories that are established via learned stimulus equivalence is not likely to be an accurate representation of the reinforcer, neither is it likely to be a distinctive response that is made to the discriminative stimulus. Motivational or emotional mediation is a more likely account.     

Active regulation to be lean by rats with ventromedial hypothalamic lesions.

Adult female Long-Evans rats with direct-current electrolytic or radio-frequency thermocoagulatory lesions of the ventromedial hypothalamus (VMH) lived on pellet fragments or a powdered chow containing as much as 1.2% quinine sulfate by weight or lived in Skinner boxes with 45-mg Noyes pellets delivered contingent on fixed ratios (FR) of lever pressing up to FR 128. As had been found previously for intact rats, the body weights maintained by VMH rats were determined by the percentage of quinine sulfate in or the contingency of reinforcement of the food on which they lived. Even when the rats lived on highly adulterated or response-contingent food and were lean, they ate more of that food when the ambient temperature was reduced and less of that food during several weeks of forced feeding of eggnog by gavage. Weight maintenance in the cold and caloric compensation during forced feeding were as precise for VMH rats eating highly adulterated chow or Noyes pellets contingent on high fixed ratios of lever pressing as for VMH rats eating typical laboratory chow ad lib, even though the former rats at the time maintained weights no greater than intact rats and the latter rats at the time were grossly obese. Furthermore, regulation in the cold or during forced feeding was in general only a little less precise for the rats with lesions than for intact rats. It may be as characteristic of VMH rats that they eat to become lean and remain lean as that they eat to be obese. The diets of both intact and VMH rats in some manner determine the adiposities that rats will defend against caloric challenge.     

Resistance to extinction following variable-interval reinforcement: reinforcer rate and amount

Rats obtained food-pellet reinforcers by nose poking a lighted key. Experiment 1 examined resistance to extinction following single-schedule training with different variable-interval schedules, ranging from a mean interval of 16 min to 0.25 min. That is, for each schedule, the rats received 20 consecutive daily baseline sessions and then a session of extinction (i.e., no reinforcers). Resistance to extinction (decline in response rate relative to baseline) was negatively related to the rate of reinforcers obtained during baseline, a relation analogous to the partial-reinforcement-extinction effect. A positive relation between these variables emerged, however, when the unit of extinction was taken as the mean interreinforcer interval that had been in effect during training (i.e., as an omitted reinforcer during extinction). In a second experiment, rats received blocks of training sessions, all with the same variable-interval schedule but with a reinforcer of four pellets for some blocks and one pellet for others. Resistance to extinction was greater following training with the larger (four pellets) than with the smaller (one pellet) reinforcer. Taken together, these results support the principle that greater reinforcement during training (e.g., higher rate or larger amount) engenders greater resistance to extinction even when the different conditions of reinforcement are varied between blocks of sessions.