Topography of signal-centered behavior in the rat: Effects of deprivation state and reinforcer type

In a series of three experiments, groups of food-deprived and water-deprived rats were given pairings of a retractable lever (CS⁺) with response-independent deliveries of either solid or liquid reinforcers. In Experiment 1 food-deprived rats given a solid-pellet reinforcer differentially tended to sniff, paw, mouth, and bite the CS⁺ lever more often than a lever that was not paired with food (CS⁻), whereas food-deprived rats given a liquid reinforcer tended to differentially sniff, paw, and lick the CS⁺ lever. 23½-hour water-deprived rats given liquid reinforcers showed very little CS⁺ contact. In Experiment 2 increasing the severity of water deprivation from 23½ to 47½ hours significantly increased CS⁺ contact. In Experiment 3, subjects that were simultaneously food and water deprived and given a water reinforcer failed to exhibit differential CS⁺ contact, but subjects that were simultaneously food and water deprived and given a food reinforcer did acquire differential CS⁺-contact behavior. These results suggest that (a) even under a single motivational state the nature of signal-centered behavior can be determined by type of reinforcer, (b) although water reinforcement produces less signal contact than food reinforcement, this can be facilitated with more severe water-deprivation levels, and (c) high CS-contact rates using food reinforcement are not simply a product of reductions in body weight with food deprivation.     

Blocking a selective association in pigeons

Experiment 1 demonstrated for the first time a stimulus-reinforcer interaction in pigeons trained with free-operant multiple schedules of reinforcement. Pigeons that treadle pressed in the presence of a tone-light (TL) compound for food exhibited primarily visual stimulus control on a stimulus-element test, whereas pigeons that avoided shock in TL exhibited auditory control. In Experiment 2, this selective association was blocked in pigeons pretrained with the biologically contingency-disadvantage element of the compound (i.e., tone-food or light-shock) before TL training. When this pretraining preceded compound-stimulus training, control was now auditory in pigeons that treadle pressed for food and was visual in pigeons that avoided shock. Previous attempts at blocking this selective association were unsuccessful in pigeons (LoLordo, Jacobs, & Foree, 1982) but were successful in rats (Schindler & Weiss, 1985). Experiment 2 established that selective associations can be blocked in pigeons when the procedures that were effective with rats were systematically replicated. These results further demonstrate the cross-species generality of an associative attentional mechanism involving a biological constraint on learning in species with different dominant sensory systems.     

Falsification of matching theory: changes in the asymptote of Herrnstein''s hyperbola as a function of water deprivation.

Five rats pressed levers on variable-interval schedules of water reinforcement at various levels of water deprivation. In one phase of the experiment, three deprivation conditions that replicated conditions in Heyman and Monaghan (1987) were arranged, along with three less extreme deprivation conditions. In a second phase, water deprivation was arranged so that subjects were exposed to a greater range of access to water per day. Herrnstein's hyperbola described the rats' response-rate data well. The y asymptote, k, of the hyperbola appeared roughly constant over the conditions that replicated those of Heyman and Monaghan, but decreased markedly when less extreme deprivation conditions were included. In addition, k varied systematically when the second method of arranging deprivation was used. These results falsify a strong form of matching theory and confirm predictions made by linear system theory.     

Modifying drug-reinforced behavior by altering the economic conditions of the drug and a nondrug reinforcer.

Six rhesus monkeys were trained to self-administer orally delivered phencyclidine (0.25 mg/mL) and saccharin (0.03% wt/vol) under concurrent fixed-ratio 16 schedules. In Condition 1 the fixed-ratio requirement for phencyclidine was changed from 16 to 4, 8, 16, 32, 64, 128 and 16 while the fixed-ratio requirement for saccharin deliveries remained constant at 16. In Condition 2 the fixed-ratio value for saccharin was systematically altered while the fixed-ratio requirement for phencyclidine remained at 16, and in Condition 3 the fixed-ratio requirements for both phencyclidine and saccharin were altered simultaneously. Water was then substituted for saccharin, and the series of fixed-ratio manipulations was replicated. The phencyclidine concentration was reduced to 0.125 mg/mL and Conditions 1 and 3 were repeated. When the fixed-ratio requirement for phencyclidine was increased and the fixed-ratio requirement for saccharin or water remained fixed at 16, phencyclidine deliveries decreased when saccharin (vs. water) was concurrently available. The magnitude of the decrease ranged from 20% to 90% (of the concurrent water condition) as the fixed-ratio requirement for phencyclidine increased from 4 to 128. When the fixed-ratio requirement for phencyclidine remained at 16 and the fixed-ratio requirements for concurrent saccharin or water varied between 4 and 128, phencyclidine deliveries decreased by 30% to 40% due to the concurrent availability of saccharin (vs. water). This decrease occurred only at the three lowest fixed-ratio values when saccharin intake was relatively high. When the fixed-ratio requirements for both phencyclidine and concurrent saccharin or water were varied simultaneously, phencyclidine deliveries were reduced from 20% to 45% when saccharin (vs. water) was concurrently present. There was little effect of reducing the phencyclidine concentration when the data were analyzed in terms of unit price (responses per milligram). Thus, changes in the fixed-ratio requirement or drug concentration were functionally similar, and unit price of phencyclidine was the variable that was influenced by the presence of concurrent saccharin. These data indicate that drug-reinforced behavior is substantially reduced when the environment is enriched with an alternative nondrug reinforcer. The economic context in which these substances are presented is an important determinant of drug-reinforced behavior.     

Effects of varying stimulus disparity and the reinforcer ratio in concurrent-schedule and signal-detection procedures.

The present study measured the effects of stimulus and reinforcer variations on pigeons' behavior in two different choice procedures. Two intensities of white light were presented as the stimuli on the main key in a switching-key concurrent schedule and as the sample stimuli in a signal-detection procedure. Under both procedures, the scheduled rate of reinforcement was varied across conditions to produce various ratios of obtained reinforcement. These ratios were obtained for seven pairs of light intensities. In the concurrent schedules, the effects of reinforcer-ratio variations were positively correlated with the physical disparity between the two light intensities. In the signal-detection procedure, changes in the reinforcer ratio produced greater effects on performance when stimulus disparity was very low or very high compared to those found at intermediate levels of stimulus disparity. This discrepancy creates a dilemma for existing behavioral models of signal-detection performance.     

The associative relation underlying autoshaping in the pigeon

Fifteen pigeons were exposed to either response-independent or response-dependent schedules of water reinforcement, whereby water was injected directly into the unrestrained pigeons' mandibles. Key-contact responses were released by a lighted key correlated with water, but not by a lighted key uncorrelated with water. A negative response-reinforcer contingency suppressed autoshaped key-contact responses, resulting in responding directed away from the lighted key. In all pigeons, water injected directly into the mandibles elicited a consummatory fixed-action pattern of “mumbling” and swallowing. The lighted key correlated with water released a broader set of both appetitive and consummatory responses: approach to the lighted key, “bowing”, “rooting”, “mumbling”, and swallowing. Key-contact responses were “rooting” and “mumbling” motions of the beak on the surface of the key. Views of autoshaping based on stimulus substitution or stimulus surrogation do not fully explain the origin of autoshaped responses not previously elicited by the reinforcer. The present findings are consonant with views of conditioning that emphasize the large degree of biological pre-organization in conditioned response patterns, and the importance of associative factors in the control of such patterns.     

Matching-based hedonic scaling in the pigeon

Four slightly hungry pigeons chose between pairs of grains in a Findley concurrent choice procedure. For Condition I, choice involved hemp versus buckwheat; for Condition II, wheat versus buckwheat; and for Condition III, hemp versus wheat. In all conditions, frequency of reinforcement was arranged according to concurrent variable-interval variable-interval schedules. On the assumption that subjects matched their behavior and time distributions to those of reinforcer value, the choice functions obtained in Conditions I and II were transformed to yield estimates of values of hemp and wheat relative to buckwheat. These, in turn, provided predictions about behavior and time allocation in Condition III. In general, the predicted outcomes were close to those actually obtained. The results evidence the effectiveness of matching-based hedonic scales in the prediction of choice between qualitatively different reinforcers.     

Escape from serial stimuli leading to food

If the functional relations governing the strength of a conditioned reinforcer correspond to those obtained with other Pavlovian procedures (e.g., Kaplan, 1984), the termination of stimuli appearing early in the interval between successive food deliveries should be reinforcing. During initial training we presented four key colors, followed by food, in a recurrent sequence to each of 6 pigeons. This established a baseline level of autoshaped pecking. In later sessions, we terminated each of these colors or only the first color for a brief period following each peck, replacing the original color with a standard substitute to avoid darkening the key. Pecking decreased in the presence of the last color in the sequence but increased in the presence of the first. In accord with contemporary models of Pavlovian conditioning, these and other data suggest that the behavioral effects of stimuli in a chain may be better understood in terms of what each stimulus predicts, as measured by relative time to the terminal reinforcer, than in the exclusively positive terms of the traditional formulation (Skinner, 1938). The same model may also account for the initial pause under fixed-interval and fixed-ratio schedules of reinforcement.     

The effects of providing access to stimuli following choice making during vocal preference assessments

Two variations of a vocal paired-stimulus preference assessment were evaluated to determine whether the verbal reports of preference, given by individuals with developmental disabilities when no access to the activity was given, matched their verbal reports when access to the activity was given contingent on their choice. The results indicated different outcomes between the two methods for 6 of the 7 participants. Subsequent reinforcer assessments, conducted for 2 participants, showed that activities identified in the preference assessments that provided access contingent on selection resulted in more responding than did activities identified in the preference assessment that did not include access to items following their selection.     

An evaluation of the value of choice with preschool children

The current study examined the reinforcing effects of choosing among alternatives in a four-part evaluation. In the first study, initial-link responses in a concurrent-chains arrangement resulted in access to terminal links in which the completion of an academic task resulted in (a) the choice of a reinforcer (choice), (b) the delivery of an identical reinforcer (no choice), or (c) no material reinforcer (control). Three patterns of responding emerged: persistent preference for choice (3 participants); initial preference for choice, which did not persist (2 participants); and preference for no choice (1 participant). Additional evaluations determined if preference for choice could be enhanced (Study 2) or established (Study 3) by including more stimuli from which to choose. Choice-link selections systematically increased for all participants when more items were available from which to choose. Study 4 identified the precise value of the opportunity to choose by progressively increasing the response requirement during the choice terminal links for 3 children and determining the point at which these children stopped selecting the choice link. All children continued to select the choice link even when the work required in the choice link was much greater than that arranged in the no-choice link.