Signal modality and choice between signaled and unsignaled food

Choice between signaled and unsignaled response-independent food schedules was assessed in three experiments using a commitment procedure. In Experiment 1, subjects tested with a 5-s visual signal consistently changed from the signaled to the unsignaled schedule. Changing from the unsignaled to the signaled schedule was observed only occasionally and only at low levels. The same outcome was observed in Experiment 2 with different types of visual signals and with different stimulus combinations identifying the signal period, the signal-absent period, and the unsignaled schedule. In Experiment 3 the visual signal was replaced with an auditory signal for four of the subjects tested in Experiment 2. The subjects then changed from the unsignaled to the signaled schedule or showed a substantial reduction in choice for the unsignaled schedule. The data were assessed using a conditioned-reinforcement interpretation of choice.     

Choosing schedules of signaled appetitive events over schedules of unsignaled ones

Two experiments were completed allowing albino rats to choose between signaled and unsignaled reward conditions. These experiments examined the effects on preference of (1) response dependent versus response-independent reward and, (2) food pellets versus chocolate milk as the reward. All subjects preferred the signaled condition over the unsignaled condition, whether exposed to response-dependent, or to response-independent delivery of rewards. Preference was controlled most effectively by presenting both the signal itself and the correlated stimulus identifying the signaled condition. The signal presented alone (Extinction 3) controlled preference more effectively than did the stimulus correlated with the signaled condition (Extinction 2). The second experiment showed that the quality of the reinforcer (pellets and chocolate milk) did not affect preference for signaled reward since all subjects preferred the signaled condition at levels comparable to those observed in Experiment 1, with food pellets. These results, along with others, argue against species differences, response-dependency, and reinforcer quality as variables affecting the direction of preference.     

Preference for signaled over unsignaled shock schedules: Ruling out asymmetry and response fixation as factors

Experiment 1 tested whether a “symmetrical” choice procedure yields results different from those previously reported using the “unidirectional” standard changeover procedure (e.g., Badia & Culbertson, 1972). Subjects could change at any time from unsignaled to signaled shock by pressing a lever and from signaled to unsignaled shock by pressing a second lever. Results were identical to those of the standard procedure and showed that the standard procedure is fully adequate. Experiment 2 tested whether choice of high density signaled shock over low-density unsignaled shock (Badia, Coker, & Harsh, 1973) resulted from initial training with equal-density schedules. Subjects were trained and tested with signaled shock twice as dense as unsignaled shock. Three of four subjects strongly preferred the signaled condition, thus ruling out carry-over and “response fixation” as alternative explanations.     

Preference for signaled versus unsignaled reinforcement delay in concurrent-chain schedules

A concurrent-chain schedule was employed to examine pigeons' preferences for signaled versus unsignaled delay of reinforcement in which the delay durations ranged from zero to ten seconds. In general, pigeons preferred signaled delay over unsignaled delay especially when a variable-interval 30-second schedule operated in each initial link; when a variable-interval 90-second schedule operated in each initial link, these preferences tended toward indifference or were attenuated. In addition, prior training seemed to exert partial control over behavior. Responding in the terminal link was higher under signaled delay than unsignaled delay in a majority of the cases. Moreover, response rates under signaled delay remained fairly constant whereas responding under unsignaled delay was initially high, but decreased systematically with delay durations as short as 2.5 seconds. These results are consistent with a number of other studies demonstrating the significant role of a signal for impending positive stimuli.     

Choice for signaled over unsignaled shock as a function of signal length.

Subjects chose between signaled and unsignaled shock conditions while signal length was varied between .5 and 2.0 seconds in steps of .5 seconds in both ascending and descending series. Preference for the signaled condition failed to develop initially for five of six subjects when signals were .5 or 1.0 seconds but became strong for all subjects when signals were 2.0 seconds (ascending series). Preference declined when signals were shortened, but for most subjects this decline was small (descending series). Since discriminable shock-free periods were present in the signaled condition at all signal lengths, these results suggest that safety may not be a sufficient condition for preference to develop for signaled shock.     

Punishment of schedule-induced drinking in rats by signaled and unsignaled delays in food presentation

Food-deprived rats were exposed to a fixed-time 60-s schedule of food-pellet presentation and developed schedule-induced drinking. Using an ABA reversal design, three experiments investigated the effects of events then made dependent on licks. In Experiment 1, lick-dependent signaled delays (10 s) in food presentation in general led to decreased drinking, which recovered when the signaled delays were discontinued. The drinking of yoked-control rats, which received food at the same times as those exposed to the signaled-delay contingency, showed much smaller changes. Experiment 2 showed that 10-s lick-dependent signals alone did not reduce drinking. In Experiment 3, when licks produced unsignaled 10-s delays in food there were less marked and more gradual changes in drinking than in Experiment 1, although these effects again were greater than with yoked-control animals. We concluded that both signaled and unsignaled delays functioned as punishers of drinking. These findings support the view that schedule-induced drinking, like operant behavior, is subject to control by its consequences.     

Responding of pigeons under variable-interval schedules of unsignaled, briefly signaled, and completely signaled delays to reinforcement

In Experiment 1, three pigeons' key pecking was maintained under a variable-interval 60-s schedule of food reinforcement. A 1-s unsignaled nonresetting delay to reinforcement was then added. Rates decreased and stabilized at values below those observed under immediate-reinforcement conditions. A brief stimulus change (key lit red for 0.5 s) was then arranged to follow immediately the peck that began the delay. Response rates quickly returned to baseline levels. Subsequently, rates near baseline levels were maintained with briefly signaled delays of 3 and 9 s. When a 27-s briefly signaled delay was instituted, response rates decreased to low levels. In Experiment 2, four pigeons' responding was first maintained under a multiple variable-interval 60-s (green key) variable-interval 60-s (red key) schedule. Response rates in both components fell to low levels when a 3-s unsignaled delay was added. In the first component delays were then briefly signaled in the same manner as Experiment 1, and in the second component they were signaled with a change in key color that remained until food was delivered. Response rates increased to near baseline levels in both components, and remained near baseline when the delays in both components were lengthened to 9 s. When delays were lengthened to 27 s, response rates fell to low levels in the briefly signaled delay component for three of four pigeons while remaining at or near baseline in the completely signaled delay component. In Experiment 3, low response rates under a 9-s unsignaled delay to reinforcement (tandem variable-interval 60 s fixed-time 9 s) increased when the delay was briefly signaled. The role of the brief stimulus as conditioned reinforcement may be a function of its temporal relation to food, and thus may be related to the eliciting function of the stimulus.     

Some conditions affecting the choice to cooperate or compete

Three experiments investigated conditions affecting the choice to cooperate or compete. Experiment I compared the effects first of an individual activity, then of a competitive task as an alternative to cooperation. For both comparisons, subjects could earn more by cooperating. Choice of competition, but not individual activity, was found to depend on the task choice contingencies. Competition predominated when both subjects could compete if either or both chose competition. Previously competitive pairs cooperated when both subjects could cooperate if either or both chose cooperation. Experiment II investigated the effects of differences in magnitude of the reinforcers for cooperating or competing. Choice between the two alternatives was manipulated in all pairs by varying reinforcer difference. Competition was chosen over cooperation only within the limits within which competition was potentially profitable. Experiment III replicated the findings of Experiment II using triads. Subjects in triads, however, were more likely to withdraw from the experiment. Thus, the data for pairs and triads suggest an orderly relation between reinforcer difference for cooperating or competing and task choice. Motivation of subjects to maximize relative gain by competing can be overridden by moderate reinforcer differences favoring cooperation.     

A temporal parameter influencing choice between signalled and unsignalled shock schedules

The present study investigated whether choice of a signalled variable-time shock schedule over an unsignalled one was influenced by the average intershock interval. Eight rats were given a choice between signalled and unsignalled shock schedules in a series of conditions with average intershock intervals of 510, 270, 150, 90, 60, and 45 sec. Each test condition was preceded by a training-baseline condition, and schedule values were arranged in an ascending (four subjects) or descending (four subjects) order. Choice of the signalled conditions was directly related to the average intershock interval of the variable-time schedule for six of the eight subjects. The per cent of time in the signalled condition was highest when the average intershock interval was 150 sec or longer and lowest when the average intershock interval was 45 sec. The findings were interpreted as being due to changes in the safety features of the signalled schedule, rather than to changes in the average intershock interval per se.     

Effects of signaled and unsignaled shock on schedule-controlled lever pressing and schedule-induced licking: Shock intensity and body weight

Schedule-controlled lever pressing and schedule-induced licking were studied in rats under a multiple fixed-interval fixed-interval schedule of food reinforcement. Following acquisition of stable rates of pressing and licking, a multiple variable-time variable-time schedule of electric-shock delivery was superimposed upon the baseline schedule. In only one component of the multiple schedule, a 5-sec stimulus preceded each shock (signaled shock). In the other component shock was unsignaled. Several shock intensities (Experiment 1) and body weights (Experiment 2) were studied. Lever pressing and licking were affected similarly by experimental manipulations, although with parametric differences. Depending upon shock intensity and body weight, rates of lever pressing and licking were hardly suppressed, suppressed primarily in the unsignaled shock component (differential suppression), or markedly suppressed in both components. Differential suppression during components with signaled and unsignaled shock and conditioned suppression of responding during the preshock stimulus appeared not to be functionally related. Differential suppression depended more on the discriminability of shock-free time, and on shock intensity, body weight, and the type of response than on the “preparatory” behavior preceding shock.     

A comparison of signaled and unsignaled delay of reinforcement

Pigeons were trained on either a variable-interval 60-second schedule, or on a schedule that differentially reinforced responses that were spaced at least 20 seconds apart. The birds were then exposed to several durations of reinforcement delay, with comparisons between signaled and unsignaled delays. Although unsignaled delays of 5 and 10 seconds produced large decreases in response rate, signaled delays of up to 10 seconds produced only moderate decreases in response rates. In addition, some subjects responded more rapidly with a .5 or 1.0 second duration of unsignaled delay than with immediate reinforcement. These response rate changes occurred regardless of whether the rate of reinforcement concomitantly decreased or increased.     

Signal detection and matching: analyzing choice on concurrent variable-interval schedules.

Pigeons' pecks on a red key and a green key were followed by access to grain according to pairs of concurrent independent variable-interval schedules in a combined signal detection/matching law paradigm. Pecks on the red key were reinforced by the richer variable-interval schedule if a short-duration tone had been presented; pecks on the green key were reinforced by the richer variable-interval schedule if a long-duration tone had been presented. Pecks on the green key given a short-duration tone, or on the red key given a long-duration tone, were reinforced by the leaner variable-interval schedule. The data were analyzed according to both signal detection's and the matching law's separate measures of, first, the discrimination of the choices and, second, the bias to make one response or another. Increasing the difficulty of the tone-duration discrimination decreased both methods' measures of the discrimination of the choices and did not change both methods' measures of the bias to make one response or another. Changing the leaner variable-interval schedule so that it approached the richer variable-interval schedule decreased signal detection's measure of discrimination but left its measure of response bias and the matching law measures unchanged. Data collected only until a subject's first changeover response following presentation of a long or a short tone showed higher values for both methods' measures of discrimination, no change in signal detection's measure of response bias, and lower values for the matching law's measure of response bias. Relationships between the matching law's and signal detection's methods of analyzing choice are discussed. It is concluded that a signal detection analysis is more efficient for examining changes in the difficulty of a discrimination, whereas a matching law analysis is more effective for examining the effects of changes in relative reinforcer frequency.     

Comparisons of rats' choice behavior among three different radial-maze tasks

The present study compared rats' behavioral changes on three tasks on the radial-arm maze. In the free-choice task (0Fo/8Fr; no forced choice/eight free choices), rats performed efficiently with the simple response pattern of sequential adjacent-arm choices. In the two forced-choice tasks (3Fo/5Fr and 5Fo/3Fr), rats performed as efficiently as 0Fo/8Fr but showed no particular response patterns. The frequency of arm investigation was the highest in 5Fo/3Fr, and was higher in 3Fo/5Fr than in 0Fo/8Fr. The probability of correct rejection, avoiding re-entry to visited arms after investigation, was also higher in 3Fo/5Fr and 5Fo/3Fr than in 0Fo/8Fr. These results suggest that the rats could adjust their behavior to the task demands.     

Delayed matching-to-sample performance: Effects of relative reinforcer frequency and of signaled versus unsignaled reinforcer magnitudes

Six pigeons were trained on a delayed red-green matching-to-sample task that arranged four delays within sessions. Matching responses intermittently produced either 1.5-s access to food or 4.5-s access to food, and nonmatching responses produced either 1.5-s or 4.5-s blackout. Two phases were conducted: a signaled phase in which the reinforcer magnitudes (small and large) were signaled by houselights (positioned either on the left or right of the chamber), and an unsignaled phase in which there was no correlation between reinforcer magnitude and houselight position. In both phases, the relative frequency with which red and green matching responses produced food was varied across five values. Both matching accuracy and the sensitivity of performance to the distribution of reinforcers for matching responses decreased with increasing delays in both phases. In addition, accuracy and reinforcer sensitivity were significantly lower on signaled small-reinforcer trials compared with accuracy and sensitivity values on signaled large-reinforcer trials and on both types of unsignaled trials. These results are discussed in the context of research on both nonhuman animal and human memory.     

Discriminability of frequency of food or stimulus presentations in variable-time schedules

Pigeons responded in a two-alternative forced-choice task in which reinforcement was dependent upon the frequency of events that occurred in an immediately preceding schedule sample. On a given trial the events were either brief food presentations or brief visual and auditory stimulus changes. High levels of stimulus control were obtained by food-presentation schedules only. Discriminative control by frequency or stimulus change was absent. Stimulus control by food frequency was decreased by the imposition of a delay period between the schedule sample and the choice. Moreover, stimulus control by food frequency was related to the ratio of food-presentation schedule pairs when novel schedules were presented in a transfer test.     

Risky choice as a function of amount and variance in food supply.

In Experiment 1, 4 rats earned their daily food ration by choosing on a trials basis between a "risky" and a "riskless" lever. The risky lever produced either 15 45-mg food pellets or no pellets, and on average provided five pellets per choice. The riskless lever always produced three pellets. Across conditions, the number of trials per session was varied. Body weight and choice of the risky lever decreased as the number of trials per session decreased, even though body weight could only be defended by increased choice of the risky lever. In Experiment 2, trials per session were fixed, but the number of pellets delivered by the risky and riskless levers was either at the same level as in Experiment 1 or tripled from those levels. Now choice of the risky lever was inversely related to the size of reinforcement and to body weight. The results of these experiments show that risk aversion covaries with the amount of food available in a session and the daily variance in the amount of food earned.     

Choice of timeout during response-independent food schedules

Rats' lever pressing terminated visual or auditory stimuli associated with fixed-time or variable-time schedules of food delivery and produced a timeout period during which food delivery could not occur. Lever pressing during a timeout period reinstated the food-associated stimuli and again permitted food delivery according to the fixed-time or variable-time schedules. The mean interfood interval ranged from 1 minute to 16 minutes (variable-time schedules) or 32 minutes (fixed-time schedules); the timer controlling schedule intervals did not stop during timeout periods. The percentage of session time spent in timeout increased when the mean interfood intervals were lengthened and decreased when the mean interfood intervals were shortened. Timeouts were initiated most frequently about half way between successive food deliveries (fixed-time schedules) or after 15 seconds or more had lapsed since the last food delivery (variable-time schedules). Elimination of food delivery increased the percentage of session time spent in timeout, and elimination of the timeout contingency decreased lever press rates. When timeout was produced only when the lever was held in the depressed position, little time was spent in timeout. The main determinants of timeout initiation and termination appeared to be the rate of food delivery, freedom of movement during timeout, and the stimulus change associated with initiation and termination of timeout.     

Preference in pigeons given a choice between sequences of fixed-ratio schedules: Effects of ratio values and duration of food delivery

Pigeons were exposed to schedules that consisted of two sequential fixed ratios, the completion of each followed by food delivery. When each alternative provided two food deliveries per 100 responses, the schedule with the shorter initial fixed-ratio value was consistently preferred. Subsequent attempts were made to shift this established preference by (1) increasing the ratio requirement in the second fixed ratio of the preferred schedule; (2) increasing the duration of food delivery in the second fixed ratio of the nonpreferred schedule; (3) decreasing the duration of food delivery in the first fixed ratio of the preferred schedule; and (4) shortening the second fixed ratio of the nonpreferred schedule. Preference shifted from the schedule with the shorter initial fixed ratio only when the duration of food delivery associated with the first fixed ratio of that schedule was too brief to allow eating. Under all other conditions, pigeons strongly preferred the schedule with the shorter initial fixed ratio even when, overall, that schedule yielded briefer access to food or required more responses to obtain equivalent access.     

在线抑制控制训练对失败的限制性饮食者不健康食物选择的改善

失败的限制性饮食者是进食障碍的高危人群,他们面对食物时的抑制控制能力通常很弱,从而更易发展为肥胖,所以改善失败的限制性饮食者对不健康食物的进食选择十分重要。本文采用在线停止信号任务,通过提高失败的限制性饮食者对不健康食物图片的抑制控制能力,从而减少他们在日常生活中对不健康食物的选择。首先对66名失败的限制性饮食者实施前测,然后随机分为对不健康食物图片进行抑制反应的干预组(n=33)和对非食物图片进行抑制反应的控制组(n=31),两组被试接受每天一次(每次10 min左右)共计7次的训练。完成训练后,所有被试均接受后测。结果发现,干预训练后,与控制组相比,干预组被试对不健康食物的选择频率以及对不健康食物自我报告的吸引力和喜爱程度均显著降低。     

A molecular analysis of choice on concurrent-chains schedules.

Six pigeons responded on concurrent-chains schedules with either independent or interdependent equal variable-interval schedules in the initial links and unequal variable-interval schedules, always in a 2:1 ratio, in the terminal links. Relative response rates in the initial links increased across conditions as initial-link duration was shortened and decreased across conditions as terminal-link duration was shortened, replicating previous findings. Responses in the initial links were recorded in 5-s bins, and local or molecular relative response rates were calculated in order to ascertain how relative response rate varied as a function of time since the onset of the initial links. Two distinct molecular patterns were found. With interdependent initial links, relative response rates for the preferred key were elevated for the first 10 or 20 s of the initial links and then declined to an asymptotic value. With independent initial links, a negative recency effect was found similar to that reported by Killeen (1970). These two molecular patterns were related to the different momentary reinforcement probabilities resulting from independent and interdependent scheduling.