Choice, changeover, and travel

Since foraging in nature can be viewed as instrumental behavior, choice between sources of food, known as “patches,” can be viewed as choice between instrumental response alternatives. Whereas the travel required to change alternatives deters changeover in nature, the changeover delay (COD) usually deters changeover in the laboratory. In this experiment, pigeons were exposed to laboratory choice situations, concurrent variable-interval schedules, that were standard except for the introduction of a travel requirement for changeover. As the travel requirement increased, rate of changeover decreased and preference for a favored alternative strengthened. When the travel requirement was small, the relations between choice and relative reinforcement revealed the usual tendencies toward matching and undermatching. When the travel requirement was large, strong overmatching occurred. These results, together with those from experiments in which changeover was deterred by punishment or a fixed-ratio requirement, deviate from the matching law, even when a correction is made for cost of changeover. If one accepted an argument that the COD is analogous to travel, the results suggest that the norm in choice relations would be overmatching. This overmatching, however, might only be the sign of an underlying strategy approximating optimization.     

Key-peck probability and topography in a concurrent variable-interval variable-interval schedule with food and water reinforcers.

The relation between variables that modulate the probability and the topography of key pecks was examined using a concurrent variable-interval variable-interval schedule with food and water reinforcers. Measures of response probability (response rates, time allocation) and topography (peck duration, gape amplitude) were obtained in 5 water- and food-deprived pigeons. Key color signaled reinforcer type. During baseline, response rates and time allocations were greater to the food key than to the water key, and food-key pecks had larger gapes and shorter durations. Relative probability measures (for the food key) were increased by prewatering and decreased by prefeeding. Deprivation effects upon topography measures were apparent only when food- and water-key pecks were analyzed separately. Food-key gape amplitudes increased with prewatering and decreased with prefeeding. The clearest effect occurred with prewatering. There were no consistent effects upon water-key gapes. The key color-reinforcer relation was reversed for 3 pigeons to determine how response topography was modulated during the transition from food- to water-key pecks. Reacquisition was faster for the probability than for the topography measures. Analysis of gape-amplitude distributions during reversal indicated that response-form modulation proceeded through the generation of intermediate gape sizes.     

Molar versus local reinforcement probability as determinants of stimulus value.

During one component of a multiple schedule, pigeons were trained on a discrete-trial concurrent variable-interval variable-interval schedule in which one alternative had a high scheduled rate of reinforcement and the other a low scheduled rate of reinforcement. When the choice proportion between the alternatives matched their respective relative reinforcement frequencies, the obtained probabilities of reinforcement (reinforcer per peck) were approximately equal. In alternate components of the multiple schedule, a single response alternative was presented with an intermediate scheduled rate of reinforcement. During probe trials, each alternative of the concurrent schedule was paired with the constant alternative. The stimulus correlated with the high reinforcement rate was preferred over that with the intermediate rate, whereas the stimulus correlated with the intermediate rate of reinforcement was preferred over that correlated with the low rate of reinforcement. Preference on probe tests was thus determined by the scheduled rate of reinforcement. Other subjects were presented all three alternatives individually, but with a distribution of trial frequency and reinforcement probability similar to that produced by the choice patterns of the original subjects. Here, preferences on probe tests were determined by the obtained probabilities of reinforcement. Comparison of the two sets of results indicates that the availability of a choice alternative, even when not responded to, affects the preference for that alternative. The results imply that models of choice that invoke only obtained probability of reinforcement as the controlling variable (e.g., melioration) are inadequate.     

Asymmetry of reinforcement and punishment in human choice

The hypothesis that a penny lost is valued more highly than a penny earned was tested in human choice. Five participants clicked a computer mouse under concurrent variable-interval schedules of monetary reinforcement. In the no-punishment condition, the schedules arranged monetary gain. In the punishment conditions, a schedule of monetary loss was superimposed on one response alternative. Deviations from generalized matching using the free parameters c (sensitivity to reinforcement) and log k (bias) were compared in the no-punishment and punishment conditions. The no-punishment conditions yielded values of log k that approximated zero for all participants, indicating no bias. In the punishment condition, values of log k deviated substantially from zero, revealing a 3-fold bias toward the unpunished alternative. Moreover, the c parameters were substantially smaller in punished conditions. The values for bias and sensitivity under punishment did not change significantly when the measure of net reinforcers (gains minus losses) was applied to the analysis. These results mean that punishment reduced the sensitivity of behavior to reinforcement and biased performance toward the unpunished alternative. We concluded that a single punisher subtracted more value than a single reinforcer added, indicating an asymmetry in the law of effect.     

Factors affecting choice of signaled or unsignaled food schedules

Choice between signaled and unsignaled food schedules was assessed in two experiments using a shuttlebox. Experiment 1 examined preference with both a five-second signal and a thirty-second signal. Subjects preferred the unsignaled side with a five-second signal but preferred the signaled side with a thirty-second signal. Experiment 2 assessed preference using either a commitment procedure (a shuttle response resulted in exposure to the schedule for a fixed time) or a noncommitment procedure (each shuttle response changed the schedule in effect). Subjects preferred the signaled condition with the commitment procedure but the unsignaled condition with the noncommitment procedure. These results indicate that the discrepant findings of earlier studies are due to procedural differences involving signal duration and choice commitment. The data are consistent with a conditioned reinforcement interpretation of choice.     

Signal modality and choice between signaled and unsignaled food

Choice between signaled and unsignaled response-independent food schedules was assessed in three experiments using a commitment procedure. In Experiment 1, subjects tested with a 5-s visual signal consistently changed from the signaled to the unsignaled schedule. Changing from the unsignaled to the signaled schedule was observed only occasionally and only at low levels. The same outcome was observed in Experiment 2 with different types of visual signals and with different stimulus combinations identifying the signal period, the signal-absent period, and the unsignaled schedule. In Experiment 3 the visual signal was replaced with an auditory signal for four of the subjects tested in Experiment 2. The subjects then changed from the unsignaled to the signaled schedule or showed a substantial reduction in choice for the unsignaled schedule. The data were assessed using a conditioned-reinforcement interpretation of choice.     

Local effects of delayed food

Five pigeons were trained on a procedure in which seven concurrent variable-interval schedules arranged seven different food-rate ratios in random sequence in each session. Each of these components lasted for 10 response-produced food deliveries, and components were separated by 10-s blackouts. We varied delays to food (signaled by blackout) between the two response alternatives in an experiment with three phases: In Phase 1, the delay on one alternative was 0 s, and the other was varied between 0 and 8 s; in Phase 2, both delays were equal and were varied from 0 to 4 s; in Phase 3, the two delays summed to 8 s, and each was varied from 1 to 7 s. The results showed that increasing delay affected local choice, measured by a pulse in preference, in the same way as decreasing magnitude, but we found also that increasing the delay at the other alternative increased local preference. This result casts doubt on the traditional view that a reinforcer strengthens a response depending only on the reinforcer's value discounted by any response-reinforcer delay. The results suggest that food guides, rather than strengthens, behavior.     

Risky choice as a function of amount and variance in food supply.

In Experiment 1, 4 rats earned their daily food ration by choosing on a trials basis between a "risky" and a "riskless" lever. The risky lever produced either 15 45-mg food pellets or no pellets, and on average provided five pellets per choice. The riskless lever always produced three pellets. Across conditions, the number of trials per session was varied. Body weight and choice of the risky lever decreased as the number of trials per session decreased, even though body weight could only be defended by increased choice of the risky lever. In Experiment 2, trials per session were fixed, but the number of pellets delivered by the risky and riskless levers was either at the same level as in Experiment 1 or tripled from those levels. Now choice of the risky lever was inversely related to the size of reinforcement and to body weight. The results of these experiments show that risk aversion covaries with the amount of food available in a session and the daily variance in the amount of food earned.     

Control your cravings: Self-controlled food choice varies by eating attitudes,sex, and food type among Division I collegiate athletes

Eating attitudes are predictive of disordered eating, which can be quite prevalent among collegiate athletes. The present study tested if disordered eating attitudes and the sex of collegiate athletes are related to “self-controlled food choice” for four food types: a dessert, fried food, fruit, and vegetable. In total, 102 athletes completed a disordered eating attitudes assessment and a delay discounting task. For the delay discounting task, athletes chose between one large delayed reward and one successively smaller immediate reward for four food types, and indifference points were computed with lower indifference points indicating greater self-controlled food choice. In this study female athletes showed greater self-controlled food choice for all three tempting food types (dessert, fried food, and fruit), but not the control food type (vegetable). For males, results were moderated by their level of disordered eating attitudes. Overall, these data show that “self-controlled food choice,” measured using a delay discounting task, is a key factor related to sex differences in disordered eating attitudes among college athletes.     

Preferences for and against stimuli paired with food.

Pigeons were presented with a concurrent-chains schedule in which terminal-link entries were assigned to two response keys on a percentage basis. The terminal links were fixed delays that sometimes ended with food and sometimes did not. In most conditions, 80% of the terminal links were assigned to one key, but a smaller percentage of the terminal links ended with food for this key, so the number of food reinforcers delivered by the two alternatives was equal. When the same terminal-link stimuli (orange houselights) were used for both alternatives, the pigeons showed a preference for whichever alternative delivered more frequent terminal links. When different terminal-link stimuli (green vs. red houselights) were used for the two alternatives, the pigeons showed a preference for whichever alternative delivered fewer terminal links when terminal-link durations were long, and no systematic preferences when terminal-link durations were short. This pattern of results was consistent with the predictions of Grace's (1994) contextual choice model. Preference for the alternative that delivered more frequent terminal links was usually stronger in the first few sessions of a condition than at the end of a condition, suggesting that the conditioned reinforcing effect of the additional terminal-link presentation was, in part, transitory.     

Histological data: Hollard and Davison (1971)

As Mogenson and Cioé (1977) have assumed that our electrodes aimed at the ectostriatum (Hollard and Davison, 1971) were actually located there, we feel that a presentation of the histological data is necessary. Following termination of further experiments (Hollard, 1974) the pigeons, numbered 93, 95, and 119, were sacrificed and perfused with saline followed by 10% formalin. Sections, 50 microns thick, were cut on a freezing microtome. Prints were made by mounting each unstained section of a microscope slide and placing them in a standard photographic enlarger. The electrode tips of Pigeons 93 and 119 were located in the paleostriatal complex. The sections of Pigeon 95 were damaged and precise localization was not possible. Further work in this laboratory has also found that, using the same coordinates, electrode tips tend to fall in the paleostriatum, rather than in the more dorsal ectostriatum at which they are aimed. The paleostriatal placements tended to sustain self-stimulation, whereas others located in the ectostriatum sustained relatively low or unstable rates.     

Choice as a dependent measure in autoshaping: sensitivity to frequency and duration of food presentation.

Previous investigations have shown that rate, latency, and percentage of trials with at least one response are somewhat insensitive measures of the strength of autoshaped responding. In the present studies, these measures were contrasted with the allocation of responding during simultaneous choice tests, a measure of response strength frequently used in operant paradigms. In two experiments, nine pigeons were exposed to a forward pairing autoshaping procedure. Training sessions consisted of the successive presentation of three stimuli, each followed by food on either 100%, 50%, or 0% of the trials. Choice testing involved the simultaneous presentation of the three stimuli. In Experiment I, all pigeons consistently directed their initial choice responses and the majority of subsequent responses to the stimulus always followed by food, despite the fact that during training sessions the response rates of most birds were highest in the presence of the stimulus followed by food on 50% of the trials. In Experiment II, rate, latency, and percentage of trials with at least one response did not change appreciably as a function of duration of feeder presentations. However, choice responding was lawfully affected by duration of feeder presentations. These data suggest that choice is perhaps a more sensitive measure of the strength of autoshaped responding than other, more commonly employed, indices.     

Domestic dogs (Canis familiaris) use a physical marker to locate hidden food

Dogs can use the placement of an arbitrary marker to locate hidden food in an object-choice situation. We tested domestic dogs (Canis familiaris) in three studies aimed at pinning down the relative contributions of the human’s hand and the marker itself. We baited one of two cups (outside of the dogs’ view) and gave the dog a communicative cue to find the food. Study 1 systematically varied dogs’ perceptual access to the marker placing event, so that dogs saw either the whole human, the hand only, the marker only, or nothing. Follow-up trials investigated the effect of removing the marker before the dog’s choice. Dogs used the marker as a communicative cue even when it had been removed prior to the dog’s choice and attached more importance to this cue than to the hand that placed it although the presence of the hand boosted performance when it appeared together with the marker. Study 2 directly contrasted the importance of the hand and the marker and revealed that the effect of the marker diminished if it had been associated with both cups. In contrast touching both cups with the hand had no effect on performance. Study 3 investigated whether the means of marker placement (intentional or accidental) had an effect on dogs’ choices. Results showed that dogs did not differentiate intentional and accidental placing of the marker. These results suggest that dogs use the marker as a genuine communicative cue quite independently from the experimenter’s actions.     

Preference reversals with food and water reinforcers in rats

Rats were given a choice between a smaller, immediately available reward and a larger reward available after a delay. In one phase, the reward was food and in another phase, the reward was water. Constant delays were added between the choice presentation and the delivery of the reward alternatives. As the time between choice and reward delivery increased from 0 to 25 s, all rats (except one in the water phase) reversed their preference from the smaller, sooner alternative to the larger, later alternative. These findings extend the generality of the preference-reversal animal model to qualitatively different reinforcers. Furthermore, the presence of both impulsive and self-control choices within the same animal is consistent with the view that self-control may be understood as choice behavior, and that species differences in self-control may be differences in degree, not kind.     

Motivational influences on performance maintained by food reinforcement

In Study 1, we examined the independent effects of reinforcer consumption during sessions and meal consumption prior to sessions on performance maintained by food reinforcement. Nine individuals with developmental disabilities participated. On alternate days, a preferred edible item was delivered during (a) seven sessions conducted before lunch (repeated-reinforcement condition) versus (b) one session each conducted before and after lunch (pre- and postmeal conditions). Results for 7 of 9 participants showed decreased response rates across sessions in the repeated-reinforcement condition; results for 3 of 9 participants showed decreased rates during postmeal relative to premeal conditions. Two participants who did not show a decrement in responding during either comparison participated in Study 2, in which reinforcer consumption during sessions, combined with meal consumption prior to sessions, also had no effect on their performance. In Study 3, we determined whether (a) choice of reinforcers, (b) increased break time between sessions, (c) varied reinforcers, or (d) intermittent reinforcement schedules mitigated the satiation effects observed for the 7 participants in Study 1. Presession choice of reinforcers resulted in maintained performance for 2 of 6 participants exposed to this condition. Varied reinforcement resulted in maintained performance for only 1 of 5 participants exposed to this condition. Neither the increased break between sessions nor the intermittent reinforcement schedule was effective in maintaining performance for the participants who were exposed to these conditions.     

女性食物选择的演化视角：基于性选择过程的理论探讨

性选择在人类心理、行为等表型的演化过程中扮演了重要角色,但其对女性食物选择的影响却相对较少被关注。性选择塑造了男女不同的择偶策略,男性择偶时对女性外在吸引力的关注使得女性更加重视身材等外在吸引力信息。而女性身材与饮食的密切联系,进一步提示性选择过程应该会对女性的食物选择产生影响。以之为基础,梳理求偶动机激活可能引发的女性食物选择的变化,以及女性生理期不同阶段在食物选择上的变异,有助于了解性选择过程对女性食物选择的影响。未来研究中,进一步从行为、激素、脑等不同层面剖析对应影响及涉及机制,对该领域的长远发展有重要意义。     

在线抑制控制训练对失败的限制性饮食者不健康食物选择的改善

失败的限制性饮食者是进食障碍的高危人群,他们面对食物时的抑制控制能力通常很弱,从而更易发展为肥胖,所以改善失败的限制性饮食者对不健康食物的进食选择十分重要。本文采用在线停止信号任务,通过提高失败的限制性饮食者对不健康食物图片的抑制控制能力,从而减少他们在日常生活中对不健康食物的选择。首先对66名失败的限制性饮食者实施前测,然后随机分为对不健康食物图片进行抑制反应的干预组(n=33)和对非食物图片进行抑制反应的控制组(n=31),两组被试接受每天一次(每次10 min左右)共计7次的训练。完成训练后,所有被试均接受后测。结果发现,干预训练后,与控制组相比,干预组被试对不健康食物的选择频率以及对不健康食物自我报告的吸引力和喜爱程度均显著降低。