Preference for mixed versus constant delays of reinforcement: Effect of probability of the short, mixed delay

Preference for mixed versus constant delays of reinforcement was studied with a concurrent-chain procedure. Lever pressing by rats in concurrently available variable-interval 60-second initial links occasionally produced mutually exclusive terminal-link reinforcement delays. A constant delay of reinforcement (either 15 seconds or 30 seconds) composed one terminal link and mixed delays (.2 second and twice the value of the constant delay) were arranged in the other terminal link. The proportion of .2-second delays in the mixed-delay terminal link took on values of 0, .1, .25, .5, .75, .9, and 1.0 over experimental conditions. Based on relative rates of responding in the initial links, preference for the mixed delays was a negatively accelerated function of the proportion of short, mixed delays. Three of five rats preferred the mixed delays to the constant delays when the proportion of short, mixed delays was .1 or higher, and all five rats preferred the mixed delays when the proportion of short, mixed delays was .25 or higher. Neither Squires and Fantino's (1971) delay-reduction model of choice nor a model based on the harmonic mean reinforcement delay provided a close estimate of choice proportions over the range of short-delay proportions studied. The delay-reduction model underestimated choice for the mixed delays at low and intermediate proportions of short delays, and the harmonic-mean-delay model overestimated choice for the mixed delays at intermediate and high proportions of short delays.     

Choice as a function of local versus molar reinforcement contingencies.

Rats were trained on a discrete-trial probability learning task. In Experiment 1, the molar reinforcement probabilities for the two response alternatives were equal, and the local contingencies of reinforcement differentially reinforced a win-stay, lose-shift response pattern. The win-stay portion was learned substantially more easily and appeared from the outset of training, suggesting that its occurrence did not depend upon discrimination of the local contingencies but rather only upon simple strengthening effects of individual reinforcements. Control by both types of local contingencies decreased with increases in the intertrial interval, although some control remained with intertrial intervals as long as 30 s. In Experiment 2, the local contingencies always favored win-shift and lose-shift response patterns but were asymmetrical for the two responses, causing the molar reinforcement rates for the two responses to differ. Some learning of the alternation pattern occurred with short intertrial intervals, although win-stay behavior occurred for some subjects. The local reinforcement contingencies were discriminated poorly with longer intertrial intervals. In the absence of control by the local contingencies, choice proportion was determined by the molar contingencies, as indicated by high exponent values for the generalized matching law with long intertrial intervals, and lower values with short intertrial intervals. The results show that when molar contingencies of reinforcement and local contingencies are in opposition, both may have independent roles. Control by molar contingencies cannot generally be explained by local contingencies.     

Choice, changeover, and travel: A quantitative model

Six pigeons were trained on concurrent variable-interval schedules in which responding on fixed-interval schedules was required to give access to the alternate schedule. Responding on the concurrent schedules was not allowed, after changing over had commenced, until the changeover schedule had been completed. In Parts 1 to 3 of the experiment, the changeover fixed-interval schedules were equal and were 0 s, 10 s, and 20 s, respectively. In each part, the relative frequency of reinforcement obtained on the concurrent schedules was varied over at least five conditions. In Part 4, the concurrent schedules were equal, and one changeover fixed-interval schedule was twice the other. Under these conditions, the absolute sizes of the changeover schedules were varied. Increasing the changeover requirement from 0 s to 10 s (Parts 1 and 2) resulted in increases in the sensitivity of behavior allocation to reinforcers obtained, but no further increase was obtained when the changeover schedules were increased to 20 s (Part 3). In Part 4, performance was biased towards the concurrent schedule that took less time to enter. These results are consistent with a subtractive punishment model of travel in which the degree of punishment is measured by the number of reinforcers apparently lost from a schedule when the subject changes to that schedule. Absolute times spent on the main keys could be accurately described by a previous model of changeover performance.     

Choice, changeover, and travel

Since foraging in nature can be viewed as instrumental behavior, choice between sources of food, known as “patches,” can be viewed as choice between instrumental response alternatives. Whereas the travel required to change alternatives deters changeover in nature, the changeover delay (COD) usually deters changeover in the laboratory. In this experiment, pigeons were exposed to laboratory choice situations, concurrent variable-interval schedules, that were standard except for the introduction of a travel requirement for changeover. As the travel requirement increased, rate of changeover decreased and preference for a favored alternative strengthened. When the travel requirement was small, the relations between choice and relative reinforcement revealed the usual tendencies toward matching and undermatching. When the travel requirement was large, strong overmatching occurred. These results, together with those from experiments in which changeover was deterred by punishment or a fixed-ratio requirement, deviate from the matching law, even when a correction is made for cost of changeover. If one accepted an argument that the COD is analogous to travel, the results suggest that the norm in choice relations would be overmatching. This overmatching, however, might only be the sign of an underlying strategy approximating optimization.     

Choice and multiple reinforcers

Pigeons chose between equivalent two-component mixed and multiple terminal-link schedules of reinforcement in the concurrent-chains procedure. The pigeons preferred the multiple schedule over the mixed when the components of the compound schedules were differentiated in terms of density of reinforcement, but the pigeons were indifferent when the components were differentiated in terms of number of reinforcers per cycle. Taken together, these results indicate that a local variable, the interval to the first reinforcer, but not a molar variable, the number of reinforcers, was sufficient to differentiate the components and thereby evoke preference.     

Effects of fixed-ratio sample and choice response requirements upon oddity matching

Three pigeons were trained on oddity matching in which either 1, 4, 8, 16, or 32 sample-key observing responses were required to turn off the sample stimuli and turn on the comparison stimuli. Oddity accuracy increased when the observing-response requirement was raised and decreased when the requirement was lowered. Next, while the observing requirement was maintained at one response, the number of responses required to the comparison stimuli was either 1, 4, 8, 16, or 32. Under these conditions, choice was defined as the comparison that first accumulated the required number of responses. In general, increasing the comparison-response requirement decreased accuracy and lowering the comparison requirement increased accuracy. The fixed-ratio observing requirements appeared to facilitate control by stimuli serving an instructional function.     

The effect of rearing environments on the contrafreeloading phenomenon in rats

Eight naive rats were reared in enriched or impoverished environments for 39 days after weaning and then lived in operant chambers, in which they could obtain food pellets freely or by lever pressing, for 25 or 30 days. The animals raised in an impoverished environment acquired the bar-press response quickly when placed in the operant chambers and maintained a preference for obtaining food via bar pressing. Animals raised in an enriched environment did not learn to lever press, as demonstrated by low levels of responding and the lack of bar pressing when free food was subsequently removed. It was concluded that restricting animals' postweaning environments facilitated learning in a choice situation, probably because of increased activity levels. The results are interpreted in relation to previous studies on rearing environments and on contrafreeloading.     

消费者基于选择集的情境效应

消费者基于选择集的情境效应颠覆了传统的理性选择理论,表明了情境对消费者偏好和选择的系统性影响。情境效应主要的类型有吸引效应和折衷效应。情境效应具有感知偏差、风险和负面情绪规避以及信息推理等方面的内在机理。选择集结构和特征及消费者等因素都对情境效应产生影响,而情境效应会影响消费者偏好的构建。未来情境效应研究将会向复杂属性组合、复杂购买情境和新情境效应的发现等方面拓展。     

风险决策过程验证：补偿/非补偿模型之争的新认识与新证据

风险决策是人类赖以生存和发展的重大决策。如何进行风险决策是人类不断认识和改造世界过程中遇到的未解之谜。主流风险理论认为, 风险决策是一个补偿性的、期望值最大化的过程; 而非主流的风险理论则认为, 风险决策是非补偿性的, 并不遵循期望法则所假设的加权求和等过程。这一谜团为何一直没有得以破解, 或许是因为我们未找到揭示其心理过程的令人信服的证据。近10年来, 我们针对风险决策过程, 借助行为实验、眼动记录法、事件相关电位、功能磁共振成像等技术, 系统探索风险决策的心理和神经机制, 为回答“风险决策是否遵循补偿性规则”这一问题提供了汇聚性证据。本文依据期望法则所假设的概率函数推导、加权过程、加权求和过程、总分最大化等步骤, 对这些研究进行梳理与回顾, 以期加深人们对风险决策机制的理解, 并为建立、健全与风险决策相关的政策、法律法规提供理论依据。     

厌恶和恐惧情绪对跨期选择的不同影响：基于ERP的研究

本研究运用事件相关电位技术(ERPs)考察厌恶和恐惧情绪对跨期选择的影响。其中,厌恶和恐惧情绪采用情绪面孔图片进行启动,分析跨期选择任务中评估阶段所诱发的ERP成分。行为结果发现,与中性面孔相比,厌恶面孔启动使个体倾向于选择立即奖赏。ERP结果发现,在选项评估阶段,厌恶面孔比中性和恐惧面孔启动诱发更大的P2、P3和LPP波幅。这说明,厌恶情绪促使个体投入更多的注意和动机资源对跨期选项进行评估,进而使个体倾向即时满足。