Relative allocation on concurrent schedules can depend on schedule parameters when behavioral parameters are constant

We develop a simple model of switching between the initial links of a concurrent-chain procedure. Behavior is determined by four parameters μ₁, μ₂, q₁, and q₂. The first two are the basic rates of switching from Schedule 1 and Schedule 2, respectively. The second two are the probabilities of leaving Schedule 1 and Schedule 2 after the corresponding terminal link has been completed. We show that for fixed values of these four parameters, the relative allocation on the initial links may change as a result of changes in initial-link schedules. The effect can be quite large if the switching rates are low. An implication is that relative allocation is not necessarily a good measure of behavior.     

The matching law applies to wagtails' foraging in the wild

Field data concerning the time budgets and foraging success of pied wagtails (Motacilla alba yarrelli, Gould) are reanalyzed. It is found that the data are well described by the generalized matching law, with a marked bias towards spending time on the territory. In this case matching is not the result of maximizing reward rate, but it remains possible that it results from an allocation of time that maximizes survival.     

More on concurrent interval-ratio schedules: a replication and review.

It has been suggested that the failure to maximize reinforcement on concurrent variable-interval, variable-ratio schedules may be misleading. Inasmuch as response costs are not directly measured, it is possible that subjects are optimally balancing the benefits of reinforcement against the costs of responding. To evaluate this hypothesis, pigeons were tested in a procedure in which interval and ratio schedules had equal response costs. On a concurrent variable time (VT), variable ratio-time (VRT) schedule, the VT schedule runs throughout the session and the VRT schedule is controlled by responses to a changeover key that switches from one schedule to the other. Reinforcement is presented independent of response. This schedule retains the essential features of concurrent VI VR, but eliminates differential response costs for the two alternatives. It therefore also eliminates at least one significant ambiguity about the reinforcement maximizing performance. Pigeons did not maximize rate of reinforcement on this procedure. Instead, their times spent on the alternative schedules matched the relative rates of reinforcement, even when schedule parameters were such that matching earned the lowest possible overall rate of reinforcement. It was further shown that the observed matching was not a procedural artifact arising from the constraints built into the schedule.     

Time reallocation in a multiresponse environment: Effects of restricting response classes

Four adult male rats were each placed for three hours daily into an apparatus that provided individual compartments for six separate location-defined responses. The available responses consisted of: (1) the opportunity to turn off room lighting, producing darkness; (2) the opportunity to view a female rat; (3) the opportunity to turn off white noise; (4) the opportunity to drink; (5) the opportunity to eat; and (6) "other," representing time in the hallway between compartments. Each subject underwent a series of conditions characterized as an A-B-A-C-A design. Manipulations consisted of the removal of a low-probability response (darkness) and of a high-probability response (escape from noise) in a counter-balanced manner across subjects. The dependent measure for all subjects was the percentage of total session time spent in each compartment. Four predictive rules concerning the redistribution of behavior after response restriction were tested, including the constant-ratio rule, equal time redistribution, the most probable alternative, and the sequential-dependency rule. The results indicate no support for any of the four predictive rules and suggest that empirical assessment of restriction effects is necessary in reinforcement studies involving temporally extended responses.     

Resource scarcity aggravates ingroup bias: Neural mechanisms and cross-scenario validation

Previous studies examining the relationship between ingroup bias and resource scarcity have produced heterogeneous findings, possibly due to their focus on the allocation of positive resources (e.g. money). This study aims to investigate whether ingroup bias would be amplified or eliminated when perceived survival resources for counteracting negative stimuli are scarce. For this purpose, we exposed the participants and another confederate of the experimenters (ingroup/outgroup member) to a potential threat of unpleasant noise. Participants received some ‘relieving resources’ to counteract noise administration, the amount of which may or may not be enough for them and the confederate in different conditions (i.e. abundance vs. scarcity). First, a behavioural experiment demonstrated that intergroup discrimination manifested only in the scarcity condition; in contrast, the participants allocated similar amounts of resource to ingroup and outgroup members in the abundance condition, indicating a context-dependent allocation strategy. This behavioural pattern was replicated in a follow-up neuroimaging experiment, which further revealed that when contrasting scarcity with abundance, there was higher activation in the anterior cingulate cortex (ACC) as well as stronger functional connectivity of the ACC with the empathy network (including the temporoparietal junction and medial prefrontal cortex) for ingroup compared to outgroup members. We suggest that ACC activation reflects the mentalizing process toward ingroup over outgroup members in the scarcity condition. Finally, the ACC activation level significantly predicted the influence of resource scarcity on ingroup bias in hypothetical real-life situations according to a follow-up examination.     

编码后奖赏影响基于议程的学习：奖赏预期和结果的作用

基于ABR模型考察奖赏预期和奖赏结果对不同难度词对记忆与元记忆的影响。结果发现：(1)限时学习条件下,奖赏结果促进不同难度词对记忆成绩和学习判断,奖赏预期仅提高简单词对的记忆成绩。(2)自定步调学习条件下,定时学习判断时奖赏结果仅影响学习判断;奖赏预期促进高难度词对的学习时间分配,从而提高记忆成绩和学习判断。(3)在自定步调学习时,奖赏预期超越难度成为影响学习时间分配的因素。以上结果表明,个体会综合奖赏预期、奖赏结果和难度构建学习议程,足够大的奖赏预期会超越难度成为议程构建的主导因素。但奖赏预期和奖赏结果对记忆成绩、学习时间分配和学习判断的影响受学习条件调节。     

The elderly and high technology medicine: A case for individualized,autonomous allocation

The issues involved in decision making about the aggressiveness of future medical care for older persons are explored. They are related to population trends, the heterogeneity of older persons and a variety of factors involved in individual preferences. Case studies are presented to illustrate these points, as well as a review of pertinent literature. The argument is offered that, considering these many factors, a system of flexible, individualized care by informed patient preference, is more rational than the rationing of technological services by age.     

小学儿童奖赏公平性的认知发展

采用信息加工研究途径并假设故事情境探索小学儿童对奖赏公平性的社会认知发展,并将儿童的发展与成人作对比。研究结果表明,７,９岁儿童容易将＂均等＂与＂公平＂混淆,还没形成一个稳定的分配模式,而１２岁儿童已能运用＂努力＂、＂成果＂、＂能力＂等规则较为稳定地作出公平奖赏决定或评价,但还没达到对更高层次的社会准则的理解和掌握。儿童这一发展制约于他们的信息加工能力以及获得有关社会价值观的社会化过程。     

Human choice in concurrent ratio-interval schedules of reinforcement.

Seven undergraduates participated in a concurrent-choice experiment with monetary reinforcers. Response-independent analogues of variable-interval and variable-ratio schedules were used to assess whether subjects would maximize reinforcement rate. The optimal pattern of behavior, in terms of maximizing reinforcement rate, involved a large bias toward the ratio alternative, with only occasional sampling of the interval schedule. Most experiments with pigeons, however, demonstrate matching of response rates to reinforcement rates, with only slight biases for the ratio schedule. Although subjects in the present experiment allocated more time to the ratio alternative than required by matching, the magnitude of the bias did not approximate that predicted by a maximizing account. After exposure to clock stimuli correlated with the operation of each schedule, 1 subject's behavior did show a substantial level of bias, increasing the total number of reinforcers obtained, and lay at a point between the predictions of matching and maximizing. The other subjects, however, continued to respond less optimally. The present results can be accounted for by a view of matching that incorporates the effects of delayed reinforcement.