The Faulty Magnitude Detector: Why SNARC‐Like Tasks Cannot Support a Generalized Magnitude System

Do people represent space, time, number, and other conceptual domains using a generalized magnitude system (GMS)? To answer this question, numerous studies have used the spatial‐numerical association of response codes (SNARC) task and its variants. Yet, for a combination of reasons, SNARC‐like effects cannot provide evidence for a GMS, even in principle. Rather, these effects support a broader theory of how people use space metaphorically to scaffold their understanding of myriad non‐spatial domains, whether or not these domains exhibit variation in magnitude.     

Fixed-ratio pausing: Joint effects of past reinforcer magnitude and stimuli correlated with upcoming magnitude

Pigeons responded on fixed-ratio schedules ending in small or large reinforcers (grain presentations of different duration) interspersed within each session. In mixed-schedule conditions, the response key was lit with a single color throughout the session, and pausing was directly related to the past reinforcer (longer pauses after large reinforcers than after small ones). In multiple-schedule conditions, different colors accompanied the ratios ending in small and large reinforcers, and pausing was affected by the upcoming reinforcer as well as the past one. Pauses were shorter before large reinforcers than before small ones, but they continued to be longer after large reinforcers than after small ones. The influence of the past reinforcer was modulated by the magnitude of the upcoming reinforcer; in the presence of the stimulus before the small reinforcer, the effect of the past reinforcer was enhanced relative to its effect in the stimulus before the large reinforcer. These results show that pausing between ratios is jointly determined by two competing factors: past conditions of reinforcement and stimuli correlated with upcoming conditions.     

Handling time and choice in pigeons

According to optimal foraging theory, animals should prefer food items with the highest ratios of energy intake to handling time. When single items have negligible handling times, one large item should be preferred to a collection of small ones of equivalent total weight. However, when pigeons were offered such a choice on equal concurrent variable-interval schedules in a shuttlebox, they preferred the side offering many small items per reinforcement to that offering one or a few relatively large items. This preference was still evident on concurrent fixed-cumulative-duration schedules in which choosing the alternative with longer handling time substantially lowered the rate of food intake.     

Choice between reliable and unreliable outcomes: mixed percentage-reinforcement in concurrent chains.

Pigeons' choices between alternatives that provided different percentages of reinforcement in mixed schedules were studied using the concurrent-chains procedure. In Experiment 1, the alternatives were terminal-link schedules that were equal in delay and magnitude of reinforcement, but that provided different percentages of reinforcement, with one schedule providing, reinforcement twice as reliably as the other. All pigeons preferred the more reliable schedule, and their level of preference was not systematically affected by variation in the absolute percentage values, or in the magnitude of reinforcement. In Experiment 2, preference for a schedule providing 100% reinforcement over one providing 33% reinforcement increased systematically with increases in the duration of the terminal links. In contrast, preference decreased systematically with increases in the duration of the initial links. Experiment 3 examined choice with equal percentages of reinforcement but unequal delays to reinforcement. Preference for the shorter delay to reinforcement was not systematically affected by variation in the absolute percentage of reinforcement. The overall pattern of results supported predictions based on an extension of the delay-reduction hypothesis to choice procedures involving mixed schedules of percentage reinforcement.     

编码后奖赏影响基于议程的学习：奖赏预期和结果的作用

基于ABR模型考察奖赏预期和奖赏结果对不同难度词对记忆与元记忆的影响。结果发现：(1)限时学习条件下,奖赏结果促进不同难度词对记忆成绩和学习判断,奖赏预期仅提高简单词对的记忆成绩。(2)自定步调学习条件下,定时学习判断时奖赏结果仅影响学习判断;奖赏预期促进高难度词对的学习时间分配,从而提高记忆成绩和学习判断。(3)在自定步调学习时,奖赏预期超越难度成为影响学习时间分配的因素。以上结果表明,个体会综合奖赏预期、奖赏结果和难度构建学习议程,足够大的奖赏预期会超越难度成为议程构建的主导因素。但奖赏预期和奖赏结果对记忆成绩、学习时间分配和学习判断的影响受学习条件调节。     

自闭症谱系障碍社交动机理论：机制及干预探索

自闭症谱系障碍(Autism Spectrum Disorder, ASD)表现为社会交往困难以及重复刻板兴趣或行为。社交动机理论提出ASD个体是由于社交动机缺乏导致的社交障碍。目前该理论缺乏理论元素及结构关系的系统论证, 及基于此理论的低龄ASD儿童群体的研究证据。本研究拟采用心理实验法、眼动及近红外脑成像技术, 探索低龄ASD儿童早期社交奖赏、社交定向异常眼动标记及眶额叶脑区活动的神经机制。此外, 通过音乐奖赏强化学习的干预方式改善该理论的核心元素(社交奖赏), 观测能否改善ASD儿童的社交动机。本研究的开展有望对该理论进行系统验证, 并形成改善社交行为的潜在干预方案。     

Effect of Daily Life Reward Loop Functioning on the Course of Depression

Engagement in activities increases positive affect (Reward Path 1), which subsequently reinforces motivation (Reward Path 2), and hence future engagement in activities (Reward Path 3). Strong connections between these three reward loop components are considered adaptive, and might be disturbed in depression. Although some ecological nomentary assessment (EMA) studies have investigated the cross-sectional association between separate reward paths and individuals’ level of depression, no EMA study has looked into the association between individuals’ reward loop strength and depressive symptom course. The present EMA study assessed reward loop functioning (5x/day, 28 days) of 46 outpatients starting depression treatment at secondary mental health services and monitored with the Inventory of Depressive Symptomatology—Self-Report (IDS-SR) during a 7-month period. Results of multilevel regression analyses showed significant within-person associations for Reward Path 1 (b = 0.21, p < .001), Reward Path 2 (b = 0.43, p < .001), and Reward Path 3 (b = 0.20, p < .001). Stronger average reward loops (i.e., within-person mean of all reward paths) did not relate to participants’ improvement in depressive symptoms over time. Path-specific results revealed that Reward Paths 1 and 2 may have partly opposite effects on depressive symptom course. Together, our findings suggest that reward processes in daily life might be best studied separately and that further investigation is warranted to explore under what circumstances strong paths are adaptive or not.     

Unit price as a useful metric in analyzing effects of reinforcer magnitude.

In this paper, we applied the behavioral-economic concept of unit price to the study of reinforcer magnitude in an attempt to provide a consistent account of the effects of reinforcer magnitude on behavior. Recent research in the experimental analysis of behavior and in behavioral pharmacology suggests that reinforcer magnitude interacts with the schedule of reinforcement to determine response rate and total consumption. The utility of the unit-price concept thus stems from its ability to quantify this interaction as a cost-benefit ratio (i.e., unit price = characteristics of the schedule of reinforcement divided by magnitude of reinforcement). Research employing the unit-price concept has shown that as unit price increases, a positively decelerating function exists for consumption (i.e., a function with an increasingly negative slope, when plotted on log coordinates) and a bitonic function exists for response rate. Based on these findings, the present analysis applied the unit-price concept to those studies of reinforcer magnitude and drug self-administration that examined the effects of reinforcer magnitude on response rate using simple schedules of reinforcement (e.g., fixed-ratio schedule). This resulted in three findings: (a) Reinforcer-magnitude manipulations and schedule manipulations interact in a manner that can be quantified in terms of unit price as benefit and cost factors, respectively; (b) different reinforcer-magnitude manipulations are functionally interchangeable as benefit factors in the unit-price ratio; and (c) these conclusions appear warranted despite the differences in reinforcers (food or drug), species (dogs, monkeys, or rats), and schedules (interval or ratio), and despite the fact that these studies were not designed for a unit-price analysis. In methodological terms, these results provide further evidence that employing the unit-price concept is a parsimonious method for examining the effects of reinforcer magnitude. In theoretical terms, these results suggest that a single process may underlie the effect of combined reinforcer-magnitude and schedule manipulations.     

Enhancing Classroom Performance: A Review of Reinforcement Schedules

During the past decade the application of elementary principles of behavior have become a standard in the classroom teacher's repertoire of behavior change strategies. Unfortunately, the application of more advanced principles of behavior derived through basic behavioral research lies as an untapped resource for classroom teachers. Nowhere is this more apparent than in the use of systematic procedures to deliver reinforcers to enhance academic performance. In this paper we provide educators with information on the use of reinforcement schedules in academic settings. Various schedules of reinforcement are presented along with examples of their application in applied settings.     

How to maximize reward rate on two variable-interval paradigms

Without assuming any constraints on behavior, we derive the policy that maximizes overall reward rate on two variable-interval paradigms. The first paradigm is concurrent variable time-variable time with changeover delay. It is shown that for nearly all parameter values, a switch to the schedule with the longer interval should be followed immediately by a switch back to the schedule with the shorter interval. The matching law does not hold at the optimum and does not uniquely specify the obtained reward rate. The second paradigm is discrete trial concurrent variable interval-variable interval. For given schedule parameters, the optimal policy involves a cycle of a fixed number of choices of the schedule with the shorter interval followed by one choice of the schedule with the longer interval. Molecular maximization sometimes results in optimal behavior.