Time-allocation matching between punishing situations

In the presence and absence of white noise, response-independent aversive events were delivered to rats according to several variable-time electric-shock schedules. The animals could switch from the noise component to the no-noise component and vice versa by making a single lever-press response. If the schedule in one component was not in operation when the animal was in the other component, the proportion of time allocated to one component equalled or matched the proportion of obtained punishers in the other component. If both schedules were always in operation, minimizing tended to occur: the animals allocated almost all of their time to the component having the lower shock rate. An analysis of these results, in terms of the expected time until an aversive event, is presented.     

Effects of ratio contingencies on responding maintained by schedules of electric-shock presentation (response-produced shock)

Squirrel monkeys' lever pressing was established under fixed-interval schedules of electric-shock presentation (response-produced shock). After appropriate temporal patterns of lever pressing were engendered, either fixed-ratio schedules of shock presentation were added to the fixed interval, or yoked variable-ratio schedules were substituted for the fixed-interval schedules. When fixed-ratio schedules were added, there was an initial rise in response rate and schedule-appropriate patterns of responding developed. After many sessions, however, responding ceased abruptly, in some cases with remarkable quickness. When variable-ratio schedules were substituted, responded declined gradually and eventually was poorly maintained. Ratio contingencies may not support responding as well as interval contingencies when electric shock is the maintaining event.     

Punishment-specific effects of pentobarbital: dependency on the type of punisher.

Pigeons were trained to peck a key under a multiple random-interval 1-minute, random-interval 6-minute schedule of food presentation. Subsequently, over three phases, additions were made during the random-interval 1-minute component as follows: pecks during the component occasionally were punished by timeout presentation (Phase 1), timeouts were presented independently of responding during the component (Phase 2), pecks during the component occasionally were punished by electric-shock presentation (Phase 3). In Phases 1 and 3, response-dependent timeout and shock suppressed responding and established equivalent rates in both components of the multiple schedule. Intermediate doses of pentobarbital increased responding suppressed by electric-shock punishment but had little or no effect on responding suppressed by timeout punishment. Response-independent presentation of timeouts did not result in suppression of responding (thus showing that response-dependent timeout acted as a punisher), and pentobarbital did not reliably increase unpunished responding. Pentobarbital's selective "punishment-attenuating" properties depend on the nature of the punisher.     

Fixed-ratio discrimination: effects of intermittent reinforcement

Four pigeons had discrimination training that required the choice of a left side-key after completing a fixed-ratio 10 on the center key, and a right side-key choice after fixed-ratio 20. Correct choices were reinforced on various fixed-interval, fixed-ratio, random-interval, and random-ratio schedules. When performance was examined across successive 15-second intervals (fixed-interval and fixed-ratio schedules) accuracy was high in the first 15-second interval, decreased in one or several of the next 15-second intervals, and then increased again as reinforcement was approached. When performance was examined across correct trials on fixed-interval and fixed-ratio schedules, accuracy was lowest immediately after reinforcement, followed by a systematic increase in accuracy as the number of correct choices increased. These patterns were due primarily to errors on fixed-ratio 20 trials. Systematic accuracy patterns did not occur on random-interval or random-ratio schedules. The results indicate that when choice patterns differed on fixed-interval and fixed-ratio schedules, the differences were due to the method of data analysis.     

AVERSIVE CONTROL: A SEPARATE DOMAIN?

Traditionally, aversive control has been viewed as a separate domain within behavior theory. Sometimes this separateness has been based upon a distinction between reinforcement and punishment, and sometimes upon a distinction between positive and negative reinforcement. The latter is regarded here as the more compelling basis, due to some inherent procedural asymmetries. An approach to the interpretation of negative reinforcement is presented, with indication of types of experiments that support it and that also point to promising directions for further work. However, most of the interpretive issues that arise here are relevant to positively reinforced behavior as well. These include: possible reformulation of the operant/respondent distinction; the place of emotional concepts in behavior analysis; the need for simultaneous, complementary analysis on differing time scales; the understanding of behavioral situations with rewarding or aversive properties that depend as much upon the contingencies that the situations involve as upon the primary rewarding or aversive stimuli that they include. Thus, an adequate understanding of this domain, which has been traditionally viewed as distinct, has implications for all domains of behavior-analytic theory.     

Interresponse-time punishment: a basis for shock-maintained behavior.

Lever pressing of squirrel monkeys postponed brief electric shock according to a free-operant shock-postponement procedure. Pressing also produced shock with a probability proportional to the duration of the current interresponse time in some conditions, or to the fifth ordinally-preceding interresponse time in others. These conditions provided equal frequencies and temporal distributions of response-produced shocks either contingent on or independent of the current interresponse-time duration, respectively. Shock delivered contingent on the current interresponse-time duration resulted in shorter mean interresponse times and higher overall response rates that shock delivered independent of the current interresponse time. In subsequent conditions, response-produced shocks were sufficient to maintain responding following suspension of the postponement procedure only when those shocks were contingent on the current interresponse time. Presenting shock independent of the current interresponse time, conversely, suppressed response rate and ultimately led to cessation of responding in the absence of a conjoint shock-postponement procedure. These results demonstrate interresponse-time punishment in the absence of any indirect avoidance contingencies based on overall shock-frequency reduction, and strongly support similar interpretation at the more local level of shock-frequency reduction correlated with particular interresponse times. Differential punishment of long interresponse times also provides both an a priori basis for predicting whether a schedule of shock presentation will maintain or suppress responding and a framework for interpreting many of the functional relations between overall response rate and parameters of consequent shock presentation. Finally, these results and others indicate the importance of response-consequence contiguity above and beyong any notion of noncontiguous contingency in the control of behavior.     

奖惩频率对3～5岁幼儿完成博弈任务的影响

通过对情感决策的常用研究工具——标准爱荷华博弈任务进行了得失总量不变而频率改变的修改,并使之适合于年幼的3～5岁儿童,可以比较幼儿在不同奖惩频率任务中的表现,从而考察奖惩频率对幼儿情感决策的影响。对120名3～5岁幼儿在四种不同类型的任务中的表现进行分析后,所得实验结果如下:(1)儿童对惩罚和奖励频率的变化比较敏感:正向博弈任务中,"有利纸牌不变,不利纸牌的惩罚总量不变,只增加不利纸牌的惩罚频率"可以使3～5岁儿童完成博弈任务的成绩有显著提高;逆向博弈任务中,"不利纸牌不变,有利纸牌的奖惩总量不变,而有利纸牌奖励频率的增加"能促使4～5岁幼儿更多更快地做出正确选择。(2)幼儿的情感决策能力在3～4岁时期发展迅速,而在4～5岁时仍然有较快发展。     

Early extinction effects following intermittent reinforcement: Little evidence of extinction bursts

The occurrence of extinction bursts—transient increases in response rate in excess of those observed in baseline during the period immediately following discontinuation of reinforcement of a response—was examined. In Experiment 1, key pecking of pigeons was reinforced according to a multiple schedule in which a variable-ratio schedule alternated with an interval schedule in which the reinforcers were yoked to the preceding variable-ratio component. In Experiments 2 and 3, rats were screened such that the lever-press response rates of different rats maintained by variable-interval schedules were either relatively high or relatively low. Following these baseline conditions, in Experiments 1 and 2 responding was extinguished by eliminating the food reinforcer and in Experiment 3 by removing the response–reinforcer dependency. Responses immediately following extinction implementation were examined. Response increases relative to baseline during the first 20 min of a 324.75-min extinction session (Experiment 1) or during the first 30-min extinction session (Experiments 2 and 3) were rare and unsystematic. The results (a) reinforce earlier meta-analyses concluding that extinction bursts may be a less ubiquitous early effect of extinction than has been suggested and (b) invite further experimentation to establish their generality as a function of preceding reinforcement conditions.     

利他性惩罚的动机

社会规范的维系离不开对违规者实施的利他性惩罚, 然而, 从个体心理层面来看, 利他性惩罚的动机却并不是全然利他的。除了积极维护公平原则以外, 追求良好声誉、规避潜在损失或消除负性情绪也在不同程度上驱动了利他性惩罚。此外, 对惩罚成本数量和成本形式的敏感也表明基于成本-收益原则的策略性动机在驱动利他性惩罚中占据一席之地。进一步探索在利他性惩罚实施过程中不同动机之间的相互作用是未来的重要研究方向。     

The emergence of psychopathy: implications for the neuropsychological approach to developmental disorders

In this paper, I am going to examine the disorder of psychopathy and consider how genetic anomalies could give rise to the relatively specific neuro-cognitive impairments seen in individuals with this disorder. I will argue that genetic anomalies in psychopathy reduce the salience of punishment information (perhaps as a function of noradrenergic disturbance). I will argue that the ability of the amygdala to form the stimulus-punishment associations necessary for successful socialization is disrupted and that because of this, individuals with psychopathy do not learn to avoid actions that will harm others. It is noted that this model follows the neuropsychological approach to the study of developmental disorders, an approach that has been recently criticized. I will argue that these criticisms are less applicable to psychopathy. Indeed, animal work on the development of the neural systems necessary for emotion, does not support a constructivist approach with respect to affect. Importantly, such work indicates that while environmental effects can alter the responsiveness of the basic neural architecture mediating emotion, environmental effects do not construct this architecture. However, caveats to the neuropsychological approach with reference to this disorder are noted.