Social reinforcement of operant behavior in rats: a methodological note.

An apparatus was developed to study social reinforcement in the rat. Four Long-Evans female rats were trained to press a lever via shaping, with the reinforcer being access to a castrated male rat. Responding under a fixed-ratio schedule and in extinction was also observed. Social access was found to be an effective reinforcer. When social reinforcement was compared with food reinforcement under similar conditions of deprivation and reinforcer duration, no significant differences were observed.     

Response strength in multiple periodic and aperiodic schedules

Responding in multiple periodic and aperiodic schedules of equal mean reinforcement rate was examined during extinction, satiation, and in the presence of various free-food schedules. In Experiments I and II, pigeons were trained on multiple variable-interval–fixed-interval schedules. Decreases in the rate of responding due to extinction, satiation, or food schedules were approximately equal regardless of the temporal pattern of reinforcer presentation. In Experiment III, pigeons responded on a two-component multiple schedule in which each component was a two-member homogeneous response chain terminating in a fixed-interval schedule during one component and in a variable-interval schedule during the other. The length of both terminal links was varied over a series of conditions. Initial-link responding in the fixed-interval component was reduced more by increasing terminal-link length than was initial-link responding in the variable-interval component. However, no differences in resistance to satiation and extinction were obtained across the fixed and variable components. If the relative decrease in responding produced by satiation and extinction is used as an index of the “value” of the conditions maintaining responding, then these data suggest that fixed and variable schedules of equal mean length are equally valued. This conclusion, however, is not consistent with findings of preference for variable over fixed schedules obtained in studies using concurrent-chain procedures.     

EFFECTS OF DIRECT,INTERMITTENT, AND VICARIOUS REINFORCEMENT PROCEDURES ON THE DEVELOPMENT AND MAINTENANCE OF INSTRUCTION-FOLLOWING BEHAVIORS IN A GROUP OF YOUNG CHILDREN1

A group of young children (mean age: 2.5 yr) were instructed to follow different requests by a teacher in a day-care setting. Experiment I verified that mean group instruction following was low (10%) despite the opportunity for “observational learning”, i.e., the group of 12 children could watch a nonreinforced adult comply with the teacher's request. In Experiment II, when positive consequences were provided contingent on the adult model's behavior, mean group instruction following was relatively unaffected (14%). When direct reinforcement was given to four peer models, each for several sessions, the individual performances of three of the four peer models was elevated (from 50% to 80%); however, the mean performance of the remaining nonreinforced children (N = 7) was only moderately affected (21%). When reinforcement contingencies were again changed, so that each group member was provided direct, but intermittent reinforcement, mean group performance increased substantially to levels of over 70%. Once instruction following was high, presentation of reinforcement only to one peer model sufficed to maintain performance whereas earlier, this same vicarious reinforcement procedure had failed to establish group compliance. The maintenance of instruction-following behavior when reinforcement was applied solely to one child was interpreted mainly in terms of a high resistance to extinction following a history of intermittent reinforcement rather than a “vicarious”- or “self”-reinforcement mechanism. Finally, removal and re-introduction of group intermittent reinforcement, respectively, lowered performance (to levels of 40%) and elevated (to levels of 65%) the group's performance.     

An operant analysis of human altruistic responding

Human altruistic responding (called give responding), which delivered a reinforcer to someone other than the responder, was compared to responding where the responder was the recipient of the reinforcer (called earn responding). The same type of response (button pressing), the same reinforcer (a point representing a penny), and the same reinforcer contingency (a 40-response fixed-ratio schedule) were used for both give and earn responding. Since points representing pennies were used to reinforce give and earn responding, responding for points not worth money was also assessed. Give, earn, and point responding were arranged as concurrent incompatible operants. Lowest rates were obtained for point responding. Compared to earn responding, give responding occurred at lower rates, was more susceptible to cessation when point responding was possible, extinguished more rapidly in the absence of money, and produced less responding during reconditioning compared to conditioning when reconditioning followed a period of nonreinforcement. Give responding was less when it reduced the giver's opportunity to earn. Finally, histories of getting reinforcement from others were shown to determine give responding.     

Alternative response training, differential reinforcement of other behavior, and extinction in squirrel monkeys (Saimiri sciureus)

In Experiment I, (a) extinction, (b) extinction plus reinforcement of a discrete alternative response, and (c) differential reinforcement of other behavior were each correlated with a different stimulus in a three-component multiple schedule. The alternative-response procedure more rapidly and completely suppressed behavior than did differential reinforcement of other behavior. Differential reinforcement of other behavior was slightly more effective than extinction alone. In Experiment II, reinforcement of specific alternative behavior during extinction and differential reinforcement of other behavior were used in two components, while one component continued to provide reinforcement for the original response. Once again, the alternative-response procedure was most effective in reducing responding as long as it remained in effect. However, the responding partially recovered when reinforcement for competing behavior was discontinued. In general, responding was less readily reduced by differential reinforcement of other behavior than by the specific alternative-response procedure.     

即刻消退缺损的原因分析及其神经生物学机制

即刻消退缺损(immediate extinction deficit, IED)是指在条件性恐惧习得后, 立即进行的消退训练不能长期抑制恐惧记忆的现象。IED可能与消退起始时的应激水平和事件分割等因素有关。在高应激水平下, 消退记忆的巩固受损导致IED; 而在中等或较低的应激水平条件下, 即刻消退有效但效果可能容易受事件分割的影响。IED的神经生物学机制涉及应激激活蓝斑去甲肾上腺素能系统, 去甲肾上腺素引起杏仁核基底外侧核(basolateral amygdala, BLA)过度兴奋, 然后BLA通过投射突触抑制在恐惧消退中起核心作用的内侧前额叶神经元的活动。未来研究应注意即刻消退缺损引起的长期后果, 并深入探讨如何优化即刻消退在临床上的应用。     

A preliminary evaluation of treatment duration on the resurgence of destructive behavior

Quantitative models of resurgence (e.g., Behavioral Momentum Theory, Resurgence as Choice) suggest that resurgence is partly a function of the duration of extinction exposure, with longer histories of extinction producing less resurgence. This prediction is supported by some laboratory research and has been partially supported by clinical translations that did not isolate the effects of extinction exposure prior to testing for resurgence. The degree to which different histories of extinction impact the likelihood of treatment relapse in therapeutic applications of differential reinforcement is of great interest to the clinical community, including insurance carriers and other financial providers. In the present study, we isolated the effects of extinction history for severe destructive behavior across 6 participants referred for treatment services and examined resurgence of destructive behavior when alternative reinforcement terminated. Our within-subject evaluation showed no difference in the level of resurgence or persistence of destructive behavior following short and long exposures to differential reinforcement with extinction. We discuss our failure to replicate in relation to experimental-design considerations for investigating this and other relapse phenomena in future research with clinical populations.     

Re-exposure to reinforcement in Context A during treatment in Context B reduces ABC renewal

Previous work from our laboratory showed that intermittently re-exposing rats to reinforcement for lever pressing in a training (A) context, while eliminating lever pressing in a second (B) context, increased ABA renewal of lever pressing relative to rats that experienced only Context B during response elimination. In the current study, we replicated these procedures while assessing renewal in the presence of a novel context (i.e., ABC renewal). Unlike the findings described above, renewal was reduced in the group that experienced re-exposure to Context A during lever-press elimination relative to rats that experienced only Context B. These findings suggest that alternating between contexts associated with reinforcement and extinction during treatment reduces the probability that organisms will respond in novel contexts. These outcomes may be the result of discrimination and/or generalization processes. Moreover, this training procedure may offer a potential mitigation strategy for ABC renewal.     

恐惧记忆习得与消退的性别差异及其神经机制

大多数人在其一生中都会经历创伤事件,但只有少数人会发展成为创伤后应激障碍（PTSD）。焦虑障碍的易感性和保护因素成为一个重要议题。基于恐惧记忆习得与消退模型的研究发现女性个体表现出“易习得、难消退”的特点。在恐惧相关脑区的脑生理结构、功能/结构连接性、以及大脑可塑性的性别差异可能是该特征的根本原因。性激素作为一种焦虑障碍的保护因素,可以调节这种性别差异,这种调节效应可能是通过影响大脑结构形态（如神经细胞的形态和数量）、调控与记忆相关基因的表达（如HDAC4）而实现的。雌性激素水平的不稳定性可能是女性易感焦虑障碍的重要原因。未来对性别差异的深入研究将有助于推进个性化医疗。     

Choice in a variable environment: effects of blackout duration and extinction between components

Pigeons were trained in a procedure in which sessions included seven four- or 10-reinforcer components, each providing a different reinforcer ratio that ranged from 27:1 to 1:27. The components were arranged in random order, and no signals differentiated the component reinforcer ratios. Each condition lasted 50 sessions, and the data from the last 35 sessions were analyzed. Previous results using 10-s blackouts between components showed some carryover of preference from one component to the next, and this effect was investigated in Experiment 1 by varying blackout duration from 1 s to 120 s. The amount of carryover decreased monotonically as the blackout duration was lengthened. Preference also decreased between reinforcers within components, suggesting that preference change during blackout might follow the same function as preference change between reinforcers. Experiment 2 was designed to measure preference change between components more directly and to relate this to preference change during blackout. In two conditions a 60-s blackout occurred between components, and in two other conditions a 60-s period of unsignaled extinction occurred between components. Preference during the extinction period progressively fell toward indifference, and the level of preference following extinction was much the same as that following blackout. Although these results are consistent with Davison and Baum's (2000) theory of the effects of reinforcers on local preference, other findings suggest that theory is incomplete: After a sequence of reinforcers from one alternative, some residual preference remained after 60 s of extinction or blackout, indicating the possibility of an additional longer term accumulation of reinforcer effects than originally suggested.