Training of instrumental responses in dogs socially reinforced by humans

The motivational bases of the social reinforcement in human-dog relations were examined. In experiment I, performed on seven dogs, it was found that dogs were able to learn and sustain the natural responses of sitting, paw extension, and lying prostrate to conditional stimuli in the form of vocal commands reinforced only by social rewards given by the experimenter, such as petting and vocal encouragement. Overtraining did not produce deterioration of performance but, on the contrary, the continual decrease of latencies. It was evidenced that tactile stimulation plays an important role in social reward. In experiment II, instrumental responses to the auditory conditional stimuli were elaborated in two groups of dogs. The first group (nine dogs) was reinforced by food, and the second group (eight dogs) was reinforced exclusively by petting. A similar course of learning and level of performance during overtraining sessions in both groups indicated that petting serves as a good reinforcement, with rewarding value comparable to that of food reinforcement. It is suggested that a strong rewarding effect of pleasurable sensory stimuli occurs in the formation of the bond between dog and human and in the learning of different tasks.     

Suppressive and enhancing effects of footshock on food-reinforced operant responding following septal lesions in rats.

Effect of septal lesions on suppression of an intermittently food-reinforced lever press by contingent and noncontingent footshock was measured. Rats with septal damage maintained higher response rates than did intact animals under both contingent and noncontingent shock. Furthermore, the difference in suppression produced by the contingent and noncontingent conditions was approximately the same for the experimental and control groups. In a second experiment, performance was measured during counter-conditioning in which the correlation between contingent shock and positive reinforcement was varied. Rats with septal lesions responded at higher rates than did controls. When only reinforced responses were punished, this lesion-induced elevation represented an increase above baseline performance without punishment. This finding suggests that the effect of septal damage on appetitive instrumental performance cannot be due solely to a deficit in response inhibition.     

Shock-induced aggression and pain sensitivity in the rat: Catecholamine involvement in the corticomedial amygdala

The possible role of amygdaloid catecholamines in the control of shock-induced aggression and pain sensitivity in the rat was investigated. Bilateral microinjections of chlorpromazine into the corticomedial amygdala resulted in decreased fighting and decreased sensitivity to the shock stimulus. Further analysis of this effect, using specific adrenergic antagonists, revealed that neither a- nor Padrenergic systems appeared to be responsible for the behavioral effect of chlorpromazine. Injections of haloperidol into the same region, however, yielded a reduction similar to that produced by chlorpromazine, while dopamine injections resulted in significant elevations in both fighting and pain sensitivity. No effect on any of these behavioral measures was obtained following injection of any of the agents into the basolateral amygdala. These results suggest that the observed effect of catecholamine injections in the corticomedial amygdala is related to changes in pain sensitivity mediated by dopamine.     

Pharmacological effects on lateralized behavior

Sixteen student volunteers were administered a placebo and 50 mg. of chlorpromazine in tablet form, on separate occasions, two hours before testing. The three tests measured dichotic listening performance, lateral eye movements while answering questions about spatial location and verbal meaning, and lateralized facial expression while relating pleasant and unpleasant life incidents. Results showed that chlorpromazine increased the number of trials showing an ear advantage in dichotic listening. Chlorpromazine reduced lateral and increased vertical eye movements in response to the questions about spatial location and verbal meaning. Under the placebo both negative and positive emotions were expressed more in the left face. Although chlorpromazine did not affect this lateralization of negative emotions, the expression of positive emotions occurred equally often on the two sides of the face under chlorpromazine. Results may be related to an effect of chlorpromazine on the asymmetrical dopamine pathways of the brain. It is suggested that the findings may be related to a left hemisphere deficit in schizophrenia.     

Roles of nucleus accumbens and basolateral amygdala in autoshaped lever pressing

Initially-neutral cues paired with rewards are thought to acquire motivational significance, as if the incentive motivational value of the reward is transferred to the cue. Such cues may serve as secondary reinforcers to establish new learning, modulate the performance of instrumental action (Pavlovian-instrumental transfer, PIT), and be the targets of approach and other cue-directed behaviors. Here we examined the effects of lesions of the ventral striatal nucleus accumbens (ACb) and the basolateral amygdala (BLA) on the acquisition of discriminative autoshaped lever-pressing in rats. Insertion of one lever into the experimental chamber was reinforced by sucrose delivery, but insertion of another lever was not reinforced. Although sucrose was delivered independently of the rats' behavior, sham-lesioned rats rapidly came to press the reinforced but not the nonreinforced lever. Bilateral ACb lesions impaired the initial acquisition of sign-tracking but not its terminal levels. In contrast, BLA lesions produced substantial deficits in terminal levels of sign-tracking. Furthermore, whereas ACb lesions primarily affected the probability of lever press responses, BLA lesions mostly affected the rate of responding once it occurred. Finally, disconnection lesions that disrupted communication between ACb and BLA produced both sets of deficits. We suggest that ACb is important for initial acquisition of consummatory-like responses that incorporate hedonic aspects of the reward, while BLA serves to enhance such incentive salience once it is acquired.     

齐拉西酮与氯丙嗪对精神分裂症首次发作患者心电图影响的比较研究

为了探讨齐拉西酮与氯丙嗪对首发精神分裂症患者心电图（ECG）的影响,将221例首发精神分裂症患者随机分为两组,齐拉西酮组111例,氯丙嗪组110例,分别给予齐拉西酮和氯丙嗪治疗。于治疗前和治疗后的第2、4、8周末定期进行心电图检查,并对两组患者的心电图结果进行对比分析。服药后两组患者的心电图均有不同程度的改变,以窦性心动过速和ST—T改变为主,齐拉西酮组与氯丙嗪组患者心电图异常发生率分别为24．3％、54．5％,齐拉西酮组所致心电图改变明显低于氯丙嗪组（P〈0．01）。齐拉西酮与氯丙嗪治疗精神分裂症疗效相当,而齐拉西酮对首发精神分裂症患者心电图的影响显著低于氯丙嗪,临床安全性高。     

Verbal and Nonverbal Emotional Memory Following Unilateral Amygdala Damage

The amygdala is involved in the normal facilitation of memory by emotion, but the separate contributions of the left and right amygdala to memory for verbal or nonverbal emotional material have not been investigated. Fourteen patients with damage to the medial temporal lobe including the amygdala (seven left, seven right), 18 brain-damaged, and 36 normal controls were exposed to emotional and neutral pictures accompanied by verbal narratives. Memory for both narratives and pictures was assessed with a free recall test 24 h later. Subjects with left amygdala damage failed to show the normally robust enhancement of memory for verbal and nonverbal emotional stimuli. The group with right amygdala damage showed the normal pattern of facilitation of memory by emotion for both verbal and nonverbal stimuli despite an overall reduction in memory performance. Furthermore, subjects with left amygdala damage were disproportionately impaired on memory for emotional narratives as compared with memory for emotional pictures. The latter finding offers partial support for a lateralized and material-specific pattern of the amygdala's contribution to emotional memory.     

Effects of chlorpromazine on fixed-ratio responding: modification by fixed-interval discriminative stimuli.

Effects of chlorpromazine (1 to 100 mg/kg) were assessed on two pigeons' responding under various modifications of a multiple schedule of food delivery. During a fixed-interval component, the first response after 5 min produced food; during the subsequent, fixed-ratio component, the 30th response produced food. Modifications of the schedule entailed changes in stimulus conditions imposed during the fixed-ratio component that did not systematically alter characteristics of performance under non-drug conditions. In the first phase of the experiment, distinctive visual stimuli were correlated with each schedule component (conventional multiple schedule); chlorpromazine produced small decreases in fixed-ratio responding (20% at 30 mg/kg). When each response during the fixed-ratio component produced the stimulus correlated with the fixed-interval schedule (fixed-interval discriminative stimulus) for 1.2 s, effects of chlorpromazine were not different from those under the conventional multiple schedule. Chlorpromazine produced greater decreases in fixed-ratio responding (55% at 30 mg/kg) when either the first response of each fixed ratio changed the stimulus correlated with the fixed-ratio schedule to the fixed-interval discriminative stimulus for the remainder of the fixed-ratio component, or when the fixed-interval discriminative stimulus was presented independently of responding according to a matched temporal sequence. When the fixed-interval discriminative stimulus was present continuously during the fixed-ratio component (mixed schedule), chlorpromazine produced even more substantial decreases in fixed-ratio responding (greater than 80% at 30 mg/kg). Effects of chlorpromazine on fixed-interval responding were also modified by the schedules of fixed-interval discriminative stimulus presentation. The effects of chlorpromazine were a joint function of the stimuli prevailing during the multiple schedule and the degree to which responding influenced these stimuli.     

Drug effects in squirrel monkeys trained on a multiple schedule with a punishment contingency

The behavior of four monkeys trained on a multiple schedule was differentially sensitive to selected pharmacological agents. The three components of the multiple schedule were: (1) a variable-interval schedule in which responses were reinforced on the average of once per minute; (2) a concurrent schedule in which every tenth response was reinforced and every fifteenth response, on the average, was shocked; and, (3) a neutral stimulus in the presence of which responses were neither reinforced nor shocked. Pentobarbital, chlordiazepoxide, and meprobamate increased responding during each of the components. Scopolamine and d-amphetamine decreased variable-interval performance, had minimal effects on performance during the concurrent-schedule component, and increased responding in the presence of the neutral stimulus. Chlorpromazine decreased variable-interval responding and had slight effects on the responding during the other two components.     

Amphetamine increases intertrial but not conditional instrumental responding in the cortico-basomedial amygdalar dogs

The effect of partial cortico-basomedial amygdaloid lesions on dogs’ social behavior was investigated. The lesions did not affect the conditional instrumental responding (CRs) reinforced by petting or the dogs’ need for petting (US). The lesions increased the number of intertrial responses (ITRs) in all dogs. Subsequently the effect of low amphetamine doses (0.5 mg/l kg) administered intramuscularly to the amygdalar animals on the same behavioral parameters of the social behavior was examined. Amphetamine did not affect CRs but dramatically increased the ITRs and dogs’ need for petting. These findings suggest that the cortico-basomedial amygdaloid region may be involved in the cortical inhibitory mechanisms that are indispensable for promoting behavioral acts according to their usefulness and the situational context.     

Observing responses in pigeons

Pigeons were trained on an observing-response procedure in which periods of VR 100 and EXT alternated unpredictably during a white light (mixed stimulus). During VR 100, responses on a food-producing key (the first key) were intermittently reinforced. Responses on the observing key (the second key) produced a green light (positive stimulus) when VR 100 was in effect, and a red light (negative stimulus) for EXT. The birds did not respond on either key during the negative stimulus, but they responded on the food-producing key when the positive stimulus appeared. When observing responses produced the positive or negative stimulus on FR, observing responses were maintained until the FR reached a maximum; beyond this, only food-producing responses occurred. When observing responses did not produce either stimulus, the observing-response rates fell to zero. With prolonged exposure to an FR 20 schedule of observing, observing-response rates during EXT were higher than during VR 100. Chlorpromazine hydrochloride decreased the total response output but markedly increased observing-response rates except when it was administered before sessions of observing response extinction.     

Effects of reward distribution and performance feedback on competitive responding

To implement competitive contingencies, one must select a distribution of unequal rewards and a schedule of feedback for competitors regarding one another's performance. This study investigated three bases for distributing rewards and two performance feedback conditions. Pairs of college students competed over a series of 2-min contests in which the competitive response was a knob pull. A sum of money was divided using a proportional distribution or one of two fixed reward distributions. In the proportional distribution, a subject's proportion of the sum was his or her proportion of the total number of responses. The two fixed distributions were divisions of 100%/0% or 67%/33%. Also, in every contest either subject could make a response that would end the contest prematurely and give both subjects the same amount—a sum equal to 33% of the competitive total. In the two feedback conditions, cumulative responses by each subject were either shown to both subjects during the contest or were not shown. The proportional distribution was clearly superior to either of the fixed distributions in number of responses produced across contests. The proportional distribution with feedback produced the largest number of competitive responses, and the 100%/0% distribution without feedback produced the smallest number. Differences among distributions typically emerged only during later blocks of contests. Fixed distributions of rewards often produced decelerating rates of responding, with losing competitors ending the contests before they were completed. Response-rate decreases were greatest for pairs in which the 2 subjects differed most in their response rates and proportion of wins. The presence of feedback had a small effect, increasing responding for some pairs in the 100%/0% distribution. Performance patterns were interpreted in terms of the consequences arranged for the individual participants by the reward distributions and differences in performance between competitors.     

Discrimination between outcomes in instrumental learning: Effects of preexposure to the reinforcers

In two experiments rats received instrumental training with two response levers, one response being reinforced by sucrose solution and the other by sucrose pellets. Prior to a test session, on which both levers were made available in the absence of reinforcement, the rats were given free access to one of the reinforcers, a procedure known to reduce its value. It was found that the rats responded at a lower rate on the lever that had produced the now-devalued reinforcer, but that this effect was substantial only in rats that had received preexposure to the two reinforcers before instrumental training was begun (Experiment 1). Experiment 2 demonstrated that this effect was obtained only when presentations of the two reinforcers were presented according to an inter-mixed schedule during preexposure. It is suggested that this result constitutes an instance of the perceptual learning effect in which intermixed preexposure to similar events enhances their discriminability.     

Amphetamine effects on unconditional and conditional instrumental responses with alimentary and social rewards in dogs

The effect of amphetamine dose (0.5 mg per 1 kg) on conditional and unconditional responses based on alimentary and social motivation was investigated in two groups of dogs. Amphetamine resulted in a significant decrease of conditional instrumental responses (CRs) in both groups but did not attenuate significantly the dogs’ need for food or petting. On the contrary, the drug drastically increased the dogs’ need for petting, and its anorectic effect was mild. The deteriorating effect of amphetamine on mnemonic processes and its facilitatory effect on behaviors directed to get more than the usual amount of pleasant tactile stimulation might underlie the behavioral changes described in this study.     

d-Amphetamine-chlorpromazine antagonism in a food reinforced operant

Dose effect curves for d-amphetamine and chlorpromazine were obtained with rats on a milk reinforced FR 10 schedule. A dose of d-amphetamine (2.5 mg/kg, i.p.) which completely suppressed all responding for 60 min was administered simultaneously (concomitant with the pretreatment times) with various doses of chlorpromazine. The d-amphetamine-induced cessation of responding was removed by several of the doses of chlorpromazine with maximal antagonism occurring at a dose of 1.5 mg/kg i.p. This dose of chlorpromazine, when administered independently, produced no observable side effects and showed no effect on the FR 10 schedule. One animal appeared to develop tolerance to the repeated dosages of d-amphetamine.     

A specific role for the human amygdala in olfactory memory

The medial temporal lobe is known to play a role in the processing of olfaction and memory. The specific contribution of the human amygdala to memory for odors has not been addressed, however. The role of this region in memory for odors was assessed in patients with unilateral amygdala damage due to temporal lobectomy (n = 20; 11 left, 9 right), one patient with selective bilateral amygdala damage, and in 20 age-matched normal controls. Fifteen odors were presented, followed 1 h later by an odor-name matching test and an odor-odor recognition test. Signal detection analyses showed that both unilateral groups were impaired in their memory for matching odors with names, these patients were not significantly impaired on odor-odor recognition. Bilateral amygdala damage resulted in severe impairment in both odor-name matching as well as in odor-odor recognition memory. Importantly, none of the patients were impaired on an auditory verbal learning task, suggesting that these findings reflect a specific impairment in olfactory memory, and not merely a more general memory deficit. Taken together, the data provide neuropsychological evidence that the human amygdala is essential for olfactory memory.     

Reward,affect, and young children's motivational orientation

In this study we examined the proposition that the detrimental effect of reward on young children's intrinsic motivation may be due to increased negative affect associated with performing the target task under expected reward conditions. Fifty-six children were randomly assigned to one of three non-reward mood induction conditions (positive, negative, neutral) or to a reward, neutral mood induction condition. Children then played an attractive game. Subsequent intrinsic interest was measured in a free-choice period in which rewards were neither forthcoming nor expected and children could freely choose to play with the target game or with other toys. It was found that rewards produced a less positive mood state, which subsequently was related to lowered intrinsic interest in the free-choice situation. In general, the results for the reward/neurtral mood condition paralleled those for the non-reward/negative mood condition. It was concluded that instrumental rewards may induce a temporary negative mood state in young children that can undermine intrinsic motivation.This research was sponsored in part by a Faculty-Grant-in-Aid (No. 420893) from Arizona State University, and by a Faculty Release Award from the Department of Family Resources and Human Development, both to the first author. The authors would like to express their appreciation to Barry Arbuckle, Anna Burke, Mia Nymoh, Darlene Richmond, Phil Swanson, and Irma Vega for their assistance in data collection.     

Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making

Research on the neural basis that underlies decision making in humans has revealed that these processes are mediated by distributed neural networks that incorporate different regions of the frontal lobes, the amygdala, the ventral striatum, and the dopamine system. In the present article, we review recent studies in rodents investigating the contribution of these systems to different forms of cost-benefit decision making and focus on evaluations related to delays, effort, or risks associated with certain rewards. Anatomically distinct regions of the medial and orbital prefrontal cortex make dissociable contributions to different forms of decision making, although lesions of these regions can induce variable effects, depending on the type of tasks used to assess these functions. The basolateral amygdala and the nucleus accumbens play a more fundamental role in these evaluations, helping an organism overcome different costs to obtain better rewards. Dopamine activity biases behavior toward more costly yet larger rewards, although abnormal increases in dopamine transmission can exert opposing actions on different types of decision making. The fact that similar neural circuits are recruited to solve these types of problems in both humans and animals suggests that animal models of decision making will prove useful in elucidating the mechanisms mediating these processes.     

Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus

Three experiments examined appetitive Pavlovian-instrumental interactions by presenting separately trained conditioned stimuli (CSs) during reinforced instrumental responding in rabbits. Intra-oral reinforcement was used to minimize interference from peripheral responses such as magazine approach. In experiment 1, the rabbits were first trained to perform an instrumental head-raising response for sucrose reward. A conditioned jaw movement response was then established to a 2-sec CS by pairing it with sucrose; a control stimulus was unpaired with sucrose. Instrumental responding maintained by a variable-interval 40-sec schedule was enhanced during 10-sec presentations of the paired, but not the unpaired, CS. Responding on a variable-ratio 15 schedule was unaffected except on trials on which the pre-CS baseline response rate was low; in such cases the paired CS caused a long-lasting acceleration of responding. Noncontingent presentation of the sucrose reinforcer itself briefly suppressed responding but had no long-term effect. In Experiment 2, a CS that had been conditioned at a 10-sec duration produced the same pattern of effects as in the first study, indicating that facilitation resulted from CS presentation rather than from the frustrative effects of non-reinforcement of the CS. In Experiment 3 an inhibitory CS blocked facilitation by the excitatory CS but did not itself affect instrumental responding. These results support the view that Pavlovian processes play a positive role in instrumental performance and suggest that previous findings of suppression by a short-duration CS reflect peripheral interference. The dependence of facilitation on the baseline level of responding is discussed in terms of associative and motivational theories of Pavlovian mediation.     

Effect of telencephalon ablation on the reinforcing and eliciting properties of species-specific events in Betta splendens

In male Betta splendens, aggressive behavior is drastically attenuated following telencephalon ablation. Because instrumental training and Pavlovian conditioning experiments with intact fish have suggested that associative factors may play an important role in the performance of agonistic behaviors, the effect of ablation on instrumental learning and Pavlovian conditioning was studied. In Experiment 1, ablation had no effect on the learning of the instrumental tunnel-swimming response reinforced by mirror presentation (i.e., viewing a conspecific), although the mirror presentations in yoked-control groups elicited fewer responses in ablates than in normal and sham-operated control fish. Yoked controls further established that instrumental responding was maintained by the reinforcement contingency and was not merely the result of increased motor activity. Experiment 2 studied Pavlovian conditioning of the components of the agonistic display. Unconditioned fin erection, gill erection, and tail beating (i.e., unconditioned responses, URs) to the mirror US all were less frequent in ablates than in normals or shams. Of these, only gill cover erection showed evidence of true conditioning (i.e., conditioned responses; CRs) in which responses to the conditioned stimulus (CS) are due to the pairings of CS and US (unconditioned stimulus). However, ablates suffered no impairment of conditioned gill erections. Ablates performed fewer fin erections to the CS; however, fin erection responses were not due to CS-US pairings but were attributable to pseudoconditioning. These results are related to hypotheses postulating the involvement of learning mechanisms in ablation-produced deficits and normal aggressive behavior.