Neural substrate for brain stimulation reward in the rat: cathodal and anodal strength-duration properties.

The trade-off between current strength and duration of a stimulating pulse was studied for the rewarding and priming effects of brain stimulation reward (BSR). With cathodal pulses, strenght-duration functions for BSR had chronaxies of .8-3 msec. No differences were observed between the results for rewarding and priming effects. With anodal pulses. strength-duration curves were parallel to the cathodal curves at pulse durations of .1-5 msec, but at pulse durations greater than 5 msec the anodal curves showed a greater drop in required current intensity than did the cathodal curves. The parallel portion of the anodal curves was interpreted as due to anode-make excitation, and the drop at longer pulse durations was interpreted as due to anode-break excitation. Cathodal strength-duration functions for the motor effect elicited through the BSR electrodes had chronaxies of .15-.48 msec. Measurements of the latency of the muscle twitch confirmed that anode-make and anode-break excitation occurred, the latter becoming evident at pulse durations as brief as .3-.4 msec. The results provide quantitative characterization of cathodal and anodal strength-duration properties of the neural substrate for BSR and are discussed in terms of their value in guiding electrophysiological investigation of that substrate.     

Preference paradigm: provides better self-stimulation reward discrimination than a rate-dependent paradigm

To obtain a better understanding of how well the Y-maze preference test paradigm indexes electrical brain stimulation reward, the present experiment compared the abilities of this rate-independent paradigm and a rate-dependent paradigm to assess the rewarding effectiveness of brain stimulation. The rate-dependent paradigm used was an operant chamber. The results showed that over a wide range of stimulation parameters the rate-independent paradigm provided a better assessment of the rewarding effectiveness of the brain stimulation than did the rate-dependent paradigm.     

Synergistic effects of ethanol and cocaine on brain stimulation reward.

The effects of two widely abused drugs, ethanol and cocaine, were examined alone and in combination on intracranial reward processes. In agreement with previous research, higher doses of both cocaine and ethanol alone produced facilitation of behavior maintained by brain stimulation reward. Low intraperitoneal doses of ethanol and cocaine, which alone did not affect performance, were found to reduce stimulation reward threshold and modestly increase response rate. The enhancement of brain stimulation reward by the combination of ethanol and cocaine suggests that both drugs may produce their rewarding effects through common neuronal substrates and that they may potentiate the abuse of each other.     

The effects of reinforcer magnitude on timing in rats

The relation between reinforcer magnitude and timing behavior was studied using a peak procedure. Four rats received multiple consecutive sessions with both low and high levels of brain stimulation reward (BSR). Rats paused longer and had later start times during sessions when their responses were reinforced with low-magnitude BSR. When estimated by a symmetric Gaussian function, peak times also were earlier; when estimated by a better-fitting asymmetric Gaussian function or by analyzing individual trials, however, these peak-time changes were determined to reflect a mixture of large effects of BSR on start times and no effect on stop times. These results pose a significant dilemma for three major theories of timing (SET, MTS, and BeT), which all predict no effects for chronic manipulations of reinforcer magnitude. We conclude that increased reinforcer magnitude influences timing in two ways: through larger immediate after-effects that delay responding and through anticipatory effects that elicit earlier responding.     

A multifunctional on-line brain stimulation system

A flexible on-line electrical brain stimulation system designed for brain stimulation reward (BSR) research is described. A Cromemco Z-2D microcomputer is interfaced with a constant-current stimulator and a standard operant chamber. The system programs, written substantially in BASIC, calculate BSR threshold by two rate-independent methods, measure rate of operant responding, and determine resistance of the brain. Other software programs are used for training rats on complex schedules of reinforcement, for system hardware calibration, and for sophisticated statistical data analyses.     

Reward versus performance in self-stimulation: electrode-specific effects of alpha-methyl-p-tyrosine on reward in the rat.

The hypothesis that alpha-methyl-p-tyrosine (AMPT), an inhibitor of catecholamine synthesis, reduces brain stimulation reward was tested, using a measure of reward previously shown to be relatively unaffected by variables that alter performance but not reward. The rewarding effectiveness of stimulation was determined by the location of the sharp rise in the function relating running speed in an alley to the number of pulses received as a reward. For some electrodes, AMPT depressed self-stimulation performance (speed of running) without producing any sizable effect on the measure of reward (location of rise). For other electrodes, the rewarding effectiveness of the stimulation was greatly reduced by AMPT and restored by L-dopa. These opposing results could be repeatedly demonstrated on different electrodes in the same rat. The electrode-specific differential sensitivity to AMPT suggests neurochemically disparate substrates for reward.     

Runway performance of rats for brain-stimulation or food reward: effects of hunger and priming.

In a runway paradigm, pretrial electric stimulation of the brain (ESB), food deprivation, and to a lesser extent water deprivation increased the running speed of rats to an ESB reward. The trial-by-trail course of the change in running speed after the manipulation of food deprivation resembled the steplike performance effect seen when pretrial priming ESB is changed rather than the incremental learning effect seen when the response contingent ESB is changed. In a second experiment, pretrial ESB enhance rats' performance for an ESB reward, but act in opposing directions rats' performance for a food reward. Implications for Deutsch's model of self-stimulation are discussed.     

Reinforcement contrast effects on the rewarding and aversive components of intracranial stimulation

Rats performing a free-operant locomotor response in a shuttlebox to initiate and then escape medial diencephalic stimulation were tested daily on a randomized sequence of three stimulation intensities. In spite of a 1-hr interval between stimulation intensity changes, substantial and graded reinforcement contrast effects were obtained. “Elation” effects were obtained both on the rewarding (latency to initiate) and the aversive (latency to escape) components of stimulation whereas “depression” effects were found only on the measure of reward.     

Measuring threshold shifts for brain stimulation reward using the method of limits.

Thresholds determined from the frequency of pulses and the current for rewarding brain stimulation were obtained from rats with lateral hypothalamic electrodes. The threshold, defined as the frequency or current corresponding to one-half the maximum response rate, was interpolated from reward summation functions. Daily trials of both ascending and descending sequences of frequency and current yielded no significant difference between order of presentation. While there was more variability in the maximum response rates across the sessions, neither frequency- nor current-based threshold evaluations yielded significant rate effects. Our findings suggest that the threshold procedure is generally not influenced by the sequence of delivery of stimulus values and, thus, may be regarded as a reliable measure of the reinforcing properties of brain-stimulation reward.     

肥胖成因的解释——基于食物奖赏研究的视角

肥胖的形成和发展受生物、心理和社会因素的共同作用,其中食物奖赏对肥胖的产生有重要的作用。食物是一种自然奖赏,它指机体天生对食物的渴望和依赖。食物奖赏包括"wanting"、"liking"以及"learningreinforcement"三个成分,每个成分由相应的神经通路表征。食物奖赏调控机体的摄食行为并以此调控体重变化。目前,关于肥胖与食物奖赏关系的理论模型主要有刺激—敏感化理论、奖赏过度理论以及奖赏不足理论。采用横断面设计、前瞻研究设计和纵向被试内重复测量设计,使用食物图片线索和直接给予美味奶昔的技术方法,人类脑成像研究从不同侧面为以上三个理论模型提供了证据。除此之外,食物奖赏还受基因的调控。目前,研究者关注较多的是多巴胺D2受体基因Taq IA rs1800497的多态性和FTO基因rs9939609的多态性对食物奖赏及体重改变的调控。     

Reward-priming impacts visual working memory maintenance: Evidence from human electrophysiology

Reward can benefit visual processing of reward-associated objects in a non-strategic way. Recent studies have suggested that such influence extends also to visual working memory (VWM) representations of reward-associated stimuli. However, it is not clear yet which mechanisms underlie the behavioural effects in VWM tasks: reward could directly impact on our ability to maintain representations in VWM or it could influence memory indirectly via priming of attentional selection. To distinguish between these alternatives we measured event-related potential indices of selective attention – the N2pc – and VWM maintenance – the CDA (contralateral delay activity) – while participants completed a VWM task. Results show that reward outcome in one trial caused similarly coloured targets to be strongly represented in VWM in subsequent trials, as expressed in a larger-amplitude CDA This was not preceded by a corresponding effect on attentional selection, in so far as our key manipulation had no impact on the N2pc. In a second experiment, we found that reward priming produced a behavioural benefit that emerged over time, suggesting that the representations of reward-associated items stored in VWM are more resistant to interference and decay. We conclude that when the task stresses VWM maintenance, it is at this representational level that reward will have impact.     

Reward, dopamine and the control of food intake: implications for obesity

The ability to resist the urge to eat requires the proper functioning of neuronal circuits involved in top-down control to oppose the conditioned responses that predict reward from eating the food and the desire to eat the food. Imaging studies show that obese subjects might have impairments in dopaminergic pathways that regulate neuronal systems associated with reward sensitivity, conditioning and control. It is known that the neuropeptides that regulate energy balance (homeostatic processes) through the hypothalamus also modulate the activity of dopamine cells and their projections into regions involved in the rewarding processes underlying food intake. It is postulated that this could also be a mechanism by which overeating and the resultant resistance to homoeostatic signals impairs the function of circuits involved in reward sensitivity, conditioning and cognitive control.     

Evidence for an antagonistic interaction between reward and punishment sensitivity on striatal activity: A verification of the Joint Subsystems Hypothesis

The Reinforcement Sensitivity Theory proposes that the Behavioral Approach System (BAS) comprises dopaminergic brain regions and underpins reward sensitivity causing impulsivity. It has been shown in a supraliminal priming task that highly reward sensitive subjects have a larger reaction time (RT) priming effect and make more commission errors to prime-incongruent targets. We adapted a similar task to event-related fMRI and hypothesized that (1) high reward sensitivity is associated with increased activation in dopaminergic brain regions, the ventral striatum in particular, (2) that BAS related personality traits predict impulsivity and (3) that the BAS effects are larger after adjusting for the interactive influence of trait avoidance, as predicted by the Joint Subsystems Hypothesis. Fourteen healthy females participated in the fMRI experiment and were scored on sensitivity to reward (SR) and trait avoidance, i.e., sensitivity to punishment (SP) and neuroticism (N). SR scores were adjusted by SP and N scores. As hypothesized, adjusted SR scores predicted, more than SR scores alone, activity in the ventral striatum (left caudate nucleus and nucleus accumbens). SR+/ SP− scores predicted increased impulsiveness, i.e., a right side RT priming effect. These results support the Joint Subsystems Hypothesis.     

Food priming and short-term retention in the delayed alternation task

The delayed alternation task, with rats as subjects, was used to assess the effects of a priming food reward on subsequent retention of a reinforced target location in a T maze. Subjects received a pretrial feeding, followed by a forced-choice rewarded entry into one goal box of the maze (the “cuing” run). Following a delay interval (5–60 s), the subjects were allowed to choose either goal, with reward available only in the one not entered on the cuing run. Priming significantly reduced such alternation after 30- and 60-s delays (Experiment 1), whereas administering the reward following the cuing run had no effect on choice behavior (Experiment 2). In the third study, prefeeding had a decremental effect when the following cuing run was reinforced, but no decrement occurred when reinforcement was omitted on the cuing run. The results suggest that food reward enhances retention of spatial information, but priming reduces this effect.     

Effects of food priming on instrumental acquisition and performance

Four experiments investigated the effects of a priming food reinforcement, given 0 or 75 sec pretrial, on runway performance of rats. The studies differed in the use of between-versus-within-subject designs, and by using food or water as the goal reinforcer. In Experiment 1, using food as the goal reward, subjects primed with food 0 sec pretrial conditioned slower than subjects primed 75 sec pretrial. In Experiment 2, using water as the goal reward, subjects primed with food 0 sec pretrial conditioned faster. These differences were evident on both prefed trials and on nonprefed test trials. Experiments 3 and 4 showed an opposite pattern of results when within-subject comparisons of 0- and 75-sec pretrial intervals were used: Food priming immediately pretrial facilitated food-rewarded running but inhibited water-rewarded running. The results suggest prefeeding has differential effects on acquisition and performance of instrumental behavior, and also depending upon the similarity of the priming and goal reinforcers.     

Training of instrumental responses in dogs socially reinforced by humans

The motivational bases of the social reinforcement in human-dog relations were examined. In experiment I, performed on seven dogs, it was found that dogs were able to learn and sustain the natural responses of sitting, paw extension, and lying prostrate to conditional stimuli in the form of vocal commands reinforced only by social rewards given by the experimenter, such as petting and vocal encouragement. Overtraining did not produce deterioration of performance but, on the contrary, the continual decrease of latencies. It was evidenced that tactile stimulation plays an important role in social reward. In experiment II, instrumental responses to the auditory conditional stimuli were elaborated in two groups of dogs. The first group (nine dogs) was reinforced by food, and the second group (eight dogs) was reinforced exclusively by petting. A similar course of learning and level of performance during overtraining sessions in both groups indicated that petting serves as a good reinforcement, with rewarding value comparable to that of food reinforcement. It is suggested that a strong rewarding effect of pleasurable sensory stimuli occurs in the formation of the bond between dog and human and in the learning of different tasks.     

Movement-Based Priming: Clinical Applications and Neural Mechanisms

Priming can be described as behavior change generated by preceding stimuli. Although various types of priming have been long studied in the field of psychology, priming that targets motor cortex is a relatively new topic of research in the fields of motor control and rehabilitation. In reference to a rehabilitation intervention, priming is categorized as a restorative approach. There are a myriad of possible priming approaches including noninvasive brain stimulation, motor imagery, and sensory-based priming, to name a few. The authors report on movement-based priming which, compared to other priming types, is less frequently examined and under reported. Movement-based priming includes, but is not limited to, bilateral motor priming, unilateral priming, and aerobic exercise. Clinical and neural mechanistic aspects of movement-based priming techniques are explored.     

前额叶的无创神经干预对饮食控制的影响:基于rTMS和tDCS研究的综述

饮食控制缺陷可导致超重、肥胖和饮食失调。已有研究表明,肥胖和饮食失调者在前额叶认知控制神经环路上存在缺陷。无创神经干预-经颅直流电刺激(t DCS)和重复经颅磁刺激(r TMS)-通过调节前额叶皮层兴奋性来提高饮食控制能力,改善饮食失调症状。未来的研究应考虑不同刺激参数和刺激位点下的干预效应,融合其他神经生理技术考察无创神经干预改善饮食控制的作用机制,考虑个体差异性并结合客观的行为范式进行探究。     

Searching beneath the shelf in macaque monkeys: evidence for a gravity bias or a foraging bias?

The reasons underpinning search biases in 2 species of macaque monkeys (Macaca mulatta and Macaca arctoides) were explored over the course of 3 experiments requiring monkeys to search for a hidden food reward. The results reveal that monkeys are adept at exploiting perceptual cues to locate a food reward but are unable to use physical constraints such as solidity as cues to the reward's location. Monkeys prefer to search for a food reward beneath a solid shelf, not because they have an expectation that the reward should be there, but rather because, in the absence of usable cues, this bias emerges as a default search option. It is hypothesized that this bias may have its roots in a history of competition for food resources.