How do social fears in adolescence develop? Fear conditioning shapes attention orienting to social threat cues

Social fears emerging in adolescence can have negative effects on emotional well-being. Yet the mechanisms by which these risks occur are unknown. One possibility is that associative learning results in fears to previously neutral social stimuli. Such conditioned responses may alter subsequent processing of social stimuli. We used a novel conditioning task to examine how associative processes influence social fear and attention orienting in adolescents. Neutral photographs were paired with socially rewarding or aversive stimuli during conditioning; a dot-probe task then assessed biases in attention orienting. The social conditioning task modified subjective ratings of the neutral stimuli. Moreover, for the neutral stimulus that was paired with the aversive stimulus, the strength of conditioning showed a relationship with subsequent attentional vigilance. The findings elucidate mechanisms by which negative peer experiences during adolescence may affect emotional processing.     

How do social fears in adolescence develop? Fear conditioning shapes attention orienting to social threat cues

Social fears emerging in adolescence can have negative effects on emotional well-being. Yet the mechanisms by which these risks occur are unknown. One possibility is that associative learning results in fears to previously neutral social stimuli. Such conditioned responses may alter subsequent processing of social stimuli. We used a novel conditioning task to examine how associative processes influence social fear and attention orienting in adolescents. Neutral photographs were paired with socially rewarding or aversive stimuli during conditioning; a dot-probe task then assessed biases in attention orienting. The social conditioning task modified subjective ratings of the neutral stimuli. Moreover, for the neutral stimulus that was paired with the aversive stimulus, the strength of conditioning showed a relationship with subsequent attentional vigilance. The findings elucidate mechanisms by which negative peer experiences during adolescence may affect emotional processing.     

Motivational systems in adolescence: Possible implications for age differences in substance abuse and other risk-taking behaviors

Adolescence is an evolutionarily conserved developmental phase characterized by hormonal, physiological, neural and behavioral alterations evident widely across mammalian species. For instance, adolescent rats, like their human counterparts, exhibit elevations in peer-directed social interactions, risk-taking/novelty seeking and drug and alcohol use relative to adults, along with notable changes in motivational and reward-related brain regions. After reviewing these topics, the present paper discusses conditioned preference and aversion data showing adolescents to be more sensitive than adults to positive rewarding properties of various drugs and natural stimuli, while less sensitive to the aversive properties of these stimuli. Additional experiments designed to parse specific components of reward-related processing using natural rewards have yielded more mixed findings, with reports of accentuated positive hedonic sensitivity during adolescence contrasting with studies showing less positive hedonic affect and reduced incentive salience at this age. Implications of these findings for adolescent substance abuse will be discussed.     

AVERSIVE CONTROL: A SEPARATE DOMAIN?

Traditionally, aversive control has been viewed as a separate domain within behavior theory. Sometimes this separateness has been based upon a distinction between reinforcement and punishment, and sometimes upon a distinction between positive and negative reinforcement. The latter is regarded here as the more compelling basis, due to some inherent procedural asymmetries. An approach to the interpretation of negative reinforcement is presented, with indication of types of experiments that support it and that also point to promising directions for further work. However, most of the interpretive issues that arise here are relevant to positively reinforced behavior as well. These include: possible reformulation of the operant/respondent distinction; the place of emotional concepts in behavior analysis; the need for simultaneous, complementary analysis on differing time scales; the understanding of behavioral situations with rewarding or aversive properties that depend as much upon the contingencies that the situations involve as upon the primary rewarding or aversive stimuli that they include. Thus, an adequate understanding of this domain, which has been traditionally viewed as distinct, has implications for all domains of behavior-analytic theory.     

Stimulant-induced adaptations in neostriatal matrix and striosome systems: transiting from instrumental responding to habitual behavior in drug addiction

Converging evidence indicates that repeated exposure to motor stimulants such as cocaine and amphetamine produces marked alterations in network responsiveness of striatal neurons to subsequent challenge with the same stimulant drug. Such alterations, which correlate with persistent patterns of repetitive behavior, associate with distinct compartmental changes in the neostriatum. Striatal matrix system neurons undergo "silencing" following repeated drug challenges, allowing striosome system neurons to exhibit preferential activation. Matrix neurons are innervated by sensory and motor areas of neocortex and are activated in the course of on-going, adaptive behavior. Inactivation of matrix neurons by chronic stimulant exposure may therefore constrain sensorimotor and cognitive processing. In turn, the striosomes are anatomically connected through re-entrant loops with limbic prefrontal and allocortical structures, such as anterior cingulate cortex, orbital frontal cortex, and basolateral amygdala, all of which play a part in stimulant-induced reinforcement and relapse to drug-taking. Moreover, functional evidence links striosome system neurons, which are responsible for providing inhibitory regulatory feedback to midbrain dopamine neurons, with reinforcement-based processes. In considering such evidence, we postulate that recurrent matrix inactivation and recruitment of striosome-based pathways by chronic stimulant exposure represent neural end-points of the transit from action-outcome associative behavior to conditioned habitual responding. Within this theoretical framework, habitual behavior can be elicited by both interoceptive cues and exteroceptive conditioned stimuli to promote the automatic execution of learned responses.     

Animal Cognition: The Bridge BetweenAnimal Learning and Human Cognition

Carefully controlled research with animals has demonstrated cognitive capacities for which traditional theories of associative learning cannot account. One example is the symbolic representation of stimuli. If two arbitrary stimuli are associated with a third event, an emergent relation can be shown to develop. A second example is the ability of animals to plan ahead, and to choose whether to plan ahead or not. Although animals have often been used to model drug effects in humans, these models have rarely been used to examine the effects of drugs on cognitive functioning. Furthermore, examination of the effects of drugs on the cognitive behavior of animals may help to identify the nature of the representations underlying the cognition.     

Drugs as instruments: a new framework for non-addictive psychoactive drug use

Most people who are regular consumers of psychoactive drugs are not drug addicts, nor will they ever become addicts. In neurobiological theories, non-addictive drug consumption is acknowledged only as a "necessary" prerequisite for addiction, but not as a stable and widespread behavior in its own right. This target article proposes a new neurobiological framework theory for non-addictive psychoactive drug consumption, introducing the concept of "drug instrumentalization." Psychoactive drugs are consumed for their effects on mental states. Humans are able to learn that mental states can be changed on purpose by drugs, in order to facilitate other, non-drug-related behaviors. We discuss specific "instrumentalization goals" and outline neurobiological mechanisms of how major classes of psychoactive drugs change mental states and serve non-drug-related behaviors. We argue that drug instrumentalization behavior may provide a functional adaptation to modern environments based on a historical selection for learning mechanisms that allow the dynamic modification of consummatory behavior. It is assumed that in order to effectively instrumentalize psychoactive drugs, the establishment of and retrieval from a drug memory is required. Here, we propose a new classification of different drug memory subtypes and discuss how they interact during drug instrumentalization learning and retrieval. Understanding the everyday utility and the learning mechanisms of non-addictive psychotropic drug use may help to prevent abuse and the transition to drug addiction in the future.     

Medicalizing the drug war

Recent findings in the field of psychopharmacology pertain to the abuse of drugs and alcohol among criminal offenders and have implications for new management techniques. Drugs of abuse exert their effects on areas of the brain responsible for pleasure, providing a powerful reinforcement for drug usage. Furthermore, there is a prevalence of psychological, psychiatric and social dysfunctions that antedate drug use which are identifiable at an early age. It is suggested that drugs of abuse differentially influence users via these biological, psychological and social mechanisms, reinforcing the development of serious and chronic abuse in a vulnerable subgroup. Studies of drug abuse specially indicate that within this subgroup, antisocial behavior precedes and exacerbates drug abuse, and multiple risk factors contribute to the concomitant development of criminality and drug abuse. Early detection and comprehensive treatment of underlying disorders that may both precipitate and result from drug abuse promise to improve possibilities for prevention and reducing relapse rates. Furthermore, the inclusion of pharmacologic treatments may further enhance the success of conventional drug treatments. This article proposes that incorporating scientific data and medicalizing our approach to drug abuse is essential to win the war against drugs.     

Aberrant learning and memory in addiction

Over the past several years, drug addiction has increasingly been accepted to be a disease of the brain as opposed to simply being due to a lack of willpower or personality flaw. Exposure to addictive substances has been shown to create enduring changes in brain structure and function that are thought to underlie the transition to addiction. Specific genetic and environmental vulnerability factors also influence the impact of drugs of abuse on the brain and can enhance the likelihood of becoming an addict. Long-lasting alterations in brain function have been found in neural circuits that are known to be responsible for normal appetitive learning and memory processes and it has been hypothesized that drugs of abuse enhance positive learning and memory about the drug while inhibiting learning about the negative consequences of drug use. Therefore, the addict's behavior becomes increasingly directed towards obtaining and using drugs of abuse, while at the same time developing a poorer ability to stop using, even when the drug is less rewarding or interferes with functioning in other facets of life. In this review we will discuss the clinical evidence that addicted individuals have altered learning and memory and describe the possible neural substrates of this dysfunction. In addition, we will explore the pre-clinical evidence that drugs of abuse cause a progressive disorder of learning and memory, review the molecular and neurobiological changes that may underlie this disorder, determine the genetic and environmental factors that may increase vulnerability to addiction, and suggest potential strategies for treating addiction through manipulations of learning and memory.     

Synergistic effects of ethanol and cocaine on brain stimulation reward.

The effects of two widely abused drugs, ethanol and cocaine, were examined alone and in combination on intracranial reward processes. In agreement with previous research, higher doses of both cocaine and ethanol alone produced facilitation of behavior maintained by brain stimulation reward. Low intraperitoneal doses of ethanol and cocaine, which alone did not affect performance, were found to reduce stimulation reward threshold and modestly increase response rate. The enhancement of brain stimulation reward by the combination of ethanol and cocaine suggests that both drugs may produce their rewarding effects through common neuronal substrates and that they may potentiate the abuse of each other.     

Behavioral pharmacology of the odor span task: Effects of flunitrazepam,ketamine, methamphetamine and methylphenidate

The Odor Span Task is an incrementing non‐matching‐to‐sample procedure that permits the study of behavior under the control of multiple stimuli. Rats are exposed to a series of odor stimuli and selection of new stimuli is reinforced. Successful performance thus requires remembering which stimuli have previously been presented during a given session. This procedure has been frequently used in neurobiological studies as a rodent model of working memory; however, only a few studies have examined the effects of drugs on performance in this task. The present experiments explored the behavioral pharmacology of a modified version of the Odor Span Task by determining the effects of stimulant drugs methylphenidate and methamphetamine, NMDA antagonist ketamine, and positive GABA_A modulator flunitrazepam. All four drugs produced dose‐dependent impairment of performances on the Odor Span Task, but for methylphenidate and methamphetamine, these occurred only at doses that had similar effects on performance of a simple odor discrimination. Generally, these disruptions were based on omission of responding at the effective doses. The effects of ketamine and flunitrazepam were more selective in some rats. That is, some rats tested under flunitrazepam and ketamine showed decreases in accuracy on the Odor Span Task at doses that did not affect simple discrimination performance. These selective effects indicate disruption of within‐session stimulus control. Overall, these findings support the potential of the Odor Span Task as a baseline for the behavioral pharmacological analysis of remembering.     

Infants at risk for child abuse

Child abuse is most likely to occur when socially isolated parents react impulsively to aversive stimuli emitted by their children. Certain child signals and characteristics are aversive to adults. Infant cries are aversive to all parents, but children who are unusually irritable or whose cries are especially grating may become aversive to their parents even when they are not crying. Studies show that the cries of premature infants and the cries of babies incorrectly labelled premature are more aversive to parents, and that abusive mothers and the mothers of premature infants find cries more aversive than other mothers do. The incidence of abuse would be reduced by the availability of supportive social networks and the elimination of distorted parental expectations.     

Stimulus control of cocaine self-administration

Environmental stimuli that set the occasion wherein drugs are acquired can "trigger" drug-related behavior. Investigating the stimulus control of drug self-administration in laboratory animals should help us better understand this aspect of human drug abuse. Stimulus control of cocaine self-administration was generated here for the first time using multiple and chained schedules with short, frequently-alternating components--like those typically used to study food-maintained responding. The procedures and results are presented along with case histories to illustrate the strategies used to produce this stimulus control. All these multicomponent schedules contained variable-interval (VI) components as well as differential-reinforcement-of-other-behavior (DRO) or extinction components. Schedule parameters and unit dose were adjusted for each rat to produce stable, moderate rates in VI components, with minimal postreinforcement (infusion) pausing, and response cessation in extinction and DRO components. Whole-body drug levels on terminal baselines calculated retrospectively revealed that all rats maintained fairly stable drug levels (mean, 2.3 to 3.4 mg/kg) and molar rates of intake (approximately 6.0 mg/kg/hr). Within this range, no relation between local VI response rates and drug level was found. The stimulus control revealed in cumulative records was indistinguishable from that achieved with food under these schedules, suggesting that common mechanisms may underlie the control of cocaine- and food-maintained behavior.     

Control by reinforcers across time and space: A review of recent choice research

Reinforcers affect behavior. A fundamental assumption has been that reinforcers strengthen the behavior they follow, and that this strengthening may be context‐specific (stimulus control). Less frequently discussed, but just as evident, is the observation that reinforcers have discriminative properties that also guide behavior. We review findings from recent research that approaches choice using nontraditional procedures, with a particular focus on how choice is affected by reinforcers, by time since reinforcers, and by recent sequences of reinforcers. We also discuss how conclusions about these results are impacted by the choice of measurement level and display. Clearly, reinforcers as traditionally considered are conditionally phylogenetically important to animals. However, their effects on behavior may be solely discriminative, and contingent reinforcers may not strengthen behavior. Rather, phylogenetically important stimuli constitute a part of a correlated compound stimulus context consisting of stimuli arising from the organism, from behavior, and from physiologically detected environmental stimuli. Thus, the three‐term contingency may be seen, along with organismic state, as a correlation of stimuli. We suggest that organisms may be seen as natural stimulus‐correlation detectors so that behavioral change affects the overall correlation and directs the organism toward currently appetitive goals and away from potential aversive goals. As a general conclusion, both historical and recent choice research supports the idea that stimulus control, not reinforcer control, may be fundamental.     

Callous-Unemotional Traits Modulate Brain Drug Craving Response in High-Risk Young Offenders

Adults with psychopathy have a high propensity for substance abuse, generally starting from a young age. This investigation tested hypotheses about differences in the neural responses associated with drug craving among high-risk young offenders with histories of abuse of stimulants and other drugs as a function of psychopathic traits. Fifty-four male adolescents (44 with a history of stimulant abuse and 10 controls) incarcerated at a maximum-security facility (M age = 17.08 years) completed a drug-cue exposure task while brain hemodynamic activity was monitored using functional magnetic resonance imaging (fMRI) with a mobile MRI scanner stationed at the facility. Psychopathic traits were assessed using the Hare Psychopathy Checklist: Youth Version (PCL:YV). In the stimulant abuser group, drug cues elicited activity in classic reward circuitry. Consistent with studies of adult psychopathic traits and substance abuse, there was a negative association between PCL-YV scores and hemodynamic response related to drug craving in the amygdala and ACC in youth with a history of stimulant abuse. However, there were considerably more negative associations between the PCL:YV and hemodynamic response among youth than adults and this was primarily due to callous-unemotional traits rather than interpersonal or behavioral traits. The implications for how personality traits modulate motivations for drug-seeking behavior among adolescent offenders are discussed.     

Post-training amphetamine administration enhances memory consolidation in appetitive Pavlovian conditioning: Implications for drug addiction

It has been suggested that some of the addictive potential of psychostimulant drugs of abuse such as amphetamine may result from their ability to enhance memory for drug-related experiences through actions on memory consolidation. This experiment examined whether amphetamine can specifically enhance consolidation of memory for a Pavlovian association between a neutral conditioned stimulus (CS-a light) and a rewarding unconditioned stimulus (US-food), as Pavlovian conditioning of this sort plays a major role in drug addiction. Male Long-Evans rats were given six training sessions consisting of 8 CS presentations followed by delivery of the food into a recessed food cup. After the 1st, 3rd, and 5th session, rats received subcutaneous injections of amphetamine (1.0 or 2.0 mg/kg) or saline vehicle immediately following training. Conditioned responding was assessed using the percentage of time rats spent in the food cup during the CS relative to a pre-CS baseline period. Both amphetamine-treated groups showed significantly more selective conditioned responding than saline controls. In a control experiment, there were no differences among groups given saline, 1.0 or 2.0 mg/kg amphetamine 2 h post-training, suggesting that immediate post-training amphetamine enhanced performance specifically through actions on memory consolidation rather than through non-mnemonic processes. This procedure modeled Pavlovian learning involved in drug addiction, in which the emotional valence of a drug reward is transferred to neutral drug-predictive stimuli such as drug paraphernalia. These data suggest that amphetamine may contribute to its addictive potential through actions specifically on memory consolidation.     

Associative learning performance is impaired in zebrafish (Danio rerio) by the NMDA-R antagonist MK-801

The zebrafish is gaining popularity in behavioral neuroscience perhaps because of a promise of efficient large scale mutagenesis and drug screens that could identify a substantial number of yet undiscovered molecular players involved in complex traits. Learning and memory are complex functions of the brain and the analysis of their mechanisms may benefit from such large scale zebrafish screens. One bottleneck in this research is the paucity of appropriate behavioral screening paradigms, which may be due to the relatively uncharacterized nature of the behavior of this species. Here we show that zebrafish exhibit good learning performance in a task adapted from the mammalian literature, a plus maze in which zebrafish are required to associate a neutral visual stimulus with the presence of conspecifics, the rewarding unconditioned stimulus. Furthermore, we show that MK-801, a non-competitive NMDA-R antagonist, impairs memory performance in this maze when administered right after training or just before recall but not when given before training at a dose that does not impair motor function, perception or motivation. These results suggest that the plus maze associative learning paradigm has face and construct validity and that zebrafish may become an appropriate and translationally relevant study species for the analysis of the mechanisms of vertebrate, including mammalian, learning and memory.     

Behavioral perspectives on the neuroscience of drug addiction

Neuroscientific approaches to drug addiction traditionally have been based on the premise that addiction is a process that results from brain changes that in turn result from chronic administration of drugs of abuse. An alternative approach views drug addiction as a behavioral disorder in which drugs function as preeminent reinforcers. Although there is a fundamental discrepancy between these two approaches, the emerging neuroscience of reinforcement and choice behavior eventually may shed light on the brain mechanisms involved in excessive drug use. Behavioral scientists could assist in this understanding by devoting more attention to the assessment of differences in the reinforcing strength of drugs and by attempting to develop and validate behavioral models of addiction.     

Teacher escape,avoidance, and countercontrol behaviors: Potential resoponses to disruptive and aggressive behaviors of students with severe behavior disorders

We develop hypothese based on the research literature regarding behavioral responses to aversive stimuli. Specifically, escape, avoidance, and countercontrol responses are presented as teacher behaviors which may occur in the presence of disruptive and aggressive behaviors (aversive stimuli) which, in part, characterize many students with severe behavior disorders (SBD). The potential for teacher escape, avoidance, and countercontrol responses to the detrimental for both teachers and students is presented, as well as suggestions for addressing aversive behaviors of students in ways to reduce the potential detrimental impact.