Note on aversion learning to the shape of food by monkeys

Vervet and grivet monkeys were repeatedly tested eating bar- and circle-shaped cookies. One subject was always injected with lithium immediately after eating cookies with the circle shape and learned to avoid the circular cookies while continuing to eat the bar-shaped cookies. Another subject received similar treatment except that lithium injections were always delayed 30 minutes after access to the circle-shaped cookies. She also acquired a discriminative aversion. Aversion learning was not observed with 60-minute delayed toxicosis or with lithium injections administered unpaired with access to the cookies. The two types of cookies differed only in shape, and conditioning and test sessions were conducted in total darkness to preclude the use of visual cues. Therefore, the avoidance observed in subjects conditioned with immediate and 30-minute delayed toxicosis represents a conditioned aversion to the shape of the cookies as revealed by tactile cues. These findings illustrate that monkeys can learn to select food on the basis of tactile stimuli when such stimuli are conditioned with delayed aversive stimulation.     

Mechanics of the animate.

Behavior is treated as basic physics. Dimensions are identified and their transformations from physical specification to axes in behavioral space are suggested. Responses are treated as action patterns arrayed along a continuum of activation energy. Behavior is seen as movement along a trajectory through this behavior space. Incentives or reinforcers are attractors in behavior space, at the centers of basins of lowered potential. Trajectories impinging on such basins may be captured; repeated capture will warp the trajectory toward a geodesic, a process called conditioning. Conditioning is enhanced by contiguity, the proximity between the measured behavior and the incentive at the end of the trajectory, and by contingency, the depth of the trajectory below the average level of the potential energy landscape. Motivation is seen as the potential of an organism for motion under the forces impinging on it. Degree of motivation is characterized by the depth of the potential field, with low motivation corresponding to a flat field and a flat gradient of activation energy. Drives are the forces of incentives propagated through behavior space. Different laws for the attenuation of drive with behavioral distance are discussed, as is the dynamics of action. The basic postulate of behavior mechanics is incentive-tracking in behavior space, the energy for which is provided by decreases in potential. The relation of temporal gradients to response differentiation and temporal discrimination is analyzed. Various two-body problems are sketched to illustrate the application of these ideas to association, choice, scalar timing, self-control, and freedom.     

A cellular analogue of operant conditioning.

Using the hippocampal-slice preparation, we attempted to model operant conditioning in vitro by reinforcing pyramidal cell bursting responses with local micropressure applications of transmitters and drugs. The same injections were administered independently of bursting to provide a "noncontingent" control for direct pharmacological stimulation or facilitation of firing. The results suggested that the bursting responses of individual CA1 pyramidal neurons may be reinforced in a dose-related manner by response-contingent (but not noncontingent) injections of dopamine and the selective dopamine D2 agonist, N-0923. N-0924, a stereoisomer of N-0923 that is largely devoid of D2-agonist activity, failed to reinforce CA1 bursting. Burst-contingent injections of the excitatory neurotransmitter glutamate also failed to reinforce CA1 bursting; indeed, the glutamate applications (whether contingent or random) reduced the likelihood of bursts while increasing the frequency of solitary spikes. Reinforcement delays exceeding 200 ms largely eliminated the reinforcing efficacy of the D2 agonist N-0437 in CA1 operant conditioning. The results are consistent with the suggestion that the behaviorally reinforcing effects of dopaminergic agents can be modeled in vitro in the hippocampal-slice preparation.     

Enhancement of conditioned autonomic responses in monkey when preshock signals occasion operant suppression.

Classical pairings of a sound stilulus with shock elicited larger magnitude and more rapidly conditioned autonomic responses when subjects were responding on variable-interval schedules for food than when they were eating freely available food. The difference was not attributable to changes in control values of heart rate and blood pressure, or to alterations in motor activity, but appeared related to operant suppression.     

Automaintenance in guinea pigs: effects of feeding regimen and omission training

Behavior maintained by stimulus-reinforcer pairings was examined. Guinea pigs maintained at 85 per cent of free-feeding weights reliably contacted a retractable lever presented before delivery of a single piece of guinea-pig chow or a 45-milligram guinea-pig pellet. When animals were given free access to one food and received the second food preceded by the lever, contact responses persisted. Such responses seldom occurred when a single food was freely available and was also delivered after lever presentation. Introduction of an omission training (negative automaintenance) procedure, in which lever contacts resulted in lever retraction and prevented food delivery, strongly reduced lever contacts. Observation indicated that mouthing the food cup, instead of the lever, became the prominent behavior during the prefood stimulus under the omission training procedure.     

EFFECT OF REINFORCEMENT PROBABILITY AND PRIZE SIZE ON COCAINE AND HEROIN ABSTINENCE IN PRIZE‐BASED CONTINGENCY MANAGEMENT

Although treatment outcome in prize‐based contingency management has been shown to depend on reinforcement schedule, the optimal schedule is still unknown. Therefore, we conducted a retrospective analysis of data from a randomized clinical trial (Ghitza et al., 2007) to determine the effects of the probability of winning a prize (low vs. high) and the size of the prize won (small, large, or jumbo) on likelihood of abstinence until the next urine‐collection day for heroin and cocaine users (N = 116) in methadone maintenance. Higher probability of winning, but not the size of individual prizes, was associated with a greater percentage of cocaine‐negative, but not opiate‐negative, urines.     

The emergence of conditioned reinforcement from observation

We report an experiment in which observations of peers by six 3-5-year-old participants under specific conditions functioned to convert a small plastic disc or, for one participant, a small piece of string, from a nonreinforcer to a reinforcer. Prior to the observational procedure, we compared each participant's responding on (a) previously acquired performance tasks in which the child received either a preferred food item or the disc (string) for correct responses, and (b) the acquisition of new repertoires in which the disc (string) was the consequence for correct responses. Verbal corrections followed incorrect responses in the latter tasks. The results showed that discs and strings did not reinforce correct responses in the performance tasks, but the food items did; nor did the discs and strings reinforce correct responses in learning new repertoires. We then introduced the peer observation condition in which participants engaged in a different performance task in the presence of a peer who also performed the task. A partition blocked the participants from seeing the peers' performance. However, participants could observe peers receiving discs or strings. Participants did not receive discs or strings regardless of their performance. Peer observation continued until the participants either requested discs or strings repeatedly, or attempted to take discs or strings from the peers. Following the peer observation condition, the same performance and acquisition tasks in which participants had engaged prior to observation were repeated. The results showed that the discs and strings now reinforced correct responding for both performance and acquisition for all participants. We discuss the results with reference to research involving nonhuman subjects that demonstrated the observational conditioning of reinforcers.     

When two paradigms meet: Does evaluative learning extinguish in differential fear conditioning?

Contemporary theories of Pavlovian conditioning propose a distinction between signal learning (SL), in which a conditioned stimulus (CS) becomes a predictor for a biologically significant unconditioned stimulus (US), and evaluative learning (EL), in which the valence of the US is transferred to the CS. This distinction is based largely on the different susceptibilities of EL and SL to extinction. This study compared the extinction of indices of EL (online valence ratings) and SL (US-expectancy ratings and skin conductance responses, SCRs) in a differential fear conditioning design using complex CSs. Only half of the participants gave online valence ratings, allowing us to confirm that online valence measurement did not influence SCRs. In line with the distinction between EL and SL, SCRs extinguished rapidly while valence ratings showed resistance to extinction. US-expectancy ratings, however, were not distinguishable from valence ratings indicating that verbal indicators of EL and SL share a similar time course.     

Auditory specific fear conditioning results in increased levels of synaptophysin in the basolateral amygdala

Auditory fear conditioning is one of the most well characterized models used in studies of learning and memory. In order to ensure the animals have been conditioned to fear the auditory stimulus, animals are generally tested for their response to this stimulus in a different context to that used for training. For this reason it is often unclear how much contextual fear conditioning the animals also acquire when they are trained. In this study, we have established a protocol for fear conditioning in mice which is explicit for auditory cues; mice trained using this protocol, show a very low fear response to contextual cues encountered during training. We have undertaken analysis to look for potential brain changes associated with this model by measuring levels of the synaptic vesicle protein, synaptophysin, in the basolateral nuclei of the amygdala following auditory fear conditioning. Our results show levels of synaptophysin were significantly higher in mice which learnt to associate the auditory stimulus with fear, in comparison to all non-learning control animals. These findings support the idea that synaptic plasticity associated with formation of fear conditioning to a single specific conditioned stimulus occurs within the basolateral nuclei of the amygdala. Furthermore, our results demonstrate the usefulness of this model in looking for changes in the brain specific for a defined learning event.     

Activation of amygdaloid PKC pathway is necessary for conditioned cues-provoked cocaine memory performance

Drug-associated cues are critical in reinstating the drug taking behavior even during prolonged abstinence and thus are thought to be a key factor to induce drug craving and to cause relapse. Amygdaloid complex has been known for its physiological function in mediating emotional experience storage and emotional cues-regulated memory retrieval. This study was undertaken to examine the role of basolateral nuclei of amygdala and the intracellular signaling molecule in drug cues-elicited cocaine memory retrieval. Systemic anisomycin treatment prior to the retrieval test abolished the cues-provoked cocaine conditioned place preference (CPP) memory. Likewise, a similar blockade of cues-provoked cocaine CPP performance was achieved by infusion of anisomycin and cycloheximide into the basolateral nuclei of amygdala before the test. Intra-amygdaloid infusion of H89, a protein kinase A inhibitor, or U0126, a MEK inhibitor, did not affect retrieval of the cues-elicited cocaine CPP memory. In contrast, intra-amygdaloid infusion of NPC 15437, a PKC inhibitor, abolished the cues-elicited cocaine CPP expression, while left the memory per se intact. Intra-amygdaloid infusion of NPC 15437 did not seem to affect locomotor activity or exert observable aversive effect. Taken together, our results suggest that activation of PKC signaling pathway and probably downstream de novo protein synthesis in the basolateral nuclei of amygdala is required for the cues-elicited cocaine memory performance. However, temporary inhibition of this signaling pathway does not seem to affect cocaine CPP memory per se.