Stimulus learning versus response learning in a discriminated punishment situation

The suppression of bar pressing under two kinds of conditions was compared. Under one condition the response was occasionally punished by shock in the presence of a signal. Suppression to the signal was quickly acquired, indicating rapid learning about the signal-shock relationship (stimulus learning). Under the other condition the response was occasionally punished in the presence of the signal but additional free shocks were given in the absence of the signal. The slow acquisition of suppression found in this case indicated that there was, at best, only gradual learning about the response-shock relationship (response learning).     

Disruption of a temporal discrimination under response-independent shock

The responding of rats was reinforced on one key after a 1-sec auditory stimulus and on a second key after a 5-sec stimulus. With errors punished by a short timeout, all subjects achieved a high level of accuracy. A chain of responses during the stimuli mediated the performance so that when the auditory signals were omitted accuracy decreased only slightly. Response-independent aversive stimulation superimposed upon this procedure both suppressed the total amount of behavior and reduced the accuracy of the discriminative performance, the intensity of the stimulus determining the error rate. The increase in errors under these conditions may have depended in part upon differential suppression of members of the response chain, but such suppression was not necessary, since error rate increased even in its absence. Furthermore, the locus of response disruption within the chain was not consistent from day to day either for any individual animal or across animals.     

Imitative learning in Japanese quail (Coturnix japonica) using the bidirectional control procedure

In the bidirectional control procedure, observers are exposed to a conspecific demonstrator responding to a manipulandum in one of two directions (e.g., left vs. right). This procedure controls for socially mediated effects (the mere presence of a conspecific) and stimulus enhancement (attention drawn to a manipulandum by its movement), and it has the added advantage of being symmetrical (the two different responses are similar in topography). Imitative learning is demonstrated when the observers make the response in the direction that they observed it being made. Recently, however, it has been suggested that when such evidence is found with a predominantly olfactory animal, such as the rat, it may result artifactually from odor cues left on one side of the manipulandum by the demonstrator. In the present experiment, we found that Japanese quail, for which odor cues are not likely to play a role, also showed significant correspondence between the direction in which the demonstrator and the observer push a screen to gain access to reward. Furthermore, control quail that observed the screen move, when the movement of the screen was not produced by the demonstrator, did not show similar correspondence between the direction of screen movement observed and that performed by the observer. Thus, with the appropriate control, the bidirectional procedure appears to be useful for studying imitation in avian species.     

Motivational aspects of escape from punishment

Punishment and escape were studied simultaneously by allowing a subject to escape from a stimulus situation in which responses were punished, into a stimulus situation in which responses were not punished. The frequency of the punished responses was found to be an inverse function of the intensity of punishment, whereas the frequency of the escape response was a direct function of the intensity of punishment. Both of these functions were obtained under three different schedules of food reinforcement. The strength of the escape behavior was evidenced by (1) the emergence of the escape response even when the frequency of food reinforcement decreased as a consequence of the escape response, (2) the maintenance of the escape response by fixed-interval and fixed-ratio schedules of escape reinforcement, and (3) the occurrence of escape responses at intensities of punishment that otherwise produced only mild suppression of the punished response when no escape was possible. This last finding indicates that a subject may be driven out of a situation involving punishment even though the punishment is relatively ineffective in suppressing the punished responses when no escape is possible.     

Learning to fear a second-order stimulus following vicarious learning

Vicarious fear learning refers to the acquisition of fear via observation of the fearful responses of others. The present study aims to extend current knowledge by exploring whether second-order vicarious fear learning can be demonstrated in children. That is, whether vicariously learnt fear responses for one stimulus can be elicited in a second stimulus associated with that initial stimulus. Results demonstrated that children's (5–11 years) fear responses for marsupials and caterpillars increased when they were seen with fearful faces compared to no faces. Additionally, the results indicated a second-order effect in which fear-related learning occurred for other animals seen together with the fear-paired animal, even though the animals were never observed with fearful faces themselves. Overall, the findings indicate that for children in this age group vicariously learnt fear-related responses for one stimulus can subsequently be observed for a second stimulus without it being experienced in a fear-related vicarious learning event. These findings may help to explain why some individuals do not recall involvement of a traumatic learning episode in the development of their fear of a specific stimulus.     

Do rats in a two-action test encode movement egocentrically or allocentrically?

Two-action tests of imitation compare groups that observe topographically different responses to a common manipulandum. The general aim of the two experiments reported here was to find a demonstrator-consistent responding effect in a procedure that could be elaborated to investigate aspects of what was learned about the demonstrated lever response. Experiment 1 was a pilot study with rats of a variant of the two-action method of investigating social learning about observed responses. Groups of observer rats (Rattus norvegicus) saw a demonstrator push a lever up or down for a food reward. When these observers were subsequently given access to the lever and rewarded for responses in both directions, their directional preferences were compared with two 'screen control' groups that were unable to see their demonstrators' behaviour. Demonstrator-consistent responding was found to be restricted to observers that were able to see demonstrator performance, suggesting that scent cues alone were insufficient to cue a preference for the demonstrators' response direction and thereby that the rats learned by observation about body movements (imitation) or lever movement (emulation). Experiment 2 assessed responding on two levers, one that had been manipulated by the demonstrator, and a second, transposed lever positioned some distance away. Demonstrator-consistent responding was abolished when actions were observed and performed in different parts of the apparatus, suggesting that observed movement was encoded allocentrically with respect to the apparatus rather than egocentrically with respect to the actor's body. With particular reference to the influence of scent cues, the results are discussed in relation to the strengths and weaknesses of this and other varieties of the two-action procedure as tests of imitation in animals and human infants. Electronic Publication     

Aversive learning overcomes appetitive innate responding in honeybees

Despite their miniature brain, honeybees have emerged as a powerful model for the study of learning and memory. Yet, they also exhibit innate responses to biologically relevant social signals such as pheromones. Here, we asked whether the bees’ developed learning capabilities allow them to overcome hardwired appetitive responses. Can they learn that attractant pheromones, that are not normally associated with a noxious stimulation in nature, predict the punishment of an electric shock? Immobilized honeybees were trained to discriminate two odorants, one that was paired with a shock and another that had no consequences. We measured whether they learned to produce aversive sting extension responses to the punished but not the non-punished odorant. One odorant was a neutral odor without innate value while the other was either an attractive pheromone (geraniol or citral) or an attractive floral odorant (phenylacetaldehyde). In all cases, bees developed a conditioned aversive response to the punished odorant, be it pheromone or not, and efficiently retrieved this information 1 h later. No learning asymmetries between odors were found. Thus, associative aversive learning in bees is strong enough to override preprogrammed responding, thus reflecting an impressive behavioral flexibility.     

Control of responding by location of auditory stimuli: rapid acquisition in monkey and rat

Monkeys require a considerably larger number of trials to bring responding under the control of the location of an auditory stimulus than cats, rats, and bats with the same experimental procedures. The present experiment sought to determine the conditions necessary for rapid acquisition of control of responding by location of noise and tone bursts in the monkey. Monkeys were run in an enclosure that contained four loudspeakers and four manipulanda. Two conditions were used in training. In the adjacent condition, a stimulus (noise or tone burst) was presented through one or other of two speakers and a response on the manipulandum adjacent to the speaker was reinforced with food. In the nonadjacent condition, a stimulus was presented through one of two speakers and a response on a manipulandum remote from the speaker was reinforced with food. Acquisition of control was measured by change in the percentage of reinforced responses during training. In the adjacent condition, responding came under control of location within zero to three sessions. In nonadjacent conditions, the animals required 14 to 20 sessions to come under control of location. These latter numbers are comparable to those reported in the literature for localization discrimination in monkeys.     

Effects of category learning on the stimulus selectivity of macaque inferior temporal neurons

Primates can learn to categorize complex shapes, but as yet it is unclear how this categorization learning affects the representation of shape in visual cortex. Previous studies that have examined the effect of categorization learning on shape representation in the macaque inferior temporal (IT) cortex have produced diverse and conflicting results that are difficult to interpret owing to inadequacies in design. The present study overcomes these issues by recording IT responses before and after categorization learning. We used parameterized shapes that varied along two shape dimensions. Monkeys were extensively trained to categorize the shapes along one of the two dimensions. Unlike previous studies, our paradigm counterbalanced the relevant categorization dimension across animals. We found that categorization learning increased selectivity specifically for the category-relevant stimulus dimension (i.e., an expanded representation of the trained dimension), and that the ratio of within-category response similarities to between-category response similarities increased for the relevant dimension (i.e., category tuning). These small effects were only evident when the learned category-related effects were disentangled from the prelearned stimulus selectivity. These results suggest that shape-categorization learning can induce minor category-related changes in the shape tuning of IT neurons in adults, suggesting that learned, category-related changes in neuronal response mainly occur downstream from IT.     

Timeout as a punishing stimulus in continuous and intermittent schedules

The effectiveness of a brief period of isolation (timeout) in the control of disruptive behavior emitted by a retarded child in a preschool classroom setting was examined. Timeout was shown to be an effective punishing stimulus, and its control of the child's disruptive behavior was investigated under four schedules of intermittent timeout. The results suggest that as a larger percentage of responses were punished, a greater decrease in the frequency of that response occurred. This inverse relationship between the percentage of responses punished and the frequency of the response did not appear to be linear, but rather a non-linear function. This function suggests that some schedules of intermittent punishment may be as effective as continuous punishment, at least in the case of the continued suppression of a response that has already been reduced to a low frequency.     

A category-overshadowing effect in pigeons: support for the Common Elements Model of object categorization learning

A model proposing error-driven learning of associations between representations of stimulus properties and responses can account for many findings in the literature on object categorization by nonhuman animals. Furthermore, the model generates predictions that have been confirmed in both pigeons and people, suggesting that these learning processes are widespread across distantly related species. The present work reports evidence of a category-overshadowing effect in pigeons' categorization of natural objects, a novel behavioral phenomenon predicted by the model. Object categorization learning was impaired when a second category of objects provided redundant information about correct responses. The same impairment was not observed when single objects provided redundant information, but the category to which they belonged was uninformative, suggesting that this effect is different from simple overshadowing, arising from competition among stimulus categories rather than individual stimuli during learning.     

Transfer of avoidance responding to a sensory preconditioned cue: Evidence for the role of S-S and R-S knowledge in avoidance learning

In avoidance learning studies, a warning signal (Sd) is directly paired with an aversive unconditioned stimulus (US) unless a particular response is performed. Research by Augustson and Dougher (1997) demonstrated that not only warning signals but also stimuli that are indirectly paired with the aversive event are capable of affecting the avoidance response. In the present study, we extended these results by incorporating a sensory preconditioning paradigm in an avoidance learning procedure. Sensory preconditioning training influenced the selection of avoidance responses in the presence of warning signals that were never paired directly with the aversive events. Moreover, results suggest that the selection of the avoidance responses was based on an integration of knowledge about the relation between the Sd and the US (S-S knowledge) and knowledge about the relation between the avoidance response and the US (R-S knowledge). As the expectancy-based theory of Lovibond (2006) is the only theory of avoidance that incorporates both knowledge structures, the results provide unique support for this theory.     

Fractional punishment of fixed-ratio performance

Key-peck responses of pigeons under a fixed-rate 60 (Exp. I) or fixed-ratio 99 (Exp. II) schedule of positive reinforcement were punished by response-dependent electric shock during a segment of the ratio. The punishing stimulus was scheduled in one of three locations: the first third of the ratio, the middle third, or the final third. At high shock levels, the different loci of punishment differentially affected the typical fixed-ratio performance pattern. Post-reinforcement pauses were lengthened by all punishment conditions but to a greater degree when the responses in initial third of the ratio were punished. Disruption of responses before the punished segment of the ratio was a conspicuous feature of the performances when the middle or final third of the ratio was punished. Two of the punishment conditions produced similar effects on both fixed-ratio baselines but punishing the final third of the ratio suppressed the punished responses of the ratio only with the fixed-ratio 99 schedule. General effects of all punishment conditions included consistent intra-session recoveries of partially suppressed performances, the rapid recovery of the FR performances after the punishment dependency was removed after complete suppression, and the facilitation of overall and/or local response rates of most subjects by low-intensity shock.     

AX+, BX- discrimination learning in the fear-potentiated startle paradigm: possible relevance to inhibitory fear learning in extinction

The neural mechanisms of fear suppression most commonly are studied through the use of extinction, a behavioral procedure in which a feared stimulus (i.e., one previously paired with shock) is nonreinforced repeatedly, leading to a reduction or elimination of the fear response. Although extinction is perhaps the most convenient index of fear inhibition, a great deal of behavioral work suggests that postextinction training conditioned stimuli are both excitatory and inhibitory, making it difficult to determine whether a neural manipulation affects inhibition, excitation, or some combination thereof. For this reason we sought to develop a behavioral procedure that would render a stimulus primarily inhibitory while at the same time avoiding some of the issues raised by the traditional conditioned inhibition paradigm, namely second-order conditioning, external inhibition, and configural learning. Using the fear-potentiated startle paradigm, we adapted an AX+, BX- training procedure in which stimuli A and X were presented simultaneously and paired with shock, and stimuli B and X were presented simultaneously in the absence of shock. In testing, high levels of fear-potentiated startle were seen in the presence of A and AX and much lower levels were seen in the presence of B and AB, as would be predicted if stimulus B were a conditioned inhibitor. We believe this method is a viable alternative to the traditional conditioned inhibition training procedure and will be useful for studying the neural mechanisms of fear inhibition.     

Peak shift in honey bee olfactory learning

If animals are trained with two similar stimuli such that one is rewarding (S+) and one punishing (S?), then following training animals show a greatest preference not for the S+, but for a novel stimulus that is slightly more different from the S? than the S+ is. This peak shift phenomenon has been widely reported for vertebrates and has recently been demonstrated for bumblebees and honey bees. To explore the nature of peak shift in invertebrates further, here we examined the properties of peak shift in honey bees trained in a free-flight olfactory learning assay. Hexanal and heptanol were mixed in different ratios to create a continuum of odour stimuli. Bees were trained to artificial flowers such that one odour mixture was rewarded with 2 molar sucrose (S+), and one punished with distasteful quinine (S?). After training, bees were given a non-rewarded preference test with five different mixtures of hexanal and heptanol. Following training bees’ maximal preference was for an odour mixture slightly more distinct from the S? than the trained S+. This effect was not seen if bees were initially trained with two distinct odours, replicating the classic features of peak shift reported for vertebrates. We propose a conceptual model of how peak shift might occur in honey bees. We argue that peak shift does not require any higher level of processing than the known olfactory learning circuitry of the bee brain and suggest that peak shift is a very general feature of discrimination learning.     

Sequence learning in Parkinson's disease: the effect of spatial stimulus-response compatibility

Patients with Parkinson's disease (PD) have repeatedly demonstrated reduced sequence-specific learning effects in serial reaction time tasks (SRTs). Previous research with PD patients has mainly employed the 'classical' SRT task, involving a spatially compatible assignment of stimuli and responses. From cognitive research, it is known that spatial compatibility triggers rapid, automatic responses in the direction of the stimulus. Automatic responding has shown to be disinhibited in PD patients and may therefore interfere with stimulus anticipation during the learning process. The aim of the present study was to test this hypothesis by investigating if reduced sequence-specific learning depends on spatial stimulus-response compatibility. PD patients and age-matched controls were examined either with an SRT variant involving central stimulus presentation, thereby preventing automatic linking of stimulus and response locations, or with a spatially compatible SRT task. Patients showed reduced sequence-specific learning effects only when the stimulus-response assignment was spatially compatible. This pattern of results confirms the hypothesis that sequence learning deficits in PD may result from a predominance of automatic response activation over learning-based stimulus anticipations during the learning phase.     

AX+/BX- discrimination learning in the fear-potentiated startle paradigm in monkeys

Individuals with anxiety disorders often do not respond to safety signals and hence continue to be afraid and anxious. Consequently, it is important to develop paradigms in animals that can directly study brain systems involved in learning about, and responding to, safety signals. We previously developed a discrimination procedure in rats of the form AX+/BX-, where cues A and X presented together are paired with an aversive stimulus and cues B and X presented together predict the absence of an aversive stimulus. The present experiment adapted this procedure to the fear-potentiated startle paradigm in rhesus monkeys.     

Sign- and goal-tracking in Atlantic cod (<Emphasis Type="Italic">Gadus morhua</Emphasis>)

When animals associate a stimulus with food, they may either direct their response towards the stimulus (sign-tracking) or towards the food (goal-tracking). The direction of the conditioned response of cod was investigated to elucidate how cod read cue signals. Groups of cod were conditioned to associate a blinking light (conditioned stimulus, CS) with a food reward (unconditioned stimulus, US), with the CS and the US located at opposite sides of the tank. Two groups were trained in a delay conditioning procedure (CS = 60 s, interstimulus interval = 30 s) and two groups were trained in a trace conditioning procedure (CS = 12 s, trace interval = 20 s). The response pattern was similar for the delay- and trace-conditioned groups. The initial main response at the onset of the CS was approaching the blinking lights, i.e. sign-tracking. In the early trials, the fish did not gather in the feeding area before the arrival of food. In the later trials, the fish first approached the blinking lights, but then moved across the tank and gathered below the feeder before the food arrived, i.e. sign-tracking followed by goal-tracking within each trial. These two responses are interpreted as reflecting two learning systems, i.e. one rapid, reflexive response directed at the signal (sign-tracking) and one slower, more flexible response based on expectations about time and place for arrival of the food (goal-tracking). The ecological significance of these two learning systems in cod is discussed.     

Effects of selective forebrain noradrenaline loss on behavioral inhibition in the rat.

Virtually total depletion of cortical and hippocampal noradrenaline by stereotaxic injection of 6-hydroxydopamine into the fibers of the dorsal noradrenergic bundle produced no impairment in acquisition learning of a runway response for food reward. Extinction of this response, once learned, was markedly slower in the treated group than in controls, the treated animals perseverating in rapid running to the goal box even with no food present there. Similarly, no impairment was found on acquisition of a continuously reinforced lever-pressing response for food. Extinction of this response, however, was again slower in the treated group. Subsequent acquisition of a successive light-dark discrimination task was also slower in the treated group, with these animals perseverating in responding to the negative stimulus. Although selective forebrain noradrenaline loss does not impair the acquisition of appetitive responses, the suppression of responses in the absence of reward is impeded. A parallel is drawn with those effects found classically after surgical lesion to the hippocampus.     

I like it because I said that I like it: evaluative conditioning effects can be based on stimulus-response learning

Evaluative conditioning (EC) effects are often assumed to be based on a learned mental link between the CS (conditioned stimulus) and the US (unconditioned stimulus). We demonstrate that this link is not the only one that can underlie EC effects, but that if evaluative responses are actually given during the learning phase also a direct link between the CS and an evaluative response-a CS-ER link-can be learned and lead to EC effects. In Experiment 1, CSs were paired with USs and participants were asked to evaluate the pairs during the conditioning phase. Resulting EC effects were unaffected by a later revaluation of the USs, suggesting that these EC effects can be attributed to CS-ER learning rather than to CS-US learning. Experiment 2 replicated Experiment 1 with the difference that no evaluative responses were given during the learning phase. EC effects in this study were influenced by US revaluation, suggesting that these EC effects are mainly based on CS-US learning. In Experiment 3, it was shown that EC effects can be found even if the USs are entirely removed from the procedure and the CSs are only paired with enforced evaluative responses. Together the experiments show that the valence of a stimulus can change because of a contingency with an evaluative response. (PsycINFO Database Record (c) 2011 APA, all rights reserved).