Signaled alternative reinforcement and the persistence of operant behavior

Differential reinforcement of alternative behavior (DRA) is a treatment designed to eliminate problem behavior by reinforcing an alternative behavior at a higher rate. Availability of alternative reinforcement may be signaled, as with Functional Communication Training, or unsignaled. Whether or not alternative reinforcement is signaled could influence both the rate and persistence of problem behavior. The present study investigated whether signaling the availability of alternative reinforcement affects the rate and persistence of a concurrently available target response with pigeons. Three components of a multiple concurrent schedule arranged equal reinforcement rates for target responding. Two of the components also arranged equal reinforcement rates for an alternative response. In one DRA component, a discrete stimulus signaled the availability of response‐contingent alternative reinforcement by changing the keylight color upon reinforcement availability. In the other DRA component, availability of alternative reinforcement was not signaled. Target responding was most persistent in the unsignaled DRA component when disrupted by satiation, free food presented between components, and extinction, relative to the signaled DRA and control components. These findings suggest the discrete stimulus functionally separated the availability of alternative reinforcement from the discriminative stimuli governing target responding. These findings provide a novel avenue to explore in translational research assessing whether signaling the availability of alternative reinforcement with DRA treatments reduces the persistence of problem behavior.     

Shaking That Icky Feeling: Effects of Extinction and Counterconditioning on Disgust-Related Evaluative Learning

Learned disgust appears to play an important role in certain anxiety disorders, and can be explained by the process of evaluative conditioning, in which an affective evaluative reaction evoked by an unconditional stimulus (US) is transferred to a conditional stimulus (CS). Much remains unknown about how disgust-related evaluative learning can be effectively eliminated. Study 1 of the present investigation examined the effects of extinction on reducing the negative evaluation of a CS that was acquired during disgust conditioning. Participants completed acquisition trials, with a disgusting picture as US and two neutral pictures as CS (CS + was paired with the US; CS- was unpaired), followed by extinction trials ("CS only"; experimental condition) or a filler task (control condition). Extinction trials reduced acquired US expectancy to the CS +, but did not extinguish negative evaluations of the CS +. Study 2 examined the effects of counterconditioning on evaluative learned disgust. After disgust acquisition trials, counterconditioning trials followed in which the CS + was paired with a pleasant US (experimental condition) or a filler task (control condition). Counterconditioning trials reduced acquired US expectancy to the CS + and reduced evaluative conditioned disgust. Implications of the potential differential effects of extinction and counterconditioning on evaluative learning for exposure-based treatment of specific anxiety disorders are discussed.     

Stimulus-driven and goal-driven effects on Pavlovian associative reward learning

It has been shown that pure Pavlovian associative reward learning can elicit value-driven attentional capture. However, in previous studies, task-irrelevant and response-independent reward-signalling stimuli hardly competed for visual selective attention. Here we put Pavlovian reward learning to the test by manipulating the extent to which bottom-up (Experiment 1) and top-down (Experiment 2) processes were involved in this type of learning. In Experiment 1, the stimulus, the colour of which signalled the magnitude of the reward given, was presented simultaneously with another randomly coloured stimulus, so that it did not capture attention in a stimulus-driven manner. In Experiment 2, observers performed an attentionally demanding RSVP-task at the centre of the screen to largely tax goal-driven attentional resources, while a task-irrelevant and response-independent stimulus in the periphery signalled the magnitude of the reward given. Both experiments showed value-driven attentional capture in a non-reward test phase, indicating that the reward-signalling stimuli were imbued with value during the Pavlovian reward conditioning phases. This suggests that pure Pavlovian reward conditioning can occur even when (1) competition prevents attention being automatically allocated to the reward-signalling stimulus in a stimulus-driven manner, and (2) attention is occupied by a demanding task, leaving little goal-driven attentional resources available to strategically select the reward-signalling stimulus. The observed value-driven attentional capture effects appeared to be similar for observers who could and could not explicitly report the stimulus–reward contingencies. Altogether, this study provides insight in the conditions under which mere stimulus–reward contingencies in the environment can be learned to affect future behaviour.     

Past experience influences the processing of stimulus compounds in human Pavlovian conditioning

In two human skin conductance conditioning experiments we investigated whether processing of stimulus compounds can be influenced by past experience. Participants were either pre-trained with a discrimination problem that could be solved elementally (A+, B−, AB+, C− in Experiment 1 and A+, AB+, C−, CB− in Experiment 2) or one that required a configural solution (AB+, BC−, CD+, DA− in Experiment 1 and A−, AB+, C+, CB− in Experiment 2). After pre-training, participants were shown an EX+, FX− discrimination. Subsequently, responding to individual components (E and F) was tested. After elemental pre-training, participants showed larger responses to the component from the previously reinforced compound (E) than to the component from the nonreinforced compound (F) whereas no such difference was found after configural pre-training. This means that the kind of pre-training influenced whether the later discrimination problem was processed elementally or configurally. The results indicate that organisms can flexibly process stimulus compounds in different ways.     

Cross-modal transfer of conditioned suppression in rats: Effects of US intensity and extinction of the initial conditioning task

In conditioned suppression of water licking behavior by rats, we obtained data indicating general transfer of fear conditioning. A series of experiments resulted in two major findings. First, pairing of a neutral stimulus with a shock in the initial conditioning task facilitated acquisition of subsequent fear conditioning to another neutral stimulus, if the conditioned fear of the initial task was extinguished prior to the second task and if equally strong shocks were employed in both conditioning tasks. Second, omission of the extinction treatment or employment of weaker shocks in the initial task resulted in retardation, rather than facilitation, of the second conditioning task. An application to human clinical settings is discussed.     

Fear generalization in humans: Impact of prior non-fearful experiences

Fear generalization lies at the heart of many anxiety problems, and is therefore an important target for prevention and/or treatment. Here, we investigated whether fear generalization towards a specific stimulus can be weakened by prior non-fearful experiences with that stimulus. Using the standard human fear conditioning procedure, all participants received paired presentations of a geometric figure and an electric shock. This was followed by a test phase in which a similar but different figure was presented. Electrodermal responding and ratings of shock-expectancy measured the level of fear generalization towards this test stimulus. Crucially, half of the participants had been preexposed to that stimulus (without shock). The results show significantly less generalization in this group, suggesting that prior non-fearful experiences can protect against fear generalization. These results may inspire novel ways to prevent the development of clinical anxiety.     

The effects of lesions in the central nucleus of the amygdala on appetitive classical conditioning in rats

Abstract: Lesions in the central nucleus of the amygdala (cAMY) have been known to interfere with the acquisition of fear classical conditioning when footshock is used as an unconditioned stimulus (US). The present study examined whether or not a similar interference would occur with an appetitive US. Five rats with lesions in the cAMY (the cAMY group), and eight unoperated control rats were trained in an appetitive classical conditioning paradigm, which did not include elements of operant learning, using a visual conditioned stimulus (CS) (5 W of light for 10 s duration) paired with a food pellet US (45 mg, cheese flavor). The behavioral index of appetitive conditioning was an increase in rearing approach behavior to the CS after CS and US pairings. During CS and US pairings, the movement of the rat was limited so that this approach behavior could not occur. As a result, all control rats showed an increase in rearing, but the cAMY group did not. These results suggest that the cAMY is critical for appetitive as well as fear classical conditioning.     

Do different types of US produce similar evaluative conditioning? An examination with contingency-awareness and cognitive load

Evaluative conditioning (EC) refers to a modulation in the liking of a neutral stimulus after it has been paired with an unconditioned stimulus (US). Previous studies have uncovered some of the mechanisms responsible for EC, but many parameters remain unknown. The study addresses two questions: Is the amplitude of EC and the impact of cognitive variables are the same for different types of US? We compared three types of US: shocks, single images and multiple semantically related images. This conditioning occurred while participants maintained a concurrent cognitive load, or not. Our results indicate that all types of US produced a significant EC of similar amplitude. Furthermore, the two cognitive variables had a similar impact across all types of US. Specifically, contingency-awareness was related to the amplitude of EC, particularly in the cognitive load group. Our results illustrate the importance of within study comparisons to assess different parameters on EC.     

Transfer of conditioned fear and avoidance: Concurrent measurement of arousal and operant responding

A reversal design was employed for the analysis of transfer of fear and avoidance through equivalence classes. Two 5-member equivalence classes (A1-B1-C1-D1-E1 and A2-B2-C2-D2-E2) were established. Then B1 and C1 were paired with shock (CS+) and served as S^Ds in avoidance training (B2 and C2 were trained as CS-/S^∆s for avoidance). Further avoidance training followed with D1 and E1 (as S^Ds) and D2 and E2 (as S^∆s), with the first presentation of each of these stimuli serving as the first transfer test. Afterwards, aversive conditioning contingencies were reversed: B2 and D2 were paired with shock and trained as S^Ds for avoidance, B1 and D1 were presented without shock (CS-/S^∆s). Transfer was tested again with C1, E1, C2 and E2. This reversal was implemented to allow for the within-subject replication of transfer effects upon changes in the function of only a subset of each class's elements. Avoidance (key presses) and conditioned fear (skin conductance and heart rate) were simultaneously measured. Results show a clear transfer effect for avoidance, with between- and within-subject replications. For physiological measures, transfer effects in the first test could only be imputed on the basis of group-based inferential statistical analysis. Evidence for between-subject replication was weaker, with only a limited proportion of participants meeting the individual criterion for transfer.