Unequal associative changes when excitors and neutral stimuli are conditioned in compound

In four experiments a compound of a previously conditioned excitor and a neutral stimulus was either reinforced with food or nonreinforced. Two experiments used a magazine approach procedure in rats, and two used an autoshaping procedure in pigeons. All experiments employed a novel compound test procedure, which permitted evaluation of the size of the associative change that took place for the excitatory and neutral stimuli. Reinforcement of the compound resulted in greater increments in the associative strength of the neutral stimulus than of the excitor. Nonreinforcement of the compound resulted in greater decrements in the associative strength of the excitor than of the neutral stimulus. These results agree with earlier experiments with compounds of excitors and inhibitors and provide an additional challenge to contemporary error-correction models of conditioning.     

The effect of similarity between elemental stimuli and compounds in olfactory patterning discriminations

We studied the ability of honeybees to discriminate between single odorants and binary olfactory mixtures. We analyzed the effect of the number of common elements between these two stimulus classes on olfactory discrimination. We used olfactory conditioning of the honeybees' proboscis extension reflex (PER), a paradigm in which odors can be associated with a reinforcement of sucrose solution. Bees were asked to discriminate reinforced from nonreinforced olfactory stimuli. They were trained with two elemental odors (A and B) versus a binary olfactory mixture. The mixture was either AB (group 2CE, two common elements), AC (group 1CE, one common element A), or CD (group 0CE, no common element). Three groups followed a positive patterning schedule (mixture reinforced and elements nonreinforced: groups 2CE+, 1CE+, and 0CE+) and three other groups a negative patterning schedule (mixture nonreinforced and elements reinforced: groups 2CE-, 1CE-, and 0CE-). We showed that a reduction of similarity (number of common elements) between elemental odors and compounds enhanced the ability to discriminate elements from compounds and that the kind of compound processing used by the bees supports theories that assume nonelemental compound processing (i.e., that exclude the mere summation of the elemental associative strengths upon compound presentation).     

A REPLICATION AND EXTENSION OF THE ANTISYMMETRY EFFECT IN PIGEONS

Pigeons trained on successive AB symbolic matching show emergent BA antisymmetry if they are also trained on successive AA oddity and BB identity ( Urcuioli, 2008 , Experiment 4). In other words, when tested on BA probe trials following training, they respond more to the comparisons on the reverse of the nonreinforced AB baseline trials than on the reverse of the reinforced AB baseline trials (the opposite of an associative symmetry pattern). The present experiment replicated this finding. In addition, it showed that antisymmetry also emerged after baseline training on successive AB symbolic matching, AA identity, and BB oddity, consistent with the prediction from Urcuioli's (2008) theory of pigeons' stimulus‐class formation. Together, these results provide further empirical support for that theory including the proposition that the functional stimuli in pigeons' successive matching consist of the nominal stimuli plus their ordinal positions within a trial.     

Associative changes in elements and compounds when the other is reinforced.

Four experiments investigated the symmetry of associative changes in stimulus compounds and elements in a Pavlovian conditioned magazine-approach situation with rats. Experiment 1 used multiple groups to examine the associative changes in a conditioned element (A) as a result of its subsequent reinforcement in compound with a neutral X. These were compared with the changes in an AX compound when one of its elements (A) was subsequently reinforced alone. Although reinforcing A enhanced responding to the AX compound, compared with a control compound, reinforcing AX failed to enhance responding to A, compared with a control element. Experiments 2 and 3 made similar comparisons in a fully within-subject design, finding greater changes in a previously trained AX compound when A was subsequently conditioned than in a B element when BY was subsequently conditioned. Experiment 4 found associative decrements in A when it was reinforced in the presence of a moderately conditioned X. The results observed in each of these experiments are more consistent with an elemental model of conditioning than with a recently proposed configural model.     

Retrospective revaluation effects in the conditioned suppression procedure

In four experiments using the conditioned suppression procedure, rats received initial reinforced training with two compound stimuli, AX and BY, each compound consisting of one auditory and one visual element. After a second phase of training consisting of nonreinforced presentations of A, the suppression governed by X and Y was tested. In Experiment 1 X evoked slightly less suppression than Y (a mediated extinction effect). This outcome was obtained when the auditory cues served as Xand Y(Experiment 1a), when the visual cues served as Xand Y(Experiment 1b), and when the number of nonreinforced presentations of Awas increased (Experiment 1c) from 18 to 216. In Experiment 2, however, in which the initial training was given with serial compounds (i.e., A ⇒ X and B ⇒ Y) X evoked more suppression than Y (a recovery-from-overshadowing effect). It was argued that extinction of A engages two learning processes, one increasing the effective associative strength of its associate (X) and one reducing it, and that the balance between these two depends on the specific conditions of training.     

Generalization gradients of inhibition following auditory discrimination learning

A more direct method than the usual ones for obtaining inhibitory gradients requires that the dimension of the nonreinforced stimulus selected for testing be orthogonal to the dimensions of the reinforced stimulus. In that case, the test points along the inhibitory gradient are equally distant from the reinforced stimulus. An attempt was made to realize this condition by obtaining inhibitory gradients along the frequency dimension of a pure tone after discrimination training in which the nonreinforced stimulus was a pure tone (or tones), and the reinforced stimulus was either white noise or the absence of a tone. The results showed that some degree of specific inhibitory control was exerted by the frequency of the tone, although the gradients were broad and shallow in slope.

A further experiment was conducted to see whether the modification of an excitatory gradient resulting from training to discriminate neighboring tones could arise from a simple interaction of inhibitory and excitatory gradients. The results indicated that it could not, since discrimination training produced a concentration of responding in the vicinity of the reinforced stimulus which cannot be derived from any plausible gradient of inhibition.

     

Effect of following an excitatory-inhibitory compound with an intermediate reinforcer

Pavlovian-conditioned inhibition training of the form A++, AB- (where ++ is a strong reinforcer and - is nonreinforcement) was conducted in 3 experiments with rats and 1 with pigeons. Then AB+ training was given (in which + is an effective reinforcer that is weaker than ++). The + reinforcer was achieved by reducing the frequency, lessening the amount, or lengthening the delay with which ++ was delivered. All 4 experiments found the AB+ treatment to enhance responding to both the excitatory A and the inhibitory B in comparison with untreated control stimuli. However, when appropriate assessments were made, the increase was more substantial for the inhibitory B. This pattern of results presents challenges for most current theories of associative learning.     

A modified version of the unique cue theory accounts for olfactory compound processing in honeybees

We investigated the capability of honeybees to discriminate between single odorants, binary olfactory mixtures, and ternary olfactory mixtures in olfactory conditioning of the proboscis extension reflex. In Experiment 1, three single odorants (A+, B+, and C+) and three binary mixtures of these odors (AB+, AC+, and BC+) were reinforced while the ternary compound, consisting of all three odors (ABC-), was nonreinforced. In Experiment 2, only one single odorant (A+) and one binary olfactory compound (BC+) were reinforced while the ternary compound (ABC-) consisting of the single odor and the binary compound was nonreinforced. We studied whether bees can solve these problems and whether the course of differentiation can be predicted by the unique cue theory, a modified unique cue theory, or Pearce's configural theory. Honeybees were not able to differentiate reinforced from nonreinforced stimuli in Experiment 1. However, summation to ABC observed at the beginning of training contradicts the predictions of Pearce's configural theory. In Experiment 2, differentiation between the single odorant A and the ternary compound developed more easily than between the binary compound BC and ABC. This pattern of differentiation is in line with a modified unique cue theory and Pearce's configural theory. Summation to ABC at the beginning of training, however, again was at odds with Pearce's configural theory. Thus, olfactory compound processing in honeybees can best be explained by a modified unique cue theory.     

Unblocking in Pavlovian fear conditioning

Six experiments used rats to study blocking and unblocking of fear learning. An excitatory stimulus (A) blocked fear learning to a neutral stimulus (B). Unblocking of B occurred if the AB compound signaled an increase in unconditioned stimulus (US) intensity or number. Assessments of associative change during blocking showed that more was learned about B than A. Such assessments during unblocking revealed that more was learned about B than A following an increase in US intensity but not US number. These US manipulations had no differential effects on single-cue learning. The results show that variations in US intensity or number produce unblocking of fear learning, but for each there is a different profile of associative change and a potentially different mechanism.     

Competition between a Simultaneous and a Serial Feature in Appetitive Feature positive and Feature negative Discriminations

Two experiments with rats examined competition between simultaneous and serial features for behavioural control in an appetitive discrimination. In Experiment 1, an auditory target was reinforced when presented in isolation. For different groups, the target was non-reinforced when simultaneously accompanied by a visual feature (first group), when preceded by a serial visual feature (second group), or when both accompanied by a simultaneous feature and preceded by a serial feature (third group). Tests performed after discrimination learning revealed inhibitory control by the simultaneous feature in the first group and by the serial feature in the second group. In the third group, the simultaneous feature acquired inhibitory control over the target in isolation, whereas the serial feature did not. However, the serial feature further reduced responding to the target-simultaneous feature compound relative to responding shown to the compound in isolation. In Experiment 2, the same training procedure was used in three groups as in Experiment 1, except that the target was nonreinforced in isolation and reinforced in the presence of a simultaneous and/or serial feature. Tests revealed that the feature acquired excitatory control in the first and second groups. In the third group, both features acquired excitatory control, although the control exerted by the simultaneous feature was less strong than that observed in the group trained with only the simultaneous feature. The theoretical implications of these results regarding competition between occasion setters and Pavlovian excitors and inhibitors were discussed.     

Extinction of an emotional response in the presence of facial expressions of emotion

Previous studies (Lanzetta & Orr, 1980, 1981; Orr & Lanzetta, 1980) have demonstrated that fear facial expressions have the functional properties of conditioned excitatory stimuli, while happy expressions behave as conditioned inhibitors of emotional responses. The present study uses a summation conditioning procedure to distinguish between associative and nonassociative (selective sensitizations, attentional) interpretations of these findings. A neutral tone was first established as a conditioned excitatory CS by reinforcing tone presentations with shock. In subsequent nonreinforced test trials the excitatory tone was paired with either fear, happy, or neutral facial expressions. A tone alone and a tone/nonface slide compound were used as controls. The results indicate that phasic and tonic skin conductance responses to the tone/fear expression compound were significantly larger during extinction than for all other experimental and control groups. No significant differences were found among these latter conditions. The findings support the assumption that the excitatory characteristics of fear expressions do not depend on associative mechanisms. In the presence of fear cues, fear facial expressions intensify the emotional reaction and disrupt extinction of a previously acquired fear response. Happy facial expressions however, do not function as conditioned inhibitors in the absence of reinforcement, suggesting that the previously found inhibition was associative in nature.This research was supported by NSF grant No. 77-08926 and by funds from the Lincoln Filene Endowment to Dartmouth College.     

Past experience influences the processing of stimulus compounds in human Pavlovian conditioning

In two human skin conductance conditioning experiments we investigated whether processing of stimulus compounds can be influenced by past experience. Participants were either pre-trained with a discrimination problem that could be solved elementally (A+, B−, AB+, C− in Experiment 1 and A+, AB+, C−, CB− in Experiment 2) or one that required a configural solution (AB+, BC−, CD+, DA− in Experiment 1 and A−, AB+, C+, CB− in Experiment 2). After pre-training, participants were shown an EX+, FX− discrimination. Subsequently, responding to individual components (E and F) was tested. After elemental pre-training, participants showed larger responses to the component from the previously reinforced compound (E) than to the component from the nonreinforced compound (F) whereas no such difference was found after configural pre-training. This means that the kind of pre-training influenced whether the later discrimination problem was processed elementally or configurally. The results indicate that organisms can flexibly process stimulus compounds in different ways.     

Spontaneous configuring in conditioned flavor aversion

A series of experiments investigated spontaneous configuring using the conditioned flavor aversion paradigm with rat subjects. In Experiment 1, extended training of a two-flavor compound stimulus did not produce spontaneous differentiation of conditioned responding to that compound and its elements. In Experiment 2 we found that extended nonreinforced exposure to a compound stimulus generated spontaneous element-compound differentiation when the elements were later conditioned. Rats that received extended preexposure to the compound showed less conditioned responding to the compound than to either of its elements. However, rats that had not received preexposure to the compound showed greater conditioned responding to the compound than to either of its elements (summation). In Experiment 3, nonreinforced preexposure to the compound stimulus prior to minimal reinforced compound training produced spontaneous compound-element differentiation, but extended reinforced compound training eliminated that differentiation. In Experiment 4, extended partial reinforcement training with a compound produced differentiation of the compound from its elements. Implications of these data for the mechanisms responsible for spontaneous configuring and for the summation assumptions common to most learning theories are discussed.     

An extended comparator hypothesis account of superconditioning

Three conditioned taste aversion experiments with rats investigated superconditioning. In each experiment, alternate exposures of 2 flavor compounds with a common element (i.e., AB/AS) were administered to establish an inhibitory relationship between the 2 unique elements, B and S, and prior to testing, S was paired with lithium chloride (LiCl). In Experiment 1, pairings of a neutral cue (X) with S in compound with B after the AB/AS exposures resulted in superconditioning between X and S. Extinction of the common element (A) just before the S-LiCl pairing attenuated both the inhibitory relationship between B and S (Experiment 2) and superconditioning between X and S (Experiment 3). These observations suggest that superconditioning consists of enhanced performance rather than enhanced associative acquisition.     

Blocking but not conditioned inhibition results when an added stimulus is reinforced in compound with multiple pretrained stimuli

Conditioned barpress suppression by rats was used to explore the associative status of an initially neutral stimulus that was reinforced in simultaneous compound with two independently pretrained conditioned excitors. In contrast to the Rescorla-Wagner model, which predicts that the target stimulus (X) will be inhibitory following such A+/B+/ABX+ training, the present study found no evidence that X acquired inhibitory associative strength. Rather, the pretrained stimuli merely served to block conditioned excitatory responding to the target stimulus.     

The comparator hypothesis of conditioned response generation: manifest conditioned excitation and inhibition as a function of relative excitatory strengths of CS and conditioning context at the time of testing

In the present research water-deprived rats were used in a conditioned lick suppression paradigm to test and further develop Rescorla's (1968) contingency theory, which posits that excitatory associations are formed when a conditioned stimulus (CS) signals an increase in unconditioned stimulus (US) likelihood and that inhibitory associations develop when the CS signals a decrease in US likelihood. In Experiment 1 we found that responding to a CS varied inversely with the associative status of the context in which the CS was trained and that this response was unaltered when testing occurred in a distinctively dissimilar context with a different conditioning history, provided associative summation with the test context was minimized. These results suggest that manifest excitatory and inhibitory conditioned responding is modulated by the associative value of the training context rather than that of the test context. In Experiment 2 it was demonstrated that postconditioning decreases in the associative value of the CS training context reduced the effective inhibitory value of the CS even when testing occurred outside of the training context. Moreover, this contextual deflation effect was specific to the CS training context as opposed to any other excitatory context. Collectively, these studies support the comparator hypothesis, which states that conditioned responding is determined by a comparison of the associative strengths of the CS and its training context that occurs at the time of testing rather than at the time of conditioning. This implies that all associations are excitatory and that responding indicative of conditioned inhibition reflects a CS-US association that is below (or near) the associative strength of its comparator stimulus. It is suggested that response rules which go beyond a monotonic relation between associative value and response strength can partially relieve learning theories of their explanatory burdens, thereby allowing for simpler models of acquisition.     

Loss of associability by a compound stimulus comprising excitatory and inhibitory elements

In each of two experiments rats learned a discrimination between a stimulus (A) that signaled shock and a compound stimulus (AB) that signaled no shock. In Experiment 1 it was found that the AB compound acquired excitatory strength only slowly when, in a second phase of training, it was made to signal the occurrence of shock. In Experiment 2 the acquisition of inhibitory strength by the compound was similarly found to be retarded. This second experiment also replicated the results of Experiment 1. The relevance of these results to current theories of latent inhibition and attention is discussed.     

Learned associability and associative change in human causal learning.

The Mackintosh (1975) model of associative learning specifies that processing of both the cues presented on a trial and the outcome of that trial will interact to determine the amount of associative change undergone by a given cue. Experiments looking at the distribution of associative change among the elements of a reinforced compound in animal conditioning studies indicate that processing of the outcome of a trial does indeed influence associative change. The work reported here investigates the distribution of associative change among the elements of a reinforced compound in a human causal judgement paradigm, and it indicates that processing of the cues presented on a trial also plays a role in determining associative change (in terms of changes in the associability of cues as a result of experience). Taken in combination, these results provide good support for Mackintosh (1975) and the characterizations of both cue and outcome processing that it offers.     

Macaques’ (Macaca mulatta) use of numerical cues in maze trials

We tested the ability of number-trained rhesus monkeys to use Arabic numeral cues to discriminate between different series of maze trials and anticipate the final trial in each series. The monkeys prior experience with numerals also allowed us to investigate spontaneous transfer between series. A total of four monkeys were tested in two experiments. In both experiments, the monkeys were trained on a computerized task consisting of three reinforced maze trials followed by one nonreinforced trial. The goal of the maze was an Arabic numeral 3, which corresponded to the number of reinforced maze trials in the series. In experiment 1 (n=2), the monkeys were given probe trials of the numerals 2 and 4 and in experiment 2 (n=2), they were given probe trials of the numerals 2–8. The monkeys receiving the probe trials 2 and 4 showed some generalization to the new numerals and developed a pattern of performing more slowly on the nonreinforced trial than the reinforced trial before it for most series, indicating the use of the changing numeral cues to anticipate the nonreinforced trial. The monkeys receiving probe trials of the numerals 2–8 did not predict precisely when the nonreinforced trial would occur in each series, but they did incorporate the changing numerals into their strategy for performing the task. This study provides the first evidence that number-trained monkeys can use Arabic numerals to perform a task involving sequential presentations.     

The content of compound conditioning

In three experiments using Pavlovian conditioning of magazine approach, rats were trained with a compound stimulus, AB, and were concurrently trained with stimulus B on its own. The reinforcement rate of B, rB, was either 1/2, 2/3, or 2/5 of rAB. After extended training, the conditioning strength of A was assessed using probe trials in which A was presented alone. Responding during A was compared with that during AB, B, and a third stimulus, C, for which rC = rAB - rB. In each experiment, the rats' response rate during A was almost identical to that during C (and during B, when rB = 1/2rAB). This suggests that, during AB conditioning, the rats had learned about rA as being equal to [rAB - rB], and implies that the content of their learning was a linear function of r. The findings provide strong support for rate-based models of conditioning (e.g., Gallistel & Gibbon, 2000). They are also consistent with the associative account of learning defined in the Rescorla and Wagner (1972) model, but only if the learning rate during reinforcement equals that during nonreinforcement.