A further study of stimulus generalization following three-stimulus discrimination training

A group of pigeons was trained in a Skinner box to peck for VI reinforcement when the key was illuminated by a monochromatic light of 540 or 580 mμ but were non-reinforced for responding to 560 mμ. Two control groups, differing in amount of training, received only the two positive stimuli. At the completion of training all Ss received generalization tests under extinction. Both control groups produced bi-modal generalization gradients with the peaks of responding at the S+ values. The post-discrimination gradient revealed peaks displaced from the S+ values in the direction away from the S−, low responding and increased steepness in the region of S− and a general elevation of the gradient.     

Instructions and stimulus categorizing in a measure of stimulus generalization

In Experiment I, three groups of 20 Ss each were exposed to a light of 550 mμ (yellowish-green) for 60 sec and then viewed a random sequence of wavelengths with instructions to respond only to the original color. The instructions given the three groups were worded differently in an attempt to vary the strength of a set-to-discriminate assumed to be created by this procedure. The three groups produced similar gradients, each with a peak of responding at 540 mμ, in agreement with Kalish's (1958) published gradient for the 550 mμ standard stimulus value. It was suggested that the nature of the task is such that a strong discriminatory set is produced regardless of the wording of the instructions.

A temporal analysis of the gradient as it develops during the testing revealed that initially the peak of responding occurs at 550 mμ; but as testing progresses, it shifts gradually in the direction of the shorter wavelengths (purer greens). Experiment II was performed to test the generality of the phenomenon of regression to the primary color. Two groups of 20 Ss each were tested for generalization following exposure to 510 mμ (bluish-green) and 525 mμ (pure green), respectively. We predicted that the 510 mμ gradient would reveal a progressive shift toward the longer wavelengths (purer greens), whereas the 525 mμ gradient would show no tendency to shift. The results were strikingly in accord with these predictions.

We concluded that although a physiological process could not be ruled out, the verbal labeling of the standard stimulus value may well be responsible for the regression of the gradient toward the primary color.

     

Stimulus generalization as a function of the delay between training and testing procedures: a reevaluation

Three groups of 12 pigeons each were trained to discriminate between lights of 550 mμ (S^D), correlated with 1-min variable-interval reinforcement and 570 mμ (S^Δ), correlated with extinction. Group A was tested for wavelength generalization in extinction 1 min after meeting the discrimination criterion; Group B was tested 24 hr later; Group C was tested 24 hr later after a 3-min (reinforced) warm-up with the S^D. The post-discrimination gradient of Group B was significantly flatter and showed significantly greater area shift than that of Groups A and C. The gradient of Group C was similar to that of Group A, indicating that the warm-up eliminated the effect of the delay period.     

The effects of punishment intensity on squirrel monkeys

Responses of squirrel monkeys were maintained by a variable-interval schedule of food reinforcement. Concurrently, punishment consisting of a brief electric shock followed each response. As has been found for pigeons and rats, punishment did not produce extreme, all-or-none reactions. By gradually increasing the punishment intensity it was possible to produce response rates intermediate to no suppression and complete suppression. Similarly, the moment-to-moment response rate was free of extreme fluctuations. A “warm-up” effect occurred in which the punished responses were especially suppressed during the initial part of a session. The pre-punishment performance was negatively accelerated within a session, and punishment reduced the degree of negative acceleration. When punishment was discontinued, responding recovered immediately except when suppression had been complete or prolonged. When the punishment intensity was decreased gradually, more suppression resulted at a given intensity than when intensity was increased gradually. This suggests a “behavioral inertia” effect wherein behavior at a new punishment intensity is biased toward the behavior at the previous value. A corollary generalization is that the larger the change in intensity, the less the behavior at the new value will be biased toward the behavior at the previous value.     

Stimulus hierarchy generalization in systematic desensitization

A group of snake phobic Ss were desensitized to the first 5 items of a standard 7 item snake fear hierarchy in which the items were ordered on the basis of distance from a snake. This group and a no-treatment control group (which did not receive the desensitization) were treated for fear of all the hierarchy stimuli in terms of ratings both before and after the desensitization. The Ss rated their fear responses to all the stimuli as presented to them in (1) real form (2) by slide, and (3) in imaginal form. The results verified all four experimental hypotheses: (1) The experimental Ss showed greater fear reduction than the control Ss to both the training stimuli (the stimuli on which desensitization done) and the generalization stimuli (the other two stimuli), (2) The systematic desensitization (SD) group showed (a) more fear reduction to the last training stimuli than to the lower generalization stimulus and (b) more to the latter than to the higher generalization stimulus, (3) The SD group showed less fear reduction to the generalization stimuli in their real form than in both the slide and imaginai modalities (in the desensitization each stimulus presentation was done first in slide form and then in imaginal form), and (4) There were significant overall individual differences in generalization of fear reduction to the generalization stimuli.     

Stimulus control and generalization of point-loss punishment with humans

Two experiments demonstrated stimulus control and generalization of conditioned punishment with humans. In both studies, responses first were reinforced with points exchangeable for money on a variable-interval schedule in the presence of one line length (S(D)). Next, a second line length was introduced, and point loss followed every response in the presence of that line (S(D)p). In the final training condition, points were deducted at session end. Response rate was lower in the presence of the S(D)p despite equal rates of points for money in the presence of both stimuli. In generalization testing for Experiment 1, the two lines were included in a 10-line continuum; S(D)p fell in the middle and the trained SD was at one end. Lines were presented randomly, and point delivery and loss contingencies were as in training but with points available in the presence of all lines. For all subjects, response rates were lowest around S(D)p and increased towards the SD end of the continuum. Because testing included only one or two lines beyond S(D), this pattern did not rule out S(D) generalization. Thus, in Experiment 2, stimuli beyond S(D) were added to generalization tests. Response rates did not decrease as a function of distance from S(D), clarifying the demonstration of punishment generalization.     

Partial avoidance contingencies: Absolute omission and punishment probabilities

Avoidance contingencies were defined by the absolute probability of the conjunction of responding or not responding with shock or no shock. The “omission” probability (ρ₀₀) is the probability of no response and no shock. The “punishment” probability (ρ₁₁) is the probability of both a response and a shock. The traditional avoidance contingency never omits shock on nonresponse trials (ρ₀₀=0) and never presents shock on response trials (ρ₁₁=0). Rats were trained on a discrete-trial paradigm with no intertrial interval. The first lever response changed an auditory stimulus for the remainder of the trial. Shocks were delivered only at the end of each trial cycle. After initial training under the traditional avoidance contingency, one group of rats experienced changes in omission probability (ρ₀₀>0), holding punishment probability at zero. The second group of rats were studied under different punishment probability values (ρ₁₁>0), holding omission probability at zero. Data from subjects in the omission group looked similar, showing graded decrements in responding with increasing probability of omission. These subjects approximately “matched” their nonresponse frequencies to the programmed probability of shock omission on nonresponse trials, producing a very low and approximately constant conditional probability of shock given no response. Subjects in the punishment group showed different sensitivity to increasing absolute punishment probability. Some subjects decreased responding to low values as punishment probability increased, while others continued to respond at substantial levels even when shock was inevitable on all trials (noncontingent shock schedule). These results confirm an asymmetry between two dimensions of partial avoidance contingencies. When the consequences of not responding included occasional omission of shock, all subjects showed graded sensitivity to changes in omission frequency. When the consequences of responding included occasional shock delivery, some subjects showed graded sensitivity to punishment frequency while others showed control by overall shock frequency as well.     

Effects of the temporal relationship of feedback and stimulus information upon discrimination-learning strategies

Second grade Ss and college students were tested under three conditions of the temporal relationship of feedback and stimulus information. In one condition (/+3) feedback was delivered immediately upon S's response while the stimuli were still in view. In another (/0) feedback was also immediate but stimuli were extinguished immediately upon S's response. In the third condition (/?3), stimuli were extinguished immediately upon response and feedback was delayed 3 sec. Major findings among the children were (a) Ss of all conditions coded information at the same (high) average efficiency, (b) Ss of conditions /0 and /?3 recoded with significantly less efficiency than those of /+3, and (c) Ss in condition /+3 manifested primarily efficient information-processing strategies, those in condition /0 showed intermediate performance, and those of condition /?3 showed relatively primitive stereotyped behavior. Among adult Ss performance was uniformly high with little effect on any response measure investigated.     

Generalization gradients following two-response discrimination training

Stimulus generalization was investigated using institutionalized human retardates as subjects. A baseline was established in which two values along the stimulus dimension of auditory frequency differentially controlled responding on two bars. The insertion of the test probes disrupted the control established to the two S^Ds during training. The discrimination was recovered between each test probe and the resulting gradients were stable across 10 test sessions. These gradients, supported by other two-response generalization studies, indicate that this type of two-response discrimination training divides the stimulus dimension into two functional classes separated by a region of transition from one class to the other. Each stimulus value in a class, which extends from an S^D outward to the functional limit of the dimension, controls a similar proportion of the two responses as each other value in the class. All values on the stimulus dimension control identical response rates with an absence of the usual generalization decrement. The latency of the initial response, however, shows a bimodal gradient with the modes at the S^D values.     

Some effects on generalization gradients of tandem schedules

The relationship between training conditions and stimulus generalization gradients was examined using tandem schedules of reinforcement. Schedules were selected so that frequency of reinforcement and rate of responding were varied somewhat independently of each other. A peak-shift in the generalization gradient was obtained when extinction had been associated with one of the stimuli. No comparable peak shift was obtained when there were equal response rates in the training stimuli even with dissimilar frequencies of reinforcement. The data imply that response rates at the end of training, rather than reinforcement frequency per se, determine the characteristics of the generalization gradient.     

A developmental study of differences in initial coding and recoding of hypothesis information

Coding and recoding of hypothesis information was studied in children in Grades 3, 5, and 7, and college students. Each S was tested on several two-choice discrimination problems. A problem consisted of two trials, a training trial and a test trial. The information available for coding on the first trial was varied in three series of problems by using pairs of stimuli differing in 3, 4, or 6 dimensions. Recoding after an error was facilitated in half of the problems in each series by allowing the stimuli to persist briefly after response and feedback. The stimuli terminated immediately after response and feedback in the remaining problems. The second trial of a problem, in which the stimuli differed on only one dimension, was used to probe for the information coded or recoded on the first trial. On the average, fewer dimensions were coded per trial by the younger Ss than by the older Ss. Neither the effects of negative feedback nor the effects of stimulus persistence were found to be related to developmental level. It was concluded that a deficiency in young children's ability to code, but not recode, hypothesis information contributes to their less efficient performance in discrimination problems.     

Residence time and choice in concurrent foraging schedules

Five pigeons were trained on a concurrent-schedule analogue of the “some patches are empty” procedure. Two concurrently available alternatives were arranged on a single response key and were signaled by red and green keylights. A subject could travel between these alternatives by responding on a second yellow “switching” key. Following a changeover to a patch, there was a probability (p) that a single reinforcer would be available on that alternative for a response after a time determined by the value of λ, a probability of reinforcement per second. The overall scheduling of reinforcers on the two alternatives was arranged nonindependently, and the available alternative was switched after each reinforcer. In Part 1 of the experiment, the probabilities of reinforcement, ρ_red and ρ_green, were equal on the two alternatives, and the arranged arrival rates of reinforcers, λ_red and λ_green, were varied across conditions. In Part 2, the reinforcer arrival times were arranged to be equal, and the reinforcer probabilities were varied across conditions. In Part 3, both parameters were varied. The results replicated those seen in studies that have investigated time allocation in a single patch: Both response and time allocation to an alternative increased with decreasing values of λ and with increasing values of ρ, and residence times were consistently greater than those that would maximize obtained reinforcer rates. Furthermore, both response- and time-allocation ratios undermatched mean reinforcer-arrival time and reinforcer-frequency ratios.     

Relative allocation on concurrent schedules can depend on schedule parameters when behavioral parameters are constant

We develop a simple model of switching between the initial links of a concurrent-chain procedure. Behavior is determined by four parameters μ₁, μ₂, q₁, and q₂. The first two are the basic rates of switching from Schedule 1 and Schedule 2, respectively. The second two are the probabilities of leaving Schedule 1 and Schedule 2 after the corresponding terminal link has been completed. We show that for fixed values of these four parameters, the relative allocation on the initial links may change as a result of changes in initial-link schedules. The effect can be quite large if the switching rates are low. An implication is that relative allocation is not necessarily a good measure of behavior.     

HUMAN RESPONDING ON RANDOM‐INTERVAL SCHEDULES OF RESPONSE‐COST PUNISHMENT: THE ROLE OF REDUCED REINFORCEMENT DENSITY

An experiment with adult humans investigated the effects of response‐contingent money loss (response‐cost punishment) on monetary‐reinforced responding. A yoked‐control procedure was used to separate the effects on responding of the response‐cost contingency from the effects of reduced reinforcement density. Eight adults pressed buttons for money on a three‐component multiple reinforcement schedule. During baseline, responding in all components produced money gains according to a random‐interval 20‐s schedule. During punishment conditions, responding during the punishment component conjointly produced money losses according to a random‐interval schedule. The value of the response‐cost schedule was manipulated across conditions to systematically evaluate the effects on responding of response‐cost frequency. Participants were assigned to one of two yoked‐control conditions. For participants in the Yoked Punishment group, during punishment conditions money losses were delivered in the yoked component response independently at the same intervals that money losses were produced in the punishment component. For participants in the Yoked Reinforcement group, responding in the yoked component produced the same net earnings as produced in the punishment component. In 6 of 8 participants, contingent response cost selectively decreased response rates in the punishment component and the magnitude of the decrease was directly related to the punishment schedule value. Under punishment conditions, for participants in the Yoked Punishment group response rates in the yoked component also decreased, but the decrease was less than that observed in the punishment component, whereas for participants in the Yoked Reinforcement group response rates in the yoked component remained similar to rates in the no‐punishment component. These results provide further evidence that contingent response cost functions similarly to noxious punishers in that it appears to suppress responding apart from its effects on reinforcement density.     

Generalization and discrimination as a function of the SD — SΔ intensity difference

Three groups of four rats were trained on an auditory-intensity discrimination for 21 days. The S^D-S^Δ intensity difference for Group I was 10 db; for Group II, 20 db; and for Group III, 30 db. Following the initial discrimination training, the animals were tested for generalization of the bar-press response to seven novel S^Δ's which were presented intermingled with the original S^D and S^Δ values. Conclusions: (1.) The amount of simple discrimination training required to obtain fairly stable differences in S^D and S^Δ responding is an inverse function of the magnitude of the stimulus difference between S^D and S^Δ. (2.) Generalization gradients obtained immediately following simple discrimination training exhibit a maximum displaced from S^D in a direction also away from S^Δ. (3.) Gradients obtained following continued exposure to the multivalued S^Δ situation show a fairly stable maximum at the S^D value. (4.) Although the gradients tend to fall off systematically on either side of the continuum as distance from S^D is increased, they decrease most rapidly on the S^Δ limb of the gradient.     

The effects of dopamine D(1) receptor blockade in the prelimbic-infralimbic areas on behavioral flexibility

This study examined the effects of a dopamine D₁ antagonist, SCH23390, infused into the prelimbic–infralimbic areas on the acquisition of a response and visual-cue discrimination task, as well as a shift from a response to a visual-cue discrimination and vice versa. Each test was carried out in a cross-maze. The response discrimination required learning to always turn in the same direction (right or left) for a cereal reinforcement. The visual-cue discrimination required learning to always enter the arm with the visual cue. In experiment 1, rats were tested on the response discrimination task, followed by the visual-cue discrimination task. In experiment 2, the testing order was reversed. Bilateral infusions of SCH23390 (0.1 or 1 μg/0.5 μL) into the prelimbic–infralimbic areas did not impair acquisition of the response or visual-cue discrimination tasks. SCH23390 injections at 1 μg, but not 0.1 μg impaired performance when shifting from a response to a visual-cue discrimination, and vice versa. Analysis of the errors revealed that the deficit was due to perseveration of the previously learned strategy. These results suggest that activation of dopamine D₁ receptors in the prelimbic–infralimbic areas may be critical for the suppression of a previously relevant strategy and/or generating new strategies.     

Asymmetric attributions for compliance: Reward vs punishment

It was proposed that people attribute an individual's behavior more to internal factors when that individual's actions are influenced by reward than when those actions are influenced by punishment. Previous research has failed to control for the power of reward versus punishment which, in effect, creates a confounding of behavioral base rates (consensus) with the reward-punishment manipulation. The current research created reward and punishment contingencies that were equal in their base rates for producing a compliant response. In Experiment 1, subjects (n = 63) who produced the base-rate data also made attributions regarding a compliant target person. The results supported the reward-punishment attributional asymmetry hypothesis in that the target person was held more responsible for his actions in the reward than in the punishment conditions. A second experiment (n = 72) provided some attributors with information regarding base rates for compliance and measured perceived base rates for compliance. Knowledge of the base rates for compliance eliminated the reward-punishment attributional asymmetry phenomenon. Subjects not provided with such knowledge erroneously assumed different base rates for reward and punishment and maintained the perception of reward-punishment attributional asymmetry. Using subjects' estimates of base rate for compliance as a covariate eliminated the attributional asymmetry effect. It is suggested that erroneous base-rate assumptions mediate the attributional asymmetry phenomenon.     

On the discriminative control of concurrent responses: the relations among response frequency, latency, and topography in auditory generalization

Human subjects were used in a study of auditory generalization following multiple-response discrimination training. The relations observed among stimulus intensity, response probability, and response latency were invariant with respect to whether the two vocal responses conditioned were topographically discrete, as in one experiment, or topographically continuous, as in another. The major findings were:

1. The probabilities associated with a specific response were maximal over several stimulus values at the extreme ends of the continuum, then dropped sharply at stimuli intermediate to the initial S^D's as the probability of the alternative response increased.

2. Overall response latency was inversely related to the relative frequency of the two responses at each stimulus value. When the two responses were most nearly equal in probability, latencies were maximal; when one response had close to unit or zero probability, latencies were minimal.

3. Analysis of the latencies of the two responses, taken separately, revealed: (a) an increase in latency as the difference between the test stimulus and the initial S^D increased; (b) a sharp discontinuity in the latency gradient and reversal in trend at intermediate stimulus intensities; and (c) at a given stimulus value, latencies associated with the stochastically dominant response were consistently shorter than those of the nondominant response.

4. No changes in response topography (fundamental frequency) were correlated with the characteristic changes in probability and latency during stimulus generalization.

     

Operant control of vocal behavior in the cat

Evidence of operant control of vocal behavior in the cat is presented: (1) On mult FR 12 S^Δ schedule, cats miaowed rapidly during periods of S^D and much less or not at all during S^Δ. (2) This control was re-established following reversal of stimuli. (3) The frequency distribution of response durations was shifted to both shorter and longer values by the differential reinforcement of shorter or longer response durations respectively. Since both the frequency and duration of vocal responses were shown to be under the control of the schedule of reinforcement, it is concluded that at least some of the vocal behavior of the cat is susceptible to operant control.     

Increasing acetylcholine levels in the hippocampus or entorhinal cortex reverses the impairing effects of septal GABA receptor activation on spontaneous alternation

Intra-septal infusions of the γ-aminobutyric acid (GABA) agonist muscimol impair learning and memory in a variety of tasks. This experiment determined whether hippocampal or entorhinal infusions of the acetylcholinesterase inhibitor physostigmine would reverse such impairing effects on spontaneous alternation performance, a measure of spatial working memory. Male Sprague-Dawley rats were given intra-septal infusions of vehicle or muscimol (1 nmole/0.5 μL) combined with unilateral intra-hippocampal or intra-entorhinal infusions of vehicle or physostigmine (10 μg/μL for the hippocampus; 7.5 μg/μL or 1.875 μg/0.25 μL for the entorhinal cortex). Fifteen minutes later, spontaneous alternation performance was assessed. The results indicated that intra-septal infusions of muscimol significantly decreased percentage-of-alternation scores, whereas intra-hippocampal or intra-entorhinal infusions of physostigmine had no effect. More importantly, intra-hippocampal or intra-entorhinal infusions of physostigmine, at doses that did not influence performance when administered alone, completely reversed the impairing effects of the muscimol infusions. These findings indicate that increasing cholinergic levels in the hippocampus or entorhinal cortex is sufficient to reverse the impairing effects of septal GABA receptor activation and support the hypothesis that the impairing effects of septal GABAergic activity involve cholinergic processes in the hippocampus and the entorhinal cortex.