Effects of expectancies of different reward magnitudes in transfer from noncontingent pairings to instrumental performance

In two experiments, rats received noncontingent pairings of two stimuli with food reward, one paired with small reward and the other with large reward, and received bar press training with large reward or with small reward. When the noncontingent stimuli (NS) were presented for test during subsequent rewarded bar pressing and during early extinction of bar pressing, responding for each group was faster in the presence of the NS which was paired with the same reward magnitude that group received in bar press training than to the NS which had been paired with a different reward magnitude. As extinction progressed, all groups responded more slowly in the presence of the NS which had been paired with the large reward than in the presence of the NS which had been paired with small reward. These results were interpreted as indicating that responding in the presence of an NS depends on: (i) whether the reward expectancy elicited by the NS has been conditioned to the instrumental response, and (ii) the relationship between the reward expected in the presence of the NS and that received in test.     

Chaining and secondary reinforcement based on escape from shock

Three white rats were trained to press a bar while being shocked. This produced a white noise. After 30 sec they were allowed to terminate both the shock and the noise by nosing a pigeon key. Comparison of the rates of pressing before and after the onset of the noise indicated that the noise itself was the immediate reinforcing agent for pressing. Furthermore, control tests showed that pressing was maintained only if it produced the noise: either omission of the noise or elimination of the dependency of the noise on the occurrence of the response led to a gradual abolition of pressing. When automatic termination of the shock was substituted for the key nosing requirement, however, only the key nosing extinguished. This indicated that the effectiveness of the noise as a reinforcer did not depend on its status as a discriminative stimulus for some other form of operant behavior.     

The effect of rearing environments on the contrafreeloading phenomenon in rats

Eight naive rats were reared in enriched or impoverished environments for 39 days after weaning and then lived in operant chambers, in which they could obtain food pellets freely or by lever pressing, for 25 or 30 days. The animals raised in an impoverished environment acquired the bar-press response quickly when placed in the operant chambers and maintained a preference for obtaining food via bar pressing. Animals raised in an enriched environment did not learn to lever press, as demonstrated by low levels of responding and the lack of bar pressing when free food was subsequently removed. It was concluded that restricting animals' postweaning environments facilitated learning in a choice situation, probably because of increased activity levels. The results are interpreted in relation to previous studies on rearing environments and on contrafreeloading.     

Visual evoked potential augmenting/reducing slopes in cats—2. Correlations with behavior

Relationships were studied in cats between the augmenting/reducing slopes of visual evoked potentials (VEP) and three types of behavioral responses: learning and performance measures in (1) fixed interval (FI), and (2) differential reinforcement of low rate of response (DRL) bar pressing tasks for food reward, and (3) the effect of noise stress or increasing task difficulty on performance of an FI, DRL or 2 bar discrimination task. The most reliable slope measure (N1 at a medium intensity range) was found to correlate most highly with inhibitory behaviors such that reducers were most successful in controlling bar pressing behavior during an inhibitory DRL task or when stress was introduced. At a higher range of flash intensity slopes tended to be more negative, and the P1 - N1 slopes although more variable correlated most consistently with general temperament. Augmenters at a high intensity range were more active and explaratory, and learmed to bar press more quickly and efficiently.     

Rats respond for food in the presence of free food: How free is the “free” food?

An experiment conducted by A.J. Neuringer (Science, 1969,166, 399–401) in which he reported that rats maintained appreciable levels of bar pressing for earned food in the presence of freely available food was critically examined and replicated. Rats were trained to bar press, then housed in operant chambers and administered a 15-day preference test between free and earned food, followed successively by 10 days of free food only, a second 6-day preference test, and 7 days of earned food only. Throughout the experiment half of the animals were provided with tall free-food containers similar to those used by Neuringer; the other half were provided with short containers similar to those more commonly employed by other researchers. The former animals showed a consistent propensity to bar press for earned food across both preference tests, while the latter animals showed only an initial propensity to bar press which subsequently declined to very low levels. These results indicate that the maintenance of significant amounts of bar pressing by the rats in Neuringer's report was due to the relatively more effortful free-food source he employed. The utility of a neophobia-optimality model in explaining the present data is discussed.     

A conditioned reinforcer maintained by temporal association with the termination of shock

Two experiments were conducted to determine whether a stimulus can be established as a positive conditioned reinforcer by associating it with the termination of shock, but without training the animal to make any response in its presence. In the first, six rats were conditioned to press a bar to terminate shock on a variable ratio schedule; white noise was then substituted as the immediate consequence, with the shock terminating 30 sec after the last press in its presence. It was found that the rate of pressing in the absence of noise depended on the contingency between the pressing and the noise. The second experiment sought to determine whether the difference in rates before and after the onset of the noise was due to the reinforcement of prior responding by the onset of the noise or to the suppression of subsequent responding by differential reinforcement of competing behavior. Six more rats were trained in the same manner, but with shock terminating 30 sec after the onset of the noise, regardless of what the animal did in its presence. Again the rate was higher before the onset of the noise, indicating that pressing was indeed maintained by the noise as a conditioned reinforcer.     

Agonistic rank,aggression, social context,and testosterone in male pigtail monkeys

Two groups of pigtail monkeys were merged, a third was formed, and individual males were introduced into a group in a series of experiments examining the effects of social context upon agonistic rank, aggressive expression, and testosterone levels. In the first experiment, two heterosexual groups, containing adult males unfamiliar to the other group, were merged. The two groups fought, and the smaller group was defeated. The alpha and beta males of the defeated group were singled out for repeated attack and both showed significant drops in circulating levels of testosterone. Both males were removed from the group during the first day, but testosterone levels did not recover to baseline levels for several days. The alpha male of the victorious group, on the other hand, showed a significant rise in testosterone, which was apparent only on the day following the merger. In order to study the influence of previous social familiarity on male reception into a group, another group was formed by removing males from the victorious group and placing them in a separate enclosure. The males in the new group established a dominance hierarchy unrelated to their previous social ranks with one another. Three months later, each of the six adult males remaining in the parent group was individually introduced into the new group for one day or less. Each of the males introduced into the new group accepted a social position at the lower end of the dominance hierarchy without regard to his previous rank relationships with the host males when they were all in the parent group. Even the alpha and beta males of the parent group were relegated to low rank positions in the new group, despite having ranked over each of the host males since birth. In contrast to the aggression directed at the unfamiliar males in the first experiment, a minimum of aggression was directed to the familiar males introduced into the new group in the second experiment. Although the males introduced accepted low social ranks, it appeared that each was readily integrated into the group with a minimum of aggressive interaction during the time he was scheduled to remain in the group. There were no significant changes in circulating levels of testosterone in any of the males during the introductions of familiar males to one another.     

An orientation anisotropy in induced brightness

It is shown that an orientation anisotropy exists for the magnitude of induced brightness in a cruciform stimulus consisting of a grey test patch positioned at the intersection of two inducing bars, one black and one white, oriented at right angles to each other. When the cruciform was oriented such that the white bar was horizontal, the grey patch appeared darker than when the same cruciform was oriented such that the white bar was vertical. The contribution of the black and white inducing bars towards the brightness of the test patch was investigated. A simple mathematical function, which took into account both the contribution of the two component inducing bars and the orientation anisotropy, was fitted to the data. No consistent orientation anisotropy was found with inducing stimuli at oblique orientations.     

Nonretinotopic processing is related to postdictive size modulation in apparent motion

The present study briefly examined how the perceived size of a leading flash would be modulated by trailing motion signals. Observers were presented with two vertical green bars that were followed by white bars with different lengths, which were presented at different locations from the green bars. The task of observers was to discriminate which of the green bars was shorter than the other (Experiment 1) or whether the lengths of the green bars were equal or not (Experiments 2 and 3). One green bar producing apparent motion with the following shorter white bar was reported to be shorter than the other green bar producing apparent motion with the following longer white bar, not only when motion correspondence was determined on the basis of retinal proximity (Experiments 1 and 2),but also when motion correspondence was determined on the basis of nonretinotopic information-that is, a relative location within each perceptual group of bars (Experiment 3). These results indicate that motion processing involving object updating or motion deblurring in the nonretinotopic frame of reference is related to postdictive size modulation.     

Nicotine trained as a negative feature passes the retardation-of-acquisition and summation tests of a conditioned inhibitor

Nicotine functions as a negative feature in a Pavlovian discriminated goal-tracking task. Whether withholding of responding to the conditional stimulus (CS) reflects nicotine functioning as a conditioned inhibitor is unknown. Accordingly, the present research sought to determine whether nicotine trained as a negative feature passed the retardation-of-acquisition and summation tests, thus characterizing it as a pharmacological (interoceptive) conditioned inhibitor. In the retardation test, rats received either nicotine (0.4 mg/kg) or chlordiazepoxide (5 mg/kg) negative feature training in which the drug state signaled when a 15-sec light CS would not be paired with sucrose; light was paired with sucrose on intermixed saline sessions. Following acquisition of the discrimination, both groups received nicotine CS training in which sucrose was intermittently available on nicotine but not intermixed saline sessions. Acquisition of conditioned responding to the nicotine CS was slower in the nicotine negative feature group than in the chlordiazepoxide negative feature group. In the summation test, rats were assigned to either the nicotine negative feature group or a pseudoconditioning control. In this control, the light CS was paired with sucrose on half the nicotine and half the saline sessions. Both groups also received excitatory training in which a white noise CS was paired with sucrose. The summation test consisted of presenting the white noise in conjunction with nicotine. Conditioned responding evoked by the white noise was decreased in the negative feature but not the pseudoconditioning group. Combined, the results provide the first evidence that an interoceptive stimulus (nicotine) can become a conditioned inhibitor.     

Blocking the development of stimulus control when stimuli indicate periods of nonreinforcement

To learn whether prior discrimination training based on one stimulus would block learning about a subsequently added stimulus, rats were first trained to press a bar on a variable-interval schedule of food reinforcement. Occasional stimuli were presented during which no reinforcement was available. Responding became suppressed in the presence of these stimuli. Stimuli could be noise, light, or a compound of noise plus light. A group trained with noise in Phase 1, then trained with the compound in Phase 2, showed less suppression to light in a subsequent test than a group that had the same compound training in Phase 2 but only variable-interval training in Phase 1. This showed that prior training with noise blocked the development of control by light during compound training. Two further groups showed that noise training following compound training did not have the same effect on control by light.     

The non-occurrence of a stimulus as a signal

Two groups of rats were rewarded for pressing a panel following a varying number of bar presses; a signal following the bar press indicated whether or not a panel press would be rewarded if made before the next bar press. For one group the signal indicating reward was a flash of light, for the other it was the non-occurrence of the flash (in the latter case the flash thus signalled non-reward). The first group learned to withold panel presses except when reward was signalled, but the second group did not. This result is related to the “feature positive effect” of Jenkins and Sainsbury (1970), in which pigeons failed to withold pecks at a negative stimulus display when it was the same as the positive display except for the addition of a distinctive feature.     

Shattered Illusions: The Effect of Explicit Memory Mediation on an Indirect Memory Test

Four experiments were conducted to explore the possible involvement of explicit memory in an indirect memory test in which white noise accompanying old sentences was judged to be quieter than white noise accompanying new sentences (Jacoby, Allan, Collins, & Larwill, 1988). Experiment 1 established that this effect lasted up to 1 week. Experiment 2 found that a group of amnesic patients showed a noise effect that was marginally above chance and not significantly less than that of their matched controls after a delay of one day. Effects of time pressure at test (Experiment 3) and divided attention at study (Experiment 4) suggested that the memory processes mediating the noise effect were not automatic, although the possibility that the processes involve enhanced fluency is also discussed.     

The physical properties of bar-pressing behaviour and the problem of reactive inhibition

Many of the terms used in the literature on reactive inhibition are vague, subjective or incorrect. The weighted bar is not a suitable device in the study of this problem, since it records irrelevant aspects of behaviour. An experiment using apparatus which gives a continuous record of the force which a rat applies to a knob produces the following results. After much practice, pressing becomes sharp and brief and the amount of activity per reward is reduced. Under conditions of no (intentional) secondary reward the amount of activity during extinction is at first positively correlated with the average activity per reward during training, but the correlation diminishes as extinction proceeds. With auditory secondary reward there is no correlation.     

A response duration schedule: effects of training, extinction, and deprivation

Rats were trained to hold down a lever for at least 40 consecutive seconds. When the lever had been held down for 40 sec, white noise came on. Releasing the bar in the presence of the noise turned off the noise and operated a feeder that delivered a pellet of food. At the end of training, frequency distributions of response durations peaked at 40 to 41 sec. If as in training, holding down the lever produced white noise at the end of 40 sec, and release of the lever terminated the noise and operated the feeder, but no food delivery occurred, duration distributions and several other measures were initially not very different from when food was delivered. However, if during extinction white noise was never produced by lever holding, and feeder operation did not occur upon lever release, most responses were shorter than 1 sec in duration, some were much longer than 41 sec, and duration distributions did not peak at 40 to 41 sec. When reinforcement was reinstated after extinction, performance quickly returned to pre-extinction measures. Further sessions at different levels of deprivation produced only temporary disruptions in performance.     

The Traditional Regression Model for Measuring Test Bias is Incorrect and Biased Against Minorities

For 25 years psychologists have measured systematic measurement bias in terms of regression lines. According to this traditional approach a test is an unbiased predictor of a criterion for all subgroups if all subgroups have identical Y regression lines (i.e., identical slopes and identical Y intercepts). This paper shows that the traditional model is fundamentally incorrect and identical Y regression lines are not expected to occur with an unbiased test in a testing situation in which one group score lower than another group on both the test and criterion. This is the case even if the test is perfectly reliable. The traditional model for measuring bias actually results in a consistent error or bias against groups which score lower than average on both the test and criterion. In practice this bias operates against minority groups. Tests now thought to be unbiased or even biased in favor of minority groups may in fact be biased against minority groups. A new model of test bias, which is based solely on measurement principles, is briefly introduced. In this model unbiased tests produce groups with identical test-criterion common-factor axes having a slope of S _YC/S _XC and with each axis intersecting the group centroids.     

Negative reinforcement with shock-frequency increase

Two avoidance-conditioning experiments in which responding delayed shocks are reported. Rats receiving an average of two shocks per minute (imposed condition) could produce, by pressing a bar, a 3-min alternate condition. Six (Experiment I) or more (Experiment II) shocks occurred in the alternate condition. All shocks in the alternate condition were delayed and delivered at 1-sec intervals. With long delays, all subjects produced the alternate condition and spent a large percentage of each session in the alternate condition. The first experiment demonstrated that the longer the delay from onset of the alternate condition to onset of the shocks, the more session time spent in the alternate condition. The second experiment indicated that despite increased shock frequency, behavior is acquired and maintained when responding leads to sufficient delay. Individual subjects produced the alternate condition by bar pressing in essentially one of two patterns. One pattern, termed postshock, involved bar pressing immediately after shock; the other, termed posttransition, involved responding immediately after the transition from the alternate to the imposed condition. These results indicate that shock-frequency reduction is not necessary for avoidance conditioning; delay to shock onset is sufficient.     

Influence of a 14-day regimen of electrical stimulation involving large portions of the cerebral mass on later habit acquisition in the rat

Four groups of rats, one of which served as a normal, nonoperated group, were used. The other three groups were operated and fitted with an electrode carrier of eight electrodes of varying lengths arranged in a 7.5 mm X 5 mm rectangle. About 10 or 12 days after surgery, the following groups of animals underwent a 14-day regimen wherein each animal spent 15 min in a deep, metal, electrically insulated cylinder: Group A, normal, nonoperated group, with no intervention; Group B, stimulated each day with 45 trains of rectangular biphasic pulses (3 trains per min) at the rate of 20 pulses per second (pps); Group C, the same but at the rate of 100 pps; Group D, the same but 180 pps. After a 48-hr fast and without benefit of shaping, each animal was placed for 60 min in a lever-pressing device and was rewarded with a pellet after each three to four presses. The resulting performance curves showed no improvement in pressing rate for Group A; marginal improvement for Group B; definite improvement for Group C; and the greatest improvement for Group D, the terminal rate being almost twice that of Group C.     

SOME RELATIONS BETWEEN CLASSICALLY CONDITIONED AGGRESSION AND CONDITIONED SUPPRESSION IN SQUIRREL MONKEYS

During three experiments with squirrel monkeys, stimulus and shock pairings were given in the presence of a bite tube. Experiments 1 and 2 used a conditioned-suppression procedure in which bar pressing was reinforced with food. A transparent shield prevented biting of the bar. When the stimulus was paired with shock, bar pressing decreased (conditioned suppression) and tube biting increased during the stimulus (classically conditioned aggression). When the bite tube was removed on alternate sessions in Experiment 2, there was more suppression when the tube was present, thus suggesting that biting competed with bar pressing. However, this simple competing-response interpretation was complicated by the findings of Experiment 3 where, with naive monkeys, bar pressing was never reinforced with food, yet bar pressing was induced during the stimulus and was highest when the bite tube was absent. The fact that stimulus-induced bar pressing developed indicates that bar pressing in conditioned-suppression procedures, suppressed or not, may be maintained by two types of control—the food reinforcer and induced CS control. The higher rate of induced bar pressing during the stimulus with the bite tube absent confounds a simple competing response interpretation of conditioned suppression. It suggests that shock-induced responses during conditioned suppression could be both contributing to and competing with responding maintained by food, with the net effect depending on specific but ill-defined features of the situation.