SUPPRESSIVE AND FACILITATIVE EFFECTS OF SHOCK INTENSITY AND INTERRESPONSE TIMES FOLLOWED BY SHOCK

Although response‐dependent shock often suppresses responding, response facilitation can occur. In two experiments, we examined the suppressive and facilitative effects of shock by manipulating shock intensity and the interresponse times that produced shock. Rats' lever presses were reinforced on a variable‐interval 40‐s schedule of food presentation. Shock followed either long or short interresponse times. Shock intensity was raised from 0.05 mA to 0.4 mA or 0.8 mA. Overall, shock contingent on long interresponse times punished long interresponse times and increased response rates. Shock contingent on short interresponse times punished short interresponse times and decreased response rates. In Experiment 1, raising the range of interresponse times that produced shock enhanced these effects. In Experiment 2, the effects of shock intensity depended on the interresponse times that produced shock. When long interresponse times produced shock, low intensities increased response rates. High intensities decreased response rates. When short interresponse times produced shock, high shock intensities punished short interresponse times and decreased response rates more than low intensities. The results may explain why punishment procedures occasionally facilitate responding and establish parameters for future studies of punishment.     

Vicious-circle behavior in the Y maze

Laboratory rats were given escape training in both arms of a Y maze followed by extinction in one of four conditions: regular (no shock), punished (both arms containing a shock mid-segment), choice, or forced (one arm containing a shock mid-segment, one arm shock free). Subjects in the punished and forced conditions required more extinction trials than those in the regular extinction condition. The choice condition was intermediate and not significantly different from the others. Choice subjects avoided the shock by choosing the safe alley early and consistently during extinction, but some continued to run for many trials without further punishment. It was suggested that the number of punished trials early in extinction is related to persistence of running, and the results were discussed in relation to the Mowrer-Brown and the discrimination hypotheses.     

Rapid acquisition of discrete-trial lever-press avoidance: effects of signal-shock interval

Acquisition of discrete-trial lever-press avoidance learning was studied in three experiments. Experiment I compared a new training procedure, which produces rates of lever-press avoidance learning comparable to those obtained in shuttle boxes, with a “conventional”, less efficient training procedure. A factorial design was used to compare continuous versus intermittent shock and a long-variable versus a short-fixed signal-shock interval. Learning was best in the groups trained with the long and variable interval and poorest in those trained with the short and fixed interval. Type of shock had no effect. Experiment II separated the effects of duration from those of variability of the signal-shock interval. Fixed and variable intervals of 10 and 60 sec were tested and duration was the only significant factor. Experiment III addressed the effect of the differential opportunity to avoid provided by long signal-shock intervals by varying this interval from 10 to 60 sec in 10-sec steps. Only the 10-sec group showed slow acquisition relative to the others. Analysis of avoidance response latencies showed that the distributions for all groups were positively skewed and that skewness increased with increasing duration of the signal-shock interval. At intervals longer than 20 sec, the animals made progressively less use of their increased opportunity to respond. The data do not support the opportunity-to-respond interpretation of the effects of duration of signal-shock interval and suggest that some type of inhibitory process may block lever-press avoidance learning at intervals as short as 10 sec. The significance of these findings for species-specific defense reaction and preparedness theories was emphasized.     

Basolateral amygdala lesions do not prevent memory of context-footshock training

The present studies examined the effects of basolateral amygdala (BLA) lesions induced prior to or after context-footshock training on 48-h memory, using several retention measures. In experiment 1, male Sprague-Dawley rats with bilateral BLA lesions (NMDA, 12.5 mg/mL, 0.2 μL) were given footshock training in one compartment of a two-compartment alley. Rats were habituated to the alley and 24 h later were given two footshocks in the shock compartment. Retention was tested 48 h later, using latency to enter the shock compartment and time spent freezing as measures of memory. Two days later, they were tested again and received a footshock on each re-entry of the shock compartment prior to remaining in the safe compartment for 200 consecutive seconds. The BLA lesions did not block retention as assessed by freezing or number of re-entries of the shock compartment. In experiment 2, no prior habituation was given, and only one footshock was used for the training. BLA lesions did not block retention, as indicated by latencies to enter the shock compartment on a 48-h test or by number of entries of the shock compartment. Experiment 3 examined the effects of the GABA_A agonist muscimol infused into the BLA prior to the 48-h retention test. The muscimol infusions decreased retention test entrance latencies but did not block retention as assessed by the number of subsequent entries of the shock compartment. These findings provide additional evidence that an intact BLA is not required for the acquisition or retention of context-footshock training.     

The effects of early handling on the partial reinforcement extinction effect and the partial punishment effect in male and female rats

Handled (Day 1-22) and non-handled infantile Wistar rats were tested in maturity for the partial reinforcement extinction effect (PREE) and the partial punishment effect (PPE). In Experiments 1 and 2, mature male and female rats were trained to run in an alley for food reward on a 1-trial/day schedule. In the PREE paradigm (Experiment 1), the partially reinforced group (PRF) received reinforcement on a quasi-random 50% schedule, while the continuously reinforced group (CRF) received reinforcement on every trial. In the test stage, both groups were given extinction training. In the PPE paradigm (Experiment 2), the partially punished (PP) group received, together with continuous reinforcement, shocks on a quasirandom 50% schedule, while the continuously reinforced group was reinforced on every trial. In test, all animals were given both reinforcement and shock on every trial. In Experiment 1, PREE—i.e. increased resistance to extinction in the PRF as compared to the CRF group—was more pronounced in the handled animals. More specifically, no PREE was obtained in the non-handled males, and in the non-handled females the PREE was reduced compared to the handled females. The results of Experiment 2 revealed no effect of handling or sex on PPE, that is, increased resistance to punishment in the PP group as compared to the CRF group was evident in all four conditions. In Experiment 3, handled and non-handled male rats were tested for the PREE using a multi-trial procedure in an operant chamber. PREE was obtained in the handled but not in the non-handled animals. The implications of these results for the differential effects of handling on male and female rats and the distinction between the PREE and PPE paradigms are discussed.     

Resistance to extinction and punishment following training with shock and non-reinforcement: Failure to obtain cross-tolerance

Two experiments investigated the phenomenon of cross-tolerance between the partial reinforcement extinction effect (PREE) and the partial punishment effect (PPE). Three groups of rats were trained in acquisition to run in a straight alley. The continuously reinforced (CRF) group received a reward on every trial. The partially reinforced (PRF) group was rewarded on a quasi-random 50% schedule. The partially punished (PP) group received food reward on every trial but, in addition, received foot shocks of gradually increasing intensity in the goal box on a random 50% of the trials. In the test stage, half of the animals in each training condition were tested in extinction, where no reward was given on any of the trials, and the other half were tested in punishment, with both food and shock presented on each trial. Experiment 1 used a 1-trial/day procedure; Experiment 2 used a multi-trial procedure. In both procedures, clear PREE and PPE were obtained. In the 1-trial/day procedure, no cross-tolerance was evident: animals trained on a PRF or PP schedule did not show increased resistance to punishment and extinction, respectively. In the multi-trial procedure, only weak cross-tolerance was obtained in animals trained on partial reinforcement and tested in punishment.     

The effects of preexposure-test and conditioning-test intervals on the magnitude of latent inhibition

Using the conditioned taste aversion paradigm, two experiments were conducted to examine the effects of the interval between preexposure and test and that between conditioning and test on the magnitude of latent inhibition. Experiment 1 revealed that the degree of latent inhibition was attenuated when rats were given a 21‐day interval between preexposure and test. It was also found that this attenuation was more marked in subjects which were given conditioning immediately after preexposure than those which were conditioned shortly before the test. Retention interval between preexposure and test was reduced to 12 days in Experiment 2, and exactly the same pattern of results as those found in Experiment 1 was obtained. These findings suggest that the memory of conditioning as well as that of preexposure decreases its retrievability after a long retention interval, although the former is more retainable than the latter.     

An automated swim alley for small animals: II. Training and procedures

Experiments were conducted to establish training procedures and testing conditions that produce uniform and reliable swimming performance of rats in an automated swim alley. Data are given on the effect of water temperature and of platform rest interval on swimming speeds. In this system, rats will swim intermittently for as long as 24 h for a distance of more than 7 km.     

Reinforcement and the organization of behavior in golden hamsters: Punishment of three action patterns

Golden hamsters received free shock (Experiment 1) or they were partially (Experiments 2 and 3) or continuously (Experiments 4 and 5) punished with mild electric shock for face washing, open rearing, or scrabbling. Punishment immediately and enduringly reduced the time engaged in scrabbling and the number and length of its bouts. Face washing was also clearly associated with shock, since effects specific to the contingency between face washing and shock were retained when shock was discontinued, but under some conditions punishment increased the number of bouts of face washing. Open rearing was the most refractory of the three activities to suppression and showed least evidence of retaining the effects of punishment. This pattern of results differs from that found previously when food reinforcement was given for the same activities. It is discussed in terms of constraints on performance of learned associations by a variety of response-specific and reinforcer-specific motivational factors.     

老年人错误记忆的情绪效价和时间效应

基于信号检测论的框架, 考察不同的情绪效价以及时间间隔如何交互影响老年人在图片再认任务中的辨别力(d′)和判断标准(β), 进而影响其错误记忆。以21名老年人(女性14名)为被试, 平均年龄67.17 ± 5.03岁。根据中国老年人对国际情绪图片库(International Affective Picture System, IAPS)中图片评定的情绪参数, 选出积极、消极和中性图片各60张作为学习材料。另选积极、消极和中性图片各30张作为每次再认测验的干扰材料, 并且两次再认测验的干扰材料不同。短时间隔条件让老年人在图片记忆编码半个小时后完成对图片的再认测验; 长时间隔条件则为在三周后完成对图片的再认测验。结果发现: 1)在短时间隔条件下, β和d′共同影响虚报率; 而在长时间隔条件下, 只有β影响虚报率, d′不影响虚报率; 2)无论是在短时还是长时间隔条件下, 积极图片与消极图片的判别力d′都没有显著差别; 3)在短时间隔条件下, 老年人对消极图片的β更低、虚报率更高; 在长时间隔条件下, 老年人对积极图片的β更低、虚报率更高。研究结果表明: 老年人的错误记忆受判别力d′和判断标准β的影响。情绪效价通过作用于老年人的反应倾向(判断标准β)、而非记忆质量(判别力d′)来影响其错误记忆。时间间隔可以调节情绪效价对老年人判断标准β和错误记忆的作用, 使之随时间发生反转。老年人的“积极效应”在错误记忆中可能表现为随着时间的流逝, 老年人更愿意将积极信息报告为经历或学习过的信息。     

Retention of Conditioned Inhibition Produced by Extinction

Rats in a flavor aversion procedure were used to examine the extent to which an extinguished CS can pass a retardation and summation test for conditioned inhibition after either a short or a long retention interval. Rats were given a single pairing of a flavored solution with LiCl, and then received a large number of CS-alone extinction trials. Following extinction, some subjects received a 3-week retention interval following extinction while others did not. Extinction produced evidence of conditioned inhibition on both tests when a short retention interval occurred following extinction. However, conditioned inhibition was attenuated by the long retention interval when assessed with a retardation test, but no effect of the long retention interval was observed when inhibition was evaluated with a summation test.     

Resistance to satiation: Reinforcing effects of food and eating under satiation

It has been shown previously that rats which have learned a response when hungry will continue to make that response when tested satiated, a phenomenon labeled resistance to satiation. Here we showed that rats which were previously trained hungry will learn a new response for the opportunity to consume pellets in a new situation when tested satiated. In four experiments various groups received each of the components of the training given when rats learn an instrumental response when hungry. Rats were placed in the goalbox of a straight alley and given food pellets when hungry or were hungry only in their home cages prior to running a straight alley in the satiated test in Experiment 1. In Experiments 2, 3, and 4 learning of a differential conditioning problem for pellets in S+ (nonreward in S?) was measured in the satiated test. Groups given pellets in their home cages when hungry with or without alley exposure learned to run more rapidly in S+ than in S? in the satiated test phase. The tendency to eat pellets in the apparatus and the reinforcing effect of eating the pellets was larger for rats which ate the pellets when hungry in their home cage than for rats which ate the pellets when satiated in their home cage. Being hungry in the home cage with no pellets was not sufficient to produce eating or running for pellets in the satiated test, indicating that any inherent reinforcing effect of the pellets is not sufficient to produce eating or running, and that incomplete satiation cannot account for the learning. These data indicate that a reinforcing effect of eating pellets under satiation is an important determiner of resistance to satiation.     

Lick-shock contingencies in the rat

Hungry rats were allowed to lick an 8% sucrose solution and then one of four lick-shock contingency conditions was superimposed on the licking baseline. These conditions were: free-operant avoidance, free shock, punishment, and no shock. From highest to lowest response rates, the groups fell in the order-avoidance, no shock, free shock, and punishment. Lick rates adjusted rapidly to introduction and removal of the contingencies. Post-shock responding was lowest in the punishment condition and highest in the free shock condition. No method was found simultaneously to equate shock frequency and separate response rates for the three shock contingency conditions. Only small, or no, reductions in shock rate occurred over sessions under the free-operant avoidance schedule when the shock-shock interval was 10 sec but large reductions occurred when the shock-shock interval was reduced to either 1 or 2 sec.     

时间延迟对故事情境关联虚假记忆的影响

研究以故事情境短文为实验材料,探讨了即时与延时48h后虚假记忆变化表现及其与真实记忆相分离的认知神经机制。结果表明,虚假记忆在延迟48h后诱发的LPC走向比即时更正性;即时条件虚假记忆与真实记忆认知加工相分离表现在有意回想加工及额叶后提取加工阶段,延迟48h后仅表现在额叶后提取加工阶段。上述结果为虚假记忆存在随时间变化及其与真实记忆相分离提供了电生理证据。     

A comparison of several procedures for eliminating behavior

The pecking response of pigeons was reinforced when a minimum period of time had elapsed since the last response (DRL schedule of food-reinforcement). Punishment, satiation, extinction, and stimulus change were employed separately to reduce responding. When the effects of the four procedures were compared, punishment was found capable of producing a more immediate, complete and long lasting response reduction than the others. Punishment had its maximum effect on the responses that were least relevant to reinforcement. The punishment reduced the frequency of the short inter-response times to a greater extent than did either extinction or satiation. In this way, punishment actually increased the efficiency of the DRL responding.     

Place avoidance learning and memory in a jumping spider

Using a conditioned passive place avoidance paradigm, we investigated the relative importance of three experimental parameters on learning and memory in a salticid, Servaea incana. Spiders encountered an aversive electric shock stimulus paired with one side of a two-sided arena. Our three parameters were the ecological relevance of the visual stimulus, the time interval between trials and the time interval before test. We paired electric shock with either a black or white visual stimulus, as prior studies in our laboratory have demonstrated that S. incana prefer dark ‘safe’ regions to light ones. We additionally evaluated the influence of two temporal features (time interval between trials and time interval before test) on learning and memory. Spiders exposed to the shock stimulus learned to associate shock with the visual background cue, but the extent to which they did so was dependent on which visual stimulus was present and the time interval between trials. Spiders trained with a long interval between trials (24 h) maintained performance throughout training, whereas spiders trained with a short interval (10 min) maintained performance only when the safe side was black. When the safe side was white, performance worsened steadily over time. There was no difference between spiders tested after a short (10 min) or long (24 h) interval before test. These results suggest that the ecological relevance of the stimuli used and the duration of the interval between trials can influence learning and memory in jumping spiders.     

Shock preexposure and the reduced effectiveness of shock

In three experiments experience with shock was shown to reduce the effectiveness of shock as a reinforcer or motivator. In Experiment 1 rats were given signaled shock in a box separate from the runway where they were subsequently punished. These rats were less suppressed by shock punishment than rats that had no previous shock experience. In Experiment 2 preshocked rats were less suppressed by punishment and were slower to learn an escape-avoidance response than nonpreshocked rats, whether the preshock was signaled or unsignaled. In Experiment 3 as number of CS-shock pairings increased, fear of the CS decreased as did fear of the context. These results suggest that some central adaptation process produced by experience with shock reduces the effectiveness of shock as a reinforcer whenever shock is used repeatedly. This is independent of other effects, such as context blocking, that can affect responding after shock preexposure.     

The effect of feedback stimuli on contextual fear depends upon the length of the minimum intertrial interval

The present experiments investigated the effects of manipulation of the minimum intertrial interval (ITI) on the ability of a feedback stimulus to reduce the amount of fear conditioned to the shock context. In Experiment 1, we found that animals exposed to yoked shock with a feedback stimulus were equivalent to animals which received escapable shock, and both these groups showed less fear of the shock context than did yoked animals not given feedback, when a minimum ITI of 60 s was used. This replicated the effect of feedback on contextual fear conditioning. However, animals exposed to yoked shock with a feedback stimulus but for whom the minimum ITI was 5 s showed as much fear of the context as yoked animals not given feedback. Experiment 2 assessed whether this difference was solely due to the lower minimum ITI resulting in more fear than the 60-s minimum ITI, or whether the lower minimum ITI precluded the effect of feedback. The former possibility was discounted. Thus, these studies demonstrate that a relatively long minimum ITI is essential for the observance of a feedback effect on fear of the shock context.     

Discriminated punishment: avoidable and unavoidable shock

Warning stimuli for two punishment conditions were alternated with periods of appetitive responding by rats. In either warning stimulus, the first response produced a brief shock, terminated the stimulus, and started an interval during which the baseline appetitive schedule was in effect. Not responding resulted in stimuli of random duration, which terminated with a shock under one condition and without a shock under the other. Each subject was exposed to several shock intensities, with trials for the two conditions programmed during alternate portions of the session. In general, response frequency in the warning signal for either condition decreased with increasing intensity; however, at a given intensity, responding was more frequent in the stimulus invariably terminating with shock than in the stimulus terminating without shock when no response was made. The frequency difference was greatest at intensities intermediate between those producing minimal and maximal suppression.     

Predator videos and electric shock function as punishers for zebrafish (Danio rerio)

Zebrafish (Danio rerio) are a promising animal model for studying the effects of gene–environment interactions on behavior. Two experiments were conducted to assess punishment effects of presenting predator videos (Indian leaf fish; Nandus nandus) and electric shock on operant approach responses in zebrafish. In Experiment 1, the predator video and shock stimuli were presented upon a response maintained by a single variable‐interval schedule of food reinforcement in different groups of fish. In Experiment 2, the predator video and shock stimuli were presented upon one of two response alternatives maintain by concurrently available variable‐interval schedules of food reinforcement in different groups of fish. Responding decreased when the predator video and shock stimuli were presented relative to their absence in both experiments. Moreover, responding on an unpunished alternative did not reliably decrease in Experiment 2. These results indicate that the decrease in responding resulted from the punishment contingency rather than from elicited species‐specific defense responses or conditioned avoidance. Thus, the predator video and electric shock functioned as punishers of operant behavior for zebrafish. Identifying punishers for this species could lead to research on how gene–environment interactions influence individual differences in sensitivity to punishment.