Reward schedule effects in extinction: Intertrial interval, memory, and memory retrieval

Rats were trained in a runway such that partial reward occurred on Trial 1 of the day and consistent reward on subsequent massed trials (Group PRT1), or consistent reward occurred on Trial 1 of the day and partial reward on subsequent massed trials (Group PRTM). Under spaced (24-hr) extinction, Group PRT1 was more resistant to extinction than Group PRTM and under massed (1-min) extinction, Group PRTM was more resistant to extinction than Group PRT1. These findings suggest that (a) distinctive stimuli are associated with Trial 1 of the day and with subsequent massed trials, (b) these distinctive stimuli function as retrieval cues for memories, memory retrieval being independent of intertrial interval, and (c) behavior in extinction is controlled by a stimulus compound consisting of the memory of nonreward plus stimuli which accompany the memory of nonreward on rewarded acquisition trials.     

The role of instrumental responding and contiguity of stimuli in the development of infant secondary reinforcement

Ten-month-old infants received contingent pairings of a tone (T+) and food reinforcer. Groups S^r and S^D received the food on an FI 23-sec schedule for target touching, the former group receiving T+ immediately after the response and 1.5 sec prior to food and the latter group receiving T+ at the end of the intertrial interval. Group SC received food reinforcers 1.5 sec after T+ with no response required. A second tone (Tⁿ) was heard by all groups once during each intertrial interval, at randomly determined points. All groups subsequently were given a spatial discrimination task, receiving T+ for one alternative and Tⁿ for the other. Group S^r gave significantly more responses for T+ than for Tⁿ, but neither of the other two groups produced a superiority for T+. Thus, both contiguity with a primary reinforcer and the presence of an operant during training appear to be necessary for a neutral signal to acquire the ability to enhance responding.     

Effects of overtraining on reversal learning by rats in concurrent and single discriminations

Two experiments examined the whole-partial effect of overtraining in concurrent discriminations and assessed the effect against single discrimination training in rats. In Experiment 1 overtraining facilitated reversal in Group W, in which rats were given concurrent training on two simultaneous discrimination tasks (A and B) in original learning before both tasks were reversed. By contrast, overtraining delayed reversal in Group P, in which animals were given the same training as in Group W in original learning, but only Task A was reversed. After overtraining, Group W reversed more rapidly than Group P. Without overtraining, Group P reversed more rapidly than both Group W and Group C, in which animals were trained only on Task A before this task was reversed. Experiment 2 investigated the effects of overtraining on the reversal of a successive discrimination in Groups W, P, and C. In addition, animals in a further group, Group S, received the same concurrent training as Group W before Task B was omitted and Task A reversed. Overtraining facilitated reversal in Groups W, C, and S but delayed it in Group P. After overtraining, Group W reversed more rapidly than Groups P, S, and C. Both Groups S and C also reversed more rapidly than did Group P. Without overtraining, Group P reversed more rapidly than Groups W, S, and C. There were no significant differences in reversal performance among Groups W, S, and C. These findings indicate that the effects of overtraining on reversal learning in concurrent discriminations differ from those observed in single discriminations.     

Repetition and alternation in rats

An experiment is reported in which rats were forced equally often to each arm of a T-maze, and, following each forced trial, were given a free trial. Group R were rewarded for repeating (i.e. choosing the side to which they had just been forced), group A for alternating. All rats began by alternating, but group R eventually learned to repeat. Various delays between free and forced trials were introduced, and the forgetting curve was found to be similar for the two groups. It is argued that these results show: (i) The decline in alternation with delay found in experiments on spontaneous and rewarded alternation is due to loss of information rather than a decline in the alternation tendency. (ii) The trace involved is sufficiently general to be regarded as a memory trace. The fact that rats can learn to repeat is inconsistent with the accounts of the memory trace suggested by the theories of Deutsch and Walker.     

Stimulus control of responding in the early trials of differential conditioning

In Experiment 1 two groups of rats were given 12 differential conditioning trials, seven to the rewarded alley (S+) and five to the nonrewarded alley (S?), prior to being extinguished in both alleys. Group S?S+ received S+ trials, following S? trials in acquisition, while Group S+S? did not receive S+ trials following S? trials in acquisition. In extinction S+ and S? trials were presented according to a quasi-random sequence for both groups. Running on the last 3 trials of acquisition was found to be faster following S+ than following S? trials. Group S?S+ showed greater resistance to extinction and less discriminative responding in extinction than Group S+S?. These results suggest that responding in differential conditioning is controlled not merely by S+ and S? but by the memories of reward (S^R) and of nonreward (S^N) as well. When the joint effects of both classes of cues were considered, e.g., S^R+S+, responding in the early trials of differential conditioning was shown to be highly orderly. Experiment 2 was highly similar to Experiment 1 except that Groups S?S+ and S+S? were equated along dimensions not equated in Experiment 1. The results obtained in Experiment 2 were highly similar to those obtained in Experiment 1.     

Relative time in dangerous and safe places influences one-way avoidance learning in the rat

This paper reports three experiments on one-way avoidance learning in rats which examined the effect of time spent in the safe and dangerous compartments on acquisition, maintenance, and extinction of avoidance. In Experiment 1 time spent in safety was manipulated, and time spent in danger was held constant. Animals spending more time in safety needed fewer trials to reach the acquisition criteria and more trials to reach the extinction criteria; both effects became stronger as the required criteria for acquisition and extinction were increased. In Experiment 2 time spent in safety/danger was manipulated while holding the intertrial interval constant. Groups simultaneously spending more time in safety and less time in danger again needed fewer trials to reach the learning criteria. In Experiment 3 time spent in danger was manipulated, whereas time spent in safety was held constant. Groups spending less time in danger needed fewer trials to reach the learning criteria. These results indicate that the magnitude of the reinforcement or incentive value of the safety compartment is not a linear function of absolute time spent therein, but a function of the ratio between the length of time spent in safety and in danger.     

Randomized controlled trial of yogic meditation techniques for patients with obsessive-compulsive disorder

The objective of this study was to compare efficacy of two meditation protocols for treating patients with obsessive-compulsive disorder (OCD). Patients were randomized to two groups-matched for sex, age, and medication status-and blinded to the comparison protocol. They were told the trial would last for 12 months, unless one protocol proved to be more efficacious. If so, groups would merge, and the group that received the less efficacious treatment would also be afforded 12 months of the more effective one. The study was conducted at Children's Hospital, San Diego, Calif. Patients were selected according to Diagnostic and Statistical Manual of Mental Disorders, Third Edition-Revised (DSM-III-R) criteria and recruited by advertisements and referral. At baseline, Group 1 included 11 adults and 1 adolescent, and Group 2 included 10 adults. Group 1 employed a kundalini yoga meditation protocol and Group 2 employed the Relaxation Response plus Mindfulness Meditation technique. Baseline and 3-month interval testing was conducted using the Yale-Brown Obsessive Compulsive Scale (Y-BOCS), Symptoms Checklist-90-Revised Obsessive Compulsive (SCL-90-R OC) and Global Severity Index (SCL-90-R GSI) scales, Profile of Moods scale (POMS), Perceived Stress Scale (PSS), and Purpose in Life (PIL) test. Seven adults in each group completed 3 months of therapy. At 3 months, Group 1 demonstrated greater improvements (Student's independent groups t-test) on the Y-BOCS, SCL-90-R OC and GSI scales, and POMS, and greater but nonsignificant improvements on the PSS and PIL test. An intent-to-treat analysis (Y-BOCS) for the baseline and 3-month tests showed that only Group 1 improved. Within-group statistics (Student's paired t-tests) showed that Group 1 significantly improved on all six scales, but Group 2 had no improvements. Groups were merged for an additional year using Group 1 techniques. At 15 months, the final group (N=11) improved 71%, 62%, 66%, 74%, 39%, and 23%, respectively, on the Y-BOCS, SCL-90-R OC, SCL-90-R GSI, POMS, PSS, and PIL; P<0.003 (analysis of variance). This study demonstrates that kundalini yoga techniques are effective in the treatment of OCD.     

Acquisition and reversal of a discriminated autoshaped response in male and female rats: Effects of long or short and fixed or variable intertrial interval durations

Groups of male and female Wistar rats were exposed to autoshaping procedures in which the duration (50 vs 20 s) and the variablity (fixed vs variable) of the intertrial interval were manipulated. Pellet delivery occurred after one of the levers (CS+) had been presented for 10 s. Presentation of the other lever (CS−) was not associated with pellet delivery. CS+ contacts occurred more frequently and at higher rates when the intertrial interval was 50 s than when it was 20 s, while intertrial interval variability did not play an important role. Males contacted CS+ and CS− more frequently and at a higher rate than did females. Goal-directed activity (nose pokes in feeder tray) occurred more often when the intertrial interval was short than when it was long. Females showed higher goal-directed activity than did males, both during CS presentation and during the intertrial interval. When experimental contingencies were reversed, CS+ contacts decreased and CS− contacts increased for males and females, but the decrease in CS+ contacts occurred more slowly for males than for females. The results of these experiments add to a growing body of literature suggesting the existence of fundamental behavioral differences between the sexes. These differences are partly attributable to the influence of gonadal hormones during development and maturation and partly attributable to the behavioral requirements of the experimental procedures.     

Massed and spaced learning in honeybees: the role of CS, US, the intertrial interval, and the test interval

Conditioning the proboscis extension reflex of harnessed honeybees (Apis mellifera) is used to study the effect temporal spacing between successive conditioning trials has on memory. Retention is monitored at two long-term intervals corresponding to early (1 and 2 d after conditioning) and late long-term memory (3 and 4 d). The acquisition level is varied by using different conditioned stimuli (odors, mechanical stimulation, and temperature increase at the antenna), varying strengths of the unconditioned stimulus (sucrose), and various numbers of conditioning trials. How learning trials are spaced is the dominant factor both for acquisition and retention, and although longer intertrial intervals lead to better acquisition and higher retention, the level of acquisition per se does not determine the spacing effect on retention. Rather, spaced conditioning leads to higher memory consolidation both during acquisition and later, between the early and long-term memory phases. These consolidation processes can be selectively inhibited by blocking protein synthesis during acquisition.     

More Than Words: Fast Acquisition and Generalization of Orthographic Regularities During Novel Word Learning in Adults

In literates, reading is a fundamental channel for acquiring new vocabulary both in the mother tongue and in foreign languages. By using an artificial language learning task, we examined the acquisition of novel written words and their embedded regularities (an orthographic surface feature and a syllabic feature) in three groups of university students with different exposures (Group 1 saw 2 words once, Group 2 saw 20 words once, Group 3 saw 20 words three times). Recognition memory results for Groups 2 and 3 indicated that adults can learn novel written words even with just a single exposure, albeit repeated exposure improved target detection. A generalization task revealed that even the minimal exposure in Group 1 was enough for acquisition of the two embedded regularities. More exemplars and repeated exposure provided more robust effects for the syllable regularity. Finally, post-test interview showed that repeated exposure was needed to become aware of the regularities. The present results show that adults learn novel written words and their inherent regularities in a fast and effective fashion.     

Cognitive performance is highly sensitive to prior experience in mice with a learning and memory deficit: failure leads to more failure

The impact of a previously successful or unsuccessful experience on the subsequent acquisition of a related task is not well understood. The nature of past experience may have even greater impact in individuals with learning deficits, as their cognitive processes can be easily disrupted. Mice with a targeted disruption of the alpha and delta isoforms of the cAMP-response element-binding protein (CREB) gene (CREB(alphadelta-)-deficient mice) have a genetic vulnerability to impaired learning and memory that is highly influenced by experimental conditions. Thus, we studied the impact of prior successful and unsuccessful experiences on the degree to which CREB(alphadelta-)-deficient mice exhibit impaired spatial learning and memory in the Morris water maze (MWM). In Experiment 1, we replicated the cognitive deficit of CREB(alphadelta-)-deficient mice when given two trials per day with a 1-min intertrial interval (MWM2), and labeled this experience as a "failure." We rescued the deficit using four trials per day with a 3- to 5-min intertrial interval (MWM4) and labeled this experience a "success." In Experiment 2, a new, naive set of wild-type (WT) and CREB(alphadelta-)-deficient mice were randomly assigned to one of two sequence protocols to assess the influence of a success or a failure on subsequent performance. In Group 1, mice were first exposed to the MWM4 condition, followed by the more difficult MWM2 task. As expected, CREB(alphadelta-)-deficient mice performed well in the MWM4; they also performed well during reversal testing (MWM4R) where the goal location is changed. With this initial successful learning experience, the CREB(alphadelta-)-deficient mice then performed as well as WT mice in the MWM2, the condition in which they are known to be impaired. In contrast, CREB(alphadelta-)-deficient mice in Group 2 had an unsuccessful experience when first exposed to the MWM2 condition, and then also showed impairment in the MWM4, the condition in which they would normally perform well. This deficit was amplified when CREB(alphadelta-)-deficient mice were then tested in the reversal test. Sex differences in learning among CREB(alphadelta-)-deficient mice were amplified upon exposure to an unsuccessful learning experience. These data indicate that, under conditions of cognitive impairment, past experience can-depending on its nature-significantly facilitate or hinder future performance.     

Influence of two types of information trials on the formation of a discrimination-reversal learning set in Japanese monkeys

Abstract: Three groups of male adult Japanese monkeys were trained in 30 discrimination-reversal learning-set (LS) problems using the Wisconsin General Test Apparatus. A control group ( N = 3) was trained in the standard procedure: acquisition of up to 12 consecutive correct responses, reversal to the same criterion, and then shift to a new problem. To the other two groups, three information trials signaling the stimulus value in reversal were given after they reached the criterion in acquisition. Subjects in the positive-stimulus information (PSI) group ( N = 4) were exposed only to the reversal positive stimulus, and a response to it was rewarded. Subjects in the negative-stimulus information (NSI) group ( N = 4) were exposed only to the reversal negative stimulus, and any response to it was not rewarded. Information trials reduced reversal errors and NSI trials were more effective than PSI trials in error reduction ( p < .05). Information trials also aided in acquisition: the NSI and PSI groups learned the acquisition phase of the problems with significantly fewer errors than control group ( p < .01) in the last stage of training. The implications of these results are discussed in relation to strategy learning and attention learning in LS formation.     

The effect of intertrial food presentations on anticipatory goal-tracking in the rat

Four experiments examined the sensitivity of anticipatory goal-tracking in the rat to stimulus-food contingency. Contingency was manipulated by varying the probability of food delivery in the absence of a food-tray-light or clicker conditional stimulus (CS), while holding constant the probability of food coincident with the CS. CS control of anticipatory food tray investigation was examined after a period of context extinction in all experiments. Acquisition of stimulus control was undermined by the scheduling of intertrial food deliveries (Experiment 1). The rate of intertrial food deliveries influenced subsequent acquisition of CS control when all intertrial food deliveries were omitted (Experiment 2). When intertrial food deliveries were added to the training regimen subsequent to acquisition of CS control, that control was impaired (Experiments 3 and 4).     

Differential runway performance using goal box placement and running trials as discriminative stimuli

Two experiments compared the effects of reinforced, partially reinforced and nonreinforced intertrial goal box placements (ITR, ITP, and ITN respectively) on runway performance. In Experiment I differential responding (animals running slower on nonreinforced (N) trials than on reinforced (R) trials) was observed during acquisition for subjects receiving ITP preceding N trials or subjects receiving ITP before R trials, and also for subjects receiving ITR preceding N trials. No differential responding was observed in subjects receiving ITP prior to both N and R trials or ITN prior to N trials. In extinction, the subjects which had responded differentially during acquisition demonstrated reduced resistance to extinction in comparison to the subjects which had not. In Experiment II, a 2 × 2 factorial design was utilized with placement schedule (ITN and ITP) and type of trial predicted by placement (N and R) serving as the factors. Differential responding was observed in all four groups. The apparent contradiction between the results and the discrimination hypothesis proposed by Capaldi and Olivier (1967) to explain the attenuation of ITR and ITN effects on resistance to extinction is discussed.     

Evaluating the effectiveness of workshop interventions on contraceptive use among first-year college students

This study tested the effectiveness of 4 interventions designed to affect contraceptive knowledge, attitudes, and use among first-year Syracuse University students in New York State in the US. Pre- and post-tests obtained data on demographic characteristics, sexual behavior, contraceptive knowledge, sexual opinions, contraceptive attitudes, and contraceptive progress on a 5-step scale. Group 1 (79 students) received contraceptive information (CI) only. Group 2 (76) received CI and a cognitively oriented intervention. Group 3 (73) received CI and an experience-oriented intervention. Group 4 (77) received a combined cognitively and experience-oriented intervention with CI. The control group included 57 people. 78% on the pretest, and 84% on the post-test, had engaged in sexual intercourse for the first time in high school. 200 indicated previous intercourse in the past 3 months. Groups varied significantly in their knowledge, beliefs, and practices. All groups had greater contraceptive knowledge than control groups. Greater behavior beliefs about contraceptive use occurred in Groups 1 and 2. Groups 3 and 4 showed greater increases in positive attitudes toward use. All intervention students showed greater increases in positive attitudes toward a contraceptive process. Greater increases in the intention to use birth control occurred in Groups 3 and 4. Groups 2, 3, and 4 showed greater increases in reported use of birth control. Group 4 intervention was the most effective for males. Females were influenced by all interventions. Findings affirm the importance of including attitudinal components in sexuality and contraception workshops.     

The effect of intertrial conditioned stimuli in autoshaping

Three autoshaping experiments, using pigeon subjects, examined the effect of presenting an S+ or an S- on acquisition to a different conditioned stimulus (CS). Experiment 1 found that signalling intertrial food with an S+ or an S- allowed acquisition of responding to the target-CS; however, that acquisition was slower when the signal was the S+. Experiment 2 found that even when the S+ or S- were presented without food in the intertrial interval, acquisition was slower in the group receiving the S+. Experiment 3 found that a similar, but weaker effect occurred when the S+ or S- stimuli were presented in the session prior to target-CS training, rather than intermixed. These results have implications for the interpretation of experiments that use a signalling manipulation to assess the interaction of CS and context in Pavlovian conditioning; they suggest that signalling unconditioned stimuli (USs) may have consequences other than that of modulating context-US learning.     

Short-term retention of response outcome as a determinant of serial reversal learning

The correlation between short-term retention of the outcome of the preceding response and overall learning proficiency was investigated for serial reversal learning. Pigeons were trained to asymptote on a serial reversal problem and then were presented a percentage reinforcement schedule where only some correct trials were rewarded. Nonrewarded correct trials were treated exactly as incorrect trials. The difference in error probability following the two types of correct trials was then used as a measure of short-term retention. When intertrial intervals (ITI) were short (6 sec), substantial differences occurred. When the ITI's were increased, the difference in accuracy declined regularly to no difference at an ITI of 60 sec. This demonstration of a short-term retention gradient, coupled with the finding that overall reversal learning was much better with the shorter ITI's, suggests that a primary mechanism of improvement in serial reversal learning is the acquisition of a conditional discrimination based on the outcome of the preceding response.     

Call-note discriminations in black-capped chickadees (Poecile atricapillus)

Bioacousticians (M.S. Ficken, S. R. Ficken, & S. R. Witken, 1978) classified black-capped chickadee call notes from the chick-a-dee call complex into 4 note types (A, B, C, and D) identified from sound spectrograms. In Experiment 1, chickadees (Poecile atricapillus) learned operant auditory discriminations both within and between the 4 note types but learned the between note-type discrimination significantly faster. In Experiment 2, when the original, unrewarded between-category exemplars were replaced with novel, rewarded exemplars of these same categories, chickadees showed transfer of inhibitory stimulus control to the novel exemplars. In Experiment 3, when novel exemplars were replaced by the original exemplars, chickadees showed propagation of positive stimulus control back to the original exemplars. This evidence suggests that chickadees and bioacousticians accurately sort conspecific call notes into the same open-ended categories (R. J. Herrnstein, 1990).     

Trial and intertrial durations in Pavlovian conditioning: issues of learning and performance

Four experiments assessed the effects of trial (T) and intertrial (I) durations on magazine approach behavior in rats. In Experiments 1 and 2, different groups of animals were conditioned with various combinations of I and T durations. The rate of acquisition, in terms of the number of trials required to reach various acquisition criteria, generally was faster in groups trained with large I:T ratios. There also were differences in rate of acquisition and terminal response rates between groups trained with identical I:T ratios but with different absolute I and T durations. Differences evident at the end of conditioning persisted during a common test with various combinations of I and T durations. Experiments 3 and 4 provided a more specific test of the predictions of 2 general classes of theories and found results that were consistent with those theories that characterize group differences as indicative of differences in learning, rather than in performance.     

The histone deacetylase inhibitor valproic acid enhances acquisition, extinction, and reconsolidation of conditioned fear

Histone modifications contribute to the epigenetic regulation of gene expression, a process now recognized to be important for the consolidation of long-term memory. Valproic acid (VPA), used for many years as an anticonvulsant and a mood stabilizer, has effects on learning and memory and enhances the extinction of conditioned fear through its function as a histone deacetylase inhibitor (HDAC). Here we report that VPA enhances long-term memory for both acquisition and extinction of cued-fear. Interestingly, VPA enhances extinction, but also enhances renewal of the original conditioned fear when tested in a within-subjects design. This effect appears to be related to a reconsolidation-like process since a single CS reminder in the presence of VPA can enhance long-term memory for the original fear in the context in which fear conditioning takes place. We also show that by modifying the intertrial interval during extinction training, VPA can strengthen reconsolidation of the original fear memory or enhance long-term memory for extinction such that it becomes independent of context. These findings have important implications for the use of HDAC inhibitors as adjuncts to behavior therapy in the treatment of phobia and related anxiety disorders.