Differential Conditioning Based on a Difference in the Predictability of Reinforcement

A Pavlovian procedure containing a set of several alternative reliable trial stimuli and a set of several alternative unreliable trial stimuli was used to determine if reliability of outcome, per se, would differentially condition additional trial stimuli that either preceded or followed those original trial stimuli in a serial conditioning paradigm. The reinforcing effectiveness of the antecedent stimuli themselves was later tested in a higher-order conditioning design. It was found that different rates could be established to the different antecedent stimuli in the absence of a difference in the probability of reinforcement. Further, stimuli paired with those antecedent stimuli in the higher-order conditioning test also exhibited a difference in rate. It was concluded that a combination of a stimulus that is always followed by food and another that is never followed by food are, in net, a more effective reinforcer than a common stimulus that has the same overall probability of reinforcement but which is followed by both outcomes.     

Revisiting the learning-without-awareness question in human pavlovian autonomic conditioning: Focus on extinction in a dichotic listening paradigm

Numerous studies have indicated that, consistent with current “cognitive” accounts of information processing, human Pavlovian autonomic discrimination acquisition cannot occur without awareness of the CS-US relationship. However, extinction studies have suggested that awareness is not necessary, findings that, in information-processing terms, have been explained by assuming that the processing by the extinction stage is parallel (automatic) rather than serial (controlled). This explanation was tested in an 80-subject study. The first, acquisition phase was a standard semantic differential conditioning arrangement with a 96-db white noise as US, and a “long” CS-US interval of 8 s, with ten trials each of CS+ (paired with US) and CS− (unpaired) trials. In extinction (USs omitted), in order to obtain non-autonomic indices of processing and thereby test the information-processing account of “unaware” autonomic conditioning during extinction, a dichotic listening task was implemented, with the CSs presented in the unattended channel (ear), while the subject had to perform a semantic differential reaction task in an attended-to channel (other ear). In early extinction, the electrodermal response occurring at an interval of 9–15 s after CS onset (i.e., following placement of the US during acquisition) and the finger-pulse-volume response occurring at an interval of 4–11 s after CS onset both showed reliable conditioning, but reaction-time and subjective-report data for the recognized critical words indicated serial rather than parallel processing of the CSs during extinction.     

The effect of on‐ or off‐line extinction of a first‐order conditioned stimulus on a second‐order conditioned response in rats

In a water‐licking experiment with rats, the effects of the extinction of a first‐order conditioned stimulus (CS1) on the suppression of licking established for a second‐order conditioned stimulus (CS2) were explored. Extinction of the first‐order conditioned response (CR1) attenuated the conditioned suppression induced by CS2 when the rats had been allowed to lick water during the CR1 extinction phase. However, if water had been unavailable during the CR1 extinction phase, suppression by CS2 was not affected. The latter result is consistent with other studies of rats' conditioned suppression and suggests that the underlying mechanism of second‐order conditioning in this experiment is a connection between CS2 and the response elicited by CS1 rather than a CS2‐CS1 connection. The former result was interpreted as the CR1 extinction phase encouraging the rats to lick water despite the fear elicited by CS1, and thus, in testing, they licked despite the fear elicited by CS2.     

实验性恶心与呕吐——大脑皮层与内脏相关研究的新途径

大脑皮层与内脏关系的脑机制是揭示心身疾病和心理疾病的重要依据。本文综述了经典条件学习与期待性恶心与呕吐的关系以及实验性恶心与呕吐的研究方法。作者认为,实验性恶心与呕吐结合脑成像技术是研究大脑皮层与内脏关系神经机制的重要途径。     

创伤后应激障碍的动物模型及其神经生物学机制

创伤后应激障碍是指个体由于经历对生命具有威胁的事件或严重的创伤,导致症状长期持续的精神障碍。研究创伤后应激障碍的主要动物模型为条件性恐惧和应激敏感化模型。研究表明,创伤后应激障碍中长时程留存的恐惧性记忆、高唤醒等症状与大脑杏仁核、内侧前额叶皮层和海马三个脑区及下丘脑-垂体-肾上腺轴负反馈功能增强密切相关。其中杏仁核活动增强是条件性恐惧记忆获得、保持和表达的关键神经基础。内侧前额叶皮层对杏仁核的去抑制及海马向杏仁核传递的威胁性环境信息,促进创伤后应激障碍症状的出现。在经历创伤应激后糖皮质激素受体的上调及多巴胺活动的增强是创伤后应激障碍产生的主要神经基础。对创伤后应激障碍的药物治疗研究证明多巴胺D2受体在改善患者症状中的作用比较重要,但仍需作更深入的探索     

Control of myoelectrical responses through reinforcement

A classic experiment by Hefferline, Keenan, and Harford (1959) showed that small thumb-twitches, imperceptible to the subject, can be controlled by the consequences of terminating and/or postponing aversive noise. These findings were further investigated in three experiments reported here. Experiment 1 replicated the original study. Experiment 2 was a control study in which stimulus changes were presented as in Experiment 1, but independently of the responses. Under these conditions the response rate varied over a large range with no systematic relation to experimental events. The increments in response rate reported by Hefferline et al. were within the present range of variation, suggesting that conditioning in the earlier study may have reflected a consistency in the direction of change rather than an increase in rate beyond the baseline range. In the present experiment, however, the rate increase was absolute. In Experiment 3, analog rather than binary changes in stimulus conditions were used as reinforcement. Under these conditions, the rates of subjects whose responses were conditioned fell from 78% (in the previous experiment) to 31%.     

Ontogeny of early event memory: II. Encoding and retrieval by 2- and 3-month-olds

The ability of 2-month-old infants to discriminate changes in a 5-object crib mobile following a retention interval of 24 hr was assessed using the mobile conjugate reinforcement paradigm. Infants were trained in 3 daily 15-min sessions to produce mobile movement by footkicking. Twenty-four hr later, independent groups received generalization tests with mobiles containing 1–5 novel objects substituted into their original training mobile. A control group was tested with the original training mobile. These findings were compared with findings of 2 previous studies involving identical procedures with 3-month-olds, reanalyzed for measures of individual performance over successive test minutes. Although, in absolute terms, 2-month-olds had a flat generalization gradient relative to 3-month-olds, when each infant's kick rate during the generalization test was expressed relative to that infant's kick rate before, and at the end of, training, it was found that the generalization gradients of 2- and 3-month-olds were indistinguishable. The relative response measures indicated a surprising degree of specificity by both age groups: Test mobiles containing more than 1 novel object did not cue retrieval, but test mobiles containing no more than 1 new object yielded perfect retention and complete generalization. These data indicate that infants as young as 2 months are capable of encoding and maintaining a representation of the specific details of their training context for at least 24 hr and, after that delay, can perform fine discriminations based on the discrepancy between their test context and that representation.     

Responding of pigeons under variable-interval schedules of unsignaled, briefly signaled, and completely signaled delays to reinforcement

In Experiment 1, three pigeons' key pecking was maintained under a variable-interval 60-s schedule of food reinforcement. A 1-s unsignaled nonresetting delay to reinforcement was then added. Rates decreased and stabilized at values below those observed under immediate-reinforcement conditions. A brief stimulus change (key lit red for 0.5 s) was then arranged to follow immediately the peck that began the delay. Response rates quickly returned to baseline levels. Subsequently, rates near baseline levels were maintained with briefly signaled delays of 3 and 9 s. When a 27-s briefly signaled delay was instituted, response rates decreased to low levels. In Experiment 2, four pigeons' responding was first maintained under a multiple variable-interval 60-s (green key) variable-interval 60-s (red key) schedule. Response rates in both components fell to low levels when a 3-s unsignaled delay was added. In the first component delays were then briefly signaled in the same manner as Experiment 1, and in the second component they were signaled with a change in key color that remained until food was delivered. Response rates increased to near baseline levels in both components, and remained near baseline when the delays in both components were lengthened to 9 s. When delays were lengthened to 27 s, response rates fell to low levels in the briefly signaled delay component for three of four pigeons while remaining at or near baseline in the completely signaled delay component. In Experiment 3, low response rates under a 9-s unsignaled delay to reinforcement (tandem variable-interval 60 s fixed-time 9 s) increased when the delay was briefly signaled. The role of the brief stimulus as conditioned reinforcement may be a function of its temporal relation to food, and thus may be related to the eliciting function of the stimulus.     

CLASSICAL CONDITIONING OF DECREASES IN HUMAN SYSTOLIC BLOOD PRESSURE1

Decrease in human systolic blood pressure of 4.35 mm Hg (range: 0 to 12 mm Hg) were classically conditioned in normal and hypertensive subjects using a delayed conditioning paradigm in which a 30-sec auditory stimulus (the conditioned stimulus) was followed immediately by tilting the subject 15° head-down to elicit small decreases in blood pressure. Conditioning occurred within five trials. A control group demonstrated that sensitization of the reflex by repeated tilting could not account for the blood-pressure decreases associated with the conditioned stimulus in experimental subjects.     

Time-dependent changes in conditioned suppression

Time-dependent changes in a response following aversive conditioning were investigated using a conditioned suppression procedure in a within-subjects design. Four groups of pigeons received Pavlovian conditioning “off the baseline”, immediately followed by an operant task. During the Pavlovian phase, two groups received a forward pairing of a tone with shock, one group received a backward pairing, and one group received a truly random pairing. One of the forward pairing groups also received a delay between the Pavlovian and operant phases. For all groups, key pecking was reinforced on a variable-interval schedule during the operant phase. Testing sessions were identical to training sessions, except that the tone used during Pavlovian conditioning was presented either 0, 15, 30, 45, of 60 minutes after the operant phase began. Testing sessions in which the Pavlovian phase was omitted were also included. The results showed suppression to change as a function of the retention interval, with maximum suppression occurring at intermediate intervals. This U-shaped function was obtained for 11 of the 12 pigeons in the forward-pairing groups and for three of the five in the truly random group. Pigeons in the background pairing group did not show changes in suppression as a function of the retention interval.