Sensitization and habituation regulate reinforcer effectiveness

We argue that sensitization and habituation occur to the sensory properties of reinforcers when those reinforcers are presented repeatedly or for a prolonged time. Sensitization increases, and habituation decreases, the ability of a reinforcer to control behavior. Supporting this argument, the rate of operant responding changes systematically within experimental sessions even when the programmed rate of reinforcement is held constant across the session. These within-session changes in operant responding are produced by repeated delivery of the reinforcer, and their empirical characteristics correspond to the characteristics of behavior undergoing sensitization and habituation. Two characteristics of habituation (dishabituation, stimulus specificity) are particularly useful in separating habituation from alternative explanations. Arguing that habituation occurs to reinforcers expands the domain of habituation. The argument implies that habituation occurs to biologically important, not just to neutral, stimuli. The argument also implies that habituation may be observed in “voluntary” (operant), not just in reflexive, behavior. Expanding the domain of habituation has important implications for understanding operant and classical conditioning. Habituation may also contribute to the regulation of motivated behaviors. Habituation provides a more accurate and a less cumbersome explanation for motivated behaviors than homeostasis. Habituation also has some surprising, and easily testable, implications for the control of motivated behaviors.     

情绪记忆的神经基础

情绪记忆具有强烈、持久的特点,在记忆中具有优势地位。杏仁核是情绪记忆的关键脑区,其外侧核被认为是情绪回路建立的中心部位。恐惧条件反射是情绪记忆,特别是情绪回路研究的有效手段。情绪记忆的编码,储存与提取受到杏仁核与各相关脑区共同影响,其中激素调节在这些过程中发挥重要作用。文中结合最新的研究成果对情绪记忆的神经机制进行讨论     

The kinematics of belief and desire

Richard Jeffrey regarded the version of Bayesian decision theory he floated in ‘The Logic of Decision’ and the idea of a probability kinematics—a generalisation of Bayesian conditioning to contexts in which the evidence is ‘uncertain’—as his two most important contributions to philosophy. This paper aims to connect them by developing kinematical models for the study of preference change and practical deliberation. Preference change is treated in a manner analogous to Jeffrey’s handling of belief change: not as mechanical outputs of combinations of intrinsic desires plus information, but as a matter of judgement and of making up one’s mind. In the first section Jeffrey’s probability kinematics is motivated and extended to the treatment of changes in conditional belief. In the second, analogous kinematical models are developed for preference change and in particular belief-induced change that depends on an invariance condition for conditional preference. The two are the brought together in the last section in a tentative model of pratical deliberation. This paper is one of a pair dedicated to Richard Jeffrey and prepared for a workshop held in his memory at the 26th International Wittgenstein Symposium. My thanks to the organisers of, and the participants in, this workshop and to two anonymous referees for their comments.     

Net Amount of Food Affects Autoshaped Response Rate, Response Latency, and Gape Amplitude in Pigeons

The contribution of net amount of food to conditioned response strength and topography was assessed in four pigeons under autoshaping contingencies. In each session, under one baseline phase and three replication phases, three trial types were presented sequentially: One conditioned stimulus (keylight) signaled one small pellet, another signaled one large pellet, and a third signaled seven small pellets which were weight-matched to one large pellet. Five dependent variables were response rates and latencies based on the occurrence of both keyswitch closures and gapes (beak openings) and gape amplitudes. In result, net amount of food, not pellet diameter or number, affected all dependent variables. Notably, gape amplitudes elicited by the seven-small pellet keylights were larger than the gape amplutides elicited by the one-small pellet keylights even though the gape amplitudes elicited by both unconditioned stimuli (one or seven pellets) were equally small. This mismatch between conditioned and unconditioned responses is incompatible with stimulus substitution accounts but is compatible with an associative strength account. Furthermore, the changes in the dependent variables were most likely determined by Pavlovian and not by inadvertent operant contingencies. The findings demonstrate that an analysis of classical conditioning benefits from the inclusion of topographical measures.     

Psychoneuroimmunology

Psychoneuroimmunology is the study of the relationships among behavioral, neural and endocrine, and immune processes. Bidirectional pathways connect the brain and the immune system and provide the foundation for neural, endocrine, and behavioral effects on immunity. Examples of such effects are conditioned and stress-induced changes in immune function and in susceptibility to immunologically mediated diseases. These data indicate that researchers should no longer study the immune system as if it functioned independently of other systems in the body. Changes in immune function are hypothesized to mediate the effects of psychological factors on the development of some diseases, and research strategies for studying the clinical significance of behaviorally induced changes in immune function are suggested.     

Causal Learning: Association Versus Computation

Causal learning enables humans and other animals not only to predict important events or outcomes, but also to control their occurrence in the service of needs and desires. Computational theories assume that causal judgments are based on an estimate of the contingency between a causal cue and an outcome. However, human causal learning exhibits many of the characteristics of the associative learning processes thought to underlie animal conditioning. One problem for associative theory arises from the finding that judgments of the causal power of a cue can be revalued retrospectively after learning episodes when that cue is not present. However, if retrieved representations of cues can support learning, retrospective revaluation is anticipated by modified versions of standard associative theories.     

Ontogeny of early event memory: I. Forgetting and retrieval by 2- and 3-month-olds

In 2 experiments, 2-month-olds, trained in the mobile conjugate reinforcement paradigm for two daily sessions, showed retrieval deficits relative to 3-month-olds. In Experiment 1, tests of simple forgetting administered to 2-month-olds after retention intervals of 1, 3, 6, and 9 days (a period over which 3-month-olds remember the contingency) indicated that their forgetting was complete after delays greater than 1 day. In Experiment 2, reactivation treatments administered to 2- and 3-month-olds alleviated forgetting after a retention interval of 28, but not 35, days in the 3-month-old group only. Previously, alleviated forgetting by a reactivation treatment had been demonstrated in 2-month-olds after a delay of 18 days. In both of the present experiments, performance of the two age groups did not differ during the immediate retention test at the end of training. These results suggest that neither the age of the infant nor the age of the memory determines memory retrieval after long delays; instead, it appears to be determined by the length of time that a memory has been inaccessible (i.e., forgotten). We propose that factors which delay simple forgetting will correspondingly increase the length of the interval over which a retrieval cue can still be effective in a reactivation paradigm, irrespective of the age of the infant or the age of the memory.     

Evidence of the origin of specific spontaneous head turns during intertrial intervals

Direction and the frequency of spontaneous head movements during the ITIs following forward and backward paired trials were compared to an acquisition of a conditioned orienting (alpha) response directed to the side of the tone source. The head movements were analyzed from video recordings using classification of head turns to preferred and to nonpreferred directions. The results showed a significant increase in the alpha responses during the forward paired conditioning to the preferred direction and rapid extinction during the subsequent backward conditioning sessions. Spontaneous head movements during the ITIs increased to the same preferred direction as the conditioned alpha responses. The results of this experiment suggest that the response initially elicited by the CS can later appear as “spontaneous,” instrumental behavior, the form and the nature of which is determined by the characteristics of the conditioned alpha response developing as a result of classical conditioning.     

A comparison of pecking generated by serial, delay, and trace autoshaping procedures

Pigeons were exposed to serial, delay, and trace autoshaping procedures. In Experiment I, all conditioned stimuli (CSs) were changes in illumination of the response key. The number of trials to acquisition of the keypeck increased from serial, to 4-sec delay, 8-sec delay, and 8-sec trace procedures, in that order. In Experiment II, which used a longer intertrial interval, trials to criterion increased from 8-sec delay, to 28-sec delay, 8-sec trace, and 28-sec trace procedures, in that order. In Experiment III, two groups received serial procedures in which the first CS was either a tone or a houselight, and the second was a keylight. The tone group acquired the key peck more rapidly than the houselight group. Early in conditioning in these experiments, and when the conditioned stimulus was a change in the keylight, there was a short latency to the onset of pecking and pecking was directed at the CS. After extensive conditioning, or when the CS was relatively diffuse, pecking still occurred, but had a longer latency and was not reliably directed toward the conditioned stimulus.     

The Holte Sleeping Technique: An experimental study

The Holte Sleeping Technique is an alternative to medication to facilitate sleep onset in situations of normal stress. The technique is based on a combination of conditioning within the theory of learning, simulation of natural bodily processes, and manipulation of naturally available sleep-releasing stimuli. The author describes the technique and reports on experimental testing of its efficacy. Fifty-six female subjects were selected according to criteria based on questionnaires and sleep logs. The subjects were randomly assigned to a treatment group, a placebo group, and a no-treatment group. A pre-test-post-test design was used. The author questions the generalizability of findings from modern electronic sleep laboratories to the bedrooms of everyday life. In order to optimize the combination of normal stress, objective criteria and generalizability, sleep onset was measured by behavioural criteria based on the "fog-horn procedure" developed by the author. At post-test 67% of the treatment group fell asleep, while only 17% of the placebo group and 25% of the no-treatment group fell asleep. The differences were significant. It is concluded that the Holte Sleeping Technique is highly effective. In a discussion of placebo trials the author argues that traditional medical trials do not take into consideration the differentiating psychological attribution effects occurring by giving the same experimental instruction under different experimental conditions. As a consequence the active treatment is given better conditions than the placebo in traditional clinical trials.