Personality, reinforcement and learning.

Conflict in predictions resulting from Eysenck's (1957) and Gray's (1970) theoretical formulations on personality and conditioning were tested at the behavioral level. Given conditions which do not produce over-arousal, it would be predicted from Eysenck's position that Introverts would condition better than Extraverts. From Gray's formulation it would follow that Introverts condition better if negative reinforcement is used and Extraverts condition better if positive reinforcement is used. The two opposing predictions were tested in pursuit rotor learning by either positively or negatively reinforcing the hit/miss dimension of performance by 166 males aged 14 to 15 yr. The results gave support to Gray's position but if over-arousal is assumed Eysenck's position is tenable.     

Decision theory,reinforcement learning,and the brain

Decision making is a core competence for animals and humans acting and surviving in environments they only partially comprehend, gaining rewards and punishments for their troubles. Decision-theoretic concepts permeate experiments and computational models in ethology, psychology, and neuroscience. Here, we review a well-known, coherent Bayesian approach to decision making, showing how it unifies issues in Markovian decision problems, signal detection psychophysics, sequential sampling, and optimal exploration and discuss paradigmatic psychological and neural examples of each problem. We discuss computational issues concerning what subjects know about their task and how ambitious they are in seeking optimal solutions; we address algorithmic topics concerning model-based and model-free methods for making choices; and we highlight key aspects of the neural implementation of decision making.     

Extinction in human learning and memory

In two experiments, participants were given extinction training in a human causal learning task. In both experiments, three critical experimental cues were paired with different outcomes in a first phase of training and were then extinguished in a second phase. Three control cues were given the same treatment in the first phase of training, but were not then presented in the second phase. Participants' ability to correctly identify the outcome with which each cue had been paired in the first phase was lower for extinguished than for control cues. Causal attributions to the extinguished cues were also lower than those to the control cues, a difference that correlated with outcome memory. These data are consistent with the idea that extinction in causal judgement is due, at least in part, to a failure to remember the cue-outcome relationship encoded in the first phase of training.     

Extinction in human learning and memory

In two experiments, participants were given extinction training in a human causal learning task. In both experiments, three critical experimental cues were paired with different outcomes in a first phase of training and were then extinguished in a second phase. Three control cues were given the same treatment in the first phase of training, but were not then presented in the second phase. Participants' ability to correctly identify the outcome with which each cue had been paired in the first phase was lower for extinguished than for control cues. Causal attributions to the extinguished cues were also lower than those to the control cues, a difference that correlated with outcome memory. These data are consistent with the idea that extinction in causal judgement is due, at least in part, to a failure to remember the cue–outcome relationship encoded in the first phase of training.     

Delayed reinforcement,selective learning and habit reversal

The Psychological Record - Three groups of hungry rats were trained in a T maze position response under conditions of 20-sec. delay of food reinforcement on 0, 50, and 100 per cent of the correct...     

Evaluating the stage learning hypothesis

A procedure for evaluating the Genevan stage learning hypothesis is illustrated by analyzing Inhelder, Sinclair, and Bovet's (Learning and the development of cognition. Cambridge: Harvard University Press 1974) guided learning experiments. The method is a chi-square-based model fitting strategy which enables comparisons to be made among different models. The method eschews critical measurement problems and is easily implemented. There appears little evidence for the Genevan position, although failure to report critical data and sample size considerations makes definitive evaluation of the Genevan position difficult. Suggestions for future research are proposed.     

Extinction of a heterogeneous chain after several reinforcement schedules

Rats were conditioned to emit the following two-member chain of responses on two different operanda always available: responses on a vertical bar produced a discriminative stimulus for food-reinforced responding on a horizontal bar. Responses on the vertical bar produced a discriminative stimulus on a variable-interval 1-min schedule, and the horizontal bar produced food on a variable ratio of 10 responses. Control conditions were included in which vertical bar responses were also food-reinforced simultaneous with the onset of the discriminative stimulus for the horizontal bar response and a tandem schedule which had the same response requirements but without different exteroceptive stimuli associated with the separate components of the response chain. The latter condition greatly retarded acquisition of the response chain compared to the other schedules studied here and compared to reports in the literature on homogeneous (single operandum) response chains. Intermittent reinforcement of the chain led to greater resistance to extinction of both members and the chain remained intact longer in the sense that stimulus control was maintained.     

On adaptation, maximization, and reinforcement learning among cognitive strategies

Analysis of binary choice behavior in iterated tasks with immediate feedback reveals robust deviations from maximization that can be described as indications of 3 effects: (a) a payoff variability effect, in which high payoff variability seems to move choice behavior toward random choice; (b) underweighting of rare events, in which alternatives that yield the best payoffs most of the time are attractive even when they are associated with a lower expected return; and (c) loss aversion, in which alternatives that minimize the probability of losses can be more attractive than those that maximize expected payoffs. The results are closer to probability matching than to maximization. Best approximation is provided with a model of reinforcement learning among cognitive strategies (RELACS). This model captures the 3 deviations, the learning curves, and the effect of information on uncertainty avoidance. It outperforms other models in fitting the data and in predicting behavior in other experiments.