Disruption of short-term memory for reinforcement by ambient illumination

Pigeons were trained on a delayed conditional discrimination (DCD) in which choice of one of two simultaneously presented stimuli was reinforced if the trial had been initiated by presentation of a food sample. On trials in which no sample was presented, choice of the other colour was reinforced. Illumination of the houselights during the retention interval was provided in an attempt to interfere with retention of information about the food sample which served as a conditional cue. In two experiments, retention interval illumination produced a greater disruption of DCD performance on no sample trials than on food sample trials. The finding that retention interval illumination disrupts DCD performance on no sample trials suggests that this manipulation does not affect memorial processes since there was good evidence that performance on no sample trials did not depend on remembering what happened at the outset of the trial. Furthermore, the magnitude of the disruption was larger if the illumination immediately preceded the choice stimuli than if it followed presentation of the sample stimuli. These results support the hypothesis that retention interval illumination disrupts DCD performance by interfering with discriminative control of the choice response rather than with memorial processes. In neither study did retention interval illumination impair discriminative autoshaping to keylight stimuli that immediately preceded the food sample and no sample DCD trials.     

Heterogeneity in generalized reinforcement learning and its relation to cognitive ability

In this paper, we study the connections between working memory capacity (WMC) and learning in the context of economic guessing games. We apply a generalized version of reinforcement learning, popularly known as the experience-weighted attraction (EWA) learning model, which has a connection to specific cognitive constructs, such as memory decay, the depreciation of past experience, counterfactual thinking, and choice intensity. Through the estimates of the model, we examine behavioral differences among individuals due to different levels of WMC. In accordance with ‘Miller’s magic number’, which is the constraint of working memory capacity, we consider two different sizes (granularities) of strategy space: one is larger (finer) and one is smaller (coarser). We find that constraining the EWA models by using levels (granules) within the limits of working memory allows for a better characterization of the data based on individual differences in WMC. Using this level-reinforcement version of EWA learning, also referred to as the EWA rule learning model, we find that working memory capacity can significantly affect learning behavior. Our likelihood ratio test rejects the null that subjects with high WMC and subjects with low WMC follow the same EWA learning model. In addition, the parameter corresponding to ‘counterfactual thinking ability’ is found to be reduced when working memory capacity is low.     

An invariant relation between changing over and reinforcement

Although concurrent schedules may arrange reinforcers irregularly, relatively large numbers of reinforcers are obtained when an animal changes from one schedule to the other. This paper proposes a quantitative relation that predicts the proportion of reinforcers obtained when an animal is working on a schedule and the proportion when the animal changes over to a schedule. Basically the relation states that the number of reinforcers obtained while an animal works on a schedule varies directly with the relative amount of time spent working on that schedule; and the number of reinforcers obtained when an animal changes to a schedule varies directly with the relative amount of time spent on the alternate schedule. An important aspect of this relation is that when relative reinforcement rates are less than .50, more reinforcers are obtained just after an animal changes to a schedule than at all other times when this schedule is engaged. Data obtained both from a stat-bird and a live pigeon were in close agreement with the quantitative predictions. The relation between changing over and reinforcement held across several procedural changes that included changes in relative reinforcement rate, changes from independent to interdependent scheduling procedures, and changes in the variable-interval reinforcement distributions. The results are discussed in terms of the effects of the local distribution of reinforcement on responding. The local reinforcement distribution can affect local response rates and affects the resulting matching relation. This arrangement has implications for explanations of choice.     

Discriminative functions based on a delay in the reinforcement relation

Pigeons were shown to come under discrimination control when the S^D and S^Δ were temporally separated from reinforcement and non-reinforcement. S^D and S^Δ consisted of distinctive key illuminations presented separately. Responding on an FR 5 in the presence of S^D or S^Δ produced a third stimulus containing a schedule requirement. If this third (or interpolated) stimulus was preceded by S^D, responding in its presence produced reinforcement followed by a time-out (TO). If, on the other hand, the third stimulus was preceded by S^Δ, responding produced TO alone. In this fashion, the same stimulus and the same response requirement were imposed between S^D and the reinforcement as between S^Δ and the TO. In Experiment I, the schedule employed during the interpolated stimulus was FR; in Experiment II, FI. Discrimination reversal was accomplished in both experiments.     

Conditioned reinforcement versus time to reinforcement in chain schedules.

Pigeons were trained on three-component chain schedules in which the initial component was either a fixed-interval or variable-interval schedule. The middle and terminal components were varied among fixed-interval fixed-interval, variable-interval variable-interval, and an interdependent variable-interval variable-interval schedule in which the sum of the durations of the two variable-interval components was always equal to the sum of the fixed-interval fixed-interval components. At issue was whether the response rate in the initial component was controlled by its time to primary reinforcement or by the temporal parameters of the stimulus correlated with the middle terminal link. The fixed-interval initial-link schedule maintained much lower response rates than the variable-interval initial-link schedule regardless of the schedules in the middle and terminal links. Nevertheless, the intervening schedules played some role: With fixed-interval schedules in the initial links, response rates were consistently highest with independent variable-interval schedules in the middle and terminal links and intermediate with the interdependent variable-interval schedules; these initial-link differences were predicted by the response rates in the middle link of the chain. With variable-interval schedules in the initial links, response rates were lowest with the fixed-interval fixed-interval schedules following the initial link and were not systematically different for the two types of variable-interval variable-interval schedules. The results suggest that time to reinforcement itself accounts for little if any variance in initial-link responding.     

The relation between response rates and reinforcement rates in a multiple schedule

In a multiple schedule, exteroceptive stimuli change when the reinforcement schedule is changed. Each performance in a multiple schedule may be considered concurrent with other behavior. Accordingly, two variable-interval schedules of reinforcement were arranged in a multiple schedule, and a third, common variable-interval schedule was programmed concurrently with each of the first two. A quantitative statement was derived that relates as a ratio the response rates for the first two (multiple) variable-interval schedules. The value of the ratio depends on the rates of reinforcement provided by those schedules and the reinforcement rate provided by the common variable-interval schedule. The following implications of the expression were evaluated in an experiment with pigeons: (a) if the reinforcement rates for the multiple variable-interval schedules are equal, then the ratio of response rates is unity at all reinforcement rates of the common schedule; (b) if the reinforcement rates for the multiple schedules are unequal, then the ratio of response rates increases as the reinforcement rate provided by the common schedule increases; (c) the limit of the ratio is equal to the ratio of the reinforcement rates. Satisfactory confirmation was obtained for the first two implications, but the third was left in doubt.     

PSYCHOPHYSICAL INVARIANTS OF ACHROMATIC COLOUR VISION: III. Colour constancy and its relation to identification of illumination

L ie , I. Psychophysical invariants of achromatic colour vision. III. Colour constancy and its relation to identification of illumination. Scand. J. Psychol ., 1969, 10 , 7.69–281.—Identification of illumination as a separate determinant of the dimensions of achromatic colour was investigated with classical methods for manipulating shifts in perceived level of illumination, while controlling the changes in colour contrast brought about by these methods. With the spot-shadow method, constancy effects may be explained by laws of colour contrast, but not by perceived shifts in illumination, whereas neither explanation holds with the cast-shadow method. Results with a method of conceiled cast-shadow may be consistent with both interpretations.     

An examination of secondary reinforcement,operant conditioning,and status envy hypotheses in relation to sex-role ideology

A series of predictions concerning adult sex-role ideology was derived from three theoretical approaches commonly applied to the sex-role development of children: secondary reinforcement, operant conditioning by peers, and status envy. Relevant data were collected by means of a questionnaire administered to 635 students at two regional state universities and to nonstudent adults in the surrounding communities. Of these, 226 were classified as having a distinctive contemporary or traditional sex-role ideology by means of a short test developed and validated by the authors for this purpose. Discriminant analyses indicated that each theoretical approach differentiated between contemporary and traditional subjects at levels significantly better than chance. However, the status envy approach, as modified by social learning theory, was most effective and correctly classified 85% of the females and 93% of the males according to their sex-role ideologies. Alternative explanations of results are discussed and an eclectic model is advocated.The authors would like to express their sincere appreciation to Dr. Barbara Wallston for her comments on an earlier draft of this paper, and to Jan Curley for computer assistance.     

The effect of foreperiod duration on reaction time and its relation to interval schedules of reinforcement

Two groups of pigeons were exposed to a simple reaction-time procedure in which mean foreperiod duration was 5, 10, or 20 seconds. For one group, the foreperiods had an arithmetic, or rectangular, distribution; for the second group, they had a constant-probability, or Bernoulli, distribution. Under both distributions, mean response latency was an increasing, negatively accelerated function of mean foreperiod duration. On a given trial, response latency was a function of its associated foreperiod duration: latency was a decreasing function of foreperiod duration in the arithmetic distribution, and an increasing function of foreperiod duration in the constant-probability distribution. Examination of the distribution of latencies revealed a harmonic structure reminiscent of distributions of interresponse times under variable-interval schedules of reinforcement. Taken together, the results confirm and extend previous findings with human subjects, and also suggest numerous similarities to behavior maintained by variable-interval schedules.     

Movement and illumination factors in adaptation to prismatic viewing

While wearing laterally displacing prisms, Ss were required to align a spot of light to the phenomenal straightahead. These measurements were obtained at the beginning and at the end of an exposure to prismatic displacement. In addition, Ss either actively controlled movement of the spot of light, or movement was manipulated by E under the direction of the S. Aftereffects were determined by having S position the spot of light with normal vision at the beginning of the experiment and after each measurement obtained under prism viewing. Ss in the darkened room condition who were required to align the spot of light actively showed a significant aftereffect in the direction of prismatic displacement both at the beginning and at the end of the exposure period. No difference in the degree of adaptation was found between those measurements at the beginning and at the end of the exposure period. No significant aftereffects were found when the room was illuminated during prism exposure or when E controlled movement of the light source.