Effects of relative reinforcer frequency on complex color detection

Pigeons were trained under a discrete-trials detection procedure in which one of a set of color stimuli was presented on the center key and a single response turned off the stimulus and illuminated two side keys. Single responses to one or the other side key produced occasional reinforcers depending on the value of the color stimulus. In Experiment 1, one color-stimulus set comprised 559, 564, 569, and 574 nm, and right-key pecks were occasionally reinforced following presentations of members of this set. The other stimulus set comprised 579, 584, 589, and 594 nm, and left-key pecks were occasionally reinforced following presentations of members of this set. Across seven experimental conditions, the left/(left + right) relative reinforcer frequency was varied from .1 to .9. In Experiment 2, one stimulus set contained only one member, 574 nm, and right-key responses were occasionally reinforced following its presentation. Over 12 experimental conditions, two manipulations were carried out. First, the number of stimuli comprising the other stimulus set was increased from one (579 nm) to two (579 and 584 nm) to three (579, 584, and 589 nm) and to four (579, 584, 589, and 594 nm), and left-key responses were reinforced occasionally following center-key presentations of members of this set. Second, for each stimulus combination, the left/(left + right) relative reinforcer frequency was varied from .1 to .5 to .9 across three experimental conditions. The principal finding of Experiments 1 and 2 was that reinforcers and stimuli interacted in their effects on behavior. In Experiment 3, pairs of adjacent stimuli (5 nm apart) in the range 559 to 594 nm were presented in each experimental condition, and the left/(left + right) relative reinforcer frequency was held constant at .5. The data from all three experiments were analyzed according to a detection model describing performance in multiple-stimulus two-response procedures. This model provided independent measures of stimulus discriminability, contingency discriminability, and bias. The analysis showed that (a) consistent with the color-naming function, pigeons were better able to discriminate between higher nanometer values than lower nanometer values; (b) their ability to discriminate between the stimuli was independent of the number of wavelengths comprising each stimulus set; (c) they allocated delivered reinforcers very accurately to the previously emitted response; and (d) no consistent biases emerged.     

Algorithmic shaping and misbehavior in the acquisition of token deposit by rats

In two experiments, rats were trained to deposit ball bearings down a hole in the floor, using an algorithmic version of shaping. The experimenter coded responses expected to be precursors of the target response, ball bearing deposit; a computer program reinforced these responses, or not, according to an algorithm that mimicked the processes thought to occur in conventional shaping. In the first experiment, 8 of 10 rats were successfully shaped; in the second, 5 of 5 were successfully shaped, and the median number of sessions required was the same as for a control group trained using conventional shaping. In both experiments, “misbehavior,” that is, excessive handling and chewing of the ball bearings, was observed, and when the algorithmic shaping procedure was used, misbehavior could be shown to occur in spite of reduced reinforcement for the responses involved.     

Visually guided catching and tracking skills in pigeons: A preliminary analysis

Research on reaching, tracking, and catching in the pigeon has been hampered by limitations of technology. A new system was developed in which the target was a small rectangle presented on a video display terminal and the pecking response was detected with touch technology. The target moved up and down vertically with sinusoidal velocity. A coincidence between the location of the pigeon's beak and the cursor produced reinforcement. The pigeon pecked ahead and behind the target, but most pecks occurred behind the target so the dominant tracking strategy was lagging. The pigeon was adept at “catching” the target at many locations throughout the trajectory. Transfer of motor learning was tested on probe trials during which the trajectory changed from vertical to horizontal. On transfer trials the pigeons' dominant pattern of pecking immediately shifted from vertical to horizontal. The motor skill displayed by the pigeons was flexible and adaptive, suggesting that the pigeons had learned to track the cursor.     

Connectionist models of conditioning: A tutorial

Models containing networks of neuron-like units have become increasingly prominent in the study of both cognitive psychology and artificial intelligence. This article describes the basic features of connectionist models and provides an illustrative application to compound-stimulus effects in respondent conditioning. Connectionist models designed specifically for operant conditioning are not yet widely available, but some current learning algorithms for machine learning indicate that such models are feasible. Conversely, designers for machine learning appear to have recognized the value of behavioral principles in producing adaptive behavior in their creations.     

Functional classes and equivalence relations

Three adult subjects were taught a set of two-choice simultaneous discriminations, with three positive and three negative stimuli; all possible combinations of positive and negative stimuli yielded nine different pairs. The discriminations were repeatedly reversed and rereversed, the former positive stimuli becoming negative and the former negative stimuli becoming positive. With all subjects, a reversal of the contingencies for one pair of stimuli became sufficient to change their responses to all of the other pairs. The reversals had produced functional stimulus classes. Then, all subjects showed conditional discriminations emerging between members of a functional class; given a sample from one class and comparisons from both classes, they selected the comparison that was in the same class as the sample. Next, 2 of the subjects showed that the within-class conditional relations possessed the symmetric and transitive properties of equivalence relations; after having been taught to relate new stimuli to existing class members, the subjects then matched other class members to the new stimuli. Subsequent tests of two-choice discriminations showed that the conditional discriminations had transferred functional class membership to the new stimuli. The 3rd subject, who did not show equivalence relations among functional class members, was also found to have lost the within-class conditional relations after the equivalence tests.     

Inferring Emotions From Multiple Cues: Revealing Age-Related Differences in "How" Without Differences in "Can"

This study examined differences in children's use of social cues to make emotional inferences. Children ages 4, 5, and 8 years were presented with stimuli that depicted another child in affectively congruous and affectively incongruous expression/situation combinations. The intensity of positive and negative facial expressions was varied across situations. Subjects judged the target's feelings and selected among the alternative facial expressions or situations the one they had just seen. No significant age-related differences were found in the extent to which children registered and used both the expressive and situational information when making emotional inferences. The main experimental measure asked children to explain their judgments. In explaining their judgments, subjects' rationales indicated that they: (a) used both the situational and expressive cues; and (b) were sensitive to congruous versus incongruous cues, and even to mild versus strong incongruous cues. Children's rationales also reflected a sensitivity to expressive and situational negativity. For each age group, the rationales were more elaborate when the cues were problematic. Characteristic strategies, however, were also found for each age group. These distinct strategies may reflect social-life changes in children's social "theories" of emotion.     

Continuities and Discontinuities in Self-Regulatory and Self-Evaluative Processes: A Developmental Theory Relating Self and Affect

This article presents a developmental theory of the relation between self and affect. Self-discrepancy theory (Higgins, 1987) is used as a framework for considering developmental and individual differences in children's self-concepts, self-regulation, and self-evaluation. Developmental changes in children's representational capacities are described that produce developmental shifts in this self-system. Different modes of caretaker-child interaction are distinguished in terms of how features of the interaction impact psychologically on the child. The implications of these differences for children's self-system and emotional/behavioral vulnerabilities are discussed. The development of self-regulatory and self-evaluative processes are distinguished with respect to developmental continuities and discontinuities. Patterns of sex differences in socialization, conduct, and emotional problems are described to exemplify the need for distinguishing these two processes developmentally. The question is raised whether children can be socialized to maximize the positive conduct valued by society and the positive self-regard valued by individuals.     

On task and theory specificity

One of the significant limitations of the motor control and skill acquisition domain is that the theories, models, and hypotheses are, in most cases, task specific. Many lines of theorizing fail to hold up under even small changes in task constraints, although clearly the field does have some robust phenomena. It is proposed that a broader consideration of the role of task constraints, which is grounded in the methodology of nonlinear dynamics, may help to formulate a more general action theory of coordination and control.     

Autobiographical memory in a case of multiple personality disorder

Previous research on multiple personality disorder (MPD) has been concerned with between-personalities amnesia, and little attention has been paid to within-personality memory function. This study examined the autobiographical memory of a multiple personality patient, I.C., with cueing procedures that have proven useful in previous studies of normal and abnormal memory. Results indicated that I.C. was able to retrieve autobiographical episodes from the recent past, although her performance differed in several respects from that of matched controls. The study also revealed a striking deficit in I.C.'s autobiographical memory for childhood: She was unable to recall a single episode from prior to the age of 10 in response to various retrieval cues, whereas control subjects had no difficulty recalling numerous childhood episodes. This phenomenon of extended childhood amnesia has not been reported previously in studies of MPD.