Algorithmic shaping and misbehavior in the acquisition of token deposit by rats

In two experiments, rats were trained to deposit ball bearings down a hole in the floor, using an algorithmic version of shaping. The experimenter coded responses expected to be precursors of the target response, ball bearing deposit; a computer program reinforced these responses, or not, according to an algorithm that mimicked the processes thought to occur in conventional shaping. In the first experiment, 8 of 10 rats were successfully shaped; in the second, 5 of 5 were successfully shaped, and the median number of sessions required was the same as for a control group trained using conventional shaping. In both experiments, “misbehavior,” that is, excessive handling and chewing of the ball bearings, was observed, and when the algorithmic shaping procedure was used, misbehavior could be shown to occur in spite of reduced reinforcement for the responses involved.     

Timing multimodal events in pigeons

The peak procedure was used in two experiments to study pigeons' ability to time multimodal events. In the first experiment, birds were trained to time a single event consisting of a 9-s tone or light followed by a 21-s fixed interval associated with a signal of light or tone (signal of the other modality). On occasional empty trials, different lengths of the first signal were followed by a long period of the second signal. Peak response times as a function of the duration of the first signal were linear and had a slope of close to one in all birds. This indicates that the birds were timing only the second signal. In a second experiment, two complex events were used in training. One consisted of a 9-s tone or light followed by a 21-s fixed interval associated with a light or tone. The other consisted of a 21-s tone or light followed by a 9-s fixed interval associated with a light or tone. Different durations of the first signal were again used on empty trials. Peak response times as a function of the duration of the first signal were again linear in all birds. The slope of the function was less than one but greater than zero for 3 birds. This indicates that these birds were partly timing the entire complex event of 30-s duration and partly timing only the second signal of the event. A model is proposed in which the bird takes as a criterion for timing a weighted average of different target criteria. Comparisons with the performance of rats are made.     

Visually guided catching and tracking skills in pigeons: A preliminary analysis

Research on reaching, tracking, and catching in the pigeon has been hampered by limitations of technology. A new system was developed in which the target was a small rectangle presented on a video display terminal and the pecking response was detected with touch technology. The target moved up and down vertically with sinusoidal velocity. A coincidence between the location of the pigeon's beak and the cursor produced reinforcement. The pigeon pecked ahead and behind the target, but most pecks occurred behind the target so the dominant tracking strategy was lagging. The pigeon was adept at “catching” the target at many locations throughout the trajectory. Transfer of motor learning was tested on probe trials during which the trajectory changed from vertical to horizontal. On transfer trials the pigeons' dominant pattern of pecking immediately shifted from vertical to horizontal. The motor skill displayed by the pigeons was flexible and adaptive, suggesting that the pigeons had learned to track the cursor.     

Connectionist models of conditioning: A tutorial

Models containing networks of neuron-like units have become increasingly prominent in the study of both cognitive psychology and artificial intelligence. This article describes the basic features of connectionist models and provides an illustrative application to compound-stimulus effects in respondent conditioning. Connectionist models designed specifically for operant conditioning are not yet widely available, but some current learning algorithms for machine learning indicate that such models are feasible. Conversely, designers for machine learning appear to have recognized the value of behavioral principles in producing adaptive behavior in their creations.     

Effects of average movement velocity on reaction time and spatiotemporal accuracy in single-aiming and rapid-timing movement tasks

The effects of instructed movement speed were investigated in two experiments. First, rapid-timing and single-aiming movement tasks were compared. Unlike rapid timing, single aiming implies spatial accuracy. The aim of the first experiment was twofold: (a) to examine whether the requirement of accurate placement termination in single aiming affects the negative relationship between instructed average velocity and reaction time found in rapid timing, and (b) to test the speed-accuracy relationships predicted by the symmetric impulse variability model of these movement tasks. For this purpose, four average velocities (5, 24, 75, and 140 cm/s) were investigated in both types of movement tasks in a two-choice reaction task. The effects of average velocity on reaction time were similar in both single-aiming and rapid-timing tasks, and the predicted linear relationship between instructed average velocity and spatial accuracy was not found. The results suggest that the movement control mode, that is, open loop or closed loop, interferes with effects of instructed average velocity. The movement control mode explanation was confirmed in the second experiment with respect to the effect of paired velocities on reaction time. It is argued that the type of movement control mode must be considered in the interpretation of effects of instructed average velocity on reaction time and spatiotemporal measures.     

Backward walking: a simple reversal of forward walking?

The purpose of this study was to determine whether backward walking represented a simple temporal reversal of forward walking and, hence, could be controlled by a reversed cycling of the same group of neurons. Electromyographic (EMG), joint angle, joint moment, and joint muscle power patterns were compared for forward and backward walking, in 6 subjects. The joint angle patterns with the time-base of the backward walking reversed were similar, with the exception of the ankle. The moment patterns were similar except for the knee, whereas the joint muscle powers were almost reversed-polarity images of each other. This suggests that somewhat similar muscle activation patterns could be used to produce both modes of locomotion, but the temporal cycling of muscle contraction would be reversed: Concentric muscle activity in forward walking would become eccentric activity in backward walking, and visa versa. The EMG results generally supported these findings.     

Inferring Emotions From Multiple Cues: Revealing Age-Related Differences in "How" Without Differences in "Can"

This study examined differences in children's use of social cues to make emotional inferences. Children ages 4, 5, and 8 years were presented with stimuli that depicted another child in affectively congruous and affectively incongruous expression/situation combinations. The intensity of positive and negative facial expressions was varied across situations. Subjects judged the target's feelings and selected among the alternative facial expressions or situations the one they had just seen. No significant age-related differences were found in the extent to which children registered and used both the expressive and situational information when making emotional inferences. The main experimental measure asked children to explain their judgments. In explaining their judgments, subjects' rationales indicated that they: (a) used both the situational and expressive cues; and (b) were sensitive to congruous versus incongruous cues, and even to mild versus strong incongruous cues. Children's rationales also reflected a sensitivity to expressive and situational negativity. For each age group, the rationales were more elaborate when the cues were problematic. Characteristic strategies, however, were also found for each age group. These distinct strategies may reflect social-life changes in children's social "theories" of emotion.     

Continuities and Discontinuities in Self-Regulatory and Self-Evaluative Processes: A Developmental Theory Relating Self and Affect

This article presents a developmental theory of the relation between self and affect. Self-discrepancy theory (Higgins, 1987) is used as a framework for considering developmental and individual differences in children's self-concepts, self-regulation, and self-evaluation. Developmental changes in children's representational capacities are described that produce developmental shifts in this self-system. Different modes of caretaker-child interaction are distinguished in terms of how features of the interaction impact psychologically on the child. The implications of these differences for children's self-system and emotional/behavioral vulnerabilities are discussed. The development of self-regulatory and self-evaluative processes are distinguished with respect to developmental continuities and discontinuities. Patterns of sex differences in socialization, conduct, and emotional problems are described to exemplify the need for distinguishing these two processes developmentally. The question is raised whether children can be socialized to maximize the positive conduct valued by society and the positive self-regard valued by individuals.     

The child's perceptions of familial relationships: convergence between two assessment techniques

Children's (N = 28) perceptions of familial relationships were investigated with the Family Environment Scale (FES) and the Network of Relationships Inventory (NRI). The FES assesses overall impressions of the family, and the NRI measures perceptions of individual relationships. Because current family systems theory indicates that positive individual relationships within a dyad (e.g., child-mother) should be related to an overall favorable impression of the family system, we hypothesized that these two instruments should demonstrate convergence on selected dimensions. Results indicated that positive or negative relationships with an individual family member were related to how the child perceived the overall family system, supporting our hypothesis.