Connectionist models of conditioning: A tutorial

Models containing networks of neuron-like units have become increasingly prominent in the study of both cognitive psychology and artificial intelligence. This article describes the basic features of connectionist models and provides an illustrative application to compound-stimulus effects in respondent conditioning. Connectionist models designed specifically for operant conditioning are not yet widely available, but some current learning algorithms for machine learning indicate that such models are feasible. Conversely, designers for machine learning appear to have recognized the value of behavioral principles in producing adaptive behavior in their creations.     

Appetitive differential conditioning of the rabbit’s jaw movement response

Two experiments examined appetitive differential conditioning of the rabbit’s jaw movement response (JMR) in a two-phase procedure. The first phase entailed reinforced training with one conditioned stimulus (CS+), and the second phase involved intermixed presentations of CS+ and an unreinforced stimulus (CS?). In Experiment 1, CS+ was a 600-Hz tone, and CS-was either a 660-,1,000-, or 2,100-Hz tone. In Experiment 2, the magnitude of the water unconditioned stimulus (US) paired with CS+ was either 1, 3, or 9 ml. The experiments revealed that 1) the level of responding to CS-rose for several days and then declined over the remainder of training; 2) the physical similarity between CS+ and CS?directly affected the level of responding to CS?but had no discernable effect on the level of responding to CS+ ; and 3) US magnitude positively affected the level of responding to CS + and, to a lesser extent, CS?. The results are discussed in terms of their implications for Spence’s gradient interaction theory and Pavlov’s external inhibition hypothesis.     

EFFECTS OF REINFORCEMENT HISTORY AND INSTRUCTIONS ON THE PERSISTENCE OF STUDENT ENGAGEMENT

We examined the effects of three reinforcement histories on the persistence of task engagement by 2 fourth-grade students using a partially counterbalanced ABCDBCD design. In each condition, an experimenter made four student contacts during the first 2 min of each session (reinforcement baseline), followed by an 8-min extinction period. The reinforcement history that contained an instructional control component produced the greatest persistence in student engagement. The applied relevance of instructional control is discussed.     

Psychopathic personality traits and temporal perspective: A test of the short time horizon hypothesis

A number of authors have proposed that psychopathic individuals possess an abnormally constricted time horizon (i.e., foreshortened sense of the future). This hypothesis was tested among 101 undergraduates, who were administered a battery of (1) self-report indices of psychopathic personality traits, antisocial behavior, and normal-range personality traits; (2) self-report indices of time perspective; (3) projective tests of time perspective; and (4) laboratory tasks assessing time estimation and capacity for foresight and impulse control. Measures of psychopathy/antisocial behavior tended to be negatively correlated with several self-report indices assessing preoccupation with the future and with a projective task assessing the frequency of thoughts concerning future events, although only one of the correlations with this latter task was significant. In most cases these correlations were not attributable to the variance shared by measures of psychopathy/antisocial behavior and measures of (low) anxiety-proneness, although several correlations decreased substantially after levels of harmavoidance were controlled. In contrast, measures of psychopathy/antisocial behavior were negligibly correlated with laboratory tasks. These results provide mixed support for the short time horizon hypothesis and suggest that further attention to the role of method factors in investigations of future time perspective is warranted.     

Naming times for the Snodgrass and Vanderwart pictures

This paper reports the results of two experiments. In the first, voice-key naming times were collected and in the second, keypress naming times were collected for 250 of the Snodgrass and Vanderwart (1980) pictures. The resulting naming times and correct naming rates were well predicted in multiple regression analyses by one or another measure of codability (name or concept agreement) and by age-of-acquisition ratings collected specifically for this study. Voice-key responses appeared to be somewhat more sensitive indicators of naming difficulty, although keypress responses did remarkably well. The Appendix presents the age-of-acquisition ratings, the trimmed vocal and keypress naming times, and the correct naming rates from the two experiments for the 250 pictures.     

Blocking acquisition of the rabbit's nictitating membrane response to serial conditioned stimuli

Three experiments demonstrated that prior training with one stimulus (CS1) would block acquisition of the rabbit's nictitating membrane response (NMR) to another stimulus (CS2) which was more contiguous to the US during serial compound training (CS1-CS2-US). Specifically, the CS1-US interval was 800 msec, which produces only a modest rate of CR acquisition, while the CS2-US interval was 400 msec, which is an optimal value for the NMR preparation. Experiment 1 demonstrated blocking when CS1 overlapped CS2, and Experiment 3 demonstrated blocking when CS1 and CS2 were presented in a strictly sequential fashion. Experiment 2 showed that the magnitude of blocking in the serial compound was comparable to that obtained in a simultaneous compound in which both the CS1-US and CS2-US intervals were 800 msec, thus making CS2 less contiguous with the US than in the serial compound. Moreover, the level of responding to CS2 in all serial compound groups (blocking and control) was lower than in the simultaneous compound groups. The present findings provide further evidence that the associative consequences of CS-US contiguity can be highly attenuated by processes of attention or competition for associative strength.     

Temporal specificity in cross-modal transfer of the rabbit nictitating membrane response

Two experiments examine cross-modal transfer of response features specific to the interstimulus interval (ISI) between a conditioned stimulus (CS) and an unconditioned stimulus. Rabbits were given initial training with a stimulus (CSA) in one modality (e.g., tone) at a designated ISI (e.g., 600 ms). Training was then shifted to a new stimulus (CSB) in another modality (e.g., light) at a new ISI (e.g., 400 ms). The timing of early conditioned responses (CRs) to CSB reflected the ISI of CSA. Ultimately, CRs to CSB shifted to a temporal location conforming to the ISI of CSB. When the ISI of CSB was shorter than that of CSA, CRs to CSA also shifted to a locus conforming to the ISI of CSB. The present results confirmed previous findings that training in one CS modality accelerates CR acquisition to a CS in another modality. The findings are compared with the transfer of response patterns in instrumental learning sets and are discussed regarding their implications for theories of cross-modal transfer.     

Second-order conditioning of the rabbit's nictitating membrane response. Interstimulus interval and frequency of CS-CS pairings.

Second-order conditioning of the rabbit's nictitating membrane response (NMR) was investigated when second-order trials (CS1-CS2) were intermixed with first-order trials (CS2-US) from the outset of training. Experiment 1 showed that CR acquisition to CS1 was inversely related to the CS1-CS2 interval but nevertheless extended to an interval of 8,400 ms. Experiment 2 revealed that CR acquisition of CS1 was an inverted-U function of the number of CS1-CS2 trials relative to a fixed number of CS2-US trials. Experiment 3 directly contrasted second-order conditioning with a reinforced serial compound procedure (CS1-CS2-US) and a mixed procedure in which second-order trials were intermixed with the reinforced serial compound. Second-order conditioning was about half the strength of either the reinforced serial compound or the mixed procedure, which were similar. The present results are discussed with respect to the relative strength of excitatory and inhibitory processes in second-order conditioning.     

Second-order conditioning of the rabbit’s nictitating membrane response

Second-order conditioning of the rabbit’s nictitating membrane response (NMR) was investigated when second-order trials (CS1-CS2) were intermixed with first-order trials (CS2-US) from the outset of training. Experiment 1 showed that CR acquisition to CS1 was inversely related to the CS1-CS2 interval but nevertheless extended to an interval of 8,400 ms. Experiment 2 revealed that CR acquisition of CS1 was an inverted-U function of the number of CS1-CS2 trials relative to a fixed number of CS2-US trials. Experiment 3 directly contrasted second-order conditioning with a reinforced serial compound procedure (CS1-CS2-US) and a mixed procedure in which second-order trials were intermixed with the reinforced serial compound. Second-order conditioning was about half the strength of either the reinforced serial compound or the mixed procedure, which were similar. The present results are discussed with respect to the relative strength of excitatory and inhibitory processes in second-order conditioning.     

Effects of peer reporting on cooperative play and aggression of kindergarten children

Kindergarten children were given opportunities to report to their class during “sharing time” the cooperative or friendly behaviors of their peers which had occurred during the day. Children whose cooperative behavior was reported by a peer received a happy face badge as a reward. Later, only peer praise served as a reward for those whose friendliness was mentioned by a peer. Cooperative behavior increased and aggressive acts decreased when peers reported prosocial behavior to the class. A reversal phase, in which unfriendly acts were reported, produced a decrease in cooperation and an increase in aggression. Peer reporting was a natural and inexpensive means of increasing prosocial responses of these children. Anecdotal teacher reports suggested a generalized behavioral improvement.