A COMPARATIVE STUDY OF INSTRUMENTAL LEARNING BY PRESCHOOL CHILDREN IN PAPUA NEW GUINEA AND AUSTRALIA1

Instrumental learning of preschool children in Papua New Guinea (PNG) and Australia (AUST) was compared using two tasks (imitative and nonimitative) and two rewards (social and nonsocial). There were no differences between the two groups in the rate of acquisition measure of trials to criterion. PNG children made more late responses during acquisition and, for nil responses, there were group x task and group x reward x task effects. In the extinction phase, there were two main effects for trials to criterion: PNG children were more resistant to extinction than AUST children, and there was greater persistence in responding after social reward regardless of nationality. Reward x group, reward x task, and reward x group x task interactions also were observed in the extinction trials to criterion. In addition, there were three main task effects during extinction for other responses: on the imitative task, more wrong responses were made, and on the nonimitative task, more extra responses and more paired responses were made. A subsidiary analysis compared the two culturally different but educationally similar groups comprising the PNG sample: no major differences were isolated in acquisition or extinction.     

Communication between domestic dogs and humans: effects of shelter housing upon the gaze to the human

It is widely known that gaze plays an essential role in communicative interactions. Domestic dogs tend to look at the human face in situations of conflict and uncertainty. This study compares the gaze of shelter and pet dogs during acquisition and extinction phases in a situation involving a reward in sight but out of reach. Even though no significant differences between the groups were recorded during acquisition, gaze duration decreased in both groups during extinction, with shelter dogs showing a significant shorter duration. This could be related to their different living conditions and to the fact that through their ordinary everyday interactions, pet dogs have more opportunities to learn to persist in their communicative responses when they do not get what they want. These results highlight the relevance of learning experiences during ontogeny, which would therefore modulate communicative responses.     

Duration of extinction trials as a determinant of instrumental extinction in terrestrial toads (<Emphasis Type="Italic">Rhinella arenarum</Emphasis>)

Instrumental learning guides behavior toward resources. When such resources are no longer available, approach to previously reinforced locations is reduced, a process called extinction. The present experiments are concerned with factors affecting the extinction of acquired behaviors in toads. In previous experiments, total reward magnitude in acquisition and duration of extinction trials were confounded. The present experiments were designed to test the effects of these factors in factorial designs. Experiment 1 varied reward magnitude (900, 300, or 100 s of water access per trial) and amount of acquisition training (5 or 15 daily trials). With total amount of water access equated in acquisition, extinction with large rewards was faster (longer latencies in 900/5 than 300/15), but with total amount of training equated, extinction with small rewards was faster (longer latencies in 100/15 than 300/15). Experiment 2 varied reward magnitude (1200 or 120 s of water access per trial) while holding constant the number of acquisition trials (5 daily trials) and the duration of extinction trials (300 s). Extinction performance was lower with small, rather than large reward magnitude (longer latencies in 120/300 than in 1200/300). Thus, instrumental extinction depends upon the amount of time toads are exposed to the empty goal compartment during extinction trials.     

Runway acquisition and extinction as a joint function of magnitude of reward and percentage of rewarded acquisition trials

To determine the joint effects of partial reward and reward magnitude on acquisition and extinction rates, and on acquisition and extinction asymptotes, 215 Wistar albino rats were trained in a Hunter straight runway. The experimental design was a 4 × 4 × 2 factorial combining four reward magnitudes, four reward percentages, and two experimenters. The data revealed that the acquisition rate was an increasing function of both percentage and magnitude of reward and that neither reward magnitude nor percentage of reward significantly affected acquisition asymptote. For extinction, it was found that, for continuous schedules, the larger the reward magnitude the less the resistance to extinction and, for partial schedules, the larger the reward magnitude the greater the resistance to extinction. These results were interpreted within the framework of the sequential effects hypothesis (Capaldi, 1966).     

Effects of repeated acquisitions and extinctions on response rate and pattern

The procedure developed by R. A. Rescorla (2002) was used to study the effects of repeated acquisitions and extinctions of head entry responses into a food cup by rats. In each of 4 20-session phases, food was delivered at the end of particular 30-s auditory and visual stimuli, but not at the end of different 30-s auditory and visual stimuli. Based on response rates to individual stimuli and compound stimuli, the increase in response rate in acquisition occurred more rapidly than the decrease in extinction. Acquisition, but not extinction, occurred faster after successive transitions between acquisition and extinction. Temporal gradients of responding developed during acquisition and remained during extinction. Conclusions based on mean response rate, temporal gradients, and transfer tests were consistent.     

Nonaware classical conditioning to pictorial facial stimuli in a between-groups paradigm

The present experiment investigated the effects of aware and nonaware modes of extinction in classical conditioning to facial emotional stimuli. The subjects participated in three different experimental phases. In the first (habituation) phase they were presented with a 500 ms angry face. In the second (acquisition) phase, for half of the subjects the 500 ms face was paired with an aversive noise (experimental group) while for the other half of the subjects the face and the noise presentations were separated by 6–10 s intervals (sensitization control group). In the third (extinction) phase, these two groups were further divided into two subgroups. One subgroup of both the experimental and control group had the face stimulus presented for 30 ms, and immediately masked with a neutral picture. The other two subgroups had the face presented for 500 ms with no mask. The results showed that conditioning only occurred in the experimental subgroups which was indicated by a significant difference between skin conductance responses during habituation and corresponding responses during extinction. Secondly, comparing the experimental and control groups during the extinction phase, a significant conditioning effect was observed for both the aware and nonaware masked modes of extinction for the experimental group. The results suggest that conditioned autonomic responses may be elicited in a nonaware mode.     

Effect of effort and latent extinction on resistance to extinction

Sixty-four male Wistar rats were given acquisition training in an enclosed straight-alley runway which could be adjusted for angles of inclination. The 2×2×2 design involved two angles of inclination in acquisition (0° and 40°) and two angles of inclination in extinction (0° and 40°). Between acquisition and extinction, half the subjects were exposed to a latent extinction procedure and half served as controls. Number of responses in a 30-min extinction session was an inverse function of effort required in extinction. Additionally, latent extinction procedures resulted in reduced resistance to extinction, but only when the effort conditions of acquisition and extinction were constant. When the effort conditions of acquisition and extinction were dissimilar, latent extinction procedures resulted in increased resistance to extinction. The results raise questions about the nature of the learning which occurs during latent extinction training.     

Nonaware classical conditioning to pictorial facial stimuli in a between-groups paradigm.

The present experiment investigated the effects of aware and nonaware modes of extinction in classical conditioning to facial emotional stimuli. The subjects participated in three different experimental phases. In the first (habituation) phase they were presented with a 500 ms angry face. In the second (acquisition) phase, for half of the subjects the 500 ms face was paired with an aversive noise (experimental group) while for the other half of the subjects the face and the noise presentations were separated by 6-10 s intervals (sensitization control group). In the third (extinction) phase, these two groups were further divided into two subgroups. One subgroup of both the experimental and control group had the face stimulus presented for 30 ms, and immediately masked with a neutral picture. The other two subgroups had the face presented for 500 ms with no mask. The results showed that conditioning only occurred in the experimental subgroups which was indicated by a significant difference between skin conductance responses during habituation and corresponding responses during extinction. Secondly, comparing the experimental and control groups during the extinction phase, a significant conditioning effect was observed for both the aware and nonaware masked modes of extinction for the experimental group. The results suggest that conditioned autonomic responses may be elicited in a nonaware mode.     

Biological vs experiential factors in phobic conditioning

The present study was performed as a test of phobic conditioning being a case of prepared learning (Seligman, 1971). Skin conductance responses were conditioned in three groups of subjects to either slides of snakes and spiders; electric outlets; or geometric shapes, as conditioned stimuli (CSs) with shock to the forearm as the unconditioned stimulus (UCS). The purpose of the experiment was to compare electrodermal conditioning to potentially phobic CSs, i.e. snakes and spiders, with conditioning to fear-relevant, but non-phobic, CSs, i.e. electric outlets.Each subject saw two pictures, either a snake or a spider; or two different slides of electric outlets; or two different geometric shapes. Only one of the two cues (the CS + ) was immediately followed by the shock-UCS during the acquisition phase. Thus, a differential paradigm was used. There were 4 habituation, 12 acquisition, and 16 extinction trials. The duration of the pictures was 8 sec with an intertrial interval of between 35–45 sec.The results showed reliable effects of conditioning in all three groups during the acquisition phase. Furthermore, a significant interaction during extinction is reported, indicating responses to potentially phobic CSs to be more resistant to extinction than responses to the other two classes of stimuli. It is concluded that the present results favor an interpretation of phobic conditioning in terms of biologically prepared learning.     

Delay of gratification in children: The effects of training under fixed,decreasing and increasing delay of reward

The effect of fixed, gradually decreasing, or increasing delay of reward in discimination learning on later delay of gratification was investigated. In discrimination training, employing a correction procedure, a candy reward was delivered either after 0, 10, 20, 40 or 60 sec fixed delay; or after 60 sec in the first block of trials and decreased in successive block; or reward was immediate in the first block of trials and delay was gradually increased to 60 sec. In the delay of gratification tests, subjects could press a button immediately to receive a small reward (one candy or a cheap toy) or delay pressing and receive an increasingly larger reward (more candy or a better toy).Learning was not significantly affected by either fixed or decreasing delays. Increasing delays resulted in faster learning than decreasing delays. The increasing delay group demonstrated superior delay of gratification on both tests. Fixed delay groups did not differ significantly among themselves, nor from the decreasing delay group. The effectiveness of exposure to increasing delays in facilitating delay of gratification was interpreted as due to either the acquisition of coping responses or the extinction of frustration.     

Orbital prefrontal cortex and guidance of instrumental behavior of rats by visuospatial stimuli predicting reward magnitude

The orbital prefrontal cortex (OPFC) is part of a circuitry mediating the perception of reward and the initiation of adaptive behavioral responses. We investigated whether the OPFC is involved in guidance of the speed of instrumental behavior by visuospatial stimuli predictive of different reward magnitudes. Unoperated rats, sham-lesioned rats, and rats with bilateral lesions of the OPFC by N-methyl-D-aspartate (NMDA) were trained in a visuospatial discrimination task. The task required a lever press on the illuminated lever of two available to obtain a food reward. Different reward magnitudes were permanently assigned to lever presses to respective sides of the operant chamber; that is, responses to one lever (e.g., the left one) were always rewarded with one pellet and responses to the other lever with five pellets. On each trial, the position of the illuminated lever was pseudorandomly determined in advance. Results revealed that OPFC lesions did not impair acquisition of the task, as the speed of conditioned responses was significantly shorter with expectancy of a high reward magnitude. In addition, during reversal, shift and reshift of lever position–reward magnitude contingencies and under extinction conditions, performance of the OPFC-lesioned and control groups did not differ. It is concluded that the OPFC in rats might not be critical for adapting behavioral responses to changes of stimulus–reward magnitude contingencies signaled by visuospatial cues.     

Amygdala and hippocampal activity during acquisition and extinction of human fear conditioning

Previous functional magnetic resonance imaging (fMRI) studies have characterized brain systems involved in conditional response acquisition during Pavlovian fear conditioning. However, the functional neuroanatomy underlying the extinction of human conditional fear remains largely undetermined. The present study used fMRI to examine brain activity during acquisition and extinction of fear conditioning. During the acquisition phase, participants were either exposed to light (CS) presentations that signaled a brief electrical stimulation (paired group) or received light presentations that did not serve as a warning signal (control group). During the extinction phase, half of the paired group subjects continued to receive the same treatment, whereas the remainder received light alone. Control subjects also received light alone during the extinction phase. Changes in metabolic activity within the amygdala and hippocampus support the involvement of these regions in each of the procedural phases of fear conditioning. Hippocampal activity developed during acquisition of the fear response. Amygdala activity increased whenever experimental contingencies were altered, suggesting that this region is involved in processing changes in environmental relationships. The present data show learning-related amygdala and hippocampal activity during human Pavlovian fear conditioning and suggest that the amygdala is particularly important for forming new associations as relationships between stimuli change.     

Order of partial and consistent reward,reward magnitude shift,and resistance to extinction

In a separate-phase runway experiment with rats, four schedules involving partial (P) and consistent (C) reward (CC, CP, PC, and PP) were crossed with three reward magnitude shift conditions (upshift, nonshift, and downshift). The data revealed three major findings: (a) Reward magnitude downshift generally led to rapid extinction; (b) consistent reward prior to partial reward (CP) resulted in slower extinction than the reverse order (PC) under conditions of reward magnitude shift (particularly downshift); and (c) the relative performance of PC and CP under conditions of reward magnitude shift was reversed from postshift to extinction. On the basis of these data it was suggested that processes not presently identified by reinforcement level theory and stimulus analyzer theory influence extinction following separate-phase acquisition. A modification of reward level theory was presented to provide an account of extinction performance following separate-phase reward reduction.     

The physical properties of bar-pressing behaviour and the problem of reactive inhibition

Many of the terms used in the literature on reactive inhibition are vague, subjective or incorrect. The weighted bar is not a suitable device in the study of this problem, since it records irrelevant aspects of behaviour. An experiment using apparatus which gives a continuous record of the force which a rat applies to a knob produces the following results. After much practice, pressing becomes sharp and brief and the amount of activity per reward is reduced. Under conditions of no (intentional) secondary reward the amount of activity during extinction is at first positively correlated with the average activity per reward during training, but the correlation diminishes as extinction proceeds. With auditory secondary reward there is no correlation.     

Effect of schedule and magnitude of reinforcement on instrumental learning in the toad, Bufo arenarum

Extinction after training with continuous (CR) or 50% partial (PR) reinforcement, and with different magnitudes of reward, was studied in the amphibian Bufo arenarum, in a runway situation. In Experiment 1, a group of toads received massed-trial, CR training with access to water as the reward. Performance improved during acquisition, including an improvement on the first trial of each session. Extinction was rapid and there was evidence for spontaneous recovery of the running response. In Experiment 2, groups of toads received PR or CR training at a rate of one trial per day. PR impaired acquisition and resulted in poor responding during extinction, compared to CR. Experiment 3 factorially studied the effects of schedule (PR vs CR) and distribution of practice (15 s vs 300 s intertrial interval). Acquisition was impaired by PR training but had little effect on extinction performance. Different magnitudes of water reinforcement were used in Experiment 4 in a one-trial-per-day situation. Terminal acquisition performance was a monotonic function of reward magnitude, but there were no differences in extinction performance across groups. The results are discussed in relation to comparative and developmental data on the paradoxical effects of reward.     

Transfer of approach responding between punishment, frustrative nonreward, and the combination of punishment and nonreward

Rats trained to make an approach response with either partial reward, intermittent punishment, or a combination of partial reward and intermittent punishment, were tested for persistence to extinction, punishment with reward, or punishment during extinction. Partial reward, alone or with punishment, produced greates resistance to extinction, while intermittent punishment, alone or with partial reward, produced greatest persistence to punishment with reward. Transfer of persistence from partial reward to punishment with reward and intermittent punishment to extinction was also demonstrated. However, partial reward alone did not increase persistence to punishment during extinction, whereas intermittent punishment and partial reward combined with intermittent punishment did increase such persistence. These results were interpreted in Amsel's (1958, 1962) conditioning-model theory by extending the hypothesized similarity of frustrative nonreward and punishment.     

Resistance to satiation of consummatory and instrumental performance

In three experiments rats received training in a straight alley under high hunger and then were tested satiated. Both eating and running continued to occur under satiation, but the two responses were not completely correlated, and continued running did not depend upon continued eating. Further, groups differed in their eating behavior, although all experienced the same satiation procedure, suggesting that eating under satiation is not just a reflection of incomplete satiation. Resistance to satiation of the running response was greater following partial reward than following consistant reward and tended to be greater following small reward training than large reward training, regardless of schedule of reward. Eating during satiation was greater following partial than following consistent reward and was greater if the same reward magnitude was given in satiation as in acquisition than if a different reward magnitude was given. It was suggested that resistance to satiation is an associative phenomenon. Eating and running occur during satiation because the stimuli present during satiation continue to elicit them. The differences between results using rewarded satiation and results using high drive extinction as measures of persistence were attributed to satiation being nonfrustrating.     

A demonstration of observational learning in rats using a bidirectional control

Hungry rats observed a conspecific demonstrator pushing a single manipulandum, a joystick, to the right or to the left for food reward and were then allowed access to the joystick from a different orientation. The effects of right-pushing vs left-pushing observation experience on (1) response acquisition, (2) reversal of a left-right discrimination, and (3) responding in extinction, were examined. Rats that had observed left-pushing made more left responses during acquisition than rats that had observed right-pushing, and rats that had observed demonstrators pushing in the direction that had previously been reinforced took longer to reach criterion reversal and made more responses in extinction than rats that had observed demonstrators pushing in the opposite direction to that previously reinforced. These results provide evidence that rats are capable of learning a response, or a response-reinforcer contingency, through conspecific observation.     

Apparent Incentive Contrast Effects in Autoshaping with Rats

The effects of shifts in reward quality and quantity on Pavlovian acquisition were studied in rats. In Experiment 1, animals preexposed to unsignaled food pellets, 10% sucrose solution, or home cage controls subsequently received autoshaping training (response-independent lever-pellet or lever-solution pairings, in three groups each). Unsignaled preexposure to sucrose solution facilitated autoshaping for pellets (relative to unshifted controls), whereas unsignaled preexposure to pellets retarded autoshaping for sucrose solution. In Experiment 2, unsignaled preexposure to 30% sucrose solution impaired acquisition reinforced by food pellets, relative to 2% solution. Using a choice procedure, Experiment 3 demonstrated that rats prefer pellets to either 2 or 10% sucrose solutions, but they prefer the 30% solution to the pellets. Experiment 4 demonstrated the facilitatory effect after an upward shift in reward magnitude rather than quality (from 1 to 12 pellets), but provided weaker evidence for retardation following a downward magnitude shift. Experiment 5 was similar to Experiment 4, except that animals received autoshaping training from the outset. No evidence of successive positive contrast was obtained, but there was a significant successive negative contrast effect. Moreover, extinction was faster after acquisition with 12 pellets rather than 1. These results suggest the presence of incentive contrast effects under Pavlovian training conditions.     

Response production during extinction training is not sufficient for extinction of evaluative conditioning

Two high-powered experiments examined the role of evaluative response production in the extinction of evaluative conditioning (EC) by positioning EC in the procedural and conceptual framework of classical conditioning (CC). According to Rescorla's response inhibition hypothesis, more frequent responding during extinction training results in larger extinction during testing. Experiment 1 used three extinction conditions following response acquisition in an EC procedure: evaluative responses were measured only after extinction; after acquisition and after extinction; or were continuously measured after acquisition, during extinction and after extinction. Based on Rescorla's response inhibition hypothesis, we predicted that extinction of EC would be the highest in the third condition. Experiment 2 was aimed at further facilitating extinction of EC by encouraging participants to experience that their evaluation may change over the course of the experiment. To this end, half of the participants completed pre- and post-acquisition ratings prior to practicing continuous response expression in the extinction phase. Contrary to our predictions, no extinction of EC was observed in either of these experiments. We conclude that Rescorla's inhibition response hypothesis may not apply to EC and discuss the theoretical implications of this finding.