Incentive shift in the rat following training to resist punishment

An incentive shift paradigm was used to test for the similarity of fear and frustration. In Experiment 1, rats trained to resist electric shock punishment showed neither a negative contrast effect nor any performance decrement when reward was shifted from 10 to one pellet. Experiment 2 replicated the basic findings of Experiment 1, but also showed that punishment training did not influence the magnitude of performance shift for animals receiving increases in reward magnitude. Finally, Experiment 3 additionally found that rats sensitized to punishment showed an increase in negative contrast effect. These results support the hypothesized functional similarity between conditioned fear and conditioned frustration with learned persistence or sensitivity to one generalizing to the other as suggested by Amsel's (1972) theory of persistence.     

Resistance to extinction versus extinction as discrimination

The hypothesis that response strength might be measured by persistence of responding in the face of extinction was discredited in the 1960s because experiments showed that responding persists longer following intermittent reinforcers than following continuous reinforcers. Instead, researchers proposed that the longer persistence following intermittent reinforcers arises because intermittent reinforcement more closely resembles extinction—a discrimination theory. Attention to resistance to extinction revived because one observation seemed to support the persistence hypothesis: Following training on a multiple schedule with unequal components, responding usually persisted longer in the formerly richer component than in the formerly lean component. This observation represents an anomaly, however, because results with single schedules and concurrent schedules contradict it. We suggest that the difference in results arises because the multiple-schedule procedure, while including extensive training on stimulus discrimination, includes no training on discrimination between food available and food unavailable, whereas comparable single- and concurrent-schedule procedures include such training with repeated extinction. In Experiment 1, we replicated the original result, and in Experiment 2 showed that when the multiple-schedule procedure includes training on food/no-food discrimination, extinction following multiple schedules contradicts behavioral momentum theory and agrees with the discrimination theory and research with single and concurrent schedules.     

The sunk cost effect with pigeons: some determinants of decisions about persistence

The sunk cost effect occurs when an individual persists following an initial investment, even when persisting is costly in the long run. The current study used a laboratory model of the sunk cost effect. Two response alternatives were available: Pigeons could persist by responding on a schedule key with mixed ratio requirements, or escape by responding on a second key. In Experiment 1, mean response requirements for persistence and escape were varied across conditions. Pigeons persisted (committing the sunk cost error) when persisting increased the mean response requirement only slightly but not when persisting was sufficiently nonoptimal. Experiment 2 explored more systematically combinations of ratios and probabilities assigned to the schedule key. Persistence varied with the ratio of the mean global response requirements for persistence and escape. In Experiment 3, transitions between ratios were signaled. This reduced nonoptimal persistence, and produced some instances of a reverse sunk cost error--escaping when persistence was optimal. In Experiment 4, it was optimal to escape after the second-smallest ratio ever presented. Pigeons escaped at approximately the optimal juncture, especially in conditions with added signals. Overall, this series of experiments suggests that the sunk cost error may arise in part because persistence is the default behavioral strategy in situations where the contingencies for escape and persistence are insufficiently disparate and/or it is relatively difficult to discriminate when to escape. The study also demonstrates the utility of animal models of complex decision making situations.     

Transfer of approach responding between punishment, frustrative nonreward, and the combination of punishment and nonreward

Rats trained to make an approach response with either partial reward, intermittent punishment, or a combination of partial reward and intermittent punishment, were tested for persistence to extinction, punishment with reward, or punishment during extinction. Partial reward, alone or with punishment, produced greates resistance to extinction, while intermittent punishment, alone or with partial reward, produced greatest persistence to punishment with reward. Transfer of persistence from partial reward to punishment with reward and intermittent punishment to extinction was also demonstrated. However, partial reward alone did not increase persistence to punishment during extinction, whereas intermittent punishment and partial reward combined with intermittent punishment did increase such persistence. These results were interpreted in Amsel's (1958, 1962) conditioning-model theory by extending the hypothesized similarity of frustrative nonreward and punishment.     

Transfer of approach responding between punishment and frustrative nonreward sustained through continuous reinforcement

A block of continuously reinforced nonpunished trials was interpolated between acquisition of a runway response with either partial reinforcement or intermittent punishment and subsequent tests for resistance of that response to the suppressive effects of either extinction or continuous punishment. As previous investigations have shown, both the partial reinforcement effect (PRE) and the intermittent punishment effect (IPE) were sustained through the block of continuously reinforced nonpunished trials. Furthermore, the increased resistance to extinction following intermittent punishment and the increased resistance to punishment following partial reinforcement were also sustained through the interpolated continuous reinforcement. These results support a hypothesized similarity of punishment and frustrative nonreward and were interpreted in an extension of Amsel's conditioning model theory of the role of nonreinforcement in the PRE.     

Resistance to punishment as a function of intensity and frequency of prior punishment experience

Rats with a history of intermittent punishment have been found to persist in the face of continuous punishment. It was predicted from an extension of frustration theory to punishment that increasing the intensity or frequency of intermittent punishment would increase persistence to high fear elicited by continuous punishment. Two experiments, employing 310 rats, verified this prediction for both intensity and frequency manipulations but indicated rather narrow boundary conditions for their effects.     

Relative persistence of avoidance and positively reinforced behavior

In one experiment with rats, and a second with pigeons, subjects were trained on a schedule in which identical response dependencies applied to intermittent receipt of positive reinforcement (PR) for one group and avoidance (AV) of shock for a second group. After obtaining comparable stable training performance for groups PR and AV, persistence tests were conducted with a traditional extinction (EXT) procedure vs. response-independent (FREE) delivery of positive reinforcers or shocks. In both experiments, response elimination was rapid in EXT for groups PR and AV, and responding tended to be maintained in groups PR and AV in the FREE persistence test. These results contradict the widely held assumption that avoidance behavior is unusually resistant to extinction, and they call for a re-examination of elimination of avoidance responding.     

Spill‐over effects of intermittent costs for defection in social dilemmas

This research investigates the role of intermittent monetary costs in restraining individuals from defection in social dilemmas. In Experiment 1, 104 car owners made fictitious choices between a slow and a fast travel mode in the context of a continuous social dilemma. There were four different conditions of monetary costs for choosing the fast mode (defection): no cost, low cost, high cost to self, or high cost to others. Participants defected most when there was no cost and least when they themselves were charged a high cost. A spill‐over effect was obtained such that when others were charged a high cost to defect, defection rates were lower than under no cost. Experiment 2 used 36 undergraduates as participants in an iterated decision task with real groups. The results replicated the major results of Experiment 1. Furthermore, whereas prosocials were strongly affected by intermittent costs for defection (i.e. showed large spill‐over effects), proselfs seemed to be unaffected. Possible explanations of this interaction effect between social value orientation and intermittent punishment for defection are provided. Copyright © 2002 John Wiley & Sons, Ltd.     

Generalized imitative affection: Relationship to prior kinds of imitation training

Two experiments utilizing first- and second-grade Canadian children showed that generalized imitative physical affection was most facilitated by prior imitative physical contact training (as opposed to verbal contact training) when the object of the affection was either a toy teddy bear, Experiment I, or an adult human, Experiment II.Additional findings from Experiment I showed that generalized imitative physical aggression was equally facilitated by imitative physical contact training and that punishment, as well as extinction operations applied to training imitations, resulted in suppression of all generalized imitations with no differential effect of punishment on affection or aggression being noted.The lack of any persisting imitations in a control group in Experiment II, which received noncontingent reinforcement but instructional prompting for training imitations, suggested that instructional control of imitation responses was initially weak and that the contingency between reinforcement and training imitations was critical for continued occurrence of training imitations and any occurrence of generalized physical affection imitations.     

Spatial-frequency-dependent visible persistence and specific reading disability

Visible persistence duration for sine-wave gratings was measured in 9-year-old normal and specific-reading-disabled children. Experiment 1 investigated the influence of stimulus duration on visible persistence. The results demonstrated a Reading Group X Spatial Frequency interaction with disabled readers showing a smaller increase in persistence duration with increasing spatial frequency than controls. This interaction was greatest with stimulus durations longer than 80 msec. In Experiments 2a and 2b persistence was measured across a range of contrasts from .1 to .5. The stimulus durations employed were 100 msec in Experiment 2a and 300 msec in Experiment 2b. In both experiments, increasing contrast decreased persistence duration at 2 and 12 cycles per degree (c/deg) for the control group. In the specific-reading-disabled group, however, contrast had little effect on the persistence of 2-c/deg gratings in either experiment. In Experiment 2a the persistence of the 12-c/deg grating decreased with increasing contrast for both groups. In Experiment 2b contrast had significantly less effect on persistence duration in the specific-reading-disabled group, however, contrast had little effect on the persistence of 2-c/deg ratings in either experiment. In Experiment 2b contrast had significantly less effect on persistence duration in the specific-reading-disabled group than in the control group at 12 c/deg. Consequently, contrast had less effect on persistence in specific-reading-disabled children than in normal readers, especially at durations longer than the "critical duration" for each spatial frequency. Experiment 3 extended this finding to gratings with spatial frequencies of 4 and 8 c/deg. These results indicate a difference between normal and specific-reading-disabled children in cortical visible persistence. Two scores of visual processing were derived from the above experiments. On these scores the reading-disabled children were divided into Visual Disabled Readers (approximately 70%--eight subjects) and Nonvisual Disabled Readers (approximately 30%--four subjects). The percentages of disabled readers in each category remained constant when the sample size was increased to 61 normal and disabled readers.     

The transfer of specific and general consequential functions through simple and conditional equivalence relations

The purpose of this study was to examine the transfer of consequential (reinforcement and punishment) functions through equivalence relations. In Experiment 1, 9 subjects acquired three three-member equivalence classes through matching-to-sample training using arbitrary visual forms. Comparison stimuli were then given conditioned reinforcement or punishment functions by pairing them with verbal feedback during a sorting task. For 8 of the 9 subjects, trained consequential functions transferred through their respective equivalence classes without additional training. In Experiment 2, transfer of function was initially tested before equivalence testing per se. Three of 4 subjects showed the transfer without a formal equivalence test. In Experiment 3, 3 subjects were given training that gave rise to six new three-member conditional equivalence classes. For 2 of the subjects, the same stimulus could have either a reinforcement or punishment function on the basis of contextual cues that defined its class membership. Experiment 4 assessed whether equivalence training had established general or specific consequential functions primarily by adding novel stimuli in the transfer test. Subjects treated even novel feedback stimuli in the transfer test as consequences, but the direction of consequential effects depended upon the transfer of specific consequential functions through equivalence relations.     

Rapid acquisition of discrete-trial lever-press avoidance: effects of signal-shock interval

Acquisition of discrete-trial lever-press avoidance learning was studied in three experiments. Experiment I compared a new training procedure, which produces rates of lever-press avoidance learning comparable to those obtained in shuttle boxes, with a “conventional”, less efficient training procedure. A factorial design was used to compare continuous versus intermittent shock and a long-variable versus a short-fixed signal-shock interval. Learning was best in the groups trained with the long and variable interval and poorest in those trained with the short and fixed interval. Type of shock had no effect. Experiment II separated the effects of duration from those of variability of the signal-shock interval. Fixed and variable intervals of 10 and 60 sec were tested and duration was the only significant factor. Experiment III addressed the effect of the differential opportunity to avoid provided by long signal-shock intervals by varying this interval from 10 to 60 sec in 10-sec steps. Only the 10-sec group showed slow acquisition relative to the others. Analysis of avoidance response latencies showed that the distributions for all groups were positively skewed and that skewness increased with increasing duration of the signal-shock interval. At intervals longer than 20 sec, the animals made progressively less use of their increased opportunity to respond. The data do not support the opportunity-to-respond interpretation of the effects of duration of signal-shock interval and suggest that some type of inhibitory process may block lever-press avoidance learning at intervals as short as 10 sec. The significance of these findings for species-specific defense reaction and preparedness theories was emphasized.     

Human Signal-detection Performance: Effects Of Signal Presentation Probabilities And Reinforcer Distributions

University students participated in one of four standard two-choice signal-detection experiments in which signal presentation probability was varied and the reinforcement distribution was held constant and equal. In Experiments 1, 3 and 4, subjects' performance showed a systematic response bias for reporting the stimulus presented least often. Experiments 1 and 4 showed that this effect was reliable with extended training and monetary, rather than point, reinforcement. In Experiment 2, all correct responses were signaled in some way, and this produced the opposite relationship between signal presentation probability and response bias. Experiments 1 and 3 found that explicitly deducting money (intended as punishment) for equal numbers of incorrect responses on each alternative, or varying the obtained overall rate of reinforcement, produced no clear change in response bias. The bias, shown by humans, for reporting the stimulus presented least often remains a challenge for theories of stimulus detection.     

Extinction after partial reinforcement: predicted vs. judged persistence

The partial reinforcement extinction effect (PREE) (i.e., increased persistence following partial reward) is one of the most important generalizations from experimental studies of learning. Many theories of PREE assume that it involves cognitive and emotional mechanisms, but investigations of PREE have focused almost exclusively on behavioral measures. Four experiments with human adults investigated whether PREE is also reflected in cognitive measures. Independent groups of subjects learned an instrumental response under CRF vs. PRF contingencies, and then predicted (Experiments 1, 2, and 3) and/or judged (Experiments 3 and 4) their own persistence under extinction conditions. Predictions of persistcnce were unrelated to prior continuous or partial reinforcement contingencies (Experiments 1, 2, and 3), but subsequent judgments of persistence behavior were accurate (Experiments 3 and 4). These results indicate that increased persistence due to occasional reward is not well represented cognitively prior to its behavioral manifestation, but it is well represented after that manifestation. Possible explanations and implications of this apparent behavior cognition dissociation are discussed.     

On knowing when to quit: Task failure, self-esteem, advice, and nonproductive persistence

Past research has found the performance of persons with high self-esteem to improve after failure, especially on tasks for which persistence correlates positively with performance. However, persistence may be nonproductive in some situations. Experiment 1 used a task for which persistence and performance were uncorrelated; subjects high in self-esteem persisted longer but performed worse than did those with low self-esteem, particularly after prior failure feedback. Experiment 2 tested whether differential sensitivity to advice about the efficacy of persistence mediates nonproductive persistence. High self-esteem subjects who received explicit advice against nonproductive persistence on a puzzle-solving task still tended to persist longer on unsolvable puzzles than did low self-esteem subjects. The implications of high self-esteem subjects' tendency to engage in nonproductive persistence are discussed.     

Further evaluation of prompt density,rate of reinforcement,and the persistence of manding

Previous research has evaluated the effects of prompt rates on the rate of communicative behavior. More recent research has suggested that dense prompting can result in communicative behavior that is more resistant to change. However, existing research has not considered the impact that higher response rates had on reinforcement rate, a variable known to impact response persistence. The current study systematically replicated previous research by evaluating communicative responding in contexts associated with dense- and lean-prompt schedules and extended existing research by (a) holding reinforcement rates similar across the two prompting schedules (lean and dense), and (b) evaluating the persistence of communicative responding in the contexts associated with each prompting schedule. The results for Experiment 1 clearly replicated and extended previous research. The results for Experiment 2 were equivocal and suggested that previous reinforcement history and response class size impacted outcomes.     

Intermittent vs continuous stimulation in the development of kinesthetic spatial aftereffects

The effect on the KSAE of intermittent versus continuous stimulation from a wooden block between thumb and finger was studied by the method of magnitude estimation. Two groups rubbed the inducing block continuously for 2 min, one actively and one passively. A third group felt the block for 3 sec in each 10 sec, and a control group had no contact with the inducing block. The control group showed significant pseudo-KSAE. Significant KSAE in comparison with the control group was observed in the intermittent stimulation group and the passive, continuous stimulation group. The finding of greatest KSAE in the intermittent stimulation group was interpreted as evidence against response decrement theories of KSAE.     

The partial punishment effect following minimal acquisition training: Sodium amobarbital and the stimulus properties of early punished trials

In a runway investigation, six groups of rats received limited runway training such that partial punishment, partial reinforcement, or continuous reinforcement was accompanied by sodium amobarbital or saline. Following an interpolated phase of continuous reinforcement without injections, all groups were given punished extinction. The entire experiment was conducted under widely spaced conditions (ITI = 24 hr). It was found that partial punishment increased resistance to punished extinction relative to partially and continuously reinforced controls when acquisition was given under saline. When partial punishment training was accompanied by amobarbital this effect was eliminated. The drug was observed to have no effect on the punished extinction performance of the partial reinforcement and continuous groups, respectively. Moreover, the partial reinforcement effect (PRE) did not generalize to punished extinction. These data provide information concerning the difference between the stimuli associated with the early trials of punishment and nonreward and indicate that the former but not the latter contain emotional elements.     

支付与报复：成本形式对第三方惩罚的影响

第三方惩罚不仅对惩罚成本的数量敏感,也对成本形式敏感。在保持成本数量相等的情况下,不同形式的惩罚成本会对第三方惩罚的频率产生不同影响。相较支付形式,当惩罚成本采取报复形式时,被试的第三方惩罚频率显著下降。进一步的实验表明,惩罚频率的变化并非因为不同的成本形式所隐含的风险水平有所差异,而是因为被试对不同的成本形式赋予了不同的主观价值。进一步探索更多形式的惩罚成本是未来研究的重要方向。     

EFFECTS OF INTERMITTENT PUNISHMENT ON SELF-INJURIOUS BEHAVIOR: AN EVALUATION OF SCHEDULE THINNING

Although the use of punishment often raises ethical issues, such procedures may be needed when the reinforcers that maintain behavior cannot be identified or controlled, or when competing reinforcers cannot be found. Results of several studies on the effects of intermittent schedules of punishment suggest that therapists must use fairly rich schedules of punishment to suppress problem behavior. However, residential caretakers, teachers, and parents often have difficulty implementing programs that require constant monitoring of the client's behavior. In this study, we examined the feasibility of gradually thinning the delivery of punishment from a continuous schedule to an intermittent schedule during the course of treatment for self-injurious behavior (SIB). Results of functional analyses for 5 individuals who had been diagnosed with profound mental retardation indicated that their SIB was not maintained by social consequences. Treatment with continuous schedules of time-out (for 1 participant) or contingent restraint (for the other 4 participants) produced substantial reductions in SIB. When they were exposed to intermittent schedules of punishment (fixed-interval [FI] 120 s or FI 300 s), SIB for all but 1 of the participants increased to levels similar to those observed during baseline. For these 4 participants, the schedule of punishment was gradually thinned from continuous to FI 120 s or FI 300 s. For 2 participants, SIB remained low across the schedule changes, demonstrating the utility of thinning from continuous to intermittent schedules of punishment. Results for the other 2 participants showed that intermittent punishment was ineffective, despite repeated attempts to thin the schedule.