EFFECT OF REINFORCER MAGNITUDE ON PERFORMANCE MAINTAINED BY PROGRESSIVE‐RATIO SCHEDULES

This experiment examined the relationship between reinforcer magnitude and quantitative measures of performance on progressive‐ratio schedules. Fifteen rats were trained under a progressive‐ratio schedule in seven phases of the experiment in which the volume of a 0.6‐M sucrose solution reinforcer was varied within the range 6–300 μl. Overall response rates in successive ratios conformed to a bitonic equation derived from Killeen's (1994) Mathematical Principles of Reinforcement. The “specific activation” parameter, a, which is presumed to reflect the incentive value of the reinforcer, was a monotonically increasing function of reinforcer volume; the “response time” parameter, δ, which defines the minimum response time, increased as a function of reinforcer volume; the “currency” parameter, b, which is presumed to reflect the coupling of responses to the reinforcer, declined as a function of volume. Running response rate (response rate calculated after exclusion of the postreinforcement pause) decayed monotonically as a function of ratio size; the index of curvature of this function increased as a function of reinforcer volume. Postreinforcement pause increased as a function of ratio size. Estimates of a derived from overall response rates and postreinforcement pauses showed a modest positive correlation across conditions and between animals. Implications of the results for the quantification of reinforcer value and for the use of progressive‐ratio schedules in behavioral neuroscience are discussed.     

金钱概念激活与金钱功能偏好对自我损耗后利他的影响

金钱启动能够提高自我损耗后个体的利他,而金钱功能也可能对损耗后个体利他产生不可忽视的影响。实验让处于自我损耗状态的被试数金钱或白纸,然后测量其利他水平及其对金钱功能的内隐偏好。结果证实了金钱启动的积极效应。此外,在数金钱和数白纸两种条件下,金钱象征性功能偏好对自我损耗后个体利他的效应是相反的。这表明,激活金钱概念与偏好金钱象征性功能都有可能补偿自我损耗后的消极影响,但两者的补偿作用是相互独立的。     

CPM领导行为模式对员工利他行为及工作投入的作用机制

通过对我国26个省市企事业单位员工的问卷调查,探讨了CPM领导行为模式对员工利他行为和工作投入的影响途径。采用潜变量路径分析的方法,对两个阶段的模型进行检验和比较,结果表明：（1）C因素和M因素通过信任上司的完全中介作用影响利他行为和工作投入,而P因素则通过信任上司的部分中介作用对它们产生影响。（2）信任上司通过情感承诺的完全中介作用影响工作投入,通过情感承诺的部分中介作用影响员工的利他行为。     

Effect of reinforcer devaluation on discriminative control of instrumental behavior

Two experiments examined the effect of reinforcer devaluation on the ability of a discriminative stimulus (Sd) to control instrumental behavior in Sprague-Dawley rats. In Experiment 1 reinforcer devaluation reduced, but did not eliminate, the ability of the Sd to control performance of the original response and to transfer its control to a new response trained with the same reinforcer. The effect of devaluation was more complete in Experiment 2, in which the reinforcer was delivered directly into the oral cavity. However, retraining the response with a different reinforcer partially restored the ability of the Sd to control performance of that response. These results suggest that an Sd may not augment its trained responses when the reinforcer has been completely devalued but may promote responses with which it shares a reinforcer, as long as those responses are associated with some reinforcer that retains its value. The implications of these results for the way that discriminative stimuli control instrumental behavior are discussed.     

Reinforcement Probability and Delay as Determinants of Human Impulsiveness

In behavior theory, “impulsiveness” refers to the choice of an immediate, small reinforcer over a delayed, large reinforcer. Such behavior generally is attributed to a reduction in the value of the large reinforcer as a function of the duration of delay. In contrast, social learning theorists have suggested that human impulsiveness can result from a lowered “expectancy” (subjective probability) of reinforcement. Effects of probability and delay were assessed by asking adults to make repeated choices between reinforcement schedules in which the reinforcers were slides of entertainment figures. An immediate, 5-s reinforcer was consistently chosen over an immediate, 40-s reinforcer if the probability of receiving the large reinforcer had previously been low (.20), implying that impulsiveness can occur without time-based discounting. However, reinforcement delay was also influential: Choice between a certain, small reinforcer and an uncertain, large reinforcer varied according to which reinforcer was immediate and which delayed.

     

Mysteries of morality

Evolutionary theories of morality, beginning with Darwin, have focused on explanations for altruism. More generally, these accounts have concentrated on conscience (self-regulatory mechanisms) to the neglect of condemnation (mechanisms for punishing others). As a result, few theoretical tools are available for understanding the rapidly accumulating data surrounding third-party judgment and punishment. Here we consider the strategic interactions among actors, victims, and third-parties to help illuminate condemnation. We argue that basic differences between the adaptive problems faced by actors and third-parties indicate that actor conscience and third-party condemnation are likely performed by different cognitive mechanisms. Further, we argue that current theories of conscience do not easily explain its experimentally demonstrated insensitivity to consequences. However, these results might be explicable if conscience functions, in part, as a defense system for avoiding third-party punishment. If conscience serves defensive functions, then its computational structure should be closely tailored to the details of condemnation mechanisms. This possibility underscores the need for a better understanding of condemnation, which is important not only in itself but also for explaining the nature of conscience. We outline three evolutionary mysteries of condemnation that require further attention: third-party judgment, moralistic punishment, and moral impartiality.     

Negative reinforcement and choice in humans

Participants chose between reinforcement schedules differing in delay and/or duration of noise offset. In Experiment 1 it was found that (1) immediate reinforcement was preferred to delayed reinforcement when amounts (durations) of reinforcement were equal; (2) a relatively large reinforcer was preferred to a smaller one when both reinforcers were obtained immediately; and (3) preference for an immediate, small reinforcer versus a delayed, large reinforcer increased as the delay preceding the large reinforcer increased, a sign of “impulsivity”. In Experiment 2, the schedules differed in amount or delay and equal intervals were added either to the constant parameter or the varied parameter. A shift from virtually exclusive preference to indifference occurred in the latter case but not the former, a result supporting a model of self-control that assumes that the value of a schedule depends on the ratio of amount and delay, and that choice between schedules depends on the ratio of these values.     

Unit price as a useful metric in analyzing effects of reinforcer magnitude.

In this paper, we applied the behavioral-economic concept of unit price to the study of reinforcer magnitude in an attempt to provide a consistent account of the effects of reinforcer magnitude on behavior. Recent research in the experimental analysis of behavior and in behavioral pharmacology suggests that reinforcer magnitude interacts with the schedule of reinforcement to determine response rate and total consumption. The utility of the unit-price concept thus stems from its ability to quantify this interaction as a cost-benefit ratio (i.e., unit price = characteristics of the schedule of reinforcement divided by magnitude of reinforcement). Research employing the unit-price concept has shown that as unit price increases, a positively decelerating function exists for consumption (i.e., a function with an increasingly negative slope, when plotted on log coordinates) and a bitonic function exists for response rate. Based on these findings, the present analysis applied the unit-price concept to those studies of reinforcer magnitude and drug self-administration that examined the effects of reinforcer magnitude on response rate using simple schedules of reinforcement (e.g., fixed-ratio schedule). This resulted in three findings: (a) Reinforcer-magnitude manipulations and schedule manipulations interact in a manner that can be quantified in terms of unit price as benefit and cost factors, respectively; (b) different reinforcer-magnitude manipulations are functionally interchangeable as benefit factors in the unit-price ratio; and (c) these conclusions appear warranted despite the differences in reinforcers (food or drug), species (dogs, monkeys, or rats), and schedules (interval or ratio), and despite the fact that these studies were not designed for a unit-price analysis. In methodological terms, these results provide further evidence that employing the unit-price concept is a parsimonious method for examining the effects of reinforcer magnitude. In theoretical terms, these results suggest that a single process may underlie the effect of combined reinforcer-magnitude and schedule manipulations.     

A behavioral economic analysis of concurrently available money and cigarettes.

In economic terms, consumption of a reinforcer is determined by its price and the availability and price of other reinforcers. This study examined the effects of response-requirement (i.e., price) manipulations on the self-administration of two concurrently available reinforcers. Six cigarette smokers participated in 4-hr sessions in which money and puffs on a cigarette were concurrently available according to fixed-ratio schedules of reinforcement. Once stable responding was obtained with both reinforcers available at Fixed Ratio 100, the response requirement for one reinforcer was systematically varied (Fixed Ratio 1,000 and 2,500), while the other reinforcer remained scheduled at Fixed Ratio 100. Increasing the fixed-ratio size for a reinforcer decreased its consumption, with a greater decrease occurring for monetary reinforcement. This finding was quantified in economic terms as own-price elasticity, with elasticity coefficients greater for money than cigarettes. The effects of fixed-ratio size on response output also differed across the two reinforcers. Although greater responding occurred for money at Fixed Ratio 100, increases in fixed-ratio size (for money) decreased responding for money, whereas the same increase in fixed-ratio size (for puffs) increased responding for puffs. Finally, increasing the fixed-ratio size for one reinforcer had little effect on consumption of the other concurrently available reinforcer. This finding was quantified as cross-price elasticity, with elasticity coefficients near 0.0 for most subjects, indicating little or no reinforcer interaction. The results indicate that the reinforcing effects of cigarettes and money in the setting studied here differed, and that the effects produced by changing the price of one reinforcer did not interact with the consumption of the other concurrently available reinforcer.     

Blocking of inhibitory conditioning within a serial conditioned stimulus-conditioned inhibitor compound: Maintenance of acquired behavior without an unconditioned stimulus

Well-trained classically conditioned stimuli, presented unreinforced, were protected from extinction when they were followed by a signal of the omission of the reinforcer (conditioned inhibitor Konorskian type) in eight cats. An aversive classical conditioning paradigm with shock as the reinforcer was used. Of several behavioral (leg flexion, vocalization) and organismic arousal (heart rate, respiration rate, respiration amplitude) measures of conditioned responses, the respiration amplitude changes were found to be most informative for the continuous assessment of elicited arousal of low and medium intensity. In all subjects conditioned stimuli presented during extinction in serial compound with the conditioned inhibitor elicited larger responses than did conditioned stimuli presented alone during extinction. The mechanism of protection from extinction in a paradigm in which the elicitor of learned behavior occurs prior to the conditioned inhibitor provides the organism with the mechanism for the maintenance of learned behavior in the absence of a reinforcer.     

Inhibiting function of reinforcement: magnitude effects on variable-interval schedules

In two experiments, the performance of rats under constant-probability and arithmetic variable-interval schedules respectively was compared when the concentration of a liquid reinforcer was varied within sessions; in other sessions, half of the reinforcers were randomly omitted. When the discriminative function of the reinforcer as a signal for a decrease in the probability of reinforcement was attenuated (the constant-probability schedule) the postreinforcement pause duration was nevertheless an increasing function of reinforcer magnitude. This relationship was also present, but more marked, when the temporal discriminative function of the reinforcer was enhanced (the arithmetic schedule). These results suggested that reinforcement has an unconditioned suppressive effect on the reinforced response distinct from any discriminative function it may acquire. The reinforcement-omission effect, where response rate accelerates following omission, was observed when the reinforcer functioned as an effective temporal discriminative stimulus, but not when such temporal control was absent.     

Response strength in extreme multiple schedules

Four pigeons were trained in a series of two-component multiple schedules. Reinforcers were scheduled with random-interval schedules. The ratio of arranged reinforcer rates in the two components was varied over 4 log units, a much wider range than previously studied. When performance appeared stable, prefeeding tests were conducted to assess resistance to change. Contrary to the generalized matching law, logarithms of response ratios in the two components were not a linear function of log reinforcer ratios, implying a failure of parameter invariance. Over a 2 log unit range, the function appeared linear and indicated undermatching, but in conditions with more extreme reinforcer ratios, approximate matching was observed. A model suggested by McLean (1991), originally for local contrast, predicts these changes in sensitivity to reinforcer ratios somewhat better than models by Herrnstein (1970) and by Williams and Wixted (1986). Prefeeding tests of resistance to change were conducted at each reinforcer ratio, and relative resistance to change was also a nonlinear function of log reinforcer ratios, again contrary to conclusions from previous work. Instead, the function suggests that resistance to change in a component may be determined partly by the rate of reinforcement and partly by the ratio of reinforcers to responses.     

Sensitivity of time allocation to an overall reinforcer rate feedback function in concurrent interval schedules

Six pigeons were trained on concurrent variable-interval schedules in which feedback functions arranged that the overall reinforcer rate either (a) was independent of preference, (b) decreased with increasing absolute preference, or (c) increased with increasing absolute preference. In Experiment 1, the reinforcer rate in an interreinforcement interval was determined by the absolute time-allocation ratio in the previous interval. When arranged reinforcer ratios were varied, there was no evidence of control over preference by overall reinforcer rate. In Experiment 2, the feedback function arranged that reinforcer rates were an inverse function of absolute preference, and window durations were fixed times. In Phase 1, using schedules that provided a four-to-one reinforcer ratio, the window duration was decreased from 20 s to 5 s over four conditions. Then, in Phases 2 and 3, the arranged reinforcer ratios were varied. In Phase 2, the reinforcer rate in the current 5-s time window was determined by preference in the previous 5-s window, and in Phase 3, the window durations were 20 s. Again, there was no indication of control by obtained overall reinforcer rate. These data call into question theories that suggest that the process underlying matching is one of maximizing overall reinforcer rates, or that preference in concurrent aperiodic schedules is controlled to any extent by overall reinforcer rate. They also question the notion that concurrent-schedule preference is controlled by molecular maximizing.     

Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons

Experiment I investigated the effects of reinforcer magnitude on differential-reinforcement-of-low-rate (DRL) schedule performance in three phases. In Phase 1, two groups of rats (n = 6 and 5) responded under a DRI. 72-s schedule with reinforcer magnitudes of either 30 or 300 microl of water. After acquisition, the water amounts were reversed for each rat. In Phase 2, the effects of the same reinforcer magnitudes on DRL 18-s schedule performance were examined across conditions. In Phase 3, each rat responded unider a DR1. 18-s schedule in which the water amotnts alternated between 30 and 300 microl daily. Throughout each phase of Experiment 1, the larger reinforcer magnitude resulted in higher response rates and lower reinforcement rates. The peak of the interresponse-time distributions was at a lower value tinder the larger reinforcer magnitude. In Experiment 2, 3 pigeons responded under a DRL 20-s schedule in which reinforcer magnitude (1-s or 6-s access to grain) varied iron session to session. Higher response rates and lower reinforcement rates occurred tinder the longer hopper duration. These results demonstrate that larger reinforcer magnitudes engender less efficient DRL schedule performance in both rats and pigeons, and when reinforcer magnitude was held constant between sessions or was varied daily. The present results are consistent with previous research demonstrating a decrease in efficiency as a function of increased reinforcer magnituide tinder procedures that require a period of time without a specified response. These findings also support the claim that DRI. schedule performance is not governed solely by a timing process.     

Effects of acute and chronic flunitrazepam on delay discounting in pigeons

Delay to delivery of a reinforcer can decrease responding for that reinforcer and increase responding for smaller reinforcers that are available concurrently and delivered without delay; acute administration of drugs can alter responding for large, delayed reinforcers, although the impact of chronic treatment on delay discounting is not well understood. In this experiment, the effects of repeated administration of the benzodiazepine flunitrazepam were studied in 6 pigeons responding on one key to receive food that was delivered immediately and on a second key to receive a larger amount of food that was delivered following delays which increased across a single session. Pigeons responded predominantly for the large reinforcer when there were no delays and when delays were short; however, as delays increased, responding for the large reinforcer decreased. Acutely, flunitrazepam (0.32, 1.0 and 3.2 mg/kg) dose-dependently increased responding for the large reinforcer, shifting the discounting curve rightward and upward. Repeated administration of flunitrazepam (0.32, 1.0 and 3.2 mg/kg, each for six sessions, separated by one session during which vehicle was administered) did not markedly alter its effects on responding for the large reinforcer, indicating that the development of tolerance to this effect of flunitrazepam is modest under these conditions.     

Concurrent-schedule performance: Effects of relative and overall reinforcer rate

Six pigeons were trained to respond on two keys, each of which provided reinforcers on an arithmetic variable-interval schedule. These concurrent schedules ran nonindependently with a 2-s changeover delay. Six sets of conditions were conducted. Within each set of conditions the ratio of reinforcers available on the two alternatives was varied, but the arranged overall reinforcer rate remained constant. Each set of conditions used a different overall reinforcer rate, ranging from 0.22 reinforcers per minute to 10 reinforcers per minute. The generalized matching law fit the data from each set of conditions, but sensitivity to reinforcer frequency (a) decreased as the overall reinforcer rate decreased for both time allocation and response allocation based analyses of the data. Overall response rates did not vary with changes in relative reinforcer rate, but decreased with decreases in overall reinforcer rate. Changeover rates varied as a function of both relative and overall reinforcer rates. However, as explanations based on changeover rate seem unable to deal with the changes in generalized matching sensitivity, discrimination accounts of choice may offer a more promising interpretation.     

Signaling and affective functions of conditioned aversive stimuli in an appetitive choice discrimination: US intensity effects

Different groups of rats received Pavlovian aversive conditioning in which US-shock intensity (0.25–1.0 mA) and CS-US correlation (+, 0, ?) were factorially varied. Then, the CS was administered for each group contingent upon the reinforced response in an appetitive choice discrimination. Absolute and ratio measures of speed of running in the presence of the CS showed that, at the start of discrimination training, CS+ suppressed and CS- facilitated performance. However, later in training but prior to any evidence of choice learning, these speed effects reversed, with the magnitude of both the initial and reversed effects being a positive function of US intensity. Consistent with the reversal of speeds, associative (choice) measures showed that CS+ facilitated and CS- retarded discrimination learning relative to CSo and, within limits, these effects were also amplified by stronger USs. The findings suggest that a CS has both affective (motivational) and signaling (associative) functions and that both are influenced by US intensity; however, the CS's affective property is rapidly extinguished in the presence of a hedonicly different reinforcer, while leaving the CS's signaling property largely intact. Hence, the CS functions as a transformed signal for the new (appetitive) reinforcer and facilitates or retards learning by mediating the reinforcer's presence (CS+) or absence (CS-).     

EFFECTS OF POINT‐LOSS PUNISHERS ON HUMAN SIGNAL‐DETECTION PERFORMANCE

Three experiments using human participants varied the distribution of point‐gain reinforcers or point‐loss punishers in two‐alternative signal‐detection procedures. Experiment 1 varied the distribution of point‐gain reinforcers for correct responses (Group A) and point‐loss punishers for errors (Group B) across conditions. Response bias varied systematically as a function of the relative reinforcer or punisher frequencies. Experiment 2 arranged two conditions — one where an unequal ratio of reinforcement (5:1 or 1:5) was presented without punishment (R‐only), and another where the same reinforcer ratio was presented with an equal distribution of point‐loss punishers (R+P). Response bias was significantly greater in the R‐only condition than the R+P condition, supporting a subtractive model of punishment. Experiment 3 varied the distribution of point‐gain reinforcers for correct responses across four unequal reinforcer ratios (5:1, 2:1, 1:2, 1:5) both without (R‐only) and with (R+P) an equal distribution of point‐loss punishers for errors. Response bias varied systematically with changes in relative reinforcer frequency for both R‐only and R+P conditions, with 5 out of 8 participants showing increases in sensitivity estimates from R‐only to R+P conditions. Overall, the results indicated that punishers have similar but opposite effects to reinforcers in detection procedures and that combined reinforcer and punisher effects might be better modeled by a subtractive punishment model than an additive punishment model, consistent with research using concurrent‐schedule choice procedures.     

Evaluation of response blocking and re-presentation in a competing stimulus assessment

Competing stimulus assessments (CSA) have been used to identify stimuli that are associated with reduced levels of problem behavior, presumably as a function of reinforcer competition. Following a standard CSA in which stimuli simply were made available, 2 more CSAs were conducted with additional components designed to enhance reinforcer competition: re-presentation of stimuli and response blocking for self-injury. The results obtained from each CSA were validated in an extended treatment analysis. The study illustrates how the effects of additional components designed to enhance reinforcer competition can be evaluated efficiently in the context of a CSA.