Independence of reinforcement delay and magnitude in concurrent chains

A three-component concurrent-chains procedure was used to investigate preference between terminal-link schedules that differed in delay and magnitude of reinforcement. Response and time allocation data were well described by a generalized matching model. Sensitivity to delay appeared to be lower when reinforcement magnitudes were unequal than when they were equal, but when obtained rather than programmed time spent responding in the initial links was used in the model, the difference vanished. The results support independence of delay and magnitude as separate dimensions of reinforcement value, as required by the matching law, and the assumption of the contextual choice model (Grace, 1994) that sensitivities to delay and magnitude are affected similarly by temporal context. Although there was statistical evidence for interaction between successive components, the effects were small and transient. The multiple-component concurrent-chains procedure should prove useful in future research on multidimensional preference, although it may be necessary to control obtained initial-link time more precisely.     

Good to the last drop? Millikan stories as “canned” pedagogy

In recent literature, the famous Millikan oil-drop experiment appears as a case of “good scientific judgment” on the one hand, and scientific misconduct on the other. This article discusses different interpretations of the fact that Nobel laureate Robert Millikan’s notebooks show that he eliminated a number of oildrops in his published 1913 paper on the charge of the electron, while reporting that he had included all the drops. Starting with the common source of all Millikan stories, historian of physics Gerald Holton’s 1978 paper, I discuss recent “canned” versions of Millikan-as-misbehaver in books on scientific fraud. Then I examine some versions of Millikan-as-good-scientist, particularly the reconstruction by historian of physics Allan Franklin, and the views of some practicing physicists. Finally, we have an instructive head-on collision between the two standard treatments of Millikan. The problem with canned stories is not only insufficient information; we also lack a realistic evaluation of the role of ethics in science. As a fundamentally knowledge-seeking enterprise, science may harbor an inherent, perhaps irresolvable, conflict between scientific and ethical concerns. The author’s special interests include standards for “good science”, science and values, and social psychology.     

初中学业不良学生习得性无能研究

采用两个２×２实验设计,研究强化方式、成就状况和任务类型对初中学业不良学生习得性无能倾向的影响二结果表明：外部奖赏不能提高成功组学生的内在动机,反而增加挫折组学生的无力感与挫折感;操作作业的成败对学生习得性无能倾向影响不明显,而数学作业的成败的影响则非常显著;学生在操作作业中的内在动机明显高于其在数学作业中的内在动机。     

The effects of smoked marijuana on progressive-interval schedule performance in humans.

In three experiments, 8 human subjects participated in a study of the effects of smoked marijuana on progressive-interval schedule performance. A two-component chained progressive-interval fixed-interval schedule of point delivery was used. In the progressive-interval component, the interval length began at 20 s and increased either geometrically or arithmetically (by either 20 s, 40 s, 80 s, 100 s, or 160 s) on each subsequent interval. After this interval elapsed, a single button press produced the fixed-interval component, with a total of five reinforcers of varying magnitude ($0.05, $0.20, or $0.40) available on a fixed-interval 20-s schedule. After the five reinforcer deliveries, the schedule returned to the initial progressive-interval component. Several relationships were found among rates of responding, postreinforcement pauses and drug administration in the progressive-interval component: (a) Postreinforcement pauses increased as the temporal requirements of the progressive-interval schedule increased; (b) rates of responding during successive progressive-interval components rapidly decreased to low rates of responding after the first few progressions; (c) postreinforcement pauses decreased systematically as dose of smoked marijuana increased; and (d) rates of responding increased after smoking active marijuana but not after smoking placebo cigarettes. Results are discussed in the context of behavioral control and relevance to other studies that have investigated the effects of smoked marijuana on schedule performance.     

Reinforcement magnitude and pausing on progressive-ratio schedules

Rats responded under progressive-ratio schedules for sweetened milk reinforcers; each session ended when responding ceased for 10 min. Experiment 1 varied the concentration of milk and the duration of postreinforcement timeouts. Postreinforcement pausing increased as a positively accelerated function of the size of the ratio, and the rate of increase was reduced as a function of concentration and by timeouts of 10 s or longer. Experiment 2 varied reinforcement magnitude within sessions (number of dipper operations per reinforcer) in conjunction with stimuli correlated with the upcoming magnitude. In the absence of discriminative stimuli, pausing was longer following a large reinforcer than following a small one. Pauses were reduced by a stimulus signaling a large upcoming reinforcer, particularly at the highest ratios, and the animals tended to quit responding when the past reinforcer was large and the stimulus signaled that the next one would be small. Results of both experiments revealed parallels between responding under progressive-ratio schedules and other schedules containing ratio contingencies. Relationships between pausing and magnitude suggest that ratio pausing is under the joint control of inhibitory properties of the past reinforcer and excitatory properties of stimuli correlated with the upcoming reinforcer, rather than under the exclusive control of either factor alone.     

Discrete-trial choice in pigeons: Effects of reinforcer magnitude

The preference of pigeons for large reinforcers which occasionally followed a response versus small reinforcers which invariably followed a response was studied in a discrete-trial situation. Two differently colored keys were associated with the two reinforcement alternatives, and preference was measured as the proportion of choice trials on which the key associated with uncertain reinforcement was pecked. A combination of choice and guidance trials insured that received distributions of reinforcement equalled the scheduled distributions. For five of six subjects, preference for the uncertain reinforcer appeared to be a linear function of the magnitude of the certain reinforcer. In addition, there was greater preference for the response alternative associated with uncertain reinforcement than would be expected on the basis of net reinforcer value.     

Some conditions affecting the choice to cooperate or compete

Three experiments investigated conditions affecting the choice to cooperate or compete. Experiment I compared the effects first of an individual activity, then of a competitive task as an alternative to cooperation. For both comparisons, subjects could earn more by cooperating. Choice of competition, but not individual activity, was found to depend on the task choice contingencies. Competition predominated when both subjects could compete if either or both chose competition. Previously competitive pairs cooperated when both subjects could cooperate if either or both chose cooperation. Experiment II investigated the effects of differences in magnitude of the reinforcers for cooperating or competing. Choice between the two alternatives was manipulated in all pairs by varying reinforcer difference. Competition was chosen over cooperation only within the limits within which competition was potentially profitable. Experiment III replicated the findings of Experiment II using triads. Subjects in triads, however, were more likely to withdraw from the experiment. Thus, the data for pairs and triads suggest an orderly relation between reinforcer difference for cooperating or competing and task choice. Motivation of subjects to maximize relative gain by competing can be overridden by moderate reinforcer differences favoring cooperation.     

Determination of discount functions in rats with an adjusting-amount procedure.

An adjusting-amount procedure was used to measure discounting of reinforcer value by delay. Eight rats chose between a varying amount of immediate water and a fixed amount of water given after a delay. The amount of immediate water was systematically adjusted as a function of the rats' previous choices. This procedure was used to determine the indifference point at which each rat chose the immediate amount and the delayed amount with equal frequency. The amount of immediate water at this indifference point was used to estimate the value of the delayed amount of water. In Experiment 1, the effects of daily changes in the delay to the fixed reinforcer (100 microliters of water delivered after 0, 2, 4, 8, or 16 s) were tested. Under these conditions, the rats reached indifference points within the first 30 trials of each 60-trial session. In Experiment 2, the effects of water deprivation level on discounting of value by delay were assessed. Altering water deprivation level affected the speed of responding but did not affect delay discounting. In Experiment 3, the effects of varying the magnitude of the delayed water (100, 150, and 200 microliters) were tested. There was some tendency for the discounting function to be steeper for larger than for smaller reinforcers, although this difference did not reach statistical significance. In all three experiments, the obtained discount functions were well described by a hyperbolic function. These experiments demonstrate that the adjusting-amount procedure provides a useful tool for measuring the discounting of reinforcer value by delay.     

Effects of Reward and Response Cost on Response Inhibition in AD/HD, Disruptive, Anxious, and Normal Children

In previous research, children with attention deficit/hyperactivity disorder (AD/HD) have demonstrated impaired response inhibition on the stop paradigm. In this study we examined whether this impairment in fact reflects a motivational deficit. Four groups of children (age range 7–13 years) participated in the study: 14 AD/HD children, 21 normal controls, 14 disruptive children, and 14 anxious children. The psychopathological groups were recruited from special educational services and mental health outpatient clinics. Parent, teacher, and child questionnaires were used to select children with pervasive disorders. Normal controls attended regular classes and scored low on all questionnaires. Children were tested once with reward contingencies and once with response cost contingencies in a randomized cross-over design. We hypothesized that if a motivational deficit underlies poor response inhibition in AD/HD children, this deficit will be remedied by response contingencies. Despite the presence of response contingencies, AD/HD children showed poor response inhibition compared with normal controls. Findings argue against a motivational explanation for the response inhibition deficit in AD/HD children     

Zebrafish choice behavior is sensitive to reinforcer rate,immediacy, and magnitude ratios

Behavioral flexibility has, in part, been defined by choice behavior changing as a function of changes in reinforcer payoffs. We examined whether the generalized matching law quantitatively described changes in choice behavior in zebrafish when relative reinforcer rates, delays/immediacy, and magnitudes changed between two alternatives across conditions. Choice was sensitive to each of the three reinforcer properties. Sensitivity estimates to changes in relative reinforcer rates were greater when 2 variable-interval schedules were arranged independently between alternatives (Experiment 1a) than when a single schedule pseudorandomly arranged reinforcers between alternatives (Experiment 1b). Sensitivity estimates for changes in relative reinforcer immediacy (Experiment 2) and magnitude (Experiment 3) were similar but lower than estimates for reinforcer rates. These differences in sensitivity estimates are consistent with studies examining other species, suggesting flexibility in zebrafish choice behavior in the face of changes in payoff as described by the generalized matching law.