Resurgence and repeated within-session progressive-interval thinning of alternative reinforcement

Resurgence of a previously suppressed target behavior is common when reinforcement for a more recently reinforced alternative behavior is thinned. To better characterize such resurgence, these experiments examined repeated within-session alternative reinforcement thinning using a progressive-interval (PI) schedule with rats. In Experiment 1, a transition from a high rate of alternative reinforcement to a within-session PI schedule generated robust resurgence, but subsequent complete removal of alternative reinforcement produced no additional resurgence. Experiment 2 replicated these findings and showed similar effects with a fixed-interval (FI) schedule arranging similarly reduced session-wide rates of alternative reinforcement. Thus, the lack of additional resurgence following repeated exposure to the PI schedule was likely due to the low overall obtained rate of alternative reinforcement provided by the PI schedule, rather than to exposure to within-session reinforcement thinning per se. In both experiments, target responding increased at some point in the session during schedule thinning and continued across the rest of the session. Rats exposed to a PI schedule showed resurgence later in the session and after more cumulative alternative reinforcers than those exposed to an FI schedule. The results suggest the potential importance of further exploring how timing and change-detection mechanisms might be involved in resurgence.     

The Project Method of Teaching Psychology: A Rejoinder to Dr. Cason

Unlike word frequency counts—e.g., Thorndike and Lorge—or nonsense syllable norms, the total number of different words scaled in extant norms with free associations is limited, although some words were repeatedly scaled. In order to remedy this situation and broaden the word pool for future research, a new norm for 48 words was obtained by means of free associations in the present study (N = 58 men and women undergraduate students in psychology). Discrete normative free associations were procured for 10 words for the first time by the current norm. For the words previously scaled, whereas there were some noticeable differences, overall substantial consistency was observed between the present and earlier results. Further, a survey of previously available word association norms disclosed useful information and interesting trends in this field.     

Delay discounting as impaired valuation: Delayed rewards in an animal obesity model

Obesity is a major public health problem, which, like many forms of addiction, is associated with an elevated tendency to choose smaller immediate rather than larger delayed rewards, a response pattern often referred to as excessive delay discounting. Although some accounts of delay discounting conceptualize this process as impulsivity (placing the emphasis on overvaluing the smaller immediate reward), others have conceptualized delay discounting as an executive function (placing the emphasis on delayed rewards failing to retain their value). The present experiments used a popular animal model of obesity that has been shown to discount delayed rewards at elevated rates (i.e., obese Zucker rats) to test two predictions that conceptualize delay discounting as executive function. In the first experiment, acquisition of lever pressing with delayed rewards was compared in obese versus lean Zucker rats. Contrary to predictions based on delay discounting as executive function, obese Zucker rats learned to press the lever more quickly than controls. In the second experiment, progressive ratio breakpoints (a measure of reward efficacy) with delayed rewards were compared in obese versus lean Zucker rats. Contrary to the notion that obese rats fail to value delayed rewards, the obese Zucker rats' breakpoints were (at least) as high as those of the lean Zucker rats.     

Behavioral effects of delayed timeouts from reinforcement

Timeouts are sometimes used in applied settings to reduce target responses, and in some circumstances delays are unavoidably imposed between the onset of a timeout and the offset of the response that produces it. The present study examined the effects of signaled and unsignaled timeouts in rats exposed to concurrent fixed‐ratio 1 fixed‐ratio 1 schedules of food delivery, where each response on one lever, the location of which changed across conditions, produced both food and a delayed 10‐s timeout. Delays of 0 to 38 s were examined. Delayed timeouts often, but not always, substantially reduced the number of responses emitted on the lever that produced timeouts relative to the number emitted on the lever that did not produce timeouts. In general, greater sensitivity was observed to delayed timeouts when they were signaled. These results demonstrate that delayed timeouts, like other delayed consequences, can affect behavior, albeit less strongly than immediate consequences.     

The effects of 100 dB 1‐kHz and 22‐kHz tones as punishers on lever pressing in rats

Aversive control is an important yet understudied process of learning. One reason aversive control may be relatively understudied is ethical concerns about painful stimuli (e.g., electric shock). High decibel broad‐band noise and 22‐kHz vocalizations both demonstrably affect rodent behavior while not necessarily being painful. The goal of this study was to determine if 100‐dB 22‐kHz‐pure tones were differentially more effective in reducing operant response rates in rats. We examined whether 22‐kHz pure tones would function as aversive stimuli, specifically as positive punishers. The effects of response‐dependent as well as continuously presented 22‐kHz and 1‐kHz tones on rate of response maintained by variable interval 30‐s food deliveries were assessed across several conditions. We found that response rates were lower when tones were presented response dependently than when tones were presented continuously throughout a session. We also found that the lower response rates obtained with response‐dependent 22‐kHz tones were not significantly different from response rates obtained with response‐dependent 1‐kHz tones. The primary conclusion of this experiment is that both 1‐kHz and 22‐kHz tones functioned as punishers, but that the 22‐kHz tones were not differentially more effective in reducing response rate.     

Modulating effects in learned helplessness of dyadic dominance-submission relations

In this experiment, learned helplessness was studied from an ethological perspective by examining individual differences in social dominance and its influence on the effects of helplessness. Ninety animals were used, 30 randomly selected and 60 selected because of their clear dominance or submission. Each condition (dominant, submissive, and random) was distributed in three subgroups corresponding to the triadic design. The test consisted of an escape/avoidance task. The results showed that the animals in the uncontrollable condition performed worse than those in the controllable and no treatment conditions. Social submission and dominance reduced vulnerability of the subjects against learned helplessness. Submission had a facilitating effect on subsequent learning, independently of whether pretreatment was controllability or uncontrollability. Learned mastery was observed in the submissive condition, because submission benefited the subjects in the controllable condition in comparison with the untreated subjects, and dominance impaired the subjects in the controllable condition.     

ISOLATING BEHAVIORAL MECHANISMS OF INTERTEMPORAL CHOICE: NICOTINE EFFECT ON DELAY DISCOUNTING AND AMOUNT SENSITIVITY

Many drugs of abuse produce changes in impulsive choice, that is, choice for a smaller—sooner reinforcer over a larger—later reinforcer. Because the alternatives differ in both delay and amount, it is not clear whether these drug effects are due to the differences in reinforcer delay or amount. To isolate the effects of delay, we used a titrating delay procedure. In phase 1, 9 rats made discrete choices between variable delays (1 or 19 s, equal probability of each) and a delay to a single food pellet. The computer titrated the delay to a single food pellet until the rats were indifferent between the two options. This indifference delay was used as the starting value for the titrating delay for all future sessions. We next evaluated the acute effects of nicotine (subcutaneous 1.0, 0.3, 0.1, and 0.03 mg/kg) on choice. If nicotine increases delay discounting, it should have increased preference for the variable delay. Instead, nicotine had very little effect on choice. In a second phase, the titrated delay alternative produced three food pellets instead of one, which was again produced by the variable delay (1 s or 19 s) alternative. Under this procedure, nicotine increased preference for the one pellet alternative. Nicotine‐induced changes in impulsive choice are therefore likely due to differences in reinforcer amount rather than differences in reinforcer delay. In addition, it may be necessary to include an amount sensitivity parameter in any mathematical model of choice when the alternatives differ in reinforcer amount.     

OBSERVING RESPONSES AND SERIAL STIMULI: SEARCHING FOR THE REINFORCING PROPERTIES OF THE S−

The control exerted by a stimulus associated with an extinction component (S−) on observing responses was determined as a function of its temporal relation with the onset of the reinforcement component. Lever pressing by rats was reinforced on a mixed random-interval extinction schedule. Each press on a second lever produced stimuli associated with the component of the schedule in effect. In Experiment 1 a response-dependent clock procedure that incorporated different stimuli associated with an extinction component of a variable duration was used. When a single S− was presented throughout the extinction component, the rate of observing remained relatively constant across this component. In the response-dependent clock procedure, observing responses increased from the beginning to the end of the extinction component. This result was replicated in Experiment 2, using a similar clock procedure but keeping the number of stimuli per extinction component constant. We conclude that the S− can function as a conditioned reinforcer, a neutral stimulus or as an aversive stimulus, depending on its temporal location within the extinction component.     

Compatibilism &; desert: critical comments on <Emphasis Type="Italic">four views on free will</Emphasis>

In this paper I offer from a source compatibilist’s perspective a critical discussion of Four Views on Free Will by John Martin Fischer, Robert Kane, Derk Pereboom, and Manuel Vargas. Sharing Fischer’s semi-compatibilist view, I propose modifications to his arguments while resisting his coauthors’ objections. I argue against Kane that he should give up the requirement that a free and morally responsible agent be able to do otherwise (in relevant cases). I argue against Pereboom that his famed manipulation argument be resisted by contending that the agents in it are free and responsible. And I also argue against Vargas by challenging the sense in which his revisionist thesis differs from a position like Fischer’s and mine. I close by reflecting on the nature of desert. All seem to assume it is central to the debate, but what is it?