Food-paired stimuli as conditioned reinforcers: effects of d-amphetamine.

Seven pigeons were studied in two experiments in which key pecks were reinforced under a second-order schedule wherein satisfaction of variable-interval schedule requirements produced food or a brief stimulus. In the second part of each session, responses produced only the brief stimulus according to a variable-interval schedule (food extinction). For the 4 pigeons in Experiment 1, the response key was red throughout the session. In separate phases, the brief stimulus was either paired with food, not paired with food, or not presented during extinction. d-Amphetamine (0.3 to 10.0 mg/kg) dose-dependently reduced food-maintained responding during the first part of the session and, at intermediate dosages, increased responding during the extinction portion of the session. The magnitude of these increases, however, did not consistently depend on whether the brief stimulus was paired, not paired, or not presented. It was also true that under nondrug conditions, response rates during extinction did not differ reliably depending on pairing operations for the brief stimulus. In Experiment 2, 3 different pigeons responded under a procedure wherein the key was red in the component with food presentations and blue in the extinction component (i.e., multiple schedule). Again, d-amphetamine produced dose-related decreases in responding during the first part of a session and increases in responding in the second part of the session. These increases, however, were related to the pairing operations; larger increases were observed when the brief stimulus was paired with food than when it was not or when it was not presented at all. Under nondrug conditions, the paired brief stimulus controlled higher response rates during extinction than did a nonpaired stimulus or no stimulus. These findings suggest that d-amphetamine can enhance the efficacy of conditioned reinforcers, and that this effect may be more robust if conditioned reinforcers occur in the context of a signaled period of extinction.     

The effects of number of sample stimuli and number of choices in a detection task on measures of discriminability

Six pigeons were trained on a conditional discrimination task involving the discrimination of various intensities of yellow light. The research asked whether stimulus—response discriminability measures between any pair of stimuli would remain constant when a third or fourth sample and reinforced response were added. The numbers of different sample stimuli presented and different responses reinforced were two (Part 1), three (Parts 2 and 4), and four (Part 3). Across conditions within parts, the ratios of reinforcers obtainable for correct responses were varied over at least five levels. In Part 5, the numbers of sample stimuli and reinforced responses were varied among two, three, and four, and the reinforcer ratio between consecutive remaining samples was constant at 2:1. It was found that once a particular response had been reinforced, subjects continued to emit that response when the conditional stimulus for that response was no longer presented. Data analysis using a generalization-based detection model indicated that this model was able to describe the data effectively. Four findings were in accord with the theory. First, estimates of stimulus—response discriminability usually decreased as the arranged physical disparity between the sample stimuli decreased. Second, stimulus—response discriminability measures were independent of response—reinforcer discriminability measures, preserving parameter invariance between these measures. Third, stimulus—response discriminability measures for constant pairs of conditional stimuli did not change systematically as conditional stimulus—response alternatives were added. Fourth, log stimulus—response discriminability values between physically adjacent conditional stimuli summed to values that were not significantly different from estimates of the discriminability values for conditional stimuli that were spaced further apart.     

Further evaluation of reinforcer magnitude effects in noncontingent schedules

We closely replicated the procedures of a previous study that showed a positive relationship between reinforcer magnitude and the response-rate-reducing effects of noncontingent schedules (NCS). NCS reduced response rates, as expected, but the NCS-magnitude effect was not reproduced, illuminating possible weaknesses of current arbitrary-response procedures and suggesting avenues for future research.     

Examination of ambiguous stimulus preferences with duration-based measures

Items that produced ambiguous results in an approach-based preference assessment were reassessed using a duration-based assessment. The reinforcing effects of three items on free-operant responding were subsequently tested. The results suggested that the duration-based assessment produced slightly more differentiated results and that predictions about reinforcer value, based on this assessment, were accurate.     

Analysis of activity preferences as a function of differential consequences

Individuals who do not possess the verbal skills to express meaningful choice in the absence of its consequences may have difficulty indicating their preference for protracted activities that are unavailable until some time in the future (e.g., taking a walk, riding a bike). When we examined the preferences of 4 individuals with developmental disabilities by showing them pictorial representations of various activities, their initial choices showed no clear preferences. In a subsequent condition, selecting a photograph resulted in brief access to the depicted activity. When selections produced differential consequences (i.e., access to the activity), clear preferences emerged. In addition, 3 individuals' preferences were later shifted to an initially less preferred but more socially desirable option by superimposing additional reinforcement contingencies for engaging in the less preferred activity. Results are discussed in terms of the conditions under which choice functions as an indicator of preference and how those conditions may be altered to improve the quality of choice making without limiting access to preferred options.     

Attenuation of latent inhibition after compound conditioning

Using a conditioned suppression procedure with rats, three experiments examined the effects of compound conditioning on the degree of latent inhibition. Experiment 1 suggested that latent inhibition of the preexposed target was not enhanced but rather attenuated when a second stimulus was presented in compound conditioning. Experiment 2 showed that a similar result was obtained when, in subjects given only compound conditioning, the salience of the target was reduced to the level where it was overshadowed by the second stimulus. Experiment 3 proved that addition of the second stimulus only during preexposure, or during both preexposure and conditioning, did not attenuate the latent inhibition to the target. These results are difficult to explain by any model of Pavlovian conditioning which assumes that both latent inhibition and overshadowing effects are a consequence of acquisition deà cit; other possible accounts are discussed.     

Psychophysics of remembering

We present a new model of remembering in the context of conditional discrimination. For procedures such as delayed matching to sample, the effect of the sample stimuli at the time of remembering is represented by a pair of Thurstonian (normal) distributions of effective stimulus values. The critical assumption of the model is that, based on prior experience, each effective stimulus value is associated with a ratio of reinforcers obtained for previous correct choices of the comparison stimuli. That ratio determines the choice that is made on the basis of the matching law. The standard deviations of the distributions are assumed to increase with increasing retention-interval duration, and the distance between their means is assumed to be a function of other factors that influence overall difficulty of the discrimination. It is a behavioral model in that choice is determined by its reinforcement history. The model predicts that the biasing effects of the reinforcer differential increase with decreasing discriminability and with increasing retention-interval duration. Data from several conditions using a delayed matching-to-sample procedure with pigeons support the predictions.     

Running and responding reinforced by the opportunity to run: effect of reinforcer duration.

The present study investigated the effect of reinforcer duration on running and on responding reinforced by the opportunity to run. Eleven male Wistar rats responded on levers for the opportunity to run in a running wheel. Opportunities to run were programmed to occur on a tandem fixed-ratio 1 variable-interval 30-s reinforcement schedule. Reinforcer duration varied across conditions from 30 to 120 s. As reinforcer duration increased, the rates of running and lever pressing declined, and latency to lever press increased. The increase in latency to respond was consistent with findings that unconditioned inhibitory aftereffects of reinforcement increase with reinforcer magnitude. The decrease in local lever-pressing rates, however, was inconsistent with the view that response strength increases with the duration of the reinforcer. Response rate varied inversely, not directly, with reinforcer duration. Furthermore, within-session data challenge satiation, fatigue, and response deprivation as determinants of the observed changes in running and responding. In sum, the results point to the need for further research with nonappetitive forms of reinforcement.     

Conditioned reinforcement dynamics in three-link chained schedules.

In two experiments rats were trained on three-link concurrent-chains schedules of reinforcement. In Experiment 1, additional entries to one terminal link were added during one of the middle links to a baseline schedule that was otherwise equal for the two chains, and, depending on the condition, these additional terminal-link presentations ended either in food or in no food. When food occurred, preference was always in favor of the chain with the additional terminal-link presentations (which also entailed a higher rate of reinforcement). When no food occurred at the end of the additional terminal links, the outcome depended on the nature of the stimuli associated with these additional terminal links. When stimuli different from the reinforced baseline terminal links were used for the no-food terminal links, preference was against the choice alternative that led to the extra periods of extinction. When the same stimulus was used for the two kinds of terminal links, preference was near indifference, that is, significantly greater than when different stimuli were used. In Experiment 2, rats learned repeated reversals of a simultaneous discrimination under a three-link concurrent-chains schedule, in which the food or no-food choice outcomes were delayed until the end of the chain. Different conditions were defined by the point in the chain at which differential stimuli occurred. When the middle and terminal links provided no differential stimuli, discrimination was acquired more slowly than when differential stimuli occurred in both links. When differential stimuli occurred in the middle but not the terminal links, acquisition rates were intermediate. Both experiments together show that the effects of stimuli in a chain schedule are due partly to the time to food correlated with the stimuli and partly to the time to the next conditioned reinforcer in the sequence.     

Reinforcer frequency and restricted stimulus control.

Stimulus control was evaluated in 3 individuals with moderate to severe mental retardation by delayed identity matching-to-sample procedures that presented either one or two discrete forms as sample stimuli on each trial. On pretests, accuracy scores on one-sample trials were uniformly high. On two-sample trials, the correct stimulus (i.e., the one that subsequently appeared in the comparison array) varied unpredictably, and accuracy scores were substantially lower, suggesting that both sample stimuli did not exert stimulus control on every trial. Subjects were then given training sessions with the one-sample task and with a new set of four stimuli. For two of the stimuli, correct matching responses were followed by reinforcers on a variable-ratio schedule that led to a high reinforcer rate. For the other two stimuli, correct responses were followed by reinforcers on a variable-ratio schedule that led to a substantially lower reinforcer rate. Results on two-sample tests that followed showed that (a) on trials in which comparison arrays consisted of one high reinforcer-rate and one low reinforcer-rate stimulus, subjects most often selected the high-rate stimulus; and (b) on trials in which the comparison arrays were either two high reinforcer-rate stimuli or two low reinforcer-rate stimuli and the samples were one high reinforcer- and one low reinforcer-rate stimulus, accuracy was higher on trials with the high-rate comparisons. These results indicate that the frequency of stimulus control by high reinforcer-rate samples was greater than that by low reinforcer-rate samples. Following more training with the one-sample task and reversed reinforcement schedules for all stimuli, the differences in stimulus control frequencies on two-sample tests also reversed. These results demonstrate experimental control by reinforcement contingencies of which of two sample stimuli controlled selections in the two-sample task. The procedures and results may prove to be relevant for understanding restricted stimulus control and stimulus overselectivity.