Acquisition of stimulus control while introducing new stimuli in fading.

After establishing discrimination between a red positive stimulus and a green negative stimulus, the lowest intensity colors that restricted all responding to the positive stimulus were determined. Then, two new white lines differing in terms of line orientation were each superimposed on one of the colors and were increased in intensity. Thereafter, the intensity of the colors was decreased and eventually eliminated. Probe stimuli consisting of the lines presented against dark backgrounds were presented before each change of stimulus intensity, and probe responding was used to assess the control acquired by various dimension of the new stimuli during the course of fading. The lines acquired control of responding while they were being introduced, and control was strengthened as the colors were attenuated. Such a locus of acquisition was attributed to the starting intensity of the original controlling stimuli and was explained in terms of stimulus blocking. Finally, using probes while introducing the new stimuli enhanced the acquisition of control by the new stimuli.     

Food delivery as a conditional stimulus: Feature-learning and memory in pigeons

Three experiments investigated the learning and memory of discriminations based on presence versus absence of a pre-trial food delivery. In Experiment 1 half the illuminations of a response key were followed by food regardless of the subject's behavior. In one group an extra food delivery preceded only reinforced trials (feature-positive condition), whereas in a second group it preceded only nonreinforced trials (feature-negative condition). Key pecks and approaches revealed more rapid and superior discrimination learning in the first group. Experiment 2 replicated the results of Experiment 1 but yielded no evidence that greater “unexpectedness” of pretrial food conditions facilitates discriminative performance. In Experiment 3, individual pigeons trained on a conditional discrimination exhibited a within-subject feature-positive superiority. Delay between pretrial and trial stimuli interacted with feature-positive versus feature-negative training in both the between-group (Experiment 2) and within-subject (Experiment 3) procedures: performance was decremented at both short and long delays in the feature-positive condition but was decremented only at longer delays in the feature-negative condition. The feature-positive superiority obtained here is incompatible with explanations based on either the general concept of “perceptual organization” or on the conditional nature of feature-negative discriminations.     

The effects of the stimulus-reinforcer correlation in a discrete-trials IRT>t procedure

The correlation between a keylight and food in a discrete-trials, interresponse-time-greater-than 6-sec (IRT>6-sec) procedure was varied by manipulating the rate of response-independent food presentation in the intertrial interval. When the correlation was positive, the rates of pecking in the IRT>6-sec condition were high and food was obtained on only about 5% of the trials. Likewise, responding was maintained at a high rate in yoked birds that received the same presentations of the light and food as the birds in the IRT>6-sec condition. When the rate of reinforcement between trials was equated to or made greater than the rate of reinforcement within trials, the response rate decreased for all birds, and those decreases were considerably larger for the yoked birds. However, the percentage of trials in which reinforced responses occurred under the IRT>6-sec procedure did not increase substantially when the light and food were either uncorrelated or negatively correlated. The percentage of trials in which a reinforcer was obtained increased when the keylight was left on continuously and the discriminative stimulus was not presented on the key. The results show that the stimulus-reinforcer correlation affects responding in the discrete-trials IRT>6-sec procedure, but that the effects of the stimulus-reinforcer correlation vary as a function of whether reinforcement is response-dependent or response-independent. The differences between the effects of response-independent and response-dependent pairings and nonpairings of the light and food are best accounted for in terms of differences in the control of responding by background stimuli.     

Conditioning of two-response patterns of key pecking in pigeons

On discrete trials, two response keys were made available to hungry pigeons and food reinforcement depended on the order in which the required two key pecks occurred. In different phases, only one of the four possible two-peck sequences (left-left, left-right, right-left, and right-right) produced food reinforcement. In each case, the pigeons learned to perform the correct two-peck sequence more often than the incorrect sequences. Furthermore, the course of differentiation mastery indicated that both reinforcement history and response-reinforcer contiguity influenced performance. These results reveal that response patterns comprising two instances of the same response left-left and right-right) or instances of two different responses (left-right and right-left) may function as operants, thereby extending the generality of conditioning principles from discrete responses to structured sequences of behavior. These and other results are discussed in terms of contiguity-based and memory-based models of learning.     

Some Effects Of Intertrial Interval Duration On Discrete-trial Choice

Pigeons were trained in Experiment 1 on a discrete-trial concurrent variable-interval (VI) 1-min VI 3-min schedule, and in Experiment 2 on a discrete-trial concurrent VI 1.5-min VI 1.5-min schedule. In each experiment, the intertrial-interval durations (ITIs) were 0 s, 6 s, 22 s, and 120 s, and the schedules were both independent and interdependent. The purpose of the research was to determine whether lengthening the ITI would disrupt any local control that existed, measured with respect to relative response rate and changeover probability. In Experiment 1, with the independent schedules, both preference and obtained relative reinforcement rate approximated .75 at short ITIs, but then decreased toward .50 with longer ITIs. With interdependent schedules, both preference and obtained relative reinforcement rate approximated .75 at all ITIs. In both experiments, with both independent and interdependent schedules, changeover probabilities for each response in a sequence of up to five successive responses to a given schedule were variable for individual birds. The average changeover probabilities for all birds suggested perseveration rather than a systematic increase within a given ITI or a systematic trend toward chance responding as ITI duration increased. Finally, the changeover functions did not differ when a sequence of responses was calculated to begin anew after reinforcement rather than with the first response on a schedule. Taken together, the data were inconsistent with a theory holding that only local processes underlie choice in discrete-trial procedures.     

Stimulus Presentation Ratios And The Outcomes For Correct Responses In Signal-detection Procedures

Three pigeons were trained to discriminate between two line orientations (S₁ and S₂). A left-key peck was correct when S₁ was presented, and a right key-peck was correct when S₂ was presented. In all procedures, correct responses were occasionally reinforced with food paired with the presentation of the magazine light. Incorrect responses produced a blackout. Six detection procedures were used. In the first, the signal presentation ratio was varied across conditions and the reinforcer ratio was allowed to covary. In the second, the signal presentation ratio was held constant at 1:1 and the reinforcer ratio varied across conditions. In the third, the signal presentation ratio was varied across conditions and the reinforcer ratio was held constant at 1:1. In these three procedures, correct responses that were not scheduled for reinforcement were followed by blackout. The remaining three procedures repeated those described above with one procedural change: Nonreinforced but correct trials were followed by the presentation of the magazine light. Birds showed systematic preferences for the key associated with the stimulus presented or reinforced most often. There was no change in the birds' performance over changes in the feedback for nonreinforced but correct responses.     

The effects of number of sample stimuli and number of choices in a detection task on measures of discriminability

Six pigeons were trained on a conditional discrimination task involving the discrimination of various intensities of yellow light. The research asked whether stimulus—response discriminability measures between any pair of stimuli would remain constant when a third or fourth sample and reinforced response were added. The numbers of different sample stimuli presented and different responses reinforced were two (Part 1), three (Parts 2 and 4), and four (Part 3). Across conditions within parts, the ratios of reinforcers obtainable for correct responses were varied over at least five levels. In Part 5, the numbers of sample stimuli and reinforced responses were varied among two, three, and four, and the reinforcer ratio between consecutive remaining samples was constant at 2:1. It was found that once a particular response had been reinforced, subjects continued to emit that response when the conditional stimulus for that response was no longer presented. Data analysis using a generalization-based detection model indicated that this model was able to describe the data effectively. Four findings were in accord with the theory. First, estimates of stimulus—response discriminability usually decreased as the arranged physical disparity between the sample stimuli decreased. Second, stimulus—response discriminability measures were independent of response—reinforcer discriminability measures, preserving parameter invariance between these measures. Third, stimulus—response discriminability measures for constant pairs of conditional stimuli did not change systematically as conditional stimulus—response alternatives were added. Fourth, log stimulus—response discriminability values between physically adjacent conditional stimuli summed to values that were not significantly different from estimates of the discriminability values for conditional stimuli that were spaced further apart.     

Prolegomena of a Logic of Causality and Dynamism

We present in this article a new logical system inspired from linear logic. This system is designed in order to express causality and dynamism. The cut elimination theorem holds for this logic. Examples of applications are given.     

The Matching Law And Amount-dependent Exponential Discounting As Accounts Of Self-control Choice

Studies with humans have found evidence for amount-dependent temporal discounting, that is, that the sensitivity of choice to reinforcer delay varies inversely with reinforcer magnitude. To test whether similar results could be obtained with nonhumans, pigeons were trained on a two-component concurrent-chains procedure in which the durations of food reinforcement in the terminal links were equal within components but unequal between components. Terminal-link schedules were varied over four conditions to allow separate estimates of sensitivity to delay to be obtained for the large and small reinforcer-magnitude components. Although sensitivity to delay was greater in the small-magnitude component for all subjects, the effect was quite small. The difference in sensitivity was generally less than one standard error, and t tests on parameter differences failed to reach significance. Several models for temporal discounting, including an amount-dependent exponential function, were fitted to the data from the first four conditions. The resulting parameter estimates were used to make predictions for a self-control condition in which one terminal link arranged a smaller, less delayed reinforcer and the other arranged a larger, more delayed reinforcer. For all models, predictions were considerably more accurate when sensitivity to delay was the same regardless of reinforcer magnitude. The results support the independence of delay and magnitude as required by a version of the matching law, and provide strong evidence against amount-dependent exponential discounting as an account of self-control choice. A new two-parameter discounting function, consistent with the matching law, is proposed that has wide empirical generality for both human and nonhuman data.     

Reversed effects in closed and open economies

Pigeons received food according to either fixed-interval, fixed-ratio, or random-interval schedules in both closed and open feeding economies. In the closed economy, they were not food deprived, they controlled the amount of food received at each meal, and they had no other source of food. In the open economy, each feeding bout consisted of one feeder cycle, and the pigeons received supplemental feeding as needed to maintain them at 80% of their free-feeding weights. Response rate always increased with larger schedule requirements in the closed economy, but it either decreased steadily or increased and then decreased in the open economy. Initial pauses lengthened with longer fixed intervals or fixed ratios (FR) in the open economy but less so in the closed economy. Responding continued under FR 10,000 schedules in the closed economy, but never survived FR 400 in the open economy. In the open economy, fixed-interval schedules could maintain far more behavior than could either fixed ratios or random intervals. Familiar concepts such as matching and arousal can describe at least some of the behavior in the open economy, but current theory does not apply well to behavior in the closed economy. An explanation of economy-dependent effects might begin with the possibility that the two economies invoke different evolved survival strategies. These strategies influence behavior by means of different mechanisms and laws. The strategy for the closed economy may relate to weight conservation, but that for the open economy may be based on energy conservation.