Response bias and the discrimination of stimulus duration

Pigeons discriminated stimulus duration in a psychophysical choice situation. Following presentation of any duration from a set of short duration (11 to 15 sec), responses on a red key were reinforced intermittently. Following presentation of any duration from a set of long durations (16 to 22 sec), responses on a green key were reinforced intermittently. Relative reinforcement rates were manipulated for choice responses across conditions. As relative reinforcement rates were varied, psychometric functions showed shifts in green-key responses at all durations. A signal-detection analysis showed that sensitivity remained roughly constant across conditions while response bias changed as a function of changes in relative reinforcement rate. Relative error rates tended to match relative reinforcement rates.     

An analytic comparison of Herrnstein's equations and a multivariate rate equation

Herrnstein's equations are approximations of the multivariate rate equation at ordinary rates of reinforcement and responding. The rate equation is the result of a linear system analysis of variable-interval performance. Rate equation matching is more comprehensive than ordinary matching because it predicts and specifies the nature of concurrent bias, and predicts a tendency toward undermatching, which is sometimes observed in concurrent situations. The rate equation contradicts one feature of Herrnstein's hyperbola, viz., the theoretically required constancy of k. According to the rate equation, Herrnstein's k should vary directly with parameters of reinforcement such as amount or immediacy. Because of this prediction, the rate equation asserts that the conceptual framework of matching does not apply to single alternative responding. The issue of the constancy of k provides empirical grounds for distinguishing between Herrnstein's account and a linear system analysis of single alternative variable-interval responding.     

Toward a quantitative theory of punishment

In two experiments, pigeons' key pecking for food on concurrent variable-interval schedules was punished with electric shock according to concurrent variable-interval punishment schedules. With unequal frequencies of food but equal rates of punishment associated with the two keys and at several intensities of shock, the response and time allocation of all six pigeons overmatched the obtained relative frequency of food. The overmatching was predicted by a subtractive model of the interaction between punishment and positive reinforcement but not by two alternative models. Increases in the k and r_e parameters of the generalized matching law could not account for the observed shifts in preference.     

Reinforcement and punishment effects in concurrent schedules: A test of two models

The joint effects of punishment and reinforcement on the pigeon's key-peck response were examined in three choice experiments conducted to compare predictions of Farley and Fantino's (1978) subtractive model with those made by Deluty's (1976) and Deluty and Church's (1978) model of punishment. In Experiment 1, the addition of equal punishment schedules to both alternatives of a concurrent reinforcement schedule enhanced the preference exhibited for the more frequent reinforcement alternative. Experiment 2 demonstrated decreases in the absolute response rate for each member of a concurrent reinforcement schedule when increasing frequencies of punishment were added to each alternative. Experiment 3 found that preference for the denser of two reinforcement schedules diminished when the absolute frequencies of reinforcement were increased by a constant factor and conditions of punishment for both alternatives were held constant. Diminished preferences were obtained regardless of whether the frequency of punishment associated with the denser reinforcement schedule was greater or less than that associated with the lean reinforcement alternative. The results from all three experiments uniquely supported Farley and Fantino's (1978) subtractive model of punishment and reinforcement.     

Sample-specific ratio effects in matching to sample

In a symbolic matching-to-sample task, pigeons were trained using sample-specific, fixed-ratio “observing responses.” Subsequently, in a mixed condition, each sample was presented equally often with each ratio requirement, i.e., the ratios were no longer correlated with the samples. In a second experiment, pigeons were trained initially in the mixed condition and subsequently shifted to the sample-specific condition in which the required ratios were correlated with the samples. Results of both experiments suggested joint control of choices by ratio value and by the exteroceptive stimuli. The discriminative properties of the ratios appeared to outweigh absolute ratio-size effects.     

Concurrent-schedule performance in dairy cows: persistent undermatching.

Performance of dairy cows responding under concurrent variable-interval variable-interval schedules of food delivery was examined, with results analyzed in terms of the generalized matching equation. In Experiment 1, bias measures indicated that crushed barley was preferred over meatmeal when these foods were available under the alternative schedules. For whole-session data, substantial undermatching of response and time-allocation ratios to obtained reinforcement ratios was evident. Postreinforcement pause time ratios approximately matched obtained reinforcement rates. Subtracting these times from total time-allocation values yielded net time-allocation ratios that undermatched obtained reinforcement ratios to a greater degree than did whole-session time-allocation ratios. In Experiment 2, substantial undermatching was evident when the same foods (hay for 2 cows, crushed barley for 2 others) were available under the alternative schedules. Food-related activities and other defined behavior not related to food were quantified by direct observation, and were found to occupy a substantial proportion (roughly 40% to 80%) of experimental sessions. Subtracting the time spent in these activities from the time allocated to each component schedule did not reduce the degree of undermatching obtained. Across all conditions in both experiments, slopes of regression lines relating behavioral outputs to environmental inputs characteristically were below 0.6, which agrees with prior findings and suggests that, contrary to suggestions in the literature, undermatching in dairy cows is not the result of using different foods under alternative schedules or differential pausing under those schedules.     

A monotonically convergent algorithm for orthogonal congruence rotation

Brokken has proposed a method for orthogonal rotation of one matrix such that its columns have a maximal sum of congruences with the columns of a target matrix. This method employs an algorithm for which convergence from every starting point is not guaranteed. In the present paper, an iterative majorization algorithm is proposed which is guaranteed to converge from every starting point. Specifically, it is proven that the function value converges monotonically, and that the difference between subsequent iterates converges to zero. In addition to the better convergence properties, another advantage of the present algorithm over Brokken's one is that it is easier to program. The algorithms are compared on 80 simulated data sets, and it turned out that the new algorithm performed well in all cases, whereas Brokken's algorithm failed in almost half the cases. The derivation of the algorithm is given in full detail because it involves a series of inequalities that can be of use to derive similar algorithms in different contexts.This research has been made possible by a fellowship from the Royal Netherlands Academy of Arts and Sciences to the first author. The authors are obliged to Willem J. Heiser and Jos M. F. ten Berge for useful comments on an earlier version of this paper.     

The dynamic programming matching analysis of handwriting movement in delayed vision

Abstract: Dynamic programming matching analysis of the velocity profile of handwriting was used to examine temporally invariant characteristics of handwriting. This was done by comparing the performance of 12 subjects in writing five words under various delayed visual feedback conditions. The rate of temporally invariant handwriting decreased when delay of visual feedback was introduced. That is, the mean number of fluctuations or hesitations increased as a function of the delay time. This indicates that subjects wrote words by segmenting their movements into submovements. The relative positions of the boundaries of submovements was shown using dynamic programming matching analysis by the distribution of fluctuations along a time axis of templates. The results suggest the development of a segmented "move-and-wait" strategy under conditions of delayed vision. It was shown that in the "move" phase, subjects performed appropriate submovements as smoothly as in the no delay condition and waited during the delay until visual feedback caught up. The increased errors were due to inadequate segmentation of movements.     

Relative sensitivity to reinforcer amount and delay in a self-control choice situation.

Rats were exposed to concurrent-chains schedules in which a single variable-interval schedule arranged entry into one of two terminal-link delay periods (fixed-interval schedules). The shorter delay ended with the delivery of a single food pellet; the longer day ended with a larger number of food pellets (two under some conditions and six under others). In Experiment 1, the terminal-link delays were selected so that under all conditions the ratio of delays would exactly equal the ratio of the number of pellets. But the absolute duration of the delays differed across conditions. In one condition, for example, rats chose between one pellet delayed 5 s and six pellets delayed 30 s; in another condition rats chose between one pellet delayed 10 s and six pellets delayed 60 s. The generalized matching law predicts indifference between the two alternatives, assuming that the sensitivity parameters for amount and delay of reinforcement are equal. The rats' choices were, in fact, close to indifference except when the choice was between one pellet delayed 5 s and six pellets delayed 30 s. That deviation from indifference suggests that the sensitivities to amount and delay differ from each other depending on the durations of the delays. In Experiment 2, rats chose between one pellet following a 5-s delay and six pellets following a delay that was systematically increased over sessions to find a point of indifference. Indifference was achieved when the delay to the six pellets was approximately 55 s. These results are consistent with the possibility that the relative sensitivities to amount and delay differ as a function of the delays.     

Most directed forgetting in pigeons can be attributed to the absence of reinforcement on forget trials during training or to other procedural artifacts.

In research on directed forgetting in pigeons using delayed matching procedures, remember cues, presented in the delay interval between sample and comparisons, have been followed by comparisons (i.e., a memory test), whereas forget cues have been followed by one of a number of different sample-independent events. The source of directed forgetting in delayed matching to sample in pigeons was examined in a 2 x 2 design by independently manipulating whether or not forget-cue trials in training ended with reinforcement and whether or not forget-cue trials in training included a simultaneous discrimination (involving stimuli other than those used in the matching task). Results were consistent with the hypothesis that reinforced responding following forget cues is sufficient to eliminate performance deficits on forget-cue probe trials. Only when reinforcement was omitted on forget-cue trials in training (whether a discrimination was required or not) was there a decrement in accuracy on forget-cue probe trials. When reinforcement is present, however, the pattern of responding established during and following a forget cue in training may also play a role in the directed forgetting effect. These findings support the view that much of the evidence for directed forgetting using matching procedures may result from motivational and behavioral artifacts rather than the loss of memory.