A weighted procrustes criterion

The Procrustes criterion is a common measure for the distance between two matricesX andY, and can be interpreted as the sum of squares of the Euclidean distances between their respective column vectors. Often a weighted Procrustes criterion, using, for example, a weighted sum of the squared distances between the column vectors, is called for. This paper describes and analyzes the performance of an algorithm for rotating a matrixX such that the column-weighted Procrustes distance toY is minimized. The problem of rotatingX intoY such that an aggregate measure of Tucker's coefficient of congruence is maximized is also discussed.We wish to thank Richard A. Harshman and C. F. Jeff Wu for valuable discussions in the early stages of this work. We would also like to thank Jos ten Berge, John Gower, and the Editor, Associate Editor, and referees whose comments and suggestions greatly improved this paper.     

Psychophysics of remembering

We present a new model of remembering in the context of conditional discrimination. For procedures such as delayed matching to sample, the effect of the sample stimuli at the time of remembering is represented by a pair of Thurstonian (normal) distributions of effective stimulus values. The critical assumption of the model is that, based on prior experience, each effective stimulus value is associated with a ratio of reinforcers obtained for previous correct choices of the comparison stimuli. That ratio determines the choice that is made on the basis of the matching law. The standard deviations of the distributions are assumed to increase with increasing retention-interval duration, and the distance between their means is assumed to be a function of other factors that influence overall difficulty of the discrimination. It is a behavioral model in that choice is determined by its reinforcement history. The model predicts that the biasing effects of the reinforcer differential increase with decreasing discriminability and with increasing retention-interval duration. Data from several conditions using a delayed matching-to-sample procedure with pigeons support the predictions.     

The Matching Law And Amount-dependent Exponential Discounting As Accounts Of Self-control Choice

Studies with humans have found evidence for amount-dependent temporal discounting, that is, that the sensitivity of choice to reinforcer delay varies inversely with reinforcer magnitude. To test whether similar results could be obtained with nonhumans, pigeons were trained on a two-component concurrent-chains procedure in which the durations of food reinforcement in the terminal links were equal within components but unequal between components. Terminal-link schedules were varied over four conditions to allow separate estimates of sensitivity to delay to be obtained for the large and small reinforcer-magnitude components. Although sensitivity to delay was greater in the small-magnitude component for all subjects, the effect was quite small. The difference in sensitivity was generally less than one standard error, and t tests on parameter differences failed to reach significance. Several models for temporal discounting, including an amount-dependent exponential function, were fitted to the data from the first four conditions. The resulting parameter estimates were used to make predictions for a self-control condition in which one terminal link arranged a smaller, less delayed reinforcer and the other arranged a larger, more delayed reinforcer. For all models, predictions were considerably more accurate when sensitivity to delay was the same regardless of reinforcer magnitude. The results support the independence of delay and magnitude as required by a version of the matching law, and provide strong evidence against amount-dependent exponential discounting as an account of self-control choice. A new two-parameter discounting function, consistent with the matching law, is proposed that has wide empirical generality for both human and nonhuman data.     

Nonstable concurrent choice in pigeons

Six pigeons were trained on concurrent variable-interval schedules in which the arranged reinforcer ratios changed from session to session according to a 31-step pseudorandom binary sequence. This procedure allows a quantitative analysis of the degree to which performance in an experimental session is affected by conditions in previous sessions. Two experiments were carried out. In each, the size of the reinforcer ratios arranged between the two concurrent schedules was varied between 31-step conditions. In Experiment 1, the concurrent schedules were arranged independently, and in Experiment 2 they were arranged nonindependently. An extended form of the generalized matching law described the relative contribution of past and present events to present-session behavior. Total performance in sessions was mostly determined by the reinforcer ratio in that session and partially by reinforcers that had been obtained in previous sessions. However, the initial exposure to the random sequence produced a lower sensitivity to current-session reinforcers but no difference in overall sensitivity to reinforcement. There was no evidence that the size of the reinforcer ratios available on the concurrent schedules affected either overall sensitivity to reinforcement or the sensitivity to reinforcement in the current session. There was also no evidence of any different performance between independent and nonindependent scheduling. Because of these invariances, this experiment validates the use of the pseudorandom sequence for the fast determination of sensitivity to reinforcement.     

Reinforcer frequency and restricted stimulus control.

Stimulus control was evaluated in 3 individuals with moderate to severe mental retardation by delayed identity matching-to-sample procedures that presented either one or two discrete forms as sample stimuli on each trial. On pretests, accuracy scores on one-sample trials were uniformly high. On two-sample trials, the correct stimulus (i.e., the one that subsequently appeared in the comparison array) varied unpredictably, and accuracy scores were substantially lower, suggesting that both sample stimuli did not exert stimulus control on every trial. Subjects were then given training sessions with the one-sample task and with a new set of four stimuli. For two of the stimuli, correct matching responses were followed by reinforcers on a variable-ratio schedule that led to a high reinforcer rate. For the other two stimuli, correct responses were followed by reinforcers on a variable-ratio schedule that led to a substantially lower reinforcer rate. Results on two-sample tests that followed showed that (a) on trials in which comparison arrays consisted of one high reinforcer-rate and one low reinforcer-rate stimulus, subjects most often selected the high-rate stimulus; and (b) on trials in which the comparison arrays were either two high reinforcer-rate stimuli or two low reinforcer-rate stimuli and the samples were one high reinforcer- and one low reinforcer-rate stimulus, accuracy was higher on trials with the high-rate comparisons. These results indicate that the frequency of stimulus control by high reinforcer-rate samples was greater than that by low reinforcer-rate samples. Following more training with the one-sample task and reversed reinforcement schedules for all stimuli, the differences in stimulus control frequencies on two-sample tests also reversed. These results demonstrate experimental control by reinforcement contingencies of which of two sample stimuli controlled selections in the two-sample task. The procedures and results may prove to be relevant for understanding restricted stimulus control and stimulus overselectivity.     

The effect of punishment on free-operant choice behavior in humans

During Phase I, three female human subjects pressed a button for monetary reinforcement in five variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtracting money) according to a variable-ratio 34 schedule. In the absence of punishment, response rates conformed to Herrnstein's equation for single variable-interval schedules. Punishment suppressed responding at all frequencies of reinforcement. This was reflected in a change in the values of both constants in Herrnstein's equation: the value of the theoretical maximum response-rate parameter was reduced, and the parameter describing the reinforcement frequency corresponding to the half-maximal response rate was elevated. During Phase II, the same five schedules (A) were in operation (without punishment), but in addition, a concurrent variable-interval schedule (B) of standard reinforcement frequency was introduced. On alternate days, responding in Component B was punished according to a variable-ratio 34 schedule. In the absence of punishment, absolute response rates conformed to equations proposed by Herrnstein to describe performance in concurrent schedules; the ratios of the response rates in the two components and the ratios of the times spent in the two components conformed to the Matching Law. When responding in Component B was punished, response rates in Component B were reduced and those in Component A were elevated, these changes being reflected in distortions of the matching relationship.     

Changeover ratio effects on concurrent variable-interval performance

Rats' bar-pressing was maintained by concurrent variable-interval schedules of reinforcement. A fixed-ratio of pulls on a chain (the changeover ratio) was required for switching between schedules. The first experiment employed equal variable-interval schedules and symmetrical changeover ratios. Increasing these ratios resulted in a decrease in the rate of switching between schedules and an increase in local response rate. In the second experiment, a range of asymmetrical changeover ratios was used with equal variable-interval schedules, and a preference was found for the schedule associated with the larger switching-into ratio. Both the distributions of responses and time between the two schedules deviated from those expected on the basis of obtained reinforcers. In the third experiment, the switching-out-of ratio was dependent on the amount of time spent in a variable-interval 2-minute schedule; a constant ratio permitted switching out of the alternative variable-interval 1-minute schedule. A strong preference was shown for the variable-interval 2-minute schedule. The fourth experiment used equal variable-interval schedules; one changeover ratio was varied while the second remained constant. The results failed to show systematic differences in local response rates immediately after a changeover.     

Time allocation in concurrent schedules: the effect of signalled reinforcement

The responses of five pigeons were reinforced on concurrent variable-interval variable-interval reinforcement schedules in which changeover key responses changed the stimulus and reinforcement schedules associated with the food key. While the reinforcement availability in one component remained unchanged throughout the experiment, the reinforcement availability in the other component was, during several conditions, signalled by the onset of an additional discriminative stimulus. During unsignalled conditions, both the relative frequency of responding and the relative time spent in each component approximated the obtained relative reinforcement frequency in each component. The effect of signalling reinforcer availability in one component was to (1) reduce responding in the signalled component to near-zero levels, and (2) increase the relative time in the unsignalled component, without a corresponding increase in the obtained relative reinforcement frequency. The magnitude of the increase in relative time in the unsignalled component decreased as the overall frequency of reinforcement increased. This deviation in the matching relation between relative time and the obtained relative reinforcement frequency was eliminated if the overall reinforcement frequency was increased before the signal was introduced and then, without removing the signal, gradually reduced.     

The symmetrical law of effect and the matching relation in choice behavior

In a concurrent-chains procedure, pigeons chose between outcomes that differed in the rate of response-independent delivery of food and electric shocks. The application of functional measurement techniques confirmed the matching relation—between choice and rate of reinforcement value—for two of three pigeons. Scale values of the outcomes were extracted for the two birds that conformed to matching, and the value of a single occurrence of shock per minute—in terms of negative food units—was estimated. A second experiment with concurrent chains provided a test of these parameter estimates. The close correspondence between predicted and obtained choice behavior found in Experiment II indicated that the estimates of outcome value were indeed reliable. Both experiments together support the contention that the effects on choice behavior of positive and aversive stimuli appear to be equal, though opposite in sign.     

Fixed-interval matching-to-sample: intermatching time and intermatching error runs

Four pigeons were trained on a matching-to-sample task in which reinforcers followed either the first matching response (fixed interval) or the fifth matching response (tandem fixed-interval fixed-ratio) that occurred 80 seconds or longer after the last reinforcement. Relative frequency distributions of the matching-to-sample responses that concluded intermatching times and runs of mismatches (intermatching error runs) were computed for the final matching responses directly followed by grain access and also for the three matching responses immediately preceding the final match. Comparison of these two distributions showed that the fixed-interval schedule arranged for the preferential reinforcement of matches concluding relatively extended intermatching times and runs of mismatches. Differences in matching accuracy and rate during the fixed interval, compared to the tandem fixed-interval fixed-ratio, suggested that reinforcers following matches concluding various intermatching times and runs of mismatches influenced the rate and accuracy of the last few matches before grain access, but did not control rate and accuracy throughout the entire fixed-interval period.