Choice between delayed reinforcers and fixed-ratio schedules requiring forceful responding.

This experiment measured pigeons' choices between delayed reinforcers and fixed-ratio schedules in which a force of approximately 0.48 N was needed to operate the response key. In ratio-delay conditions, subjects chose between a fixed-ratio schedule and an adjusting delay. The delay was increased or decreased several times a session in order to estimate an indifference point--a delay duration at which the two alternatives were chosen about equally often. Each ratio-delay condition was followed by a delay-delay condition in which subjects chose between the adjusting delay and a variable-time schedule, with the components of this schedule selected to match the ratio completion times of the preceding ratio-delay condition. The adjusting delays at the indifference point were longer when the alternative was a fixed-ratio schedule than when it was a matched variable-time schedule, which indicated a preference for the matched variable-time schedules over the fixed-ratio schedules. This preference increased in a nonlinear manner with increasing ratio size. This nonlinearity was inconsistent with a theory that states that indifference points for both time and ratio schedules can be predicted by multiplying the choice response-reinforcer intervals of the two types of schedules by different multiplicative constants. Two other theories, which predict nonlinear increases in preference for the matched variable-time schedules, are discussed.     

Delayed and current stimulus control in successive discriminations

In a successive discrimination in which successively alternating red and green hues signaled component variable-interval schedules, sensitivity of the ratio of responses in the two components to variation in the component reinforcer ratio decreased systematically during the course of the component. This decrease in stimulus control or discrimination over the course of the component was shown to be the result of delayed control of responding during the component by the stimulus transition between components. When the red–green stimulus transition was altered by interpolating a white stimulus at the end of each 60-s component, discrimination at the beginning of the component (measured by the power-function exponent for sensitivity to reinforcement) was reduced. Conditions with the white stimulus inserted in other quarters of the component indicated that the current discriminative stimulus exerts control over responding throughout the component, whereas during about the first half of the component, response differentials are influenced by the transition between discriminative stimuli.     

Additional-delay schedules: A continuum of temporal contingencies by varying food delay

Pigeons performed on discrete-trial, temporally defined schedules in which the food delay (D) was adjusted according to the latency of the key peck (X) and two schedule parameters (t and A). The schedule function was D = A(t − X), where D is the experienced delay between a response and a reinforcer. The schedule parameter t is the maximum value below which the present contingencies occur. A is the additional delay to reinforcement for each second the response latency is shorter than the t value. When A = 0 s, the schedule is a continuous reinforcement schedule with immediate reinforcement. When A = 1 s, the schedule is a conjunctive fixed-ratio 1 fixed-time t-s schedule. When A approaches infinity, the schedule becomes a differential reinforcement of long latency schedule. The latencies for subjects with t = 10 s and t = 30 s were observed with the present schedules having seven values for A between 0 s and 11 s. In addition, the latencies for subjects for which t = 30 s were observed at an A value of 31 s to 41 s. As the A value increased, the latencies approached the t value for subjects for which t = 10 s. The latencies for 30-s-t subjects did not approach t, even when the A value was 41 s. The latencies for 10-s-t subjects at 11-s A value were longer than those under yoked conditions having exactly the same delays/interreinforcement intervals. These results demonstrated a continuum of latency related to the schedule continuum (value of A) at a small t value.     

Three-term contingency patterns in mother-child verbal interactions during first-language acquisition

Selections from a large longitudinal data set of verbal interactions between a mother and her child are presented. Two sets of three-term contingency sequences that seemed to reflect maternal rewards and corrections were noted. Both the antecedents as well as the immediate consequences of maternal interventions are presented to explore training and learning processes. The observed frequencies of three-step sequences are compared to those expected based upon Markov-chain logic to substantiate the patterning of the interactions. Behavioral conceptualizations of the learning process are supported by these analyses, although their sufficiency is questioned. It is suggested that maternal rewards and corrections should be integrated with perceptual, cognitive, and social learning conceptualizations in a skill-learning approach to explain the complexity of language transmission and acquisition processes.     

Timeout from concurrent schedules.

Response-contingent timeouts of equal duration and frequency were added to both alternatives of unequal concurrent schedules of reinforcement. For each of 4 pigeons in Experiment 1, relative response rates generally became less extreme as the frequency of timeout increased. In Experiment 2, relative response rates consistently approached indifference as the duration of timeout was increased. Variation in time allocation was less consistent in both experiments. Absolute response rates did not vary with the timeout contingency in either experiment. In a third experiment, neither measure of choice varied systematically when the duration of a postreinforcement blackout was varied. In contrast to the present results, preference has been shown to vary directly with the parameters of shock delivery in related procedures. The pattern of results in the first two experiments follows that obtained with other manipulations of the overall rate of reinforcement in concurrent schedules. The results of the third experiment suggest that an intertrial interval following reinforcement is not a critical feature of the overall rate of reinforcement.     

The utility of verbal and behavioral assessments of value.

Subjects lived in a laboratory apartment for up to 30 days, engaging in ordinary activities such as reading, sewing, and artwork. The amount of time devoted to each activity was recorded and compared with periodic verbal ratings of the amount of time devoted to the activities. The verbal and observational assessments of the time distribution were very similar, but there were some discrepancies. Based on self-reports and on observation of time actually devoted to the activities, contingencies were arranged in which time devoted to one activity produced time available for a second activity. When the contingency relation was based on behavioral assessment, predictions of time redistribution were more accurate than when the relations were based on verbal assessment. The close correspondence between observed distributions of time and verbally assessed distributions was probably due to the well-specified situation and rigorous assessment methods. Contrary to some cognitive-behavioral accounts, the contingency results suggest that verbal assessment is not necessarily preferable to observation when the two make discrepant predictions. It is suggested that verbal reports might be used more often in behavior analysis in place of lengthy or difficult observations, and attention is drawn to a personality model that parallels important components of behavior analysis.     

Unification of models for choice between delayed reinforcers.

Two models for choice between delayed reinforcers, Fantino's delay-reduction theory and Killeen's incentive theory, are reviewed. Incentive theory is amended to incorporate the effects of arousal on alternate types of behavior that might block the reinforcement of the target behavior. This amended version is shown to differ from the delay-reduction theory in a term that is an exponential in incentive theory and a difference in delay-reduction theory. A power series approximation to the exponential generates a model that is formally identical with delay-reduction theory. Correlations between delay-reduction theory and the amended incentive theory show excellent congruence over a range of experimental conditions. Although the assumptions that gave rise to delay-reduction theory and incentive theory remain different and testable, the models deriving from the theories are unlikely to be discriminable by parametric experimental tests. This congruence of the models is recognized by naming the common model the delayed reinforcement model, which is then compared with other models of choice such as Killeen and Fetterman's (1988) behavioral theory of timing, Mazur's (1984) equivalence rule, and Vaughan's (1985) melioration theory.     

Determinants of pigeons' waiting time: Effects of interreinforcement interval and food delay

Four pigeons performed on three types of schedules at short (i.e., 10, 30, or 60 s) interreinforcement intervals: (a) a delay-dependent schedule where interreinforcement interval was held constant (i.e., increases in waiting time decreased food delay), (b) an interreinforcement-interval-dependent schedule where food delay was held constant (i.e., increases in waiting time increased interreinforcement interval), and (c) a both-dependent schedule where increases in waiting time produced increases in interreinforcement interval but decreases in food delay. Waiting times were typically longer under the delay-dependent schedules than under the interreinforcement-interval-dependent schedules. Those under both-dependent schedules for 1 subject were intermediate between those under the other two schedule types, whereas for the other subjects waiting times under the both-dependent procedure were similar either to those under the delay-dependent schedule or to those under the interreinforcement-interval-dependent schedule, depending both on the subject and the interreinforcement interval. These results indicate that neither the interreinforcement interval nor food delay is the primary variable controlling waiting time, but rather that the two interact in a complex manner to determine waiting times.     

Modeling item responses when different subjects employ different solution strategies

A model is presented for item responses when different subjects employ different strategies, but only responses, not choice of strategy, can be observed. Using substantive theory to differentiate the likelihoods of response vectors under a fixed set of strategies, we model response probabilities in terms of item parameters for each strategy, proportions of subjects employing each strategy, and distributions of subject proficiency within strategies. The probabilities that an individual subject employed the various strategies can then be obtained, along with a conditional estimate of proficiency under each. A conceptual example discusses response strategies for spatial rotation tasks, and a numerican example resolves a population of subjects into subpopulations of valid responders and random guessers.The first author's work was supported by Contract No. N00014-85-K-0683, project designation NR 150-539, from the Cognitive Science Program, Cognitive and Neural Sciences Division, Office of Naval Research. We are grateful to Murray Aitkin, Isaac Bejar, Neil Dorans, Frederiksen, and Marklyn Wingersky for their comments and suggestions, and to Alison Gooding, Maxine Kingston, Donna Lembeck, Joling Liang, and Kentaro Yamamoto for their assistance with Example 2.