A stochastic model for test-retest correlations

A simple stochastic model is formulated in order to determine the optimal time between the first test and the second test when the test-retest method of assessing reliability is used. A forgetting process and a change in true score process are postulated. The optimal time between tests is derived by maximizing the probability that the respondent has not remembered the response on the first test and has not had a change in true score. The resulting test-retest correlation is then found to be a linear function of the true reliability of the test, where the slope of this function is the key probability of not remembering and having no change in true score. Some numerical examples and suggestions for using the results in empirical studies are given. Specific recommendations are presented for improved design and analysis of intentions data.This research was made possible by a grant from the Center for Food Policy Research, Graduate School of Business, Columbia University, New York, New York, 10027.     

Feedback interventions and driving speed: A parametric and comparative analysis

Five experiments were conducted to assess the effects of several variables on the efficacy of feedback in reducing driving speed. Experiment 1 systematically varied the criterion used to define speeding, and results showed that the use of a lenient criterion (20 km/hr over the speed limit), which allowed for the posting of high percentages of drivers not speeding, was more effective in reducing speeding than the use of a stringent criterion (10 km/hr over the speed limit). In Experiment 2 an analysis revealed that posting feedback reduced speeding on a limited access highway and the effects persisted to some degree up to 6 km. Experiments 3 and 4 compared the effectiveness of an unmanned parked police vehicle (Experiment 3) and a police air patrol speeding program (Experiment 4) with the feedback sign and determined whether the presence of either of these enforcement variables could potentiate the efficacy of the sign. The results of both experiments demonstrated that although the two enforcement programs initially produced larger effects than the feedback sign, the magnitude of their effect attenuated over time. Experiment 5 compared the effectiveness of a traditional enforcement program with a warning program which included handing out a flier providing feedback on the number and types of accidents occuring on the road during the past year. This experiment demonstrated that the warning program produced a marked reduction in speeding and the traditional enforcement program did not. Furthermore, the warning program and a feedback sign together produced an even greater reduction in speeding than either alone.     

Reaction times of younger and older men and temporal contingencies of reinforcement

Influences of extended training and temporal contingencies on reaction time were studied in relation to developmental differences. Older and younger men were trained on a chained schedule in which completion of a variable interval produced a terminal link in which reaction time was measured. The reaction-time procedure involved a conditional discrimination with matching to sample in one component and oddity matching in the other. During baseline training, no time limit was placed on the response to the discrimination choice stimuli. Subsequently, increasingly severe time limits were imposed over a series of sessions. Older and younger men showed increased speeds (decreased reaction times) when temporal contingencies were imposed, and these changes were maintained during post-training baseline sessions when there was unlimited time in which to respond. The younger men generally responded faster than the older ones, and age differences were not appreciably reduced during the course of the experiment. The results indicated the feasibility of studying reaction time in human subjects using operant procedures analogous to those developed for the study of nonverbal organisms.     

Concurrent schedules: Effects of time- and response-allocation constraints

Five pigeons were trained on concurrent variable-interval schedules arranged on two keys. In Part 1 of the experiment, the subjects responded under no constraints, and the ratios of reinforcers obtainable were varied over five levels. In Part 2, the conditions of the experiment were changed such that the time spent responding on the left key before a subsequent changeover to the right key determined the minimum time that must be spent responding on the right key before a changeover to the left key could occur. When the left key provided a higher reinforcer rate than the right key, this procedure ensured that the time allocated to the two keys was approximately equal. The data showed that such a time-allocation constraint only marginally constrained response allocation. In Part 3, the numbers of responses emitted on the left key before a changeover to the right key determined the minimum number of responses that had to be emitted on the right key before a changeover to the left key could occur. This response constraint completely constrained time allocation. These data are consistent with the view that response allocation is a fundamental process (and time allocation a derivative process), or that response and time allocation are independently controlled, in concurrent-schedule performance.     

The life and times of PSI

This paper describes the essential features of the personalized system of instruction (PSI). Results from outcome research examining the effectiveness of PSI-based courses relative to traditional methods provide unequivocal support for the superiority of PSI. Parametric studies, or component analyses, show that the mastery requirement, immediate performance feedback, and review units are the key features underlying high quality student performances in PSI courses. The use of student proctors as peer-tutors, optional lectures, and selfpacing do not, in and of themselves, appear to be vital to student success in PSI courses. Despite its superiority, PSI has not supplanted traditional methods as the dominant pedagogical system in higher education. Difficulties inherent in overcoming the inertia of the lecture within our established instructional system, the implications of PSI for that system, and the Zeitgeist that permeates educational reform are the major obstacles to widespread adoption of PSI.     

Sensory superstition on multiple interval schedules.

Pigeons were exposed to multiple schedules in which an irregular repeating sequence of five stimulus components was correlated with the same reinforcement schedule throughout. Stable, idiosyncratic, response-rate differences developed across components. Components were rank-ordered by response rate; an approximately linear relation was found between rank order and the deviation of mean response rate from the overall mean rate. Nonzero slopes of this line were found for multiple fixed-interval and variable-time schedules and for multiple variable-interval schedules both when number of reinforcements was the same in all components and when it varied. The steepest function slopes were found in the variable schedules with relatively long interfood intervals and relatively short component durations. When just one stimulus was correlated with all components of a multiple variable-interval schedule, the slope of the line was close to zero. The results suggest that food-rate differences may be induced initially by different reactions to the stimuli and subsequently maintained by food.     

Effects of self-monitoring and feedback on residential electricity consumption

Prior research has indicated that frequent feedback could reduce residential electricity consumption by 10% to 15%. However, because feedback was primarily given in written form, this procedure might not be practical. The present study evaluated a potentially more practical feedback procedure during peak-use periods with high electricity consuming households. The study was conducted during the winter in an upper-middle class neighborhood of almost identical, all-electric townhouses (N = 71) that averaged about 170 KWH per day per household for a monthly bill of over $200. Twelve households received daily written feedback. Sixteen households (self-monitoring) were taught to read their outdoor electricity meter and to record KWH used every day. A comparison group was composed of 14 households that had volunteered to participate and 29 others that had only given permission to have their meters read. During a 1-month period that the procedures were in effect, the feedback group reduced consumption by 13% and the self-monitoring group by about 7%. These reductions, relative to the comparison group, were maintained during an early spring 1-month follow-up period and, to a lesser extent, during a 6-week warm spring period. Self-monitoring participants were highly reliable and persistent meter readers. Reductions in electricity use were reported by households to be largely attributable to lowering of the heat thermostat, and large monetary and KWH savings were found. Techniques to make self-monitoring cost-effective important components of the self-monitoring procedure, methods to apply self-monitoring more broadly, and plans to combine behavioral procedures with physical technology are discussed.     

A multi-element analysis of the effect of teacher aides in an "open"-style classroom

Open classrooms with few rules, individualized instruction, and informal class organization present new problems for the application of behavior principles. The effects of three types of teacher aides on student achievement and on-task behavior were studied. Each was compared with a standard no-aide condition. Subjects were 54 third graders in two "open"-style classrooms. The three types of aide, helping adult, disciplinary adult, and helping fifth-grade aide, were compared in a multi-element design with a no-aide control. The helping-adult aide significantly affected the academic output of the class, when compared with the no-aide condition. All aide conditions produced more academic work and on-task behavior than did the standard no-aide condition.     

Reducing residential electrical energy use: payments, information, and feedback

Monetary payments, energy information, and daily feedback on consumption were employed to reduce electricity use in four units of a university student housing complex. A combined multiple-baseline and withdrawal design permitted both within- and between-unit comparisons. Payments produced immediate and substantial reductions in consumption in all units, even when the magnitude of the payments was reduced considerably. Feedback also produced reductions, but information about ways to conserve and about the cost of using various appliances did not. It was also found that, in general, payments combined with either information or feedback produced no greater effect than payments alone.     

Choice, time allocation, and response rate during stimulus generalization

Six pigeons were trained to discriminate between two noise intensities using a procedure that assessed choice, time allocation, and response rate simultaneously and independently. Responses on the left or right key (R1 or R2) were respectively correct in the presence of two different intensities, S1 and S2. After a correct response, reinforcement became available for pecks on the center key. Reinforcement density for R1¦S1 relative to R2¦S2 was varied across experimental conditions. Generalization tests followed extensive training at each condition. As a function of stimulus intensity, proportions of initial choices of R2, of time spent in R2-initiated components, and of center-key responses emitted in R2-initiated components all yielded sigmoidal gradients of similar slope, which shifted slightly in location when relative reinforcement density changed. Changeovers were maximal where initial choice proportions approximated 0.5. Gradients relating the absolute number of center-key responses to stimulus intensity were also roughly sigmoidal, but were more sensitive to changes in reinforcement density. Gradients of momentary response rate also depended on reinforcement density. During training, large but transitory shifts in choice responding occurred when reinforcement density changed, while differences in momentary response rate developed slowly, suggesting separate control of choice and response rate by the contingencies of reinforcement.