A more powerful method for testing for agreement between a judge and a known standard

We assume that a judge's task is to categorize each ofN subjects into one ofr known classes. The design of primary interest is employed if the judge is presented withs groups, each containingr subjects, such that each group of sizer consists of exactly one subject of each of ther types. The probability distribution for the total number of correct choices is developed and used to test the null hypothesis that the judge is guessing in favor of the alternative that he or she is operating at a better than chance level. The power of the procedure is shown to be superior to two other procedures which appear in the literature.The authors are grateful for the suggestions of the referees and for computer funding provided by the Northeast Regional Data Center at the University of Florida.     

A stochastic multidimensional scaling procedure for the empirical determination of convex indifference curves for preference/choice analysis

The vast majority of existing multidimensional scaling (MDS) procedures devised for the analysis of paired comparison preference/choice judgments are typically based on either scalar product (i.e., vector) or unfolding (i.e., ideal-point) models. Such methods tend to ignore many of the essential components of microeconomic theory including convex indifference curves, constrained utility maximization, demand functions, et cetera. This paper presents a new stochastic MDS procedure called MICROSCALE that attempts to operationalize many of these traditional microeconomic concepts. First, we briefly review several existing MDS models that operate on paired comparisons data, noting the particular nature of the utility functions implied by each class of models. These utility assumptions are then directly contrasted to those of microeconomic theory. The new maximum likelihood based procedure, MICROSCALE, is presented, as well as the technical details of the estimation procedure. The results of a Monte Carlo analysis investigating the performance of the algorithm as a number of model, data, and error factors are experimentally manipulated are provided. Finally, an illustration in consumer psychology concerning a convenience sample of thirty consumers providing paired comparisons judgments for some fourteen brands of over-the-counter analgesics is discussed.     

Restricted multidimensional scaling models for asymmetric proximities

Restricted multidimensional scaling models [Bentler & Weeks, 1978] allowing constraints on parameters, are extended to the case of asymmetric data. Separate functions are used to model the symmetric and antisymmetric parts of the data. The approach is also extended to the case in which data are presumed to be linearly related to squared distances. Examples of several models are provided, using journal citation data. Possible extensions of the models are considered. This research was supported in part by USPHS Grant 0A01070, P. M. Bentler, principal investigator, and NIMH Grant MH-24819, E. J. Anthony and J. Worland, principal investigators. The authors wish to thank E. W. Holman and several anonymous reviewers for their valuable suggestions concerning this research.     

Canonical analysis of longitudinal and repeated measures data with stationary weights

When measuring the same variables on different occasions, two procedures for canonical analysis with stationary compositing weights are developed. The first, SUMCOV, maximizes the sum of the covariances of the canonical variates subject to norming constraints. The second, COLLIN, maximizes the largest root of the covariances of the canonical variates subject to norming constraints. A characterization theorem establishes a model building approach. Both methods are extended to allow for Cohort Sequential Designs. Finally a numerical illustration utilizing Nesselroade and Baltes data is presented.The authors wish to thank John Nesselroade for permitting us to use the data whose analysis we present.     

NORMAL CHILDREN AS TUTORS TO TEACH SOCIAL RESPONSES TO WITHDRAWN MENTALLY RETARDED SCHOOLMATES: TRAINING,MAINTENANCE, AND GENERALIZATION

The findings of the three experiments reported herein indicate that normal children can successfully teach social responses (i.e., delayed imitation, cooperative play, and verbalization of positive comments) to withdrawn mentally retarded peers. The effects of the intervention generalized across stimulus and response conditions, while the trained and generalized levels of responding were maintained after the end of the intervention. Moreover, the subjects developed social responding within their classrooms and play areas parallel to the intervention and continued to increase such responding after the interruption of the intervention. Direct edible reinforcement appeared to be necessary at least during the initial period of the intervention. Vicarious edible reinforcement seemed useful to prompt the appearance of responding. Vicarious social reinforcement was ineffective at the beginning of the intervention, but apparently acquired prompting power at a later stage of training. Generalization results indicated that the similarity between the response occasions used for training and those used for testing generalization played an important role. Yet, the extensiveness of training and the development of responding within the classrooms and play areas may also have had a relevant effect. The development of social responding within the classrooms and play areas appeared to be mainly the effect of new learning. This was perhaps due to vicarious and direct social reinforcement.     

Back to basics: Percentage agreement measures are adequate, but there are easier ways

Percentage agreement measures of interobserver agreement or "reliability" have traditionally been used to summarize observer agreement from studies using interval recording, time-sampling, and trial-scoring data collection procedures. Recent articles disagree on whether to continue using these percentage agreement measures, and on which ones to use, and what to do about chance agreements if their use is continued. Much of the disagreement derives from the need to be reasonably certain we do not accept as evidence of true interobserver agreement those agreement levels which are substantially probable as a result of chance observer agreement. The various percentage agreement measures are shown to be adequate to this task, but easier ways are discussed. Tables are given to permit checking to see if obtained disagreements are unlikely due to chance. Particularly important is the discovery of a simple rule that, when met, makes the tables unnecessary. If reliability checks using 50 or more observation occasions produce 10% or fewer disagreements, for behavior rates from 10% through 90%, the agreement achieved is quite improbably the result of chance agreement.     

Axiomatic and numerical conjoint measurement: An evaluation of diagnostic efficacy

Synthetic data are used to examine how well axiomatic and numerical conjoint measurement methods, individually and comparatively, recover simple polynomial generators in three dimensions. The study illustrates extensions of numerical conjoint measurement (NCM) to identify and model distributive and dual-distributive, in addition to the usual additive, data structures. It was found that while minimum STRESS was the criterion of fit, another statistic, predictive capability, provided a better diagnosis of the known generating model. That NCM methods were able to better identify generating models conflicts with Krantz and Tversky's assertion that, in general, the direct axiom tests provide a more powerful diagnostic test between alternative composition rules than does evaluation of numerical correspondence. For all methods, dual-distributive models are most difficult to recover, while consistent with past studies, the additive model is the most robust of the fitted models.Douglas Emery is now at the Krannert Graduate School of Management, Purdue University, West Lafayette, IN, on leave from the University of Calgary.     

A multi-element analysis of the effect of teacher aides in an "open"-style classroom

Open classrooms with few rules, individualized instruction, and informal class organization present new problems for the application of behavior principles. The effects of three types of teacher aides on student achievement and on-task behavior were studied. Each was compared with a standard no-aide condition. Subjects were 54 third graders in two "open"-style classrooms. The three types of aide, helping adult, disciplinary adult, and helping fifth-grade aide, were compared in a multi-element design with a no-aide control. The helping-adult aide significantly affected the academic output of the class, when compared with the no-aide condition. All aide conditions produced more academic work and on-task behavior than did the standard no-aide condition.     

Two-step weighted least squares factor analysis of dichotomized variables

A two-step weighted least squares estimator for multiple factor analysis of dichotomized variables is discussed. The estimator is based on the first and second order joint probabilities. Asymptotic standard errors and a model test are obtained by applying the Jackknife procedure.     

The design and evaluation of a worksharing system for experimental group living

Failure to share household chores equitably may be a major cause of the high failure rate of experimental group-living arrangements. A behavioral approach to worksharing based on a point system was implemented in one experimental group and its most important components experimentally evaluated. Experiment I showed that awarding credits produced more work than not awarding credits. Experiment II showed that making credits contingent on the outcome of a detailed inspection produced more work than awarding credits noncontingently. Experiment III demonstrated that awarding rent reductions contingent on credit earnings produced more work than awarding rent reductions noncontingently. Other evaluative data suggest that the resulting living arrangement is cheaper, more effective, and more satisfactory to the residents when compared to the most popular alternative living arrangements.