Spatial and conjoint models based on pairwise comparisons of dissimilarities and combined effects: Complete and incomplete designs

In pairwise multidimensional scaling, a spatial representation for a set of objects is determined from comparisons of the dissimilarity of any two objects drawn from the set to the dissimilarity of other pairs of objects drawn from that set. In pairwise conjoint scaling, comparisons among the joint effects produced by pairs of objects, where the objects in a pair are drawn from separate sets, are used to determine numerical representations for the objects in each set. Monte Carlo simulations of both pairwise dissimilarities and pairwise conjoint effects show that Johnson's algorithm can provide good metric recovery in the presence of high levels of error even when only a small percentage of the complete set of pairwise comparisons are tested.     

Probabilistic multidimensional scaling: Complete and incomplete data

Simple procedures are described for obtaining maximum likelihood estimates of the location and uncertainty parameters of the Hefner model. This model is a probabilistic, multidimensional scaling model, which assigns a multivariate normal distribution to each stimulus point. It is shown that for such a model, standard nonmetric and metric algorithms are not appropriate. A procedure is also described for constructing incomplete data sets, by taking into consideration the degree of familiarity the subject has for each stimulus. Maximum likelihood estimates are developed both for complete and incomplete data sets. This research was supported by National Science Grant No. SOC76-20517. The first author would especially like to express his gratitude to the Netherlands Institute for Advanced Study for its very substantial help with this research.     

Recovery of structure in incomplete data by alscal

A Monte Carlo study was carried out in order to investigate the ability of ALSCAL to recover true structure inherent in simulated proximity measures when portions of the data are missing. All sets of simulated proximity measures were based on 30 stimuli and three dimensions, and selection of missing elements was done randomly. Properties of the simulated data varied according to (a) the number of individuals, (b) the level of random error, (c) the proportion of missing data, and (d) whether the same entries or different entries were deleted for each individual. Results showed that very accurate recovery of true distances, stimulus coordinates, and weight vectors could be achieved with as much as 60% missing data as long as sample size was sufficiently large and the level of random error was low.     

A distance-based variety of nonlinear multivariate data analysis, including weights for objects and variables

In the distance approach to nonlinear multivariate data analysis the focus is on the optimal representation of the relationships between the objects in the analysis. In this paper two methods are presented for including weights in distance-based nonlinear multivariate data analysis. In the first method, weights are assigned to the objects while the second method is concerned with differential weighting of groups of variables. When each analysis variable defines a group the latter method becomes a variable weighting method. For objects the weights are assumed to be given; for groups of variables they may be given, or estimated. These weighting schemes can also be combined and have several important applications. For example, they make it possible to perform efficient analyses of large data sets, to use the distance-based variety of nonlinear multivariate data analysis as an addition to loglinear analysis of multiway contingency tables, and to do stability studies of the solutions by applying the bootstrap on the objects or the variables in the analysis. These and other applications are discussed, and an efficient algorithm is proposed to minimize the corresponding loss function.This study is funded by The Netherlands Organization for Scientific Research (NWO) by grant nr. 030-56403 for the PIONEER project Subject Oriented Multivariate Analysis to the third author.     

Nonmetric multidimensional scaling with clustering of subjects

A new nonmetric multidimensional scaling method is devised to analyze three-way data concerning inter-stimulus similarities obtained from many subjects. It is assumed that subjects are classified into a small number of clusters and that the stimulus configuration is specific to each cluster. Under this assumption, the classification of subjects and the scaling used to derive the configurations for clusters are simultaneously performed using an alternating least-squares algorithm. The monotone regression of ordinal similarity data, the scaling of stimuli and the K -means clustering of subjects are iterated in the algorithm. The method is assessed using a simulation and its practical use is illustrated with the analysis of real data. Finally, some extensions are considered.     

Constrained latent class analysis: Simultaneous classification and scaling of discrete choice data

A reparameterization of a latent class model is presented to simultaneously classify and scale nominal and ordered categorical choice data. Latent class-specific probabilities are constrained to be equal to the preference probabilities from a probabilistic ideal-point or vector model that yields a graphical, multidimensional representation of the classification results. In addition, background variables can be incorporated as an aid to interpreting the latent class-specific response probabilities. The analyses of synthetic and real data sets illustrate the proposed method.The authors thank Yosiho Takane, the editor and referees for their valuable suggestions. Authors are listed in reverse alphabetical order.     

A marginal maximum likelihood method for the vector threshold model to analyze dichotomous choice data

Abstract: At least two types of models, the vector model and the unfolding model can be used for the analysis of dichotomous choice data taken from, for example, the pick any/ n method. The previous vector threshold models have a difficulty with estimation of the nuisance parameters such as the individual vectors and thresholds. This paper proposes a new probabilistic vector threshold model, where, unlike the former vector models, the angle that defines an individual vector is a random variable, and where the marginal maximum likelihood estimation method using the expectation-maximization algorithm is adopted to avoid incidental parameters. The paper also attempts to discuss which of the two models is more appropriate to account for dichotomous choice data. Two sets of dichotomous choice data are analyzed by the model.     

Spatial versus tree representations of proximity data

In this paper we investigated two of the most common representations of proximities, two-dimensional euclidean planes and additive trees. Our purpose was to develop guidelines for comparing these representations, and to discover properties that could help diagnose which representation is more appropriate for a given set of data. In a simulation study, artificial data generated either by a plane or by a tree were scaled using procedures for fitting either a plane (KYST) or a tree (ADDTREE). As expected, the appropriate model fit the data better than the inappropriate model for all noise levels. Furthermore, the two models were roughly comparable: for all noise levels, KYST accounted for plane data about as well as ADDTREE accounted for tree data. Two properties of the data proved useful in distinguishing between the models: the skewness of the distribution of distances, and the proportion of elongated triangles, which measures departures from the ultrametric inequality, Applications of KYST and ADDTREE to some twenty sets of real data, collected by other investigators, showed that most of these data could be classified clearly as favoring either a tree or a two-dimensional representation.A portable PASCAL program implementing the Sattath and Tversky [1977] ADDTREE algorithm is available from J. Corter, Department of Psychology, Stanford University, Stanford, California 94305.     

The joint analysis of direct ratings,pairwise preferences,and dissimilarities

In studies involving judgments of similarity or dissimilarity, a variety of other variables may also be measured. Examples might be direct ratings of the stimuli, pairwise preference judgments, and physical measurements of the stimuli with respect to various properties. In such cases, there are important advantages to joint analyses of the dissimilarity and collateral variables. A variety of models are described for relating these and algorithms described for fitting these to data. A number of hypothesis tests are developed and an example offered.The research reported here was supported by grant number APA 320 to the author by the National Research Council of Canada.     

A dynamic generalization of the Rasch model

In the present paper a model for describing dynamic processes is constructed by combining the common Rasch model with the concept of structurally incomplete designs. This is accomplished by mapping each item on a collection of virtual items, one of which is assumed to be presented to the respondent dependent on the preceding responses and/or the feedback obtained. It is shown that, in the case of subject control, no unique conditional maximum likelihood (CML) estimates exist, whereas marginal maximum likelihood (MML) proves a suitable estimation procedure. A hierarchical family of dynamic models is presented, and it is shown how to test special cases against more general ones. Furthermore, it is shown that the model presented is a generalization of a class of mathematical learning models, known as Luce's beta-model.     

Analysis and meta-analysis of single-case designs: An introduction

The last 10 years have seen great progress in the analysis and meta-analysis of single-case designs (SCDs). This special issue includes five articles that provide an overview of current work on that topic, including standardized mean difference statistics, multilevel models, Bayesian statistics, and generalized additive models. Each article analyzes a common example across articles and presents syntax or macros for how to do them. These articles are followed by commentaries from single-case design researchers and journal editors. This introduction briefly describes each article and then discusses several issues that must be addressed before we can know what analyses will eventually be best to use in SCD research. These issues include modeling trend, modeling error covariances, computing standardized effect size estimates, assessing statistical power, incorporating more accurate models of outcome distributions, exploring whether Bayesian statistics can improve estimation given the small samples common in SCDs, and the need for annotated syntax and graphical user interfaces that make complex statistics accessible to SCD researchers. The article then discusses reasons why SCD researchers are likely to incorporate statistical analyses into their research more often in the future, including changing expectations and contingencies regarding SCD research from outside SCD communities, changes and diversity within SCD communities, corrections of erroneous beliefs about the relationship between SCD research and statistics, and demonstrations of how statistics can help SCD researchers better meet their goals.     

A reformulation of the general Euclidean model for the external analysis of preference data

This paper discusses least squares methods for fitting a reformulation of the general Euclidean model for the external analysis of preference data. The reformulated subject weights refer to a common set of reference vectors for all subjects and hence are comparable across subjects. If the rotation of the stimulus space is fixed, the subject weight estimates in the model are uniquely determined. Weight estimates can be guaranteed nonnegative. While the reformulation is a metric model for single stimulus data, the paper briefly discusses extensions to nonmetric, pairwise, and logistic models. The reformulated model is less general than Carroll's earlier formulation.The author is grateful to Christopher J. Nachtsheim for his helpful suggestions.     

The effectiveness of psychological skills training and behavioral interventions in sport using single-case designs: A meta regression analysis of the peer-reviewed studies

We used a novel meta regression analysis approach to examine the effectiveness of psychological skills training and behavioral interventions in sport assessed using single-case experimental designs (SCEDs). One hundred and twenty-one papers met the inclusion criteria applied to eight database searches and key sport psychology journals. Seventy-one studies reported sufficient detail for effect sizes to be calculated for the effects of psychological skills training on psychological, behavioral, and performance variables. The unconditional mean effect size for weighted (Δ = 2.40) and unweighted (Δ = 2.83) models suggested large improvements in psychological, behavioral, and performance outcomes associated with implementing cognitive-behavioral psychological skills training and behavioral interventions with a SCED. However, meta-regression analysis revealed important heterogeneities and sources of bias within this literature. First, studies using a group-based approach reported lower effect sizes compared to studies using single-case approaches. Second, the single-case studies, (over 90 per cent the effect sizes), revealed upwardly biased effect sizes arising from: (i) positive publication bias such that studies using lower numbers of baseline observations reported larger effects, while studies using larger numbers of baseline observations reported smaller – but still substantial – effects; (ii) not adopting a multiple baseline design; and (iii) not establishing procedural reliability. We recommend that future researchers using SCED’s should consider these methodological issues.     

Effects of conditionality on INDSCAL and ALSCAL weights

The role of conditionality in the INDSCAL and ALSCAL procedures is explained. The effects of conditionality on subject weights produced by these procedures is illustrated via a single set of simulated data. Results emphasize the need for caution in interpreting subject weights provided by these techniques.     

A stochastic multidimensional scaling procedure for the empirical determination of convex indifference curves for preference/choice analysis

The vast majority of existing multidimensional scaling (MDS) procedures devised for the analysis of paired comparison preference/choice judgments are typically based on either scalar product (i.e., vector) or unfolding (i.e., ideal-point) models. Such methods tend to ignore many of the essential components of microeconomic theory including convex indifference curves, constrained utility maximization, demand functions, et cetera. This paper presents a new stochastic MDS procedure called MICROSCALE that attempts to operationalize many of these traditional microeconomic concepts. First, we briefly review several existing MDS models that operate on paired comparisons data, noting the particular nature of the utility functions implied by each class of models. These utility assumptions are then directly contrasted to those of microeconomic theory. The new maximum likelihood based procedure, MICROSCALE, is presented, as well as the technical details of the estimation procedure. The results of a Monte Carlo analysis investigating the performance of the algorithm as a number of model, data, and error factors are experimentally manipulated are provided. Finally, an illustration in consumer psychology concerning a convenience sample of thirty consumers providing paired comparisons judgments for some fourteen brands of over-the-counter analgesics is discussed.     

Imputation of missing categorical data by maximizing internal consistency

This paper suggests a method to supplant missing categorical data by reasonable replacements. These replacements will maximize the consistency of the completed data as measured by Guttman's squared correlation ratio. The text outlines a solution of the optimization problem, describes relationships with the relevant psychometric theory, and studies some properties of the method in detail. The main result is that the average correlation should be at least 0.50 before the method becomes practical. At that point, the technique gives reasonable results up to 10–15% missing data.We thank Anneke Bloemhoff of NIPG-TNO for compiling and making the Dutch Life Style Survey data available to use, and Chantal Houée and Thérèse Bardaine, IUT, Vannes, France, exchange students under the COMETT program of the EC, for computational assistance. We also thank Donald Rubin, the Editors and several anonymous reviewers for constructive suggestions.     

A classification of computer security incidents based on reported attack data

Previous studies of computer criminals have attempted to differentiate between offenders, but have not used data from the actual attacks. Drawing on theories from investigative psychology as well as information security, the current study differentiates 2755 computer security incidents using information about Method of Operation (MO), Impact, and Source Sector from reported attacks. Multivariate statistical analyses were applied on the data‐matrix of 22 variables and showed the co‐occurrences of various aspects of computer security incidents. A radex structure emerged where the high frequency variables were positioned in the centre of the data‐plot. Based on a previously developed taxonomy of cyber intrusions, the results of the analysis showed that it was possible to draw inferences about the less informative category of Objective, from information about Attacker, Tools, Access, and Results. By applying the division‐lines indicating the Objectives of Challenge/Status, Destruction, Political Gain and Financial Gain on the SSA‐plot, it was shown how the taxonomies could be further developed by taking into account the relationships between the categories. Copyright © 2005 John Wiley & Sons, Ltd.     

Spatial,non-spatial and hybrid models for scaling

In this paper, hierarchical and non-hierarchical tree structures are proposed as models of similarity data. Trees are viewed as intermediate between multidimensional scaling and simple clustering. Procedures are discussed for fitting both types of trees to data. The concept of multiple tree structures shows great promise for analyzing more complex data. Hybrid models in which multiple trees and other discrete structures are combined with continuous dimensions are discussed. Examples of the use of multiple tree structures and hybrid models are given. Extensions to the analysis of individual differences are suggested.1976 Psychometric Society Presidential Address.While people too numerous to list here have contributed ideas, inspiration, and other help, I particularly wish to acknowledge the contributions of Sandra Pruzansky, without whom this paper could not have been written. I would also like to acknowledge the past contributions of my long-time colleague Jih-Jie Chang, without whose help I probably would not have beenasked to write it.