A multi-criterion experimental comparison of three multi-attribute weight measurement methods

The research compared three major multi-attribute weight measurement methods using multiple criteria: theoretical validity, predictive performance, and perceived performance. Major findings include (1) all three methods are theoretically valid using the EAM (Equal Weight Averaging Model) as the standard of comparison, (2) EAM outperforms SMART (Simple Multi-Attribute Rating Technique) and SMART outperforms AHP (Analytical Hierarchy Process) in terms of predictive performance, (3) in terms of perceived performance, EAM is considered more difficult and less preferred than AHP, but has equal trustworthiness. The research has demonstrated how self-estimation methods for multi-attribute analysis can be verified and improved theoretically and empirically by using weights and values from the EAM model as a theoretical validity standard. © 1998 John Wiley & Sons, Ltd.     

A Field Experiment Comparing Anchored and Unanchored Criteria Weights in the Analytic Hierarchy Process

This study reports the results of a field experiment comparing the predictive validity of two approaches to multicriteria assessments: the absolute measurement mode of AHP and the absolute measurement mode of linking pin AHP. The questioning procedures of the two differ only in that the former employs unanchored criteria weight assessments and the latter anchored criteria weight assessments. The decision task required insurance agents to respond to a mailed questionnaire in which they evaluated non-monetary incentives (contests) according to (1) the public recognition received from winning, (2) the criteria for winning and (3) the nature of the reward. There were four levels for each dimension. A between subjects design was used, with each subject receiving one of the two methods. In addition, all subjects divided 100 points among four contests and these hold-out assignments were employed as a validity check. Linking pin AHP was found to be superior to conventional AHP in this experiment, lending weight to the argument that the use of unanchored criteria weights is problematic. © 1997 by John Wiley & Sons, Ltd. J. Multi-Crit. Decis. Anal. 6 : 140–149 (1997) No. of Figures: 3. No. of Tables: 5. No. of References: 24.     

A Demonstration of Conjoint Analysis for Organizational Research

The purpose of this study was to demonstrate the potential usefulness of conjoint analysis for organizational research, as evidenced in estimating the compensating wage differential of the four-day workweek. Five hundred and seventeen employees of an insurance company on the four-day workweek rated their preferences for increments and decrements in compensation and vacation time on both a four-day and five-day workweek. The data were analysed via conjoint analysis. The results revealed the four-day workweek schedule had a positive compensating wage differential of approximately US$1161, or about 6% of the sample's annual salary. The findings were discussed in terms of the prospects of using conjoint analysis for organizational research, including means of data collection, stimulus construction, parameter estimation methods, reliability, validity and computer-interactive systems.     

预测视角下双因子模型与高阶模型的模拟比较

双因子模型和高阶因子模型,作为既有全局因子又有局部因子的两个竞争模型,在研究中得到了广泛应用。本文采用Monte Carlo模拟方法,在模型拟合比较的基础上,比较了效标分别为外显变量和内潜变量时,两个模型在各种负荷水平下预测准确度的差异。结果发现,两种模型在拟合效果方面无显著差异;但在预测效度方面,当效标为显变量时,两个模型的结构系数估计值皆为无偏估计;而效标为潜变量时,高阶因子模型表现优于双因子模型:高阶因子模型的结构系数为无偏估计,双因子模型的结构系数估计值则在50%左右的情况下存在偏差。     

On assessing “androgyny”

Research with personality instruments containing separate masculinity and femininity scales found them to be essentially orthogonal, leading to the search for methods to express their conjoint relationships with other variables. The theoretical and/or empirical assumptions underlying three methods were explored: Bem's difference model; the absolute score method; and the difference/median method, which combines features of both. The balance and difference/median methods presuppose a unique combinatory model, while the absolute method detects a number of alternative possibilities. Illustrative empirical data, using the Personal Attributes Questionnaire, were used to demonstrate that the joint contributions of M and F are not uniform and, consequently, the greater heuristic value of the absolute method.This research was supported in part by NSF Grant BNS 76-17376 (Janet T. Spence and Robert L. Helmreich, Principal Investigators) and NASA Grant NSG 2065 (Robert L. Helmreich, Principal Investigator).     

Two new cases of rank reversals when the AHP and some of its additive variants are used that do not occur with the multiplicative AHP

Many researchers have long observed some cases in which certain ranking irregularities can occur when the original analytic hierarchy process (AHP), or some of its variants, are used. This paper presents two new categories of ranking irregularities which defy common intuition. These ranking irregularities occur when one decomposes a decision problem into a set of smaller problems each defined on two alternatives and the same criteria as the original problem. These irregularities are possible when the original AHP, or some of its additive variants, are used. Computational experiments on random test problems and an examination of some real‐life case studies suggest that these ranking irregularities are dramatically likely to occur. This paper also proves that these ranking irregularities are not possible when a multiplicative variant of the AHP is used. Copyright © 2001 John Wiley & Sons, Ltd.     

The Predictive Validity of Ideal Partner Preferences in Relationship Formation: What We Know,What We Don't Know,and Why It Matters

A great deal of research on interpersonal attraction implicitly assumes that stated ideal partner preferences guide the mate selection, and therefore relationship formation, process. Nevertheless, recent research has yielded contradictory results. Whereas some research has failed to demonstrate that ideal partner preferences influence attraction to actual potential romantic partners, other studies have provided empirical evidence for the predictive validity of ideal partner preferences following interactions with potential romantic partners. A new meta‐analysis on the predictive validity of ideal partner preferences concluded that people may not preferentially pursue potential partners that more closely match their stated preferences. This conclusion has significant implications for several empirical literatures that have relied on self‐reported ideal partner preferences to test hypotheses. We demonstrate, however, that the majority of the research on the predictive validity of ideal partner preferences, and thus research included in this meta‐analysis, focuses on interpersonal attraction or later relationship processes and not on individuals transitioning into actual new relationships. We suggest that research that directly focuses on the transition into actual relationships is needed before firm conclusions can be made regarding the predictive validity of ideal partner preferences in the formation of new relationships.     

Theory and tests of the conjoint commutativity axiom for additive conjoint measurement

The empirical study of the axioms underlying additive conjoint measurement initially focused mostly on the double cancellation axiom. That axiom was shown to exhibit redundant features that made its statistical evaluation a major challenge. The special case of double cancellation where inequalities are replaced by indifferences–the Thomsen condition–turned out in the full axiomatic context to be equivalent to the double cancellation property but without exhibiting the redundancies of double cancellation. However, it too has some undesirable features when it comes to its empirical evaluation, the chief among them being a certain statistical asymmetry in estimates used to evaluate it, namely two interlocked hypotheses and a single conclusion. Nevertheless, thinking we had no choice, we evaluated the Thomsen condition for both loudness and brightness and, in agreement with other lines of research, we found more support for conjoint additivity than not. However, we commented on the difficulties we had encountered in evaluating it. Thus we sought a more symmetric replacement, which as Gigerenzer and Strube (1983) first noted, is found in the conjoint commutativity axiom proposed by Falmagne (1976, who called it the “commutative rule”). It turns out that, in the presence of the usual structural and other necessary assumptions of additive conjoint measurement, we can show that conjoint commutativity is equivalent to the Thomsen condition, a result that seems to have been overlooked in the literature. We subjected this property to empirical evaluation for both loudness and brightness. In contrast to Gigerenzer and Strube (1983), our data show support for the conjoint commutativity in both domains and thus for conjoint additivity.     

A re-examination of the algebraic properties of the AHP as a ratio-scaling technique

The Analytic Hierarchy Process (AHP) ratio-scaling approach is re-examined in view of the recent developments in mathematical psychology based on the so-called separable representations. The study highlights the distortions in the estimates based on the maximum eigenvalue method used in the AHP distinguishing the contributions due to random noises from the effects due to the nonlinearity of the subjective weighting function of separable representations. The analysis is based on the second order expansion of the Perron eigenvector and Perron eigenvalue in reciprocally symmetric matrices with perturbations. The asymptotic distributions of the Perron eigenvector and Perron eigenvalue are derived and related to the eigenvalue-based index of cardinal consistency used in the AHP. The results show the limits of using the latter index as a rule to assess the quality of the estimates of a ratio scale. The AHP method to estimate the ratio scales is compared with the classical ratio magnitude approach used in psychophysics.     

Performance oriented task-resource mapping and scheduling in fog computing environment

Resource allocation and task scheduling is a complex task in fog computing environment because of the inherent heterogeneity among the fog devices. The proposed work attempts to solve the problem by using the popular multi criteria decision making methods such as AHP and TOPSIS. The goal of this paper is to propose a model for performance oriented task - resource mapping in a fog computing environment. MIPS, RAM & storage, uplink latency, downlink latency, uplink bandwidth, downlink bandwidth, trust, cost per MIPS, cost per memory, cost per storage and cost per bandwidth are the various performance characteristics considered in this work for task – resource mapping. Two different multi-criteria decision making methods are employed in order to assess the performance characteristics of the fog devices. In the first method, Analytic Hierarchy Process (AHP) is used for both priority weight calculation and ranking of fog devices. In the second method, AHP is used for priority weight calculation, based on the weights yielded by AHP, Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) algorithm is executed in order to rank the fog devices. Then the fog devices can be allocated to the tasks based on its rank. Furthermore, a motivational example is also demonstrated to validate the proposed method. Simulation results show that the proposed technique exhibits superior performance over other scheduling algorithms in the fog environment by incorporating performance, security, and cost metrics into scheduling decisions.     

Nipping psychopathy in the bud: an examination of the convergent, predictive, and theoretical utility of the PCL-YV among adolescent girls

Over the last decade rates of violence among adolescent girls have increased. Within high-risk contexts, urgent calls for assessment options have resulted in the extension of adult and male-based instruments to adolescent females in spite of the absence of strong empirical support. The current study evaluates the downward extension of psychopathy within a population of female juvenile offenders (N=125). The convergent and predictive validity of the Psychopathy Checklist-Youth Version (PCL-YV) were evaluated within a structural equation modeling (SEM) framework. Results indicated that while a specific component of psychopathy, deficient affective experience, was related to aggression, the effect was negated once victimization experiences were entered into the models. In addition, PCL-YV scores were not predictive of future offending, while victimization experiences significantly increased the odds of re-offending. Implications for research, policy, and clinical practice are discussed.     

Short- and long-term effectiveness of two communication training modalities with distressed couples

Abstract

Communication training is a widely practiced therapeutic approach for the treatment of marital discord. Although there is some empirical support for the theoretical assumptions underlying constructive communication patterns, it has not yet been ascertained whether changing these behaviors is sufficient in bringing about stable changes in distressed marriages. The present study was designed to investigate the efficacy of this treatment approach in a conjoint and conjoint group modality. Following therapy, conjoint couples (n = 16) when compared with a waiting list control group (n = 17) showed improvement on five of the seven outcome variables. Couples in the conjoint group modality (n = 13) improved on only two of the seven variables. Follow-up assessments one year after treatment showed that initial gains had been substantially reduced. On the basis of these results it is now open to question whether conjoint group treatments are an appropriate treatment modality for even moderately distressed couples.     

The Construct Validity of Acceptance: A Multitrait-Multimethod Investigation

Despite increasing clinical and empirical attention, the construct validity of acceptance has not been extensively investigated. The present study utilized a multitrait-multimethod design and a correlated trait-correlated method minus one [CT-C(M-1)] confirmatory factor analytic model to assess acceptance's convergent validity across methods and discriminant validity in comparison to cognitive reappraisal and perceived emotional control in a sample of 210 outpatients with anxiety and mood disorders. In addition, the study evaluated acceptance's concurrent validity by investigating the extent to which it was associated with variables of clinical interest over and above the two rival constructs. Results of confirmatory factor analyses supported acceptance's convergent and discriminant validity in comparison to the two neighboring constructs, and thereby provided partial support for its construct validity. However, contrary to prediction, acceptance was not significantly associated with concurrent validation measures. These results are discussed in the context of acceptance's potential therapeutic utility and functional relationships with associated constructs.     

On the Treatment of Outliners in Cognitive and Psychomotor Test Data

Authors of many statistical texts and review articles have pointed to the possi- ble adverse effects that outliers can have on the calculation of sample statistics and have suggested several methods for detecting and treating outliers. We investigated two different methods-data censoring and transformation-for treating outliers in aptitude test data at the item level and total-score level and their effects on the internal consistency and predictive validity of six computer- ized tests being evaluated by the U.S. Air Force. Results from our sample of more than 2,000 pilot training candidates indicated that neither outlier treat- ment method at either level of analysis had significant effects on the tests' internal consistencies or predictive validities. Possible reasons for these findings include the frequency with which outliers occur and the robustness of linear modeling methods.     

Using the Analytic Hierarchy Process to Analyze Multiattribute Decisions

Since its introduction a decade ago, the Analytic Hierarchy Process (AHP) has been used by decision makers in many contexts. The vast majority of these applications has involved allocating resources or making choices from among alternatives. This article discusses how AHP may be used in a different manner: to assist researchers in the analysis of decisions. AHP is briefly compared with other decision-analysis techniques, such as multiattribute utility measurement, conjoint measurement, and general linear models (regression and analysis of variance). Some of the possible insights into decision processes that can be obtained using AHP are illustrated with data gathered from practicing auditors of financial statements.     

Preferences for multi-attributed alternatives: Traces, dominance, and numerical representations

This paper analyzes conjoint measurement models allowing for intransitive and/or incomplete preferences. This analysis is based on the study of marginal traces induced on coordinates by the preference relation and uses conditions guaranteeing that these marginal traces are complete.Within the framework of these models, we propose a simple axiomatic characterization of preference relations compatible with the notion of dominance. We show that all such relations have a nontrivial numerical representation.Our results allow us to establish useful connections between two lines of thought in the area of decision analysis with multiple attributes that have largely remained unrelated: the one based on conjoint measurement and the one emphasizing the idea of dominance.     

Four methods of locating the egocenter: A comparison of their predictive validities and reliabilities

An attempt was made to identify the best method of locating the egocenter by comparing the predictive validity and reliability of the four methods introduced by Fry (1950), Funaishi (1926), Howard and Templeton (1966), and Roelofs (1959). To determine predictive validity, egocenters located by these methods were used to predict the responses of 14 subjects on three visual direction tasks; the correlation between the predicted and the actual responses on each task was computed. To determine reliability, the test-retest stability and the internal consistency were estimated for each method. All of the methods were reliable, but only the Howard and Templeton method predicted the results on all three of the visual direction tasks. The high reliability and predictive validity of the Howard and Templeton method is attributed to its high precision.     

Longitudinal Predictive Validity of a Learning Potential Test

The aim of this article is to provide empirical psychometric evidence of the (longitudinal) predictive validity of a learning potential measure—the Learning Potential Computerised Adaptive Test (LPCAT)—in comparison with standard static tests with school aggregate results as the criterion measure. Participants were 79 boys (mean age 12.44, SD = 0.44) and 72 girls (mean age 11.18, SD = 0.42) attending two private schools. Correlation and regression analyses were used to evaluate the predictive validity of the learning potential and standard test scores for school aggregate academic results as criterion measure. Results indicate that learning potential scores were statistically significant predictors of aggregate academic results and provided results that were comparable to those of the standard test results—providing empirical support for the use of learning potential tests in mainstream educational settings.     

粗糙集和神经网络在心理测量中的应用

探讨当因素分析和多元回归方法的使用条件未得到满足时,是否可采用粗糙集方法进行观察变量的精简,以及是否可采用神经网络方法进行预测效度检验。理论分析了粗糙集和神经网络在心理测量中应用的可能性,并运用粗糙集对于人事干部胜任力评估数据进行分析,比较了7种离散化方法和2种约简算法构成的14种组合,发现当采用Manual方法进行离散化、遗传算法进行约简时,能够很好地对观测变量进行精简;运用概率神经网络能够比等级回归方法更好地进行预测效度检验。研究结果表明对于处理心理测量中的非等距变量,粗糙集和神经网络是非常有用的方法