Alternative Approaches for Measuring Values: Direct and Indirect Assessments in Performance Prediction

Two general approaches have been used to measure human values. In one approach, a direct approach, people are asked to endorse value statements. In the other approach, an indirect approach, people are asked to make choices indicative of their values. The intent of the current study was to compare these two general approaches to the measurement of values. Initially, 195 undergraduates were asked to complete both a direct measure and an indirect measure of their values before starting work on three performance tasks: an entrepreneurial task, a consulting task, and a marketing task. When scores on these performance tasks were regressed on the value measures, it was found that both types of measures yielded effective prediction. The indirect measures, however, appeared to yield better prediction and better discrimination of cross-task performance differences than the direct measures. The implications of these findings with respect to the identification and assessment of values are discussed.     

Ontological Aspects of Measurement

The concept of measurement is fundamental to a whole range of different disciplines, including not only the natural and engineering sciences, but also laboratory medicine and certain branches of the social sciences. This being the case, the concept of measurement has a particular relevance to the development of top-level ontologies in the area of knowledge engineering. For this reason, the present paper is concerned with ontological aspects of measurement. We are searching for a list of concepts that are apt to characterize measurement methods in a general manner. To establish such means of characterization, we will primarily deal with the semantics of measurement values.

Reichenbach's concept of prediction

Reichenbach emphasizes the central importance of prediction, which is—for him—the principal aim of science. This paper offers a critical reconstruction of his concept of prediction, taking into account the different periods of his thought. First, prediction is studied as a key factor in rejecting the positivism of the Vienna Circle. This part of the discussion concentres on the general features of prediction before Experience and Prediction (EP) (section 1). Second, prediction is considered in the context of Reichenbach's disagreements with his contemporaries—Carnap and Popper—(section 2). Pointing out these differences gives an additional basis for understanding how Reichenbach saw “prediction” in the period when EP was written. Third, Reichenbach's theoretical framework of prediction is analysed following EP. This analysis studies the semantical, logical, epistemological and methodological bases of his concept of prediction (section 3). Fourth, Reichenbach's conception of prediction, based on an objectivist interpretation of probabilities, is compared with the perspective on prediction of subjective Bayesians (the present personalists). This comparison (section 4) illustrates Reichenbach's views regarding the links of prediction with probability. Fifth, innovations and elements of continuity after EP are noted which give a more complete picture of Reichenbach's thought on prediction (section 5). This contributes to a comprehensive characterization of his concept of prediction. Finally, there is an assessment of his whole view of the matter and a presentation of the ingredients for a satisfactory alternative (section 6).     

Standard errors of prediction for the vineland adaptive behavior scales

When a scale has been administered to the same person more than once, the question arises whether variation in obtained scores is due to measurement error or whether it reflects actual change in the examinee's functional level. This article offers standard errors of prediction and confidence intervals for the Vineland Adaptive Behavior Scales (VABS) that can help in making such decisions where these scales are concerned. The values presented here were derived from the normative data provided in the VABS manuals.     

In search of meaning: values in modern clinical behavior analysis

Skinner described behavior analysis as the field of values and purpose. However, he defined these concepts in terms of a history of reinforcement and failed to specify whether and how human and nonhuman values might differ. Human values have been seen as theoretically central within a number of nonbehavioral traditions in psychology, including humanism and positive psychology. However, these approaches have failed to provide explanations of the behavior-environment relations involved in valuing that might allow prediction and influence with respect to this phenomenon. Modern clinical behavior analysis in the form of acceptance and commitment therapy (ACT), however, succeeds in providing a functional definition of human values that meets this latter criterion. ACT is rooted in behavior analysis and relational frame theory (RFT) and defines values in terms of verbally established motivation. ACT empirical research into values has begun to blossom in recent years, and ACT-RFT researchers are currently investigating the concept at the most basic empirical level as well as in the applied clinical arena, heralding new interest in and insight into values within clinical behavioral psychology.     

Measurement of person-environment fit and prediction of satisfaction in the theory of work adjustment

The measurement of person-environment (P-E) fit and the relationship of fit and job satisfaction are described, illustrated, and evaluated from the perspective of the Theory of Work Adjustment. The construct of correspondence is explicated in terms of statistical measures and applied to the prediction of job satisfaction. Two studies are reported. Using 19 statistical indices across six occupational groups, study 1 examined the issues of commensurate measurement and representations of the correspondence and satisfaction relationship. Results provided evidence for commensurate structures and directional interpretations of needreinforcer correspondence. Study 2 evaluated the relationship of four correspondence indices and job satisfaction with 225 adult vocational counseling clients in 98 different occupations 1 year after initial contact. The findings indicated that the correspondence and satisfaction relationship was moderated by profile component, type of reinforcer profile, and client's sex. Overall, the results show that the best statistical indices for assessing correspondence seem to be measures of profile shape, which explain 3 to 30% of the variance in satisfaction. Implications for commensurate measurement and for the operational and theoretical development of the concept of correspondence are discussed.     

The concept of measurement-precision

The science of metrology characterizes the concept of precision in exceptionally loose and open terms. That is because the details of the concept must be filled in—what I call narrowing of the concept—in ways that are sensitive to the details of a particular measurement or measurement system and its use. Since these details can never be filled in completely, the concept of the actual precision of an instrument system must always retain some of the openness of its general characterization. The idea that there is something that counts as the actual precision of a measurement system must therefore always remain an idealization, a conclusion that would appear to hold very broadly for terms and the concepts they express.     

Test “reliability”: Its meaning and determination

The concept of test reliability is examined in terms of general, group, and specific factors among the items, and the stability of scores in these factors from trial to trial. Four essentially different definitions of reliability are distinguished, which may be called the hypothetical self-correlation, the coefficient of equivalence, the coefficient of stability, and the coefficient of stability and equivalence. The possibility of estimating each of these coefficients is discussed. The coefficients are not interchangeable and have different values in corrections for attentuation, standard errors of measurement, and other practical applications.     

The concept of dichotomous correlation

Abstract.— Intuitive correlation was studied in a 2-by-2 paradigm so as to obtain both quantitative data from prediction behavior and qualitative data from inquiries about the concept. Subjects were relieved of information processing and memory demands. Their prediction behavior but not their understanding of the concept of dichotomous correlation was improved over previous experiments.     

Beyond quantitative decline: conceptual shifts in adolescents' development of interest in mathematics

Research has shown that the average values for academic interest decrease during adolescence. Looking beyond such quantitative decline, we explored qualitative change of interest in the domain of mathematics across adolescence. Study 1 was based on a longitudinal data set (annual assessments from Grade 5 to Grade 9; N = 3,193). Latent variable modeling showed that the measurement coefficients of the latent variable of interest (intercepts, structural weights, and error variances) significantly differed across time points, indicating structural changes of the construct. Study 2 was based on interviews with adolescents (Grades 5 and 9, N = 70). Cognitive validation was used to explore differences in subjective concepts of interest across age groups. As expected, there were significant age-related differences, indicating a shift from an affect-laden concept in 5th grade to a more cognitively oriented concept in 9th grade. The findings suggest that developmental research should integrate quantitative and qualitative perspectives of construct change over time and pay more attention to issues of measurement invariance and qualitative changes of constructs over time.     

The statistical regression phenomenon: II. Application of a metamodel

The relevance of the traditional regression concept to measurement of change and to causal research is investigated by applying a metamodel for the concept as a frame of reference in a logical analysis of these two research fields. It is concluded that the concept is considerably less important than ordinarily maintained in the methodological research literature. As for measurement of change, only a special error case of the concept often constitutes a biasing factor, while all special cases are of little interest for describing true changes. Concerning causal research, the regression phenomenon will probably seldom constitute any threat to internal validity. The unjustified attention given to the concept in psychological research is probably mainly due to the fact that central assumptions have been overlooked and that a thorough logical analysis of the relevance issue has not been attempted previously.     

The relationship between direct and indirect measures of values: Is social desirability a significant moderator?

IntroductionThe measurement of personal values is still a great challenge in social psychology due to the complex nature of this concept.ObjectiveBased on Schwartz's theory of human values, this study aimed at analysing the relationship between the Values Implicit Association Test (VIAT), a relatively new indirect measure of values, and the Portrait Values Questionnaire (PVQ), a well-known direct measure of values. Also, it examined whether social desirability moderates this relationship.MethodSeventy-three participants (64.4% female; M age = 25.46, SD = 4.04) took part to the study in a standardized setting.ResultsResults showed different value priorities depending on the measure used (i.e., indirect vs direct), and although social desirability was related to participants’ responses on PVQ more than on VIAT, it did not moderate the association between direct and indirect measures for any of the examined values.ConclusionsImplications of the findings for value measurement and future developments are discussed.     

Measurement as transcendental–empirical <Emphasis Type="Italic">écart</Emphasis>: Merleau-Ponty on deep temporality

Merleau-Ponty’s radical reflection conceptualizes the transcendental and the empirical as intertwined, emerging only via an écart. I advance this concept of transcendental empirical écart by studying the problem of measurement in science, in both general and quantum mechanical contexts. Section one analyses scientific problems of measurement, focusing on issues of temporality, to show how measurement entails a transcendental that diverges with the empirical. Section two briefly interprets this result via Merleau-Ponty’s concept of depth, to indicate how measurement reveals a temporality that is not an already given ground that would guarantee the transcendental in advance: temporality is instead ‘deep,’ itself engendering a divergence of transcendental and empirical operations that first allows for measurement and sense.     

Sticking to common values: Neighbourhood social cohesion moderates the effect of value congruence on life satisfaction

This article aims to explicate the role of social cohesion in the relationship between adherence to common values and life satisfaction. Shared values are often assumed to be a constitutive element of social cohesion and are used in measurement of the concept. However, sociopsychological theory of values sees social cohesion rather as a moderator of the link between value congruence and life satisfaction, not as a constituent of value congruence. Based on a representative survey of the city of Bremen, Germany (N = 2605), we predict life satisfaction from person‐group value congruence and neighbourhood social cohesion. We find no relationship between value congruence and social cohesion, but a significant positive moderating effect of social cohesion on the relationship between value congruence and life satisfaction. The findings suggest that sticking to common values does not increase social cohesion, but that positive effects of value congruence are more pronounced in high‐cohesion neighbourhoods.     

A WITHIN SETTING EMPIRICAL TEST OF THE SITUATIONAL SPECIFICITY HYPOTHESIS IN PERSONNEL SELECTION

The situational specificity hypothesis of selection procedure validity makes two predictions. The first is that variation in observed validities across settings is caused by real differences in what constitutes job performance. Validity generalization studies to date have provided disconfirming evidence for this prediction by showing that the observed variation is due to statistical and measurement artifacts. The second prediction is that if the situation (i.e., the organization, the setting, the job, the test and the criterion) is held constant, then validity findings will not vary from study to study. This article tests this prediction empirically using data from a unique series of studies reported by Bender and Loveless (1958). The results are contrary to the situational specificity hypothesis and consistent with the hypothesis that variation in observed validities is due to statistical and measurement artifacts that are unrelated to situations and settings. It is concluded that both major predictions of the situational specificity hypothesis have now been empirically disconfirmed.     

Matching models in the analysis of cross-classifications

Inference models motivated by the combinatorial chance literature and the concept of object matching may be used in the analysis of a contingency table if the conditional assumption of fixed row and column totals is imposed. More specifically, by developing a matching reinterpretation for several problems of interest in the prediction analysis of cross-classifications—as defined by Hildebrand, Laing and Rosenthal, appropriate significance tests can be given that may differ from those justified by the more common multinomial models. In the course of the paper the distinction between a degree-1 statistic (based on the relationship between single objects) and a degree-2 statistic (based on the relationship between object pairs) is reviewed in some detail. Also, several specializations are presented to topics of current methodological importance in psychology; for instance, a number of references are made to the measurement of nominal scale response agreement between two raters.Partial support for this research was provided by the National Science Foundation through GSOC-77-28227.     

Measuring Political Thinking: Development and Validation of a Scale for “Deliberation Within”

Compared to the concept of interpersonal deliberation, little is known about the underlying and preceding cognitive processes of citizens' deliberative discussions. The aim of this article is to develop a psychometric measurement for these processes, which—following an idea advanced by Goodin ( 2000, 2003 )—may be called “deliberation within.” The measurement is constructed based on theoretical definitions of the concept and further normative criteria of citizen deliberation. In three empirical studies using independent samples, the psychometric properties of the measurement are assessed, and evidence for its reliability as well as structural and criterion validity is offered. The resulting scale may serve as a useful instrument not only for deliberation research, but also for further communication research related to political processes.     

“大五”个性因素模型在工作情景中的效度分析

“大五”个性因素模型是目前一种个性分类理论模型 ,它以外向、情绪稳定性、责任意识、随和、开明性等五个因素来描述正常人群的个性特征。本文探讨了在工作情境中运用“大五”模型预测工作绩效 (个体 /团队 )的效度问题。大量的研究表明 ,责任意识能在不同的职业中用来预测个体工作绩效 ;“大五”因素能有效地预测周边绩效 ,但并不是所有的个性因素都能预测任务绩效 ;团队成员的个性组成对团队绩效有显著影响 ;个性与绩效间的关系受到缓冲变量的影响。     

MEANINGFUL LIVES?

Contemporary ethical theorists have sought criteria to identify meaningful lives. A central issue that divides accounts is whether the concept of meaningfulness rests on objective values. My own view is that each side in the controversy is partially right and partially wrong. I believe objective values are needed for the concept of a meaningful life but that no successful account of such values has yet been offered. Lacking such an account, the concept of a meaningful life should be replaced by more useful terminology. I shall contrast my view with that of Susan Wolf though my goal is not primarily critical but, instead, the development of a different and, I believe, more useful approach.     

Group Differences in Regression Intercepts: Implications for Factorial Invariance

Studies of differential prediction typically examine group differences in linear regression slopes or intercepts for predicting criterion scores from one or more test scores. When there are no group differences in slopes, what are the implications of differences in regression intercepts for the measurement equivalence of the tests or criterion across groups? Measurement equivalence is here defined as factorial invariance under a single-factor model for the tests and criterion. Two theorems are given that describe conditions under which intercept differences can exist under factorial invariance. In such cases, intercept differences do not result from measurement bias in either the tests or criterion. The conditions of the theorems are testable using multiple-group confirmatory factor analysis. These test procedures are illustrated in real data. The implications of the theorems and the test procedures for studies of differential prediction are discussed.