Spatial and conjoint models based on pairwise comparisons of dissimilarities and combined effects: Complete and incomplete designs

In pairwise multidimensional scaling, a spatial representation for a set of objects is determined from comparisons of the dissimilarity of any two objects drawn from the set to the dissimilarity of other pairs of objects drawn from that set. In pairwise conjoint scaling, comparisons among the joint effects produced by pairs of objects, where the objects in a pair are drawn from separate sets, are used to determine numerical representations for the objects in each set. Monte Carlo simulations of both pairwise dissimilarities and pairwise conjoint effects show that Johnson's algorithm can provide good metric recovery in the presence of high levels of error even when only a small percentage of the complete set of pairwise comparisons are tested.     

Axiomatic and numerical conjoint measurement: An evaluation of diagnostic efficacy

Synthetic data are used to examine how well axiomatic and numerical conjoint measurement methods, individually and comparatively, recover simple polynomial generators in three dimensions. The study illustrates extensions of numerical conjoint measurement (NCM) to identify and model distributive and dual-distributive, in addition to the usual additive, data structures. It was found that while minimum STRESS was the criterion of fit, another statistic, predictive capability, provided a better diagnosis of the known generating model. That NCM methods were able to better identify generating models conflicts with Krantz and Tversky's assertion that, in general, the direct axiom tests provide a more powerful diagnostic test between alternative composition rules than does evaluation of numerical correspondence. For all methods, dual-distributive models are most difficult to recover, while consistent with past studies, the additive model is the most robust of the fitted models.Douglas Emery is now at the Krannert Graduate School of Management, Purdue University, West Lafayette, IN, on leave from the University of Calgary.     

The use of teachers as behavioral observers

The effect of using teachers as behavioral observers on both student and teacher behavior was examined with eight teachers and 32 elementary school children. The frequency of prompts (but not praise or criticism) to those students observed by the teacher increased significantly from nonobserver to teacher observed experimental phases. In addition, students observed by the teacher showed more change in appropriate behavior than students who were not observed. The significance of these findings for research and therapy is discussed.     

Considerations in the choice of interobserver reliability estimates

Two types of interobserver reliability values may be needed in treatment studies in which observers constitute the primary data-acquisition system: trial reliability and the reliability of the composite unit or score which is subsequently analyzed, e.g., daily or weekly session totals. Two approaches to determining interobserver reliability are described: percentage agreement and "correlational" measures of reliability. The interpretation of these estimates, factors affecting their magnitude, and the advantages and limitations of each approach are presented.     

Correlation and prediction in ordinal test theory

Based on the test theory model for ordinal measurements proposed by Schulman and Haden, the present paper considers correlations between tests, attenuation, regressions involving true and observed scores, and prediction of test reliability.The population correlation between tests is shown to be related to the expected sample correlation for samples of sizen ₁ andn ₂. Errors of estimation, measurement and prediction are found to be similar to their counterparts in interval test theory, while attenuation is identical to its counterpart. The bias in estimating population reliability from sample data is compared for Kendall's tau and Spearman's rho.The author wishes to thank the referees for their helpful comments on an earlier draft of this paper, and in particular, for the suggested alternative methods of establishing some of the presented results.     

Comparing Chinese youth with American youth on adjustment: An illustration of measurement issues in cross-cultural research

In this article, we used results from two studies to show the need to go beyond linguistic equivalence to establish construct validity and measurement invariance in cross-cultural research. Study 1 examined Rosenberg Self-Esteem (RSE; 10 items) data from 156 Mainland Chinese youth (M = 13.8 years, SD = .53) and 213 Chinese-American youth (M = 13.6 years, SD = 2.1) from high socioeconomic status (SES) families. The Chinese translation of the RSE has been widely used. Study 2 included 1060 Mainland Chinese youth (M = 15.6 years, SD = 2.3) and 412 racially diverse American youth (M = 16.0, SD = 2.9) from all SES backgrounds. Data were collected with the third and newest edition of the Behavioural Assessment System for Children-Self Report of Personality (BASC-3-SRP; 189 items). We translated and back-translated the BASC-3-SRP between English and Chinese to establish linguistic equivalence. All participants were females. Study 1 showed that the RSE had acceptable internal consistency but lacked construct validity. Study 2 showed that the original and the translated BASC-3-SRP had good internal consistency and construct validity, but nine of its 16 subscales lacked measurement invariance. These results highlight measurement issues facing international and cross-cultural research.     

Factorial validation and measurement invariance of the French version of the multidimensional competitive orientation inventory (FVMCOI) in the sport field

IntroductionLittle is known about the importance of the adaptive, maladaptive and neutral facets of competitive orientations among French athletes.ObjectiveThe aim of this study is to test the factorial validation and measurement invariance of the French version of the multidimensional competitive orientation inventory (FVMCOI) from the original version (MCOI, Orosz et al., 2018), which included 12 items and four factors (i.e., hypercompetitive orientation, self-developmental competitive orientation, anxiety-driven competition avoidance, and lack of interest toward competition).MethodA series of three complementary studies was carried out with a total sample of 891 competitors.ResultsFollowing cross-cultural validation methods a preliminary version of the FVMCOI was constructed and the clarity of its items was established (study 1). Then, exploratory structural equation modeling (ESEM) confirmed that the four-factor model for the FVMCOI was factorially valid, and consistent with the model of the original version. As such, the multiple-group invariance tests showed that the FVMCOI was partially invariant across both age and gender and fully invariant across type of sport, level of competition and over time (study 2). Finally, the concurrent validity of the FVMCOI was demonstrated through its expected relationships with achievement goals, competitive aggressiveness and anger in sport (study 3).ConclusionThe establishment of the FVMCOI extends the research in sport psychology by allowing an extensive psychometric study of the MCOI in the sport domain and providing deeper insights into the healthy, unhealthy, and neutral nature of competitive orientation in this context. The FVMCOI's potential practical applications in sport context, with some limitations and perspectives of this study, are also discussed.     

Psychometric properties and measurement invariance of Depression,Anxiety and Stress Scales (DASS-21) across cultures

Cross-culturally measurement invariant instruments are useful for the assessment of mental symptoms across cultures. The current study aimed to investigate the psychometric properties and measurement invariance of the Depression, Anxiety and Stress Scales (DASS-21) (DASS) across Pakistan and Germany. German participants were recruited through an online survey (N = 1323), while Pakistani participants were recruited through online survey or paper-and-pencil survey (N = 1841). The DASS-21 showed good reliability, construct and structure validity in both countries. The DASS-21 indicated partial weak (stress subscale) and partial strong measurement invariance (depression and anxiety subscales) between both countries. Latent mean comparison of depression and anxiety symptoms between Pakistani and German students indicated that Pakistani university students experience more symptoms of depression and anxiety. Results suggest that the DASS-21 could be used in Pakistan and Germany, but caution should be taken when making direct comparisons between the two countries.     

Creativity and Self-esteem in Adolescence: A Study of Their Domain-Specific,Multivariate Relationships

Although empirical investigations on the Creative Self have historically started with a focus on self-esteem, the literature on its relationship with creative performance remains thin and inconsistent, with estimated relationships ranging from moderate and negative, to strongly positive. Discrepancies may be explained by the domain-specificity of both creativity and self-esteem that have been widely overlooked in this line of work. Therefore, this study explores the multivariate relationships between creativity in three domains (Music, Literary-Verbal, Graphic) and self-esteem in seven domains (e.g., Academic, Emotional) among 170 adolescents. Creative productions were scored by four raters, and latent consensus in each domain captured using a multi-informant latent-consensus model in SEM. This model was further extended in a structural model reveling that (a) creativity is mainly domain-specific, and (b) the contribution of domain-specific self-esteem on domain-specific creativity greatly varies according to both the domains of creativity and self-esteem. Up to 30% of the variance in creative performance was explained by “domain-relevant” self-esteem facets, and a moderate contribution of creative self-esteem across creativity domains. Results are discussed in light of several important methodological directions for this line of work, as well as its implications for creativity-based interventions designed to support positive self-esteem development in adolescence.