Some thoughts on Likert-type scales

Many articles published in the International Journal of Clinical and Health Psychology describe the results obtained in studies that have used Likert-type scales. Such scales have advantages and disadvantages and in this article I comment on some of these. In particular I comment on the effects of using scales that start with the positive end and finish with the negative one, and on those that present high ratings on the left - as opposed to the right. I also consider that scores on negatively-worded items differ from those obtained on positively-worded ones and that it is not, therefore, appropriate to simply reverse the scores obtained on such items. Finally, I note that some items on these scales present more than one issue and it is hard to know whether when responding to these items, respondents are responding to all of the item or just one part.     

The Depression Anxiety and Stress Scales: Reference data from a large psychiatric outpatient sample

The published norms for the Depression Anxiety and Stress Scale (DASS) give results for clinical populations that largely fall in the severe to very severe categories. As a result, within this population, the ability to compare the comparative contributions of the underlying emotional components is reduced. The present study presents results from a large general psychiatric outpatient population and provides percentile norms with confidence intervals for both the original DASS and the shorter 21‐item form. It is noted that both forms have high validity but that the correlations between scales are higher than those reported in non‐clinical populations. There was little variation between sexes but some variation of results with age with both younger and older cohorts having lower scores except for the Stress scale where there were higher scores in the older group. There is some evidence of a ceiling effect in the Depression and Stress scales. It was noted that nearly a quarter of patient scores fell within the originally defined normal range suggesting that the DASS would not be a particularly sensitive instrument in its previously reported use as a screening instrument for psychiatric illness.     

Development and initial validation of the anti-racism behavioral inventory (ARBI)

This investigation reports on the development and initial validation of the anti-racism behavioral inventory, a measure designed to assess anti-racism awareness and behavior among students in counseling and counseling psychology programs within the United States (US). Data from 513 participants were collected over three related studies. Factor analyses suggested that the 21-item scale was best represented as a bifactor model with one general anti-racism behavior factor and three domain-specific factors, namely individual advocacy, awareness of racism, and institutional advocacy. Additional validity was supported through inverse associations with measures of symbolic racism and color-blind racial attitudes, as well as positive associations with scores on the Quick Discrimination Index. Potential utility of the measure and future directions for ongoing development is discussed.     

Measurement invariance across gender and ethnicity on the Emotional Quotient Inventory 2.0

This study investigated the measurement invariance of the Emotional Quotient Inventory 2.0 across gender and ethnic groups in South Africa. The sample consisted of 1 144 working adults (female = 49.8%. black = 36.2%, white = 29.8%; other = 34%; age range = 18 to 74 years). Multiple group factor analysis was conducted to test for configural, metric, and scalar invariance. Results suggest that the assessment is largely invariant at configural and metric levels across gender and ethnic groups. At scalar level, full invariance was achieved for ten of the fifteen scales across gender and one scale across ethnicity. Partial scalar models were explored for all other scales. Overall, the evidence seems to suggest that the scores from the Emotional Quotient Inventory 2.0 scales had similar meanings for different gender and ethnic groups. However, for a few scales across gender, and more so for ethnicity, it seems that participant responses might also be influenced by factors other than the underlying latent constructs. Thus, while the scales of the assessment appears to be largely invariant at the configural and metric levels, a more nuanced picture emerged at scalar level with partially invariant models, especially across ethnic groups.     

Response to Stuart Kauffman: The Measurement Problem in Quantum Mechanics

Richard Feynman, a 1965 Nobel Prize winner in physics, quoting an unknown philosopher, said: “It is necessary for the very existence of science that the same conditions always produce the same results.” And Feynman's reply: “Well, they don't.” Double-slit experiments with both slits open and the wave interference pattern created by electrons falling on a screen behind the slits speak volumes to those two statements and the interpretive problem created by the non-deterministic behavior of microscopic matter. Quantum mechanics (QM) with its successes over the last 85 years has created the information age, and with insights into nature has given humans an economy concentrated with products based on quantum technology. All this even with questions about the fundamental aspects of measurement in the quantum world still being debated! Discussing the measurement aspect of QM does not require a physics background where physics scholars join other scholarly disciplines engaged in gaining knowledge about the reality of the one world of human experience. The necessary tools for discussion are imagination, speculation, and curiosity. But for a new credible interpretation of the measurement problem, quantum training or a quantum theoretician is required.     

孝道:理论、测量、变迁及与相关变量的关系

孝道是一套子女以父母为对象的社会态度和社会行为的组合。近10余年来孝道研究领域在理论建构、测量工具的开发、孝道变迁研究以及其与相关变量之间关系的研究上取得了一些重要进展。未来研究的关键在于建构孝道多元模型,不断完善孝道测量工具,采用系统化思维、综合运用多种方法改进研究质量,更加关注孝道与积极心理变量的关系。     

The classmates social isolation questionnaire (CSIQ): An initial validation

Social Isolation means having a lack of social contacts. This study reports a first validation of a brief self-report measure, the Classmates Social Isolation Questionnaire (CSIQ). The CSIQ is a questionnaire for children which assesses social isolation from classmates within the classroom as well as outside school. Data was based on a nationally representative sample of 26,670 Italian fifth grade students. Through exploratory and confirmatory factor analyses the bidimensional structure of the scale was established. The CSIQ showed measurement invariance both across gender and across groups with different immigrant backgrounds.Various tests of criterion validity had positive results and the CSIQ appears to be a valid and time-efficient instrument that can make a contribution to the study of social isolation and correlated factors.     

Dyadic measurement invariance and its importance for replicability in romantic relationship science

Comparisons of group means, variances, correlations, and/or regression slopes involving psychological variables rely on an assumption of measurement invariance—that the latent variables under investigation have equivalent meaning and measurement across group. When measures are noninvariant, replicability suffers, as comparisons are either conceptually meaningless, or hindered by inflated Type I error rates. We propose that the failure to account for interdependence among dyad members when testing measurement invariance may be a potential source of unreplicable findings in relationship research. We developed fully dyadic versions of invariance models, created an R package (dySEM) to make specifying dyadic invariance models easier and reporting more reproducible, and executed a Registered Report for gauging the extent of dyadic (non)invariance in romantic relationship research across measures of relationship well‐being, personality, and sexuality in a sample of 282 heterosexual couples. We found that although a number of popular measures display good evidence of dyadic invariance, a few display concerning levels and interesting patterns of noninvariance, while others appeared either noninvariant or poorly fitting for both men and women. We discuss our findings in terms of their meaning for the replicability dyadic close relationship research. We close by arguing that increased theorizing and research on dyadic invariance, and inclusive methods for analyzing invariance with indistinguishable dyads, are needed to capitalize on the opportunity to advance our field's understanding of dyadic constructions of relational concepts.