Premature conclusions about the signal-to-noise ratio in structural equation modeling research: A commentary on Yuan and Fang (2023)

In a recent article published in this journal, Yuan and Fang (British Journal of Mathematical and Statistical Psychology, 2023) suggest comparing structural equation modeling (SEM), also known as covariance-based SEM (CB-SEM), estimated by normal-distribution-based maximum likelihood (NML), to regression analysis with (weighted) composites estimated by least squares (LS) in terms of their signal-to-noise ratio (SNR). They summarize their findings in the statement that “[c]ontrary to the common belief that CB-SEM is the preferred method for the analysis of observational data, this article shows that regression analysis via weighted composites yields parameter estimates with much smaller standard errors, and thus corresponds to greater values of the [SNR].” In our commentary, we show that Yuan and Fang have made several incorrect assumptions and claims. Consequently, we recommend that empirical researchers not base their methodological choice regarding CB-SEM and regression analysis with composites on the findings of Yuan and Fang as these findings are premature and require further research.     

“‘WE' AND ‘THEY'”: WHY MUST WE ENGAGE IN CROSS-CULTURAL CONVERSATION?

This article contains the principal ideas that I presented in four different sessions at the IRAS 2022 conference, on the theme “‘We' and ‘They’: Cross-Cultural Conversation on Identity.” Focusing on the central topic, the article begins with (i) the contents of my opening lecture; followed by (ii) a broad outline of the concerns discussed in my book, Cross-Cultural Conversation: A New Way of Learning, intertwined with glimpses of the intellectual journey that led me to CCC, delivered in the Book-discussion session; (iii) a summary of the main ideas about the importance of meeting of religions today, which formed the background for the CCC Panel discussion on religion, where I was in conversation with spokespersons of five world religions; and (iv) my comments on how science–religion dialogue can help promote a sense for human solidarity by combining knowledge with wisdom, in the concluding session.     

Behavioral extremity moderates the association between certainty in attitudes about COVID and willingness to engage in mitigation-related behaviors

People generally intend to act more on beliefs and attitudes about which they have greater certainty. However, we introduce a boundary condition to the positive association between certainty and behavioral intentions—behavioral extremity. Uncertainty about a threatening issue like COVID-19 can be disconcerting, and we propose that uncertain people cope in part through increased openness to extreme actions like accepting risky medical treatments and aggression toward those defying mitigation policies. Testing this, we compiled and analyzed all the data on certainty about COVID-19 mitigation policies and willingness to engage in mitigation-related behaviors that our lab collected during the pandemic (6 samples, 20 behaviors, Ns up to 1496). External ratings of the behaviors' extremity moderated certainty-willingness associations: whereas greater certainty was associated with increased willingness to engage in moderate behaviors (the typical result), lower certainty was associated with increased willingness to engage in extreme behaviors, especially among those worried about becoming ill.     

Internal consistency and reliability of alternate short forms of the college women's assertion sample: Clinical and research implications

Assertive behavior is most often assessed with self-report or role-play measures. The latter modality is preferred because it provides for the sampling of the structure of behavior and for the consideration of the situational context. MacDonald (1978) has developed such an assessment device but it is limited by the length of time for administration and scoring. Two studies were conducted to reconstruct reliable alternate short forms. The first study describes the selection of items and demonstrates the internal consistency of the alternate forms. The second study demonstrates the alternate form and retest reliability and provides normative statistics. We conclude that reliable alternate short forms have been constructed to be used in research in clinical applications.This research was supported by the Marie Wilson Howells Fund.Alternate short forms of the CWAS may be obtained from the first author.     

Some relationships between the information function of IRT and the signal/noise ratio and reliability coefficient of classical test theory

It is shown that IRTs information function for an item is functionally related to local versions of classical test theories' signal/noise ratio and reliability coefficient.     

Swedish translations of the Suicide Probability Scale, Perceived Social Support from Friends and Family Scales, and the Scale for Interpersonal Behavior: A reliability analysis

The Suicide Probability Scale (SPS), the Perceived Social Support (PSS) from Friends (PSS-Fr) and Family (PSS-Fa) scales, and the Scale for Interpersonal Behavior (SIB) were translated into Swedish and their reliability was estimated in a university student sample. The reliability coefficients indicated that both subscales and the total scales of the SPS, PSS, and SIB possess highly adequate reliabilities. The intercorrelations among the subscales and between the subscales and the total scales were found to be highly significant. The results of the study supported the use of SPS, PSS-Fr and PSS-Fa, and the SIB as reliable methods for assessing suicide risk, perceived social support from friends and family, and assertive behavior.     

Inferential procedures for multifaceted coefficients of generalizability

A two-facet measurement model with broad application in the behavioral sciences is identified, and its coefficient of generalizability (CG) is examined. A normalizing transformation is proposed, and an asymptotic variance expression is derived. Three other multifaceted measurement models and CGs are identified, and variance expressions are presented. Next, an empirical investigation of the procedures follows, and it is shown that, in most cases, Type I error control in inferential applications is precise, and that the estimates are relatively efficient compared with the correlation coefficient. Implications for further research and for practice are noted. In an Appendix, four additional models, CGs, and variance expressions are presented.The research reported herein formed part of a doctoral dissertation conducted by Marsha Schroeder (Schroeder, 1986), under the direction of Ralph Hakstian, at the University of British Columbia. We acknowledge with thanks the contributions to this research of Todd Rogers and James Steiger. We are also very indebted to an mous reviewer who provided some important clarifications in connection with two of the models considered. Some support for this research was provided by a grant to Ralph Hakstian from the Natural Sciences and Engineering Research Council of Canada.     

Type A behaviour in pre-school children: Interrater reliability, stability over six months and subcomponents

Type A behaviour was measured in 250 boys and 245 girls (ages 3-7) using a Swedish version of Matthews' Youth Test for Health (MYTH). In addition, speech and voice characteristics (speed, loudness, response latency) were measured. Each child was independently rated by two play group leaders and measurements were repeated after a six month interval. Interrater reliability (first session) was 0.76 for both sexes and did not change with the age of the child. Boys obtained significantly (p less than 0.0001) higher scores than girls. Correlations over the six month period were 0.64 and 0.60 (p less than 0.001) for the two possible combinations of different raters and slightly higher (0.75 and 0.68, p less than 0.001) when the same rater was used. Two components of Type A behaviour were identified from a factor analysis of the data: impatience and competitiveness, and they accounted for 57% of the total variance. As for the total scale, boys obtained significantly higher scores than girls on both subscales. Scores on the competitiveness scale increased systematically with age. Speech and voice characteristics correlated significantly with Type A scores (total Type A behaviour: r = 0.50, using different raters, and 0.71, using the same raters, p less than 0.001) and, once again, boys obtained significantly (p less than 0.001) higher scores than girls. The results are in close agreement with the American findings from the original scale. It was concluded that the scale provides a reliable and valid instrument for measuring Type A or Type A-like behaviours in pre-school children.     

Continuous and discrete latent structure models for item response data

Relations are examined between latent trait and latent class models for item response data. Conditions are given for the two-latent class and two-parameter normal ogive models to agree, and relations between their item parameters are presented. Generalizationss are then made to continuous models with more than one latent trait and discrete models with more than two latent classes, and methods are presented for relating latent class models to factor models for dichotomized variables. Results are illustrated using data from the Law School Admission Test, previously analyzed by several authors.     

The stability of depressive symptoms in college students: An empirical demonstration of regression to the mean

In a recent paper, Vredenburg, Flett, and Krames (1993) hypothesized that the apparent instability of depressive symptom scores in college students may be due, in part, to the phenomenon known as statistical regression to the mean. This statistical principle was demonstrated in the current study. A sample of 183 university students completed the Beck Depression Inventory (BDI) at two timepoints separated by a 3-month interval. Consistent with past results, analyses revealed substantial changes in symptom scores over time with decrements being evident among many subjects with elevated symptom scores at Time 1. Examination of the amount of change over time in BDI scores indicated a pattern of findings that approximated the regression to the mean phenomenon. Statistical tests confirmed that regression to the mean accounted for a significant amount of the change in symptom scores over time. The implications of these findings are discussed in terms of the nature of depressive symptoms in students and the inappropriateness of assigning subjects to depressed or nondepressed groups on the basis of elevated scores on a self-report measure.