Premature conclusions about the signal-to-noise ratio in structural equation modeling research: A commentary on Yuan and Fang (2023)

In a recent article published in this journal, Yuan and Fang (British Journal of Mathematical and Statistical Psychology, 2023) suggest comparing structural equation modeling (SEM), also known as covariance-based SEM (CB-SEM), estimated by normal-distribution-based maximum likelihood (NML), to regression analysis with (weighted) composites estimated by least squares (LS) in terms of their signal-to-noise ratio (SNR). They summarize their findings in the statement that “[c]ontrary to the common belief that CB-SEM is the preferred method for the analysis of observational data, this article shows that regression analysis via weighted composites yields parameter estimates with much smaller standard errors, and thus corresponds to greater values of the [SNR].” In our commentary, we show that Yuan and Fang have made several incorrect assumptions and claims. Consequently, we recommend that empirical researchers not base their methodological choice regarding CB-SEM and regression analysis with composites on the findings of Yuan and Fang as these findings are premature and require further research.     

Isotonic ordinal probabilistic models (ISOP)

The concept of an ordinal instrumental probabilistic comparison is introduced. It relies on an ordinal scale given a priori and on the concept of stochastic dominance. It is used to define a weakly independently ordered system, or isotonic ordinal probabilistic (ISOP) model, which allows the construction of separate sample-free ordinal scales on a set of subjects and a set of items. The ISOP-model is a common nonparametric theoretical structure for unidimensional models for quantitative, ordinal and dichotomous variables.Fundamental theorems on dichotomous and polytomous weakly independently ordered systems are derived. It is shown that the raw score system has the same formal properties as the latent system, and therefore the latter can be tested at the observed empirical level.I wish to thank 3 reviewers and 2 editors who contributed a lot to the readability and precision of the article.     

A stochastic model for test-retest correlations

A simple stochastic model is formulated in order to determine the optimal time between the first test and the second test when the test-retest method of assessing reliability is used. A forgetting process and a change in true score process are postulated. The optimal time between tests is derived by maximizing the probability that the respondent has not remembered the response on the first test and has not had a change in true score. The resulting test-retest correlation is then found to be a linear function of the true reliability of the test, where the slope of this function is the key probability of not remembering and having no change in true score. Some numerical examples and suggestions for using the results in empirical studies are given. Specific recommendations are presented for improved design and analysis of intentions data.This research was made possible by a grant from the Center for Food Policy Research, Graduate School of Business, Columbia University, New York, New York, 10027.     

Two simple classes of mastery scores based on the beta-binomial model

Two simple classes of mastery scores which are suitable for hand calculations are presented for beta-binomial test score distributions combined with linear and cubic referral success. The models provide a simple way to explore the consequences of selecting an arbitrary mastery score. Such assessment would be useful whenever the test user is not willing to posta priori a loss ratio, but wishes to look at the various consequences before aiming at a particular score.     

Checking the Assumptions of Rasch's Model for Speed Tests

Two new tests for a model for the response times on pure speed tests by Rasch (1960) are proposed. The model is based on the assumption that the test response times are approximately gamma distributed, with known index parameters and unknown rate parameters. The rate parameters are decomposed in a subject ability parameter and a test difficulty parameter. By treating the ability as a gamma distributed random variable, maximum marginal likelihood (MML) estimators for the test difficulty parameters and the parameters of the ability distribution are easily derived. Also the model tests proposed here pertain to the framework of MML. Two tests or modification indices are proposed. The first one is focused on the assumption of local stochastic independence, the second one on the assumption of the test characteristic functions. The tests are based on Lagrange multiplier statistics, and can therefore be computed using the parameter estimates under the null model. Therefore, model violations for all items and pairs of items can be assessed as a by-product of one single estimation run. Power studies and applications to real data are included as numerical examples.     

The multiple meanings of secondary gain

The historical development of the concept of secondary gain is described in this article. Freud introduced this concept as a complement to primary gain. Freud modified the scope of both concepts during his career, but they remained within the boundary of an intrapsychological mechanism. Outside psychoanalysis, the concept of secondary gain has acquired further meaning with higher emphasis on interpersonal and social aspects. Consequently, it is often unclear what a writer or speaker means when he uses the term secondary gain. The different meanings of secondary gain in and outside psychoanalysis are illustrated with reference to literature and case reports.     

Potential underlying mechanisms for greater weight gain in massaged preterm infants

In this paper, potential underlying mechanisms for massage therapy effects on preterm infant weight gain are reviewed. Path analyses are presented suggesting that: (1) increased vagal activity was associated with (2) increased gastric motility, which, in turn, was related to (3) greater weight gain; and (4) increased IGF-1 was related to greater weight gain. The change in vagal activity during the massage explained 49% of the variance in the change in gastric activity. And, the change in vagal activity during the massage explained 62% of the variance in the change in insulin. That the change in gastric activity was not related to the change in insulin suggests two parallel pathways via which massage therapy leads to increased weight gain: (1) insulin release via the celiac branch of the vagus; and (2) increased gastric activity via the gastric branch of the vagus.     

项目反应理论观察分数核等值的影响因素

探究带宽选择方法、样本量、题目数量、等值设计、数据模拟方式对项目反应理论观察分数核等值的影响。通过两种数据模拟方式,获得研究数据,并计算局部与全域评价指标。研究发现,在随机组设计中,带宽选择方法表现相似;考生样本量和题目数量影响甚微。在非等组设计中,惩罚法与Silverman经验准则表现优异;增加题目量可降低百分相对误差和随机误差;增加样本量导致百分相对误差变大,随机误差减小。数据模拟方式可影响等值评价。未来应重点关注等值系统评估。     

The Academic Advantage of Devotion: Measuring Variation in the Value of Weekly Worship in Late Adolescence on Educational Attainment Using Propensity Score Matching

This study measures the effect of regular worship attendance at age 17 on total years of schooling by age 25, using data from the National Longitudinal Survey of Youth 1997. Expanding on previous work, this study estimates differences in the impact of worship attendance by race and family income status using propensity score matching. Individuals who frequently attend religious services complete .69 more years of schooling than similar individuals who do not frequently attend services. There are significantly greater returns to attendance for low‐income youth and no significant difference in returns by religious affiliation. These findings suggest that religious observance provides greater benefits for low‐income individuals or perhaps provides resources high‐income individuals have access to elsewhere. Moreover, this study extends previous work by examining a more recent and nationally representative sample of youth and by using methods that allow for greater causal inference.     

Moderate versus light pressure massage therapy leads to greater weight gain in preterm infants

Sixty-eight preterm infants (M GA = 30 weeks) were randomly assigned to a moderate or to a light pressure massage therapy group to receive 15 massages three times per day for 5 days. Behavior state, stress behaviors and heart rate were recorded for 15 min before and during the first 15-min therapy session. Weight gain was recorded over the 5-day therapy period. The moderate versus light pressure massage group gained significantly more weight per day. During the behavior observations the moderate versus light pressure massage group showed significantly lower increases from the pre-session to the session recording on: (1) active sleep; (2) fussing; (3) crying; (4) movement; and (5) stress behavior (hiccupping). They also showed a smaller decrease in deep sleep, a greater decrease in heart rate and a greater increase in vagal tone. Thus, the moderate pressure massage therapy group appeared to be more relaxed and less aroused than the light pressure massage group which may have contributed to the greater weight gain of the moderate pressure massage therapy group.