Reconsidering formative measurement

The relationship between observable responses and the latent constructs they are purported to measure has received considerable attention recently, with particular focus on what has become known as formative measurement. This alternative to reflective measurement in the area of theory-testing research is examined in the context of the potential for interpretational confounding and a construct's ability to function as a point variable within a larger model. Although these issues have been addressed in the traditional reflective measurement context, the authors suggest that they are particularly relevant in evaluating formative measurement models. On the basis of this analysis, the authors conclude that formative measurement is not an equally attractive alternative to reflective measurement and that whenever possible, in developing new measures or choosing among alternative existing measures, researchers should opt for reflective measurement. In addition, the authors provide guidelines for researchers dealing with existing formative measures.     

The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions

The purpose of this study was to review the distinction between formative- and reflective-indicator measurement models, articulate a set of criteria for deciding whether measures are formative or reflective, illustrate some commonly researched constructs that have formative indicators, empirically test the effects of measurement model misspecification using a Monte Carlo simulation, and recommend new scale development procedures for latent constructs with formative indicators. Results of the Monte Carlo simulation indicated that measurement model misspecification can inflate unstandardized structural parameter estimates by as much as 400% or deflate them by as much as 80% and lead to Type I or Type II errors of inference, depending on whether the exogenous or the endogenous latent construct is misspecified. Implications of this research are discussed.     

Interpretational confounding is due to misspecification, not to type of indicator: comment on Howell, Breivik, and Wilcox (2007)

R. D. Howell, E. Breivik, and J. B. Wilcox (2007) have argued that causal (formative) indicators are inherently subject to interpretational confounding. That is, they have argued that using causal (formative) indicators leads the empirical meaning of a latent variable to be other than that assigned to it by a researcher. Their critique of causal (formative) indicators rests on several claims: (a) A latent variable exists apart from the model when there are effect (reflective) indicators but not when there are causal (formative) indicators, (b) causal (formative) indicators need not have the same consequences, (c) causal (formative) indicators are inherently subject to interpretational confounding, and (d) a researcher cannot detect interpretational confounding when using causal (formative) indicators. This article shows that each claim is false. Rather, interpretational confounding is more a problem of structural misspecification of a model combined with an underidentified model that leaves these misspecifications undetected. Interpretational confounding does not occur if the model is correctly specified whether a researcher has causal (formative) or effect (reflective) indicators. It is the validity of a model not the type of indicator that determines the potential for interpretational confounding.     

Formative versus reflective measurement: an illustration using work-family balance

The aim of this article is to propose the formative measurement approach that can be used in various constructs of applied psychology. To illustrate this approach, the authors will (a) discuss the distinction between commonly used principal-factor (reflective) measures in comparison to the composite (formative) latent variable model, which is often applied in other disciplines such as marketing or engineering, and (b) point out the advantages and limitations of formative specifications using the example of the work-family balance (WFB) construct. Data collected from 2 large cross-sectional field studies confirm the reliability and validity of formative WFB measures as well as its predictive value regarding criteria of WFB (i.e., job satisfaction, family satisfaction, and life satisfaction). Last, the specific informational value of each formative indicator will be demonstrated and discussed in terms of practical implications for the assessment in different psychological fields.     

反映还是形成？平行还是层级？PSM的模型建构与检验

在心理学领域,传统的多指标潜变量的测量模型大都采用反映性建构,各指标反映了潜在构念,构念是各指标的原因.但实际上有些构念应该采用形成性建构,各指标是原因,形成了潜在构念.建构方式的选择不仅要从理论来考虑,还要通过数据特征来决定.研究以公共服务动机（PSM）构念为例,通过公益投资游戏取得投资绩效和满意度效标,验证了先前研究提出的“一阶反映二阶形成”建构模式,并进一步检验了层级性建构方式的优势,有助于PSM理论框架与实证测量的统一.     

The Alignment of Measures and Constructs in Organizational Research: The Case of Testing Measurement Models of Creativity

Purpose  

Organizational creativity research has a curious misalignment between construct definitions and measurement model specifications—definitions embrace multiple facets, but empirical measures do not. The purpose of this study was to examine potential measurement model misspecification in organizational creativity research. We compare whether creativity is best assessed as a unidimensional common latent construct model with reflective indicators or as a multi-dimensional composite latent construct model with formative indicators.     

Deconstructing the construct: A network perspective on psychological phenomena

In psychological measurement, two interpretations of measurement systems have been developed: the reflective interpretation, in which the measured attribute is conceptualized as the common cause of the observables, and the formative interpretation, in which the measured attribute is seen as the common effect of the observables. We advocate a third interpretation, in which attributes are conceptualized as systems of causally coupled (observable) variables. In such a view, a construct like ’depression’ is not seen as a latent variable that underlies symptoms like ’lack of sleep’ or ’fatigue’, and neither as a composite constructed out of these symptoms, but as a system of causal relations between the symptoms themselves (e.g., lack of sleep → fatigue, etc.). We discuss methodological strategies to investigate such systems as well as theoretical consequences that bear on the question in which sense such a construct could be interpreted as real.     

Dyadic measurement invariance and its importance for replicability in romantic relationship science

Comparisons of group means, variances, correlations, and/or regression slopes involving psychological variables rely on an assumption of measurement invariance—that the latent variables under investigation have equivalent meaning and measurement across group. When measures are noninvariant, replicability suffers, as comparisons are either conceptually meaningless, or hindered by inflated Type I error rates. We propose that the failure to account for interdependence among dyad members when testing measurement invariance may be a potential source of unreplicable findings in relationship research. We developed fully dyadic versions of invariance models, created an R package (dySEM) to make specifying dyadic invariance models easier and reporting more reproducible, and executed a Registered Report for gauging the extent of dyadic (non)invariance in romantic relationship research across measures of relationship well‐being, personality, and sexuality in a sample of 282 heterosexual couples. We found that although a number of popular measures display good evidence of dyadic invariance, a few display concerning levels and interesting patterns of noninvariance, while others appeared either noninvariant or poorly fitting for both men and women. We discuss our findings in terms of their meaning for the replicability dyadic close relationship research. We close by arguing that increased theorizing and research on dyadic invariance, and inclusive methods for analyzing invariance with indistinguishable dyads, are needed to capitalize on the opportunity to advance our field's understanding of dyadic constructions of relational concepts.     

Formative Versus Reflective Measurement: An Illustration Using Work–Family Balance

The aim of this article is to propose the formative measurement approach that can be used in various constructs of applied psychology. To illustrate this approach, the authors will (a) discuss the distinction between commonly used principal-factor (reflective) measures in comparison to the composite (formative) latent variable model, which is often applied in other disciplines such as marketing or engineering, and (b) point out the advantages and limitations of formative specifications using the example of the work–family balance (WFB) construct. Data collected from 2 large cross-sectional field studies confirm the reliability and validity of formative WFB measures as well as its predictive value regarding criteria of WFB (i.e., job satisfaction, family satisfaction, and life satisfaction). Last, the specific informational value of each formative indicator will be demonstrated and discussed in terms of practical implications for the assessment in different psychological fields.     

Ordinal state-trait regression for intensive longitudinal data

In many psychological studies, in particular those conducted by experience sampling, mental states are measured repeatedly for each participant. Such a design allows for regression models that separate between- from within-person, or trait-like from state-like, components of association between two variables. But these models are typically designed for continuous variables, whereas mental state variables are most often measured on an ordinal scale. In this paper we develop a model for disaggregating between- from within-person effects of one ordinal variable on another. As in standard ordinal regression, our model posits a continuous latent response whose value determines the observed response. We allow the latent response to depend nonlinearly on the trait and state variables, but impose a novel penalty that shrinks the fit towards a linear model on the latent scale. A simulation study shows that this penalization approach is effective at finding a middle ground between an overly restrictive linear model and an overfitted nonlinear model. The proposed method is illustrated with an application to data from the experience sampling study of Baumeister et al. (2020, Personality and Social Psychology Bulletin, 46, 1631).     

Quantifying definitional relations in psychological measurement

Quantitative inferences about psychological attributes, such as extraversion, depression and empathy, involve measurement instruments as well as mathematical models that specify how indicators should be aggregated. The type of model that is appropriate for doing so is conditional on the type of relation that exists between an attribute, its facets and its indicators. The common assumption is that such relations are causal relations. Here, instead, we address definitional attribute-facet relations. Our aim is to find an appropriate mathematical model for when an attribute is defined in terms of facets, instead of causing or being caused by facets. In doing so, we describe the semantics of definitions in logical form. From this form we then derive continuous functions for attribute-facet relations using fuzzy logic. A model with main effects and interactions between facets seems to be more powerful for representing definitional relations than traditional formative and reflective models. This has important implications for measurement in basic and applied research.     

Parental reflective functioning is associated with tolerance of infant distress but not general distress: Evidence for a specific relationship using a simulated baby paradigm

Parental reflective functioning represents the capacity of a parent to think about their own and their child's mental states and how these mental states may influence behavior. Here we examined whether this capacity as measured by the Parental Reflective Functioning Questionnaire relates to tolerance of infant distress by asking mothers (N = 21) to soothe a life-like baby simulator (BSIM) that was inconsolable, crying for a fixed time period unless the mother chose to stop the interaction. Increasing maternal interest and curiosity in their child's mental states, a key feature of parental reflective functioning, was associated with longer persistence times with the BSIM. Importantly, on a non-parent distress tolerance task, parental reflective functioning was not related to persistence times. These findings suggest that parental reflective functioning may be related to tolerance of infant distress, but not distress tolerance more generally, and thus may reflect specificity to persistence behaviors in parenting contexts.     

Bayesian modeling of measurement error in predictor variables using item response theory

It is shown that measurement error in predictor variables can be modeled using item response theory (IRT). The predictor variables, that may be defined at any level of an hierarchical regression model, are treated as latent variables. The normal ogive model is used to describe the relation between the latent variables and dichotomous observed variables, which may be responses to tests or questionnaires. It will be shown that the multilevel model with measurement error in the observed predictor variables can be estimated in a Bayesian framework using Gibbs sampling. In this article, handling measurement error via the normal ogive model is compared with alternative approaches using the classical true score model. Examples using real data are given.This paper is part of the dissertation by Fox (2001) that won the 2002 Psychometric Society Dissertation Award.     

A latent state-trait anxiety model and its application to determine consistency and specificity coefficients

Abstract

In the present study the consistency model (Steyer, 1987) was applied to data gathered with the German version of the State-Trait Anxiety Inventory (Laux, Glanzmann, Schaffner, and Spielberger, 1981). The questionnaire was presented twice to 64 university students with an interval of two months between first and second testing. The consistency and specificity coefficients, estimated by LISREL (Jöreskog and Sörbom, 1984), support the state-trait distinction. The state variables have high specificity and consistency coefficients; the trait variables, in contrast, have high consistency coefficients but low or even negligible specificity coefficients. The discussion points out the advantages of the consistency model over the stability model; the most important advantage is that the theoretical structure of the consistency model is more appropriate for the type of application considered. It contains a state factor for each occasion of measurement and a trait factor common to all occasions of measurement. In the stability model, only latent states, but no latent traits occur. Consistency, specificity, and reliability can be identified as proportions of variance determined by latent variables specified in the model. Therefore, data analysis provides statistics concerning the practical significance of the trait and of the effects of situations and/or interactions.     

The Association Between Reflective Functioning and Parent–Child Relationship Quality

Research consistently links adult and infant attachment styles, yet the means by which attachment is transmitted is relatively elusive. Recently, attention has been directed to the psychological underpinnings of caregiver sensitivity—originally thought to be the mechanism of transmission—as indicated by caregivers’ ability to keep in mind children’s mental states when interpreting children’s behavior, or reflective functioning. Unfortunately for researchers, extant measures of reflective functioning are time-consuming and require extensive observation and coding. A self-report measure could help facilitate the study and assessment of reflective functioning in research and clinical settings. This study investigated the relationship between parental reflective functioning and multiple aspects of the parent–child relationship, by using a new, self-report measure of reflective functioning. Participants were 79 caregivers (M _age = 31.8 years) who completed self-report measures assessing reflective functioning, parent–child relationship characteristics, perceived rejection in early relationships, attachment anxiety and avoidance in current close relationships, depression, and substance use. The results indicated that reflective functioning is a strong predictor of parent–child relationship quality (i.e., parental involvement, communication, parent satisfaction, limit setting, and parental support), independent of other potential indicators. Findings support parental reflective functioning as a contributor to the quality of parent–child relationship and suggest that a parent’s capacity to reflect on the mental states of his or her child in parent–child interactions may provide a key target for interventions that aim to improve parent–child relationships.     

POTENTIAL SPACE AND REFLECTIVE FUNCTIONING: TOWARDS CONCEPTUAL CLARIFICATION AND PRELIMINARY CLINICAL IMPLICATIONS

The authors propose that although the psychoanalytic constructs 'reflective functioning' and 'potential space' overlap and are sometimes used interchangeably, a knowledge of their distinctions and the ways in which they interface have important clinical implications. These concepts are similar in that both are capacities considered (1) to originate in the caregiver-child relationship, (2) to involve playing with ideas and symbolic thought, (3) to facilitate the therapeutic process and (4) to represent a desirable treatment outcome. The terms diverge in three important ways. First, potential space is a broader concept that can be applied not only to thinking about internal states but to aspects of human experience (e.g. art, religion) involving a sense of aliveness. Reflective functioning is more circumscribed to representations of mental states and their implications for interpersonal functioning. Second, potential space has more of a conscious introspective element, whereas reflective functioning is based in procedural memory. Third, reflective functioning operates intrapsychically, whereas potential space tends to be thought of as occurring in an interpersonal field. The authors hypothesise and illustrate a possible bi-directional, dialectic relationship between the two constructs. It is suggested that this new understanding might, in some cases, facilitate productive reformulations of clinical formulations, such as working with a perceived resistance.     

Attachment and borderline personality disorder

The author outlines his concept of reflective function or mentalization, which is defined as the capacity to think about mental states in oneself and in others. He presents evidence to suggest that the capacity for reflective awareness in a child's caregiver increases the likelihood of the child's secure attachment, which in turn facilitates the development of mentalization in the child. He proposes that a secure attachment relationship offers the child a chance to explore the mind of the caregiver, and in this way to learn about minds; he formulates this model of the birth of the psychological self as a variation on the Cartesian cogito: "My caregiver thinks of me as thinking and therefore I exist as a thinker." This model is then applied to provide insight into some personality-disordered individuals who were victims of childhood abuse. The author proposes (1) that individuals who experience early trauma may defensively inhibit their capacity to mentalize to avoid having to think about their caregiver's wish to harm them; and (2) that some characteristics of severe borderline personality disorder may be rooted in developmental pathology associated with this inhibition. He offers evidence for and some qualifications of this model, and argues that the therapeutic effect of psychoanalysis depends on its capacity to activate patients' ability to evolve an awareness of mental states and thus find meaning in their own and other people's behavior.     

Equivalence of a measurement model of cognitive abilities in U.S. standardization and Australian neuroscience samples

A psychological measurement model provides an explicit definition of (a) the theoretical and (b) the numerical relationships between observed scores and the latent variables that underlie the observed scores. Examination of the metric invariance of a measurement model involves testing the hypothesis that all components of the model relating observed scores to latent variables are equal across groups. The assumption of metric invariance is necessary for simple interpretation of scores. Establishing metric invariance also has implications for interpretation of convergent and divergent validity and patterns of deficit or disability. In this study the equivalence of the measurement model derived from the U.S. Wechsler Adult Intelligence Scale-III standardization sample was compared with a heterogeneous neurosciences sample in Australia. A pattern of strict metric invariance was observed across samples. These results provide evidence of the generality of the model underlying measurement of cognitive abilities.     

IMPLEMENTATION OF AN EVIDENCED‐BASED PARENTING PROGRAM IN A COMMUNITY MENTAL HEALTH SETTING

The process of mental health intervention implementation with vulnerable populations is not well‐described in the literature. The authors worked as a community‐partnered team to adapt and pilot an empirically supported intervention program for mothers of infants and toddlers in an outpatient mental health clinic that primarily serves a low‐income community. We used qualitative ethnographic methods to document the adaption of an evidence‐based intervention, Mothering from the Inside Out, and the pilot implementation in a community mental health clinic. Seventeen mothers and their identified 0‐ to 84‐month‐old children were enrolled in the study. Key lessons from this implementation include (a) the importance of formative work to build community relationships and effectively adapt the intervention to meet the needs of the therapists and their clients, (b) the importance of designing plans for training and reflective supervision that fit within the flow of the clinic and can tolerate disruptions, and (c) that use of an interdisciplinary approach is feasible with the development of a plan for communication and the support of a trained reflective clinical supervisor. These key lessons advance the scientific knowledge available to healthcare managers and researchers who are looking to adapt mental health clinical interventions previously tested in clinical trials to implementation in community settings.     

男女两性在文化震荡、心理健康及其关系中的差异比较

采用自编问卷对1555名30岁及以上被试受文化震荡的影响程度及其心理健康进行调查,分别探讨不同生活环境和环境相同但受教育程度不同的男女两性在两变量及其关系中的差异。结果表明:(1)总体上,男性报告的文化事件的主观影响明显比女性更积极,但其心理健康水平却明显低于女性;男女两性在文化震荡与心理健康之间均存在显著正相关,但具有不同特点。(2)不同生活环境和同一生活环境中不同受教育程度的男女两性在文化震荡、心理健康中均存在不同程度的差异;在这两变量间也均存在不同方面的显著正相关。