Formative Versus Reflective Measurement: An Illustration Using Work–Family Balance

The aim of this article is to propose the formative measurement approach that can be used in various constructs of applied psychology. To illustrate this approach, the authors will (a) discuss the distinction between commonly used principal-factor (reflective) measures in comparison to the composite (formative) latent variable model, which is often applied in other disciplines such as marketing or engineering, and (b) point out the advantages and limitations of formative specifications using the example of the work–family balance (WFB) construct. Data collected from 2 large cross-sectional field studies confirm the reliability and validity of formative WFB measures as well as its predictive value regarding criteria of WFB (i.e., job satisfaction, family satisfaction, and life satisfaction). Last, the specific informational value of each formative indicator will be demonstrated and discussed in terms of practical implications for the assessment in different psychological fields.     

A Test of Greenhaus and Allen (2011) Model on Work-Family Balance

The aim of the present study is to test the Greenhaus and Allen (2011) model on work-family balance (WFB). The model was tested using a survey based methodology. An online questionnaire was administered and data was collected from academicians from higher education institutes in India (492 samples) and USA (293 samples). Partial least square structural equation modeling (PLS SEM) results showed that work-family conflict and work-family facilitation predicted job and family satisfaction. Similarly both types of satisfactions (job and family) predicted feelings of WFB, which in turn results in life satisfaction. In both samples, the model was found to have adequate predictive relevance and goodness of fit with the data. Thus, academicians working in higher educational institutions in India and USA can attain work-family balance by achieving job and family satisfaction. Similarly, job and family satisfaction decreased and increased due to conflict and facilitation respectively. Finally, this work showed that if academicians can achieve balance between work and family, they can attain satisfaction in life as a whole.     

Incremental and predictive utility of formative assessment methods of reading comprehension

Formative assessment measures are commonly used in schools to assess reading and to design instruction accordingly. The purpose of this research was to investigate the incremental and concurrent validity of formative assessment measures of reading comprehension. It was hypothesized that formative measures of reading comprehension would contribute more to our understanding of students' overall reading abilities than simply oral reading fluency (ORF). It was also hypothesized that measures could be modeled in a meaningful way to explain student performance on criterion measures of academic competence. Four formative measures of reading comprehension – maze (MZ), retell fluency (RTF), written retell (WRT), and sentence verification technique (SVT) – were used to measure unique aspects of reading comprehension through production-type responses. Results suggested that reading comprehension measures, when combined with ORF, added to the total variance associated with reading ability and were reliable indicators of student performance on a high stakes criterion-referenced assessment of grade-level literacy.     

Knowledge as a formative construct: A good alpha is not always better

Measurements of domain knowledge very often use and report Cronbach's alpha or similar indicators of internal consistency for test construction. In this short article, we argue that this approach is often at odds with the theoretical conception of knowledge underlying the measure. While domain knowledge is usually described as a formative construct (formed by the manifest observations) theoretically, the use of Cronbach's alpha to construct and evaluate an empirical measure implies a reflective model (the construct reflects in manifest behaviors). After illustrating the difference between reflective and formative models, we illustrate how this mismatch between theoretical conception and empirical operationalization can have substantial implications for the assessment and modeling of domain knowledge. Specifically, the construct may be operationalized too narrowly or even be misinterpreted by applying criteria for item selection that focus on homogeneity such as Cronbach's alpha. Rather than maximizing items internal consistency, researchers constructing measures of domain knowledge should, therefore, make strong arguments for the theoretical merit of their items even if they are not correlated to each other.     

Stepwise Latent Class Models for Explaining Group-Level Outcomes Using Discrete Individual-Level Predictors

Explaining group-level outcomes from individual-level predictors requires aggregating the individual-level scores to the group level and correcting the group-level estimates for measurement errors in the aggregated scores. However, for discrete variables it is not clear how to perform the aggregation and correction. It is shown how stepwise latent class analysis can be used to do this. First, a latent class model is estimated in which the scores on a discrete individual-level predictor are used to construct group-level latent classes. Second, this latent class model is used to aggregate the individual-level predictor by assigning the groups to the latent classes. Third, a group-level analysis is performed in which the aggregated measures are related to the remaining group-level variables while correcting for the measurement error in the class assignments. This stepwise approach is introduced in a multilevel mediation model with a single individual-level mediator, and compared to existing methods in a simulation study. We also show how a mediation model with multiple group-level latent variables can be used with multiple individual-level mediators and this model is applied to explain team productivity (group level) as a function of job control (individual level), job satisfaction (individual level), and enriched job design (group level).     

Positivity and the Construction of Life Satisfaction Judgments: Global Happiness is not the Sum of its Parts

The present study investigated how reports of satisfaction with specific versus global domains can be used to assess a disposition towards positivity in subjective well-being reports. College students from 41 societies (N = 7167) completed measures of life satisfaction and ratings of global and specific aspects of their lives. For example, participants rated satisfaction with their education (global) and satisfaction with their professors, textbooks, and lectures (specific). It was hypothesized that global measures would more strongly reflect individual differences in dispositional positivity, that is, a propensity to evaluate aspects of life in general as good. At both the individual and national levels, positivity predicted life satisfaction beyond objective measures. Also, positivity was associated with norms about ideal life satisfaction such that countries and individuals who highly valued positive emotions were more likely to display positivity. The difference between more global versus more concrete measures of satisfaction can be used as an indirect and subtle measure of positivity.     

Reconsidering formative measurement

The relationship between observable responses and the latent constructs they are purported to measure has received considerable attention recently, with particular focus on what has become known as formative measurement. This alternative to reflective measurement in the area of theory-testing research is examined in the context of the potential for interpretational confounding and a construct's ability to function as a point variable within a larger model. Although these issues have been addressed in the traditional reflective measurement context, the authors suggest that they are particularly relevant in evaluating formative measurement models. On the basis of this analysis, the authors conclude that formative measurement is not an equally attractive alternative to reflective measurement and that whenever possible, in developing new measures or choosing among alternative existing measures, researchers should opt for reflective measurement. In addition, the authors provide guidelines for researchers dealing with existing formative measures.     

Demonstrating Support for the Formative and Summative Assessment Paradigm in a School-Based Intensive Mental Health Program

We illustrate the use of formative and summative assessment in evaluating a therapeutic classroom program for children with serious emotional disturbances. Information was analyzed based on data gathered for clinical decision-making during treatment (formative assessment) and measurement of outcomes at discharge (summative assessment) from a school-based Intensive Mental Health Program. Results indicated that overall ratings of daily indicators of behavior across all environments (therapeutic classroom, neighborhood school, and home) were predictive of functioning at discharge. An ecological approach during the formative assessment period of evaluation is important as compared to only examining individual environments. Formative assessment techniques can predict scores on a summative assessment measure. Thus, we found supportive evidence for the formative and summative procedures used in the Intensive Mental Health Program for therapeutic interventions, clinical decision-making, and outcomes assessment.     

How do I Analyze Thee? Let Me Count the Ways: Considering Empathy in Couple Relationships using Self and Partner Ratings

In this article we describe some of the benefits and challenges of using self ratings and ratings of the partner to measure empathy and similar terms in couple research. If both members of the dyad are assessed, there will be four measures of the same variable. How to use these 4 measures in research and clinical work is a central question in this paper. We demonstrate 3 different latent models that can be used to analyze these ratings based on different theoretical premises. Using empathy as the independent variable with a longitudinal sample of 275 couples, structural equation models are used to evaluate the strength of these models in predicting relationship satisfaction. The findings indicate that the model that is consistent with the social constructionist perspective that focuses on the perceptions within the same person is a good fit to the data. Other models that compare ratings between members of the dyad do not fit the data well. The results demonstrate that perceptions of empathy do have a significant influence on relationship satisfaction across time, especially for females. However, it is largely males' perceptions of empathy of the self and the partner that influence relationship satisfaction for females.     

Exploring the Role of Alternative Perceived Performance Measures and Needs-Congruency in the Consumer Satisfaction Process

Prior research suggests that perceived performance of a product or a service is directly linked to postpurchase satisfaction. We argue that this causal relationship might be a measurement artifact and/or insufficient modeling of the satisfaction process rather than an accurate assessment of how consumers form satisfaction judgments. To test our hypotheses, a 2 x 2 x 2 (Performance x Expectations x Needs) factorial design was used with 2 types of perceived performance measures (value-laden and objective). The findings demonstrate that the observed direct link from perceived performance to overall satisfaction diminishes when more objective perceived performance indicators replace the commonly used value-laden measures. Furthermore, desire-congruency was found to contribute independently to satisfaction over and above a disconfirmation-of-expectations standard. In fact, desire-congruency was found to be a better predictor of satisfaction than disconfirmation-of-expectations. Finally, our results suggest that the direct performance–satisfaction link becomes insignificant when the modeling of the satisfaction process is improved. Taken together, these findings support the view that the frequently observed high correlations between perceived performance and satisfaction might be a reflection of the type of measures used and/or insufficient capturing of the evaluative process leading to satisfaction, rather than support for a direct causal link.     

Decision analysis: An approach for multidisciplinary teams in planning special service programs

A decision analytic approach for use by multidisciplinary teams (MDTs) in planning special service programs is described, and formative evaluation information on its application by MDTs in planning individualized education programs (IEPs) is presented. Decision analysis is applied following initial determination of program goals and objectives. In using the approach, an MDT engages in a six-step process: (a) delineation of program alternatives, (b) determination of program outcomes, (c) assessment of probabilities, (d) assessment of utilities, (e) determination of overall program values, and (f) selection of the program to be developed. Utilization of the approach allows a complex program planning situation to be disaggregated into its essential elements, with discussion of program alternatives occurring relative to specific decision criteria. Strengths and limitations of the approach also are discussed, and future directions for research are briefly noted.     

The development and validation of an implicit measure of competence need satisfaction

Research on self-determination theory has typically relied on explicit measures when examining the concept of competence need satisfaction. As a result, we know relatively little about competence need satisfaction that arises under conditions of automaticity. Across four studies, we developed and validated implicit measures of competence need satisfaction by drawing on two tasks: a relational variant of the implicit association test (IAT; Study 1, 3, and 4) and the implicit relational assessment procedure (IRAP; Study 2–3). Results across these studies revealed that both implicit measures were either unrelated or moderately related to their explicit counterpart. They were also unrelated to one another. Unlike the IRAP, the IAT was found to be reliable, to display discriminant validity, and to yield meaningful but modest relations with constructs in a nomological network. Together, these results provide modest support for the usefulness of the competence need satisfaction IAT but not of the competence need satisfaction IRAP as an implicit measure of the need for competence. Future research examining the unique predictive value of this IAT is needed, together with research on possible explanations for the low reliability of the IRAP.     

儿童母亲拒绝与同伴拒绝的关系—— 一个有中介的调节模型

摘 要 选取393家长进行问卷调查,考察儿童的母亲拒绝、家庭环境纷杂度、问题行为和同伴拒绝之间的关系。结果发现：（1）在控制了性别、年级、家庭社会经济地位后,母亲拒绝对儿童的同伴拒绝有显著正向预测作用;（2）家庭环境纷杂度调节了母亲拒绝与同伴拒绝之间的关系;（3）儿童外化问题行为在家庭环境纷杂度对母亲拒绝和同伴拒绝关系的调节效应中起完全中介作用。     

Studying Emotions in Security and Diplomacy: Where We Are Now and Challenges Ahead

The core objective of this special issue has been to shed light on emotions as (1) frames that shape interpersonal diplomatic relations, (2) as key tools that are used as part of the statecraft's toolbox, and (3) as formative/productive dynamics with real effects on human beings—that, in turn, often construct and maintain conflicts. It is therefore pertinent that we interrogate the political psychology of individual, collective, mass, and communal emotions and how these are often (mis)used in diplomacy and security narratives to legitimize politicians' decisions and practices. This concluding article provides a state of the art account of the study of emotions in International Relations (IR), sums up the main findings from all special issue contributions and constructively explores potential challenges ahead for the study of emotions in IR, especially in security and diplomacy studies. It concludes with an appeal for the development of a multiperspective approach—that is, one that combines social sciences, natural sciences, and humanities—for a nuanced study of the role of emotional work in state, diplomatic as well as security narratives and practices. This approach will in turn require methodological pluralism in how we go about, as reflexive researchers, our emotional research.     

Testing the ruler with item response theory: increasing precision of measurement for relationship satisfaction with the Couples Satisfaction Index.

The present study took a critical look at a central construct in couples research: relationship satisfaction. Eight well-validated self-report measures of relationship satisfaction, including the Marital Adjustment Test (MAT; H. J. Locke & K. M. Wallace, 1959), the Dyadic Adjustment Scale (DAS; G. B. Spanier, 1976), and an additional 75 potential satisfaction items, were given to 5,315 online participants. Using item response theory, the authors demonstrated that the MAT and DAS provided relatively poor levels of precision in assessing satisfaction, particularly given the length of those scales. Principal-components analysis and item response theory applied to the larger item pool were used to develop the Couples Satisfaction Index (CSI) scales. Compared with the MAS and the DAS, the CSI scales were shown to have higher precision of measurement (less noise) and correspondingly greater power for detecting differences in levels of satisfaction. The CSI scales demonstrated strong convergent validity with other measures of satisfaction and excellent construct validity with anchor scales from the nomological net surrounding satisfaction, suggesting that they assess the same theoretical construct as do prior scales. Implications for research are discussed.     

Correlates of satisfaction with body function and body appearance in middle- and older aged adults: The activity counseling trial (ACT)

Abstract

This study examined the dimensional structure and correlates of body satisfaction among middle-aged and older adult men (n = 471) and women (n = 383) who were participants in the Activity Counseling Trial. Correlates were grouped as (1) fitness parameters, (2) demographic characteristics, and (3) components of subjective well-being. Factor analyses demonstrated that body function and body appearance were independent components of satisfaction in this population. Body composition and cardiorespiratory fitness were directly related to satisfaction with body appearance; however, satisfaction with body function was most strongly related in expected directions to measures of subjective well-being. Age was positively related to both measures of body satisfaction, whereas data on race revealed that blacks were more satisfied with their body appearance and function than whites. The observed relationships for body satisfaction suggest that older adults may value body function more than body appearance. Furthermore, the associations of race and age with body satisfaction have important implications for intervention research.     

Core self-evaluations and job and life satisfaction: the role of self-concordance and goal attainment

The present study tested a model explaining how the core self-evaluations (i.e., positive self-regard) concept is linked to job and life satisfaction. The self-concordance model, which focuses on motives underlying goal pursuit, was used as an explanatory framework. Data were collected from 2 samples: (a) 183 university students (longitudinal measures of goal attainment and life satisfaction were used) and (b) 251 employees (longitudinal measures of goal attainment and job satisfaction were utilized). In both studies, the core self-evaluations concept was positively related to goal self-concordance, meaning that individuals with positive self-regard were more likely to pursue goals for intrinsic and identified (value-congruent) reasons. Furthermore, in both studies, goal self-concordance was related to satisfaction (job satisfaction in Study 1 and life satisfaction in Study 2).     

A new archival approach to the study of values and value--behavior relations: validation of the value lexicon

The present effort employs a new archival approach to study values and value- behavior relations, which is likely to be particularly useful in applied settings. A value lexicon was developed on the basis of the Schwartz (1992) value theory to extract lexical indicators of values from texts. The convergent, discriminant, and predictive validity of this measure was established using American newspaper content from 1900 to 2000 vis-à-vis existing self-report measures of values and objective indicators of value-expressive behaviors. Results provide empirical support for the use of the value lexicon to study values and value- behavior relations. First, the value lexicon demonstrated convergence with self-report responses of values. Second, values in American newspapers were associated with objective indicators of their corresponding value-expressive behaviors compared with noncorresponding value- expressive behaviors. Third, patterns of values over this 101-year period exhibited meaningful fluctuations with major historical and political events. The discussion describes new possibilities for future research on values in many applied settings with the value lexicon. The discussion also suggests that the principles of the value lexicon could be adopted to measure other psychological constructs of interest to applied psychology.     

The protective role of compassion satisfaction for therapists who work with sexual violence survivors: an application of the broaden-and-build theory of positive emotions

Therapists who work with trauma survivors, such as survivors of sexual violence, can experience compassion satisfaction while experiencing negative effects of trauma work, such as secondary traumatic stress. We examined whether the negative effects of secondary traumatic stress on therapist adjustment would be buffered by compassion satisfaction and whether the broaden-and-build theory of positive emotions could be applied to examine the factors (positive emotions and positive reframing) that relate to compassion satisfaction. Sixty-one therapists who work with sexual violence survivors completed measures of secondary traumatic stress, compassion satisfaction, adjustment, positive emotions and positive reframing. Hierarchical multiple regression analyses found that compassion satisfaction buffered the negative impact of secondary traumatic stress on therapist adjustment when adjustment was conceptualised as anxiety. Using non-parametric bootstrapping, we found that the relationship between greater positive emotions and greater compassion satisfaction was partially mediated by positive reframing. The findings indicate that compassion satisfaction is likely to be helpful in ameliorating the negative effects of secondary traumatic stress on anxiety in therapists who work with sexual violence survivors and that the broaden-and-build theory of positive emotions may provide a strong theoretical basis for the further examination of compassion satisfaction in trauma therapists.     

Stability and predictive ability of personality traits across 9 years

In the present study, personality traits, as assessed by the Karolinska Scales of Personality (KSP) were found to be stable after 9 years, both with regard to mean level stability (absolute stability) and rank-order stability (relative or differential stability). Moreover, outcome scales were applied measuring either perceptions of satisfaction or scales measuring functioning. Personality scales (from the Eysenck Personality Questionnaire and the KSP) completed in 1986/1987 were associated with measures (completed in 1995/1996) of satisfaction and functioning of family life, emotional and physical health, and work. Specifically, neuroticism-related personality traits predicted a lack of satisfaction with health, but not functional problems due to health. In contrast, neuroticism-related personality traits predicted poor functioning but not satisfaction with family life and work.