WHEN PERFORMANCE IMPROVEMENT IS THE GOAL: A NEW SET OF CRITERIA FOR CRITERIA

Weitz (1961), aware of the lure of tradition and expedience, urged the identification of evaluation standards for dependent variables, which he referred to as criteria for criteria. In this article, five criteria are proposed using the mnemonic SURF & C: the directness of sampling (S); the responsiveness of the target (i.e., making sure the dependent variable is under (U) the worker's control); the reliability (R) of observers; the frequent (F) assessment of the target during the intervention period; and the critical (C) nature of the target. Together the criteria provide guidelines for what and how targets should be assessed. Their necessity is illustrated in two year-long experiments designed to improve the preventive maintenance of heavy equipment in the U.S. Marine Corps. Although the criteria are limited to evaluating dependent variables in field experiments, they are recommended as the foundation for successful performance efforts in any applied setting.     

Estimation of Controlled Direct Effects in Longitudinal Mediation Analyses with Latent Variables in Randomized Studies

Abstract

In a randomized study with longitudinal data on a mediator and outcome, estimating the direct effect of treatment on the outcome at a particular time requires adjusting for confounding of the association between the outcome and all preceding instances of the mediator. When the confounders are themselves affected by treatment, standard regression adjustment is prone to severe bias. In contrast, G-estimation requires less stringent assumptions than path analysis using SEM to unbiasedly estimate the direct effect even in linear settings. In this article, we propose a G-estimation method to estimate the controlled direct effect of treatment on the outcome, by adapting existing G-estimation methods for time-varying treatments without mediators. The proposed method can accommodate continuous and noncontinuous mediators, and requires no models for the confounders. Unbiased estimation only requires correctly specifying a mean model for either the mediator or the outcome. The method is further extended to settings where the mediator or outcome, or both, are latent, and generalizes existing methods for single measurement occasions of the mediator and outcome to longitudinal data on the mediator and outcome. The methods are utilized to assess the effects of an intervention on physical activity that is possibly mediated by motivation to exercise in a randomized study.     

Envisioning more virtuous virtues

ABSTRACT

This response addresses three key themes related to the interdisciplinary study of virtue: limitations of self-reports, demoting of the virtues, and concerns about cultural issues. I suggest that self-regulation theories of how people develop virtues are needed in order to understand how virtues (even just two at a time) may work in tandem to influence behavior. I suggest that psychologists and philosophers approach an interdisciplinary conversation about virtue with an eye towards the limitations in our field’s typical way of approaching constructs. Such an approach provides an opportunity to see problems that are typically masked by disciplinary habits.     

Positive psychology,the classification of character strengths and virtues,and issues of measurement

ABSTRACT

This essay raises concerns about positive psychology’s classification of character strengths and virtues and issues of measurement. Part I examines the process whereby the classification was compiled. Part II turns to issues of measurement and questions about positive psychologists’ sensitivity to variations in the meanings of the constructs they purport to measure, both within and across cultures. I argue that attempts to find a ‘deep structure’ of the character strengths and virtues should proceed hand in hand with efforts to render positive psychology and its measurement tools more sensitive to variability in character strengths and virtues across and within cultures. The essay concludes with suggestions for future research.     

Another way to think about psychological change: experiential vs. incremental

The traditional pre-post treatment difference reflects an incremental notion of change, where a quantity of some psychological function is added to (or subtracted from) a pretreatment quantity. This study presents a complementary, experiential notion of change. Rather than a difference, change is a feeling or experience of having changed, a feeling that one is different than before. Based on a post-treatment interview the Change after Psychotherapy (CHAP) is a method to quantify/rate such ‘differentness’ in terms of how extensively or radically the patient feels having changed. A pre-post quasi-experimental study (N = 49) comparing the CHAP with ratings on the Global Assessment of Functioning, the Karolinska Psychodynamic Profile and the Comprehensive Psychopathological Rating Scale-Self-Affective is reported. The results showed the CHAP to be a reliable, valid and sensitive way to assess an experiential kind of CHAP.     

Utrecht Gender Dysphoria Scale - Gender Spectrum (UGDS-GS): Construct validity among transgender,nonbinary, and LGBQ samples

Abstract

Background: Researchers combined both versions of the original Utrecht Gender Dysphoria Scale (UGDS) to create a single gender spectrum version (UGDS-GS) which measures dissatisfaction with gender identity and expression over time as well as comfort with affirmed gender identity.

Aim: This study examined the construct validity of the newly revised, UGDS-GS.

Method: Tests of measurement invariance were conducted in stages to assess measurement invariance of the UGDS-GS across three groups: cisgender, binary transgender, and nonbinary/genderqueer.

Results: Findings indicate that the UGDS-GS functions acceptably in all three gender groups (configural and metric invariance). Also, across binary transgender and nonbinary/genderqueer groups, the measure functions very similarly with all four types of invariance. Item level findings highlight the specificity of the measure to distinguish experiences of binary transgender and nonbinary/genderqueer persons differently from cisgender LGBQ individuals.

Conclusions: The UGDS-GS demonstrates a large degree of invariance across binary transgender, nonbinary/genderqueer, and cisgender LGBQ subgroups; and therefore, findings indicate this revision to be a substantial improvement. This 18-item self-report, Likert-type scale measure is a) inclusive of all gender identities and expressions (e.g., transfeminine spectrum, transmasculine spectrum, genderqueer, nonbinary, cisgender); b) appropriate for use longitudinally from adolescence to adulthood; and c) administered at any point in the social or medical transition process, if applicable, or in community-based research focused on gender dysphoria that examines cisgender and transgender persons.     

CREATIONISM IN THE NETHERLANDS

Recent events indicate that creationists are becoming increasingly active in the Netherlands. This article offers an overview of these events. First, I discuss the introduction of intelligent‐design (ID) creationism into the Dutch public sphere by a renowned physicist, Cees Dekker. Later, Dekker himself shifted toward a more evolution‐friendly position, theistic evolution. Second, we see how Dekker was followed in this shift by Andries Knevel, an important figure within the Dutch evangelical broadcasting group, the Evangelische Omroep (EO). His conversion to ID, and subsequently to theistic evolution, brought him into conflict with young‐Earth creationists who still strongly identify themselves with the EO. Third, provoked by the dissidence of prominent orthodox believers and the celebrations surrounding the Darwin year, young‐Earth creationists became very visible. After three decades of relative silence, they started a project to make sure that the Dutch people would hear of the “alternatives” to evolutionary theory. This article (1) adds to the growing number of reports on creationists' increased activity in Europe and (2) suggests that ID, in a context different from the United States, did not unite but rather divided the Dutch orthodox Protestant community.     

Enhancing mental health and well-being outcomes for psychotherapy and counselling through idiographic analysis: A four-quadrant approach

Mental health and well-being outcomes in psychotherapy and counselling have largely been studied through the use of standardised nomothetic measurement. A key limitation is that nomothetic measurement and current statistical analyses do not necessarily capture the outcomes of the complicated and individual psychotherapy processes. There is an increased interest in the use of idiographic patient-reported outcome measures (I-PROMs), which are uniquely useful because they may explore areas of importance that are unexplored by nomothetic outcome measures. We argue that to optimise the value of I-PROMs, it is necessary to consider their contribution alongside standardised nomothetic measures. However, there are important considerations with respect to whether or not I-PROMs from different clients, or indeed from the same client, can be meaningfully explored at a team/service level, and alongside standardised nomothetic outcomes. We provide worked examples on real client data to show that delineating four quadrants of analysis is important to explore the breadth of information: (a) individual progress on single items, (b) individual progress by aggregated scores, (c) team/service-level progress by goal item/theme and (d) team/service-level progress by aggregated scores.     

PALEY'S iPOD: THE COGNITIVE BASIS OF THE DESIGN ARGUMENT WITHIN NATURAL THEOLOGY

The argument from design stands as one of the most intuitively compelling arguments for the existence of a divine Creator. Yet, for many scientists and philosophers, Hume's critique and Darwin's theory of natural selection have definitely undermined the idea that we can draw any analogy from design in artifacts to design in nature. Here, we examine empirical studies from developmental and experimental psychology to investigate the cognitive basis of the design argument. From this it becomes clear that humans spontaneously discern purpose in nature. When constructed theologically and philosophically correctly, the design argument is not presented as conclusive evidence for God's existence but rather as an abductive, probabilistic argument. We examine the cognitive basis of probabilistic judgments in relationship to natural theology. Placing emphasis on how people assess improbable events, we clarify the intuitive appeal of Paley's watch analogy. We conclude that the reason why some scientists find the design argument compelling and others do not lies not in any intrinsic differences in assessing design in nature but rather in the prior probability they place on complexity being produced by chance events or by a Creator. This difference provides atheists and theists with a rational basis for disagreement.