Reconciling the Two Disciplines of Organisational Science: A Comparison of Findings from Lab and Field Research

A strong preference for field research exists in the organisational sciences. However, it is unclear whether or under what conditions this is warranted. To examine this issue we conducted a second‐order meta‐analysis of 203 lab‐field pairs of meta‐analytic effects representing a diverse range of work‐related relationships. As expected, results showed a larger effect for lab (r = .25) than for field research (r = .14). However, the correspondence between the rank‐order of effect sizes for relationships assessed in lab settings and matched effects assessed in field settings was weaker (r = .61) than previous estimates from related areas of research. Moderators of lab‐field effect size magnitude and rank‐order correspondence were tested. Effect size magnitudes from the lab and field were most similar when lab studies used correlational designs, when using psychological state and trait (as opposed to demographic or workplace characteristic) variables as predictors, and when assessing attitudinal outcomes. Lab–field rank‐order correspondence was strongest when testing psychological state and workplace characteristic predictors and when assessing attitudinal and decisional outcomes. Findings offer recommendations for interpreting primary lab and field effects and inform evaluations of “when” findings from lab and field studies are likely to align.     

Maternal and paternal parenting styles associated with relational aggression in children and adolescents: A conceptual analysis and meta-analytic review

How does parenting affect relational aggression in children? The goal of the present series of meta-analyses based on 48 studies (28,097 children) was to analyze and integrate the findings on the associations between various types of parenting behaviors and relational aggression, and to identify potential substantive and methodological factors that may moderate these associations. To distinguish between different parenting strategies, experts sorted the parenting measures used in the studies into 10 groups. Results of a multiple correspondence analysis revealed four separate clusters: Positive parenting, psychologically controlling parenting, negative/harsh parenting, and uninvolved parenting. The meta-analyses demonstrated that more positive parenting was associated with less relational aggression (combined effect sizes r = −.06, p < .05, for mothers, r = −.08, p < .01, for fathers). More harsh parenting (combined effect sizes r = .11, p < .01, for mothers, r = .12, p < .01, for fathers) and more uninvolved parenting (combined effect sizes r = .07, p < .01, for mothers, absent for fathers) were associated with increased relational aggression. Paternal psychologically controlling parenting was positively related to relational aggression (r = .05, p < .01), whereas maternal psychologically controlling parenting was not (combined effect sizes r = .04, p = .09). The effect of several moderators is discussed. The findings of this study suggest that dimensions of positive and negative parenting behaviors of mothers and fathers are associated with children’s relational aggression and that these associations are – in case of fathers – contingent upon a number of sampling and procedural characteristics.     

How Accurate Is the Pearson r-from-Z Approximation? A Monte Carlo Simulation Study

The Pearson r-from-Z approximation estimates the sample correlation (as an effect size measure) from the ratio of two quantities: the standard normal deviate equivalent (Z-score) corresponding to a one-tailed p-value divided by the square root of the total (pooled) sample size. The formula has utility in meta-analytic work when reports of research contain minimal statistical information. Although simple to implement, the accuracy of the Pearson r-from-Z approximation has not been empirically evaluated. To address this omission, we performed a series of Monte Carlo simulations. Results indicated that in some cases the formula did accurately estimate the sample correlation. However, when sample size was very small (N = 10) and effect sizes were small to small-moderate (ds of 0.1 and 0.3), the Pearson r-from-Z approximation was very inaccurate. Detailed figures that provide guidance as to when the Pearson r-from-Z formula will likely yield valid inferences are presented.     

Eating behaviors and emotional distress are predicted by treatment and adverse outcome in patients with type 2 diabetes

Depression and anxiety are hightly prevalent among patients with Type 2 Diabetes (T2D), however not commonly related to outcomes, treatment and comorbidities. Eating behaviors could also have an implication. To evaluate the relation between mood and eating behaviors with demographic, physical, treatment, biochemical profiles and chronic comorbidities in T2D we conducted this exploratory cross sectional study in a population from Mexico. Hospital Anxiety and Depression Scale and the Three Factor Eating Questionnaire Revised 21 (TFEQ-R21) were correlated with age, gender, blood pressure, treatment and comorbidities (nephropathy, neuropathy, retinopathy and cardiopathy). Multi-linear regression models and 2^k factorial analyses were conducted. Sixty-one patients (31 male) 55 years old (SD 13) with at least 5 years of T2D were included. Anxiety correlated with depression (r = 0.25, p < 0.05). Gender (women) (std B 0.026, p < 0.001), insulin therapy (std B 0.3, p = 0.11), systolic blood pressure (std B 0.263, p = 0.02) and cardiovascular disease (std B 0.232, p = 0.035) predicted depression. Insulin therapy had a positive effect in cognitive restraint. (std B 0.32, p = 0.001). Age (std B 0.37, p = 0.003) and systolic blood pressure (std B 0.237, p = 0.048) predicted positively emotional eating (not previously published). 2^k factorial analyses proved additive interaction between complications and insulin therapy with depression. This study supports the relation between mood disorders and eating behaviors with demographic, physical, treatment, biochemical profiles and chronic comorbidities in T2D and the additive interaction between factors and mood disorders.     

A Meta-Analysis of an Implicit Measure of Personality Functioning: The Mutuality of Autonomy Scale

The Mutuality of Autonomy scale (MA) is a Rorschach variable designed to capture the degree to which individuals mentally represent self and other as mutually autonomous versus pathologically destructive (Urist, 1977). Discussions of the MA's validity found in articles and chapters usually claim good support, which we evaluated by a systematic review and meta-analysis of its construct validity. Overall, in a random effects analysis across 24 samples (N = 1,801) and 91 effect sizes, the MA scale was found to maintain a relationship of r =.20, 95% CI [.16,.25], with relevant validity criteria. We hypothesized that MA summary scores that aggregate more MA response-level data would maintain the strongest relationship with relevant validity criteria. Results supported this hypothesis (aggregated scoring method: r =.24, k = 57, S = 24; nonaggregated scoring methods: r =.15, k = 34, S = 10; p =.039, 2-tailed). Across 7 exploratory moderator analyses, only 1 (criterion method) produced significant results. Criteria derived from the Thematic Apperception Test produced smaller effects than clinician ratings, diagnostic differentiation, and self-attributed characteristics; criteria derived from observer reports produced smaller effects than clinician ratings and self-attributed characteristics. Implications of the study's findings are discussed in terms of both research and clinical work.     

Children living with violence within the family and its sequel: A meta-analysis from 1995–2006

Based on 37 articles published in international refereed journals between 1995 and 2006, this meta-analytical review attempted to study the sequel of children living with family violence. It specifically attempted to identify the overall effect size of family violence on children's adjustment outcomes. Moderators that exerted their effects on the relationship were also studied. The overall effect size generated from the 353 study-level effect sizes was rather small (Z_r = .201). Moderating analysis on study designs, sample sources, child developmental stages and gender did not show significant heterogeneity in effect sizes, while there was significant dispersion in effect sizes among different types of child adjustment outcomes. Results of this study are basically resonant with the meta-analyses of Kitzmann et al. [Kitzmann, K. M., Gaylord, N. K., Holt, A. R., & Kenny, E. D., (2003). Child witnesses to domestic violence: A meta-analytic review. Journal of Consulting and Clinical Psychology, 71, 339–352] and Wolfe et al. [Wolfe, D. A., Crooks, C. V., Lee, V., McIntyre-Smith, A., & Jaffe, P. G., (2003). The effects of children's exposure to domestic violence: A meta-analysis and critique. Clinical Child and Family Psychology Review, 6, 171–187], but add new information in that the report source of family violence was not a significant moderator, while that of child adjustment outcomes was.     

Comparing Child Outcomes of Physical Punishment and Alternative Disciplinary Tactics: A Meta-Analysis

This meta-analysis investigates differences between the effect sizes of physical punishment and alternative disciplinary tactics for child outcomes in 26 qualifying studies. Analyzing differences in effect sizes reduces systematic biases and emphasizes direct comparisons between the disciplinary tactics that parents have to select among. The results indicated that effect sizes significantly favored conditional spanking over 10 of 13 alternative disciplinary tactics for reducing child noncompliance or antisocial behavior. Customary physical punishment yielded effect sizes equal to alternative tactics, except for one large study favoring physical punishment. Only overly severe or predominant use of physical punishment compared unfavorably with alternative disciplinary tactics. The discussion highlights the need for better discriminations between effective and counterproductive use of disciplinary punishment in general.     

Personality and physical activity: A systematic review and meta-analysis

Whether personality determines physical activity or its outcomes is relevant for theory and public health but has been understudied. We estimated the population correlations between Big-Five personality factors and physical activity and examined whether they varied according to sample characteristics and study features. Database searches were conducted according to PRISMA guidelines, for articles published in the English language prior to November 1st, 2013. Sixty-four studies including a total of 88,400 participants yielded effects (k) for Extraversion (88), Neuroticism (82), Conscientiousness (69), Openness (51) and Agreeableness (52). Significant mean r was found for Extraversion (r = .1076), Neuroticism (r = −.0710), Conscientiousness (r = .1037) and Openness (r = .0344), but not Agreeableness (r = .0020). Effects were moderately heterogeneous (I² range = 44–65%) and varied by sample characteristics (e.g., age, gender, or clinical status) and/or study features (e.g., measure quality or item format). This analysis expands results of previous reviews and provides new support for a relationship between physical activity and Openness. Future studies should use better measures of physical activity and prospective designs, adjust for statistical artifacts, and consider advances in the conceptualization of personality.     

Problem Behavior in Children of Chronically Ill Parents: A Meta-Analysis

The aim of this meta-analysis is to examine whether children of chronically ill parents differ from norm groups in problem behavior. We report moderator effects and overall effect sizes for internalizing, externalizing and total problem behavior assessed by children and parents. In fixed effect models, we found a significant overall effect size for internalizing problem behavior (number of studies k = 19, total sample size N = 1,858, Cohen’s d = .23, p < .01) and externalizing problem behavior (k = 13, N = 1,525, d = .09, p < .01) but not for total problem behavior (k = 7; N = 896). Effects for internalizing and externalizing problem behavior were larger in non-cancer studies, in samples including younger children and younger ill parents, in samples defined by low average SES and in studies including parents with longer illness duration. In addition, effects for externalizing problem behavior were larger in studies characterized by a higher percentage of ill mothers and single parents. With exclusive self-report, effect sizes were significant for all problem behaviors. Based on these results, a family-centered approach in health care is recommended.     

Social identification and depression: A meta-analysis

A meta-analysis of 76 studies (N = 31,016) examined the relationship between social identification and depression. Overall, individuals who identify highly with a group tend to report less depression (average r_z = −.15). However, a large amount of variability between studies was observed. The 95% prediction interval, which indicates the true effect size that can be expected in future research, ranged from r_z = −.50 to .19. The relationship between depression and social identification is more complex than previously assumed. Some variability is related to the social identification measure used. Studies that focused on identification with interactive groups (r_z = −.28) had larger effect sizes than studies that focused on social categories (r_z = −.11). Moreover, studies of non-stigmatized groups (r_z = −.24) had larger effect sizes than studies of stigmatized groups (r_z = −.10). In conclusion, the structure and social identity content of groups appear to play an important role in the relationship between depression and social identification.     

The Association of Cognitive Ability with Right‐wing Ideological Attitudes and Prejudice: A Meta‐analytic Review

The cognitive functioning of individuals with stronger endorsement of right‐wing and prejudiced attitudes has elicited much scholarly interest. Whereas many studies investigated cognitive styles, less attention has been directed towards cognitive ability. Studies investigating the latter topic generally reveal lower cognitive ability to be associated with stronger endorsement of right‐wing ideological attitudes and greater prejudice. However, this relationship has remained widely unrecognized in literature. The present meta‐analyses revealed an average effect size of r = ?.20 [95% confidence interval (95% CI) [?0.23, ?0.17]; based on 67 studies, N = 84 017] for the relationship between cognitive ability and right‐wing ideological attitudes and an average effect size of r = ?.19 (95% CI [?0.23, ?0.16]; based on 23 studies, N = 27 011) for the relationship between cognitive ability and prejudice. Effect sizes did not vary significantly across different cognitive abilities and sample characteristics. The effect strongly depended on the measure used for ideological attitudes and prejudice, with the strongest effect sizes for authoritarianism and ethnocentrism. We conclude that cognitive ability is an important factor in the genesis of ideological attitudes and prejudice and thus should become more central in theorizing and model building. Copyright © 2015 European Association of Personality Psychology     

Randomized controlled trial evaluating the effectiveness of a web-based stress management program among community college students

Background and Objectives: This study evaluated the effectiveness of a web-based stress management program among community college students that focused on increasing perceived control over stressful events. Design: Students (N = 257) were randomly assigned to a Present Control Intervention or a Stress-information only comparison group. Methods: Primary outcomes were perceived stress and stress symptoms; secondary outcomes were depression and anxiety. Self-report measures were completed online at preintervention, postintervention, and three-week follow-up. Intervention effects were estimated using linear mixed models. Seventy-five percent of the sample (n = 194) completed the pretest and comprised the intent-to-treat sample. Results: Participants in the intervention group reported significant increases in present control, and significant decreases in all four primary and secondary outcome measures from baseline to postintervention and follow-up. Within-group effect sizes were small to medium at postintervention (mean d = –.34) and follow-up (mean d = –.49). The mean between-group effect size on the four outcome measures was d = .35 at postintervention but d = .12 at follow-up, due to unexpected decreases in distress in the comparison group. Conclusions: Our online program is a cost-effective mental health program for college students. Limitations and future direction are discussed.     

Orchiectomy in transgender individuals: A motivation analysis and report of surgical outcomes

Abstract

Background: Different surgical procedures are available for transgender women wishing to undergo genital gender-affirming surgery.

Aim: To assess preoperative motivations, the frequency of orchiectomy procedures, and postoperative outcomes of orchiectomy in transgender individuals.

Methods: All transgender individuals who underwent orchiectomy in the period between January 2012 and January 2020 at our institution were retrospectively identified. A chart study was conducted, recording motivations, demographics, perioperative characteristics and surgical outcomes. The frequency of orchiectomy and vaginoplasty procedures during the study period were determined and compared.

Results: During the study period, an increase of performed orchiectomy procedures was observed. The orchiectomy/vaginoplasty ratio was 0.01–0.07 in the period 2012–2018 and 0.24 in 2019. A total of 43 transgender individuals were retrospectively identified. Sixteen (37%) initially wished to undergo a vaginoplasty, but did not meet institutional requirements (nonsmoker, BMI < 30kg/m²) or were not eligible for vaginoplasty surgery because of interfering somatic or mental health issues. Fourteen (33%) individuals who underwent orchiectomy regarded it as a preceding step to a future vaginoplasty procedure. Out of these fourteen, one person is now on the waiting list for vaginoplasty surgery. Thirteen (30%) others did not report a desire to pursue vaginoplasty in the future. This was mostly motivated by the absence of genital dysphoria or motivations related to their gender identity, with a desire to discontinue anti-testosterone treatment. The postoperative course was uncomplicated in 39 (91%) individuals.

Conclusion: In the Netherlands, especially in the last year, the frequency of orchiectomy procedures has increased. Reasons that people chose to undergo this procedure include: not being eligible for a vaginoplasty procedure, seeing it as a preceding step to a possible future vaginoplasty or other identity-related motivations (i.e., non-binary gender identification or absence of genital dysphoria).     

Childhood Physical Abuse and Sociopathy: Is This Link Magnified among Firstborn Children?

The Psychopathic Deviate scale of the Minnesota Multiphasic Personality Inventory–2 (MMPI–2) provides a valid psychometric index of sociopathic tendencies in both clinical and nonclinical samples. Childhood physical abuse has provided a robust predictor of sociopathic penchants. The link between childhood physical abuse and MMPI–2 Psychopathic Deviate scores was examined (N = 322) as a function of birth order. A significant childhood physical abuse by birth order interaction was found (p < .0001, η² = .62) with a 6-fold increase in relative risk of a Psychopathic Deviate elevation (T > 70) found for firstborn participants. Childhood physical abuse predicted Psychopathic Deviate scores for firstborn (r = .50, p < .0001, d = 1.15) and middle-born (r = .24, p = .006, d = .49) offspring. Harris–Lingoes subscale scores suggested firstborns felt selectively alienated from self and others in response to childhood physical abuse experiences.     

Clinical and functional correlates of processing speed in pediatric Attention-Deficit/Hyperactivity Disorder: a systematic review and meta-analysis

It is well established that processing speed is negatively impacted in children and adolescents with Attention-Deficit/Hyperactivity Disorder (ADHD). Unfortunately, exactly how processing speed vulnerabilities manifest in daily functioning has not been well established. To support clinical care of youth with ADHD, it is important to better understand the functional consequences and relevant outcomes associated with processing speed deficits. This systematic review and meta-analysis sought to identify the association between processing speed and clinical or functional correlates among children or adolescents diagnosed with ADHD. A total of 409 abstracts were screened, of which, 60 full-text articles were identified as potentially relevant, and 8 of these studies met inclusion criteria. Domains evaluated across these studies included reading skills, mathematics skills, written expression, anxiety, self-appraisals of competence, and adaptive functioning. Six studies reported an association between processing speed and reading skills, allowing for meta-analysis. Processing speed difficulties among youth with ADHD appear strongly associated with several clinical and functional correlates including weaker academic skills, poorer adaptive skills, increased self-reported anxiety, and overestimates of social competence. Meta-analytic results for studies reporting the association between processing speed and reading skills indicate a medium overall weighted mean effect size (r = 0.33, 95% CI = 0.28 –0.39) with minimal heterogeneity (I² = 0.17). Clinical implications of these findings, limitations in the current knowledge base, and suggestions for future research are discussed.     

Motivational climate interventions in physical education: A meta-analysis

Objective

The purpose of this study was to synthesize findings from motivational climate interventions employing [Ames, 1992a] and [Ames, 1992b] and [Epstein, 1988] and [Epstein, 1989] TARGET framework within school-based physical education contexts.

Design

The present study employed a quantitative research synthesis design. Meta-analysis uses empirical studies to summarize past research by drawing overall conclusions from separate investigations. This research design highlights important and unsolved issues related to motivational climate interventions within physical education.

Methods

Standard meta-analytic procedures incorporating inclusion and exclusion criteria, literature search, coding procedures, and statistical methods were used to identify and synthesize 22 studies with 24 independent samples. Cohen’s (1988) criteria for effect sizes were used to interpret and evaluate results.

Results

There was an overall small positive treatment effect (g = 0.103) for groups exposed to mastery motivational climates. Outcome analyses identified the most consistent and largest overall treatment effects for behavioral outcomes (g = 0.39–0.49) followed by affective outcomes (g = −0.27 to 0.59) and cognitive outcomes (g = −0.25 to 0.32). Moderator analyses were directed by study heterogeneity and identified several trends in intervention features and study features with the most substantial trend for participant features as elementary students had the largest overall treatment effect (g = 0.41).

Conclusions

Outcome and moderator analyses identified several trends in methodological features, participant features, and study features that should be addressed in future physical education motivational climate interventions.     

Incongruence as an explanation for the negative mental health effects of unemployment: Meta‐analytic evidence

The present paper is concerned with the effects of incongruence between a person's level of employment commitment (measured with scales of work involvement, Protestant work ethic or similar concepts) and his or her current employment situation (employed or not employed). We hypothesize that this kind of incongruence (a) is a typical characteristic of the unemployment situation and (b) is systematically associated with diminished well‐being and mental health. Meta‐analyses of empirical data endorse both hypotheses. (a) Employed people show only marginally stronger levels of employment commitment than unemployed people (d = 0.11, equivalent to r = .05). Both groups are characterized by high mean levels of employment commitment. Therefore, unemployed people are in an incongruent situation, while employed people are not. (b) Incongruent levels of employment commitment, that is, high levels among the unemployed and low levels among the employed, are significantly associated with psychological distress (mixed symptoms of distress: r = .19; depression: r = .19; anxiety: r = .14; subjective well‐being/life satisfaction: r = .13; self‐esteem: r = .08). In sum, available cross‐sectional data clearly endorse the incongruence model. Meta‐analyses of longitudinal data, although based on small sample sizes, are also consistent with the model.     

CIT in small municipalities: Officer‐level outcomes

Research on the Crisis Intervention Team (CIT) as a method to deal with mental illness in policing encounters has primarily focused on officers from large urban areas. The current study examined officer‐level outcomes in a non‐urban geographical setting using a pre/post‐CIT training design. The sample included 46 police officers from seven departments that would be considered rural and 13 that would be classified as suburban. Officers completed scales to gauge change in mental illness attitudes at the beginning and end of their one‐week CIT training. CIT training resulted in reductions in stigmatic attitudes with seven large effect sizes (ranging from η² = .24 to .59) across the two measures. The findings from this research are a direct response to the call for greater diversity in the size of police settings in the CIT literature and serve to expand the empirical base for CIT in relation to officer‐level outcomes.     

The role of anxiety sensitivity in the relationship between posttraumatic stress symptoms and negative outcomes in trauma-exposed adults

Background: The development of posttraumatic stress symptoms (PTSs) following a trauma is related to impairment, diminished quality of life, and physical health issues. Yet it is not clear why some trauma-exposed individuals experience negative outcomes while others do not. The purpose of this study was to determine the role of several influential factors related to PTS severity and negative outcomes. Methods: One hundred and twenty-two trauma-exposed adults were administered the following self-report measures: the Posttraumatic Stress Disorder Checklist-Civilian, the Trauma History Questionnaire-Short, the Anxiety Sensitivity Index-3, Depression and Anxiety Stress Scale 21, Sheehan Disability Scale, World Health Organization Quality of Life-BREF, and an abbreviated Patient Health Questionnaire. Primary Results: PTS severity was positively correlated with depressive symptom severity (r = 0.54, p < 0.001), chronicity of the most distressing trauma (r = 0.21, p = 0.017), and number of traumas (r = 0.22, p = 0.012). Main effects were found for PTS severity (β = ?0.38, p < 0.01) and anxiety sensitivity (AS; β = ?0.39, p < 0.01) on quality of life. No interaction was found between PTS severity and AS with any negative outcome. PTS severity mediated the relationship between AS and physical health issues (0.05; 95% CI: 0.02–0.08). Conclusion: This study helps clarify the role of various factors in the relationship between trauma and negative outcomes. Clinical and research implications are discussed.