Meta‐Analysis: A Systematic Method for Synthesizing Counseling Research

The authors provide a template for counseling researchers who are interested in quantitatively aggregating research findings. Meta‐analytic studies can provide relevant information to the counseling field by systematically synthesizing studies performed by researchers from diverse fields. Methodologically sound meta‐analyses require careful planning, diligent literature searches, detailed coding of study information, and knowledge of meta‐analytic approaches to statistical analyses. The authors provide steps to guide counseling researchers in conducting meta‐analytic reviews.     

Whose idea is it anyway? The importance of reputation in acknowledgement

Six‐year‐old children negatively evaluate plagiarizers just as adults do (Olson & Shaw, 2011), but why do they dislike plagiarizers? Children may think plagiarism is wrong because plagiarizing negatively impacts other people's reputations. We investigated this possibility by having 6‐ to 9‐year‐old children evaluate people who shared their own or other people's ideas (stories). In Experiment 1, we found that children consider it acceptable to retell someone else's story if the source is given credit for their story (improving the source's reputation), but not if the reteller claims credit for the story (steals credit away from someone else). Experiments 2 and 3 showed that children do not consider it bad to lie by giving someone else credit for one's own good story (improving someone else's reputation), but do consider it bad to give someone else credit for one's own bad story (improving one's own reputation at the expense of someone else's). Experiment 4 demonstrated that children think it is equally bad to take credit for someone else's idea for oneself as it is to take someone else's idea and give credit to someone else, suggesting that children dislike when others take credit away from someone else, regardless of whether or not it improves the plagiarizer's reputation. Our results suggest that children dislike plagiarism because it negatively affects others' reputations by taking credit away from them.     

Partner's understanding of affective–cognitive meta‐bases predicts relationship quality

Knowledge that partners have about each other's attitudes are consequential for relationship quality. This article extends prior research and examines whether knowledge regarding a partner's meta‐attitudinal bases, or subjective perceptions of how one's attitudes are driven, can influence relationship quality. Given how meta‐bases are reflective of information‐processing goals, we hypothesized that partner understanding of meta‐attitudinal bases would positively predict relationship quality. Self and partner ratings of how relationally relevant attitudes were driven, as well as perceptions of relationship quality, were assessed. Results revealed that a partner's knowledge of one's meta‐bases positively predicts one's own reported relationship quality. Results remained significant when controlling for relationship duration and meta‐bases similarity. Implications of meta‐bases understanding for close relationship functioning are discussed.     

Rater training revisited: An updated meta‐analytic review of frame‐of‐reference training

The present study updates Woehr and Huffcutt's (1994) rater training meta‐analysis and demonstrates that frame‐of‐reference (FOR) training is an effective method of improving rating accuracy. The current meta‐analysis includes over four times as many studies as included in the Woehr and Huffcutt meta‐analysis and also provides a snapshot of current rater training studies. The present meta‐analysis also extends the previous meta‐analysis by showing that not all operationalizations of accuracy are equally improved by FOR training; Borman's differential accuracy appears to be the most improved by FOR training, along with behavioural accuracy, which provides a snapshot into the cognitive processes of the raters. We also investigate the extent to which FOR training protocols differ, the implications of protocol differences, and if the criteria of interest to FOR researchers have changed over time.     

The statistical recommendations of the American Psychological Association Publication Manual: Effect sizes,confidence intervals,and meta‐analysis

Estimation based on effect sizes, confidence intervals, and meta‐analysis usually provides a more informative analysis of empirical results than does statistical significance testing, which has long been the conventional choice in psychology. The sixth edition of the American Psychological Association Publication Manual now recommends that psychologists should, wherever possible, use estimation and base their interpretation of research results on point and interval estimates. We outline the Manual's recommendations and suggest how they can be put into practice: adopt an estimation framework, starting with the formulation of research aims as ‘How much?’ or ‘To what extent?’ questions. Calculate from your data effect size estimates and confidence intervals to answer those questions, then interpret. Wherever appropriate, use meta‐analysis to integrate evidence over studies. The Manual's recommendations can assist psychologists improve they way they do their statistics and help build a more quantitative and cumulative discipline.     

Preliminary Evidence for the Effectiveness of Dialectical Behavior Therapy for Adolescents

This meta‐analysis evaluated the effectiveness of dialectical behavior therapy for adolescents in reducing symptoms of depression, anxiety, self‐injury, and suicide risk. Twelve between‐group studies (N = 834) were chosen that met the inclusion criteria. Results revealed small‐to‐medium Hedges's g effect sizes for all 4 symptoms compared with control and alternative treatment groups. However, the small number of effect sizes available for each analysis limited the generalizability of the findings. Implications and suggestions for future research are discussed.     

How to do a meta‐analysis

Meta‐analysis is a statistical tool for estimating the mean and variance of underlying population effects from a collection of empirical studies addressing ostensibly the same research question. Meta‐analysis has become an increasing popular and valuable tool in psychological research, and major review articles typically employ these methods. This article describes the process of conducting meta‐analysis: selecting articles, developing inclusion criteria, calculating effect sizes, conducting the actual analysis (including information on how to do the analysis on popular computer packages such as IBM SPSS and R) and estimating the effects of publication bias. Guidance is also given on how to write up a meta‐analysis.     

Surveying the forest: A meta‐analysis,moderator investigation,and future‐oriented discussion of the antecedents of voluntary employee turnover

Recent narrative reviews (e.g., Hom, Mitchell, Lee, and Griffeth, 2012; Hom, Lee, Shaw, and Hausknecht, 2017) advise that it is timely to assess the progress made in research on voluntary employee turnover so as to guide future work. To provide this assessment, we employed a three‐step approach. First, we conducted a comprehensive meta‐analysis of turnover predictors, updating existing effect sizes and examining multiple new antecedents. Second, guided by theory, we developed and tested a set of substantive moderators, considering factors that might exacerbate or mitigate zero‐order meta‐analytic effects. Third, we examined the holistic pattern of results in order to highlight the most pressing needs for future turnover research. The results of Step 1 reveal multiple newer predictors and updated effect sizes of more traditional predictors, which have received substantially greater study. The results of Step 2 provide insight into the context‐dependent nature of many antecedent–turnover relationships. In Step 3, our discussion takes a bird's‐eye view of the turnover “forest” and considers the theoretical and practical implications of the results. We offer several research recommendations that break from the traditional turnover paradigm, as a means of guiding future study.     

Meta‐stereotypes,Social Image and Help Seeking: Dependency‐Related Meta‐stereotypes Reduce Help‐Seeking Behaviour

People who need help can be reluctant to seek it. This can be due to social image concerns. Here, we investigate if these concerns may be prompted by a salient negative meta‐stereotype: the belief that one's group is judged negatively by another group. Specifically, we researched group members' help‐seeking behaviour in the context of a dependency‐related meta‐stereotype. In a two‐condition study (N = 45), we manipulated participants' belief that their national group was judged dependent by a significant out‐group. We then examined their subsequent help‐seeking behaviour on a real‐world task. Participants whose social identity as a group member was salient showed greater reluctance to seek help when the meta‐stereotype was made prominent compared with when it was not. This suggests that, in a context where social image and social identity concerns are relevant, group members are willing to sacrifice the possibility of accessing needed help in order to avoid confirming a negative stereotype of their group. The implications of these results for helping transactions and community development are discussed. Copyright © 2012 John Wiley & Sons, Ltd.     

A meta‐analysis of the effects of speakers' accents on interpersonal evaluations

This paper reports a meta‐analysis of the empirical literature on the effects of speakers' accents on interpersonal evaluations. Our review of the published literature uncovered 20 studies that have compared the effects of standard accents (i.e., the accepted accent of the majority population) versus non‐standard accents (i.e., accents that are considered foreign or spoken by minorities) on evaluations about the speakers. These 20 studies yielded 116 independent effect sizes on an array of characteristics that were selected by the original researchers. We classified each of the characteristics as belonging to one of three domains that have been traditionally discussed in this area, namely status (e.g., intelligence, social class), solidarity (trustworthiness, in‐group–out‐group member), and dynamism (level of activity and liveliness). The effect was particularly strong when American Network accented speakers were compared with non–standard‐accented speakers. These results underscore prior research showing that speakers' accents have powerful effects on how others perceive them. These and other results are discussed in the context of the literature along with implications for future research in this area. Copyright © 2011 John Wiley & Sons, Ltd.     

A closer look at the discrimination outcomes in the IAT literature

To what extent the IAT (Implicit Association Test, Greenwald et al., 1998) predicts racial and ethnic discrimination is a heavily debated issue. The latest meta‐analysis by Oswald et al. (2013) suggests a very weak association. In the present meta‐analysis, we switched the focus from the predictor to the criterion, by taking a closer look at the discrimination outcomes. We discovered that many of these outcomes were not actually operationalizations of discrimination, but rather of other related, but distinct, concepts, such as brain activity and voting preferences. When we meta‐analyzed the main effects of discrimination among the remaining discrimination outcomes, the overall effect was close to zero and highly inconsistent across studies. Taken together, it is doubtful whether the amalgamation of these outcomes is relevant criteria for assessing the IAT's predictive validity of discrimination. Accordingly, there is also little evidence that the IAT can meaningfully predict discrimination, and we thus strongly caution against any practical applications of the IAT that rest on this assumption. However, provided that the application is thoroughly informed by the current state of the literature, we believe the IAT can still be a useful tool for researchers, educators, managers, and students who are interested in attitudes, prejudices, stereotypes, and discrimination.     

Disorganized infant attachment and preventive interventions: A review and meta‐analysis

Infant disorganized attachment is a major risk factor for problematic stress management and later problem behavior. Can the emergence of attachment disorganization be prevented? The current narrative review and quantitative meta‐analysis involves 15 preventive interventions (N = 842) that included infant disorganized attachment as an outcome measure. The effectiveness of the interventions ranged from negative to positive, with an overall effect size of d = 0.05 (ns). Effective interventions started after 6 months of the infant's age (d = 0.23). Interventions that focused on sensitivity only were significantly more effective in reducing attachment disorganization (d = 0.24) than interventions that (also) focused on support and parent's mental representations (d = ?0.04). Most sample characteristics were not associated with differences in effect sizes, but studies with children at risk were more successful (d = 0.29) than studies with at‐risk parents (d = ?0.10), and studies on samples with higher percentages of disorganized attachment in the control groups were more effective (d = 0.31) than studies with lower percentages of disorganized children in the control group (d = ?0.18). The meta‐analysis shows that disorganized attachments may change as a side effect of sensitivity‐focused interventions, but it also illustrates the need for interventions specifically focusing on the prevention of disorganization.     

Death Goes to the Polls: A Meta‐Analysis of Mortality Salience Effects on Political Attitudes

Terror management theory posits that people are motivated to affirm cultural meaning systems, including political ideologies, to avoid the awareness of mortality. Accordingly, studies show that increasing mortality salience (MS) intensifies people's attitudes toward political issues and figures. However, whereas in some studies MS increases affirmation of preexisting political ideologies, be they liberal or conservative (supporting a “worldview‐defense hypothesis”), in other studies MS elicits a general shift toward conservatism, regardless of preexisting ideology (supporting a “conservative‐shift hypothesis”). The current study used meta‐analysis to assess the overall magnitude of MS effects on explicitly political attitudes and to clarify the nature of these effects by comparing effect sizes for these competing hypotheses. The overall effect of MS on political attitudes was large (r = .50). The effects of MS‐induced worldview defense (r = .35) and conservative shifting (r = .22) were significant and statistically equivalent. We discuss the conditions (e.g., contextual salience of political values) under which conservative shifting or worldview defense occurs.     

Can Computer‐Mediated Interventions Change Theoretical Mediators of Safer Sex? A Meta‐Analysis

The purpose of this study was to conduct a meta‐analysis of computer‐mediated interventions (CMIs) aimed at changing theoretical mediators of safer sex. Meta‐analytic aggregation of effect sizes from k = 20 studies indicated that CMIs significantly improved HIV/AIDS knowledge, d = .276, p < .001, k = 15, N = 6,625; sexual/condom attitudes, d = .161, p < .001, k = 12, N = 5,816; and condom self‐efficacy, d = .186, p < .001, k = 10, N = 3,308. Although assessed in fewer studies, CMIs also significantly increased perceived susceptibility, condom communication, and condom intentions. Effect sizes were found to be of similar magnitude to human‐delivered interventions. Exploratory analysis of moderating influences detected few significant variables. Implications for the development and testing of CMIs are discussed.     

Learning by Preparing‐to‐Teach and Teaching: A Meta‐Analysis

The present research meta‐analytically examined the effects of preparing‐to‐teach and subsequent teaching (relative to mere studying without teaching expectancy) on the acquisition of domain knowledge. The synthesis of 28 studies indicated that the estimated effect sizes (Hedges' gs) were 0.35 for preparing‐to‐teach and 0.56 for teaching with preparing‐to‐teach. Both preparing‐to‐teach and teaching with preparing‐to‐teach were effective in promoting deep learning (as well as surface learning) and even after a delay. The learning benefits of teaching with preparing‐to‐teach were larger when students expected and engaged in an interactive teaching activity than when they expected and engaged in a non‐interactive teaching activity. The mere expectation of interactive teaching also produced larger learning effects than the expectation of non‐interactive teaching. These results suggest that preparing‐to‐teach and teaching, interactive teaching after preparing to do so in particular, are useful for enhancing learning.     

Can We Be Self‐Deceived about What We Believe? Self‐Knowledge,Self‐Deception,and Rational Agency

Abstract: This paper considers the question of whether it is possible to be mistaken about the content of our first‐order intentional states. For proponents of the rational agency model of self‐knowledge, such failures might seem very difficult to explain. On this model, the authority of self‐knowledge is not based on inference from evidence, but rather originates in our capacity, as rational agents, to shape our beliefs and other intentional states. To believe that one believes that p, on this view, constitutes one's belief that p and so self‐knowledge involves a constitutive relation between first‐ and second‐order beliefs. If this is true, it is hard to see how those second‐order beliefs could ever be false. I develop two counter‐examples which show that despite the constitutive relation between first‐ and second‐order beliefs in standard cases of self‐knowledge, it is possible to be mistaken, and even self‐deceived, about the content of one's own beliefs. These counter‐examples do not show that the rational agency model is mistaken—rather, they show that the possibility of estrangement from one's own mental life means that, even within the rational agency model, it is possible to have false second‐order beliefs about the content of one's first‐order beliefs. The authority of self‐knowledge does not entail that to believe that one believes that p suffices to make it the case that one believes that p.     

Which preventive interventions effectively enhance depressed mothers' sensitivity? A meta‐analysis

Improving depressed mothers' sensitivity is assumed to be a key element in preventing adverse outcomes for children of such mothers. This meta‐analysis examines the short‐term effectiveness of preventive interventions in terms of enhancing depressed mothers' sensitivity toward their child and investigates what type of intervention is most effective. Thirteen interventions, reported in 10 controlled outcome studies, met the inclusion criteria (N = 918). Meta‐analytic results showed a small to medium, significant mean effect size (g = 0.32) with large variation in individual effect sizes (?0.56–1.76). Interventions including baby massage were highly effective in improving maternal sensitivity (g = 0.85). In contrast, individual therapy for the mother proved ineffective in terms of improving maternal sensitivity (g = ?0.00). Two other significant predictors of greater effect sizes were the inclusion of a support group and the use of a higher number of intervention methods; however, the significance of these results was largely accounted for by one single study. Our meta‐analysis confirms that depressed mothers' sensitivity can be improved by preventive intervention and suggests that baby massage may be an effective intervention method to evoke short‐term changes in maternal sensitivity. It is unclear whether these changes are maintained over time.     

Reactive Aggression and Suicide‐Related Behaviors in Children and Adolescents: A Review and Preliminary Meta‐Analysis

The empirical literature on the association between reactive aggression and suicide‐related behaviors in children and adolescents was reviewed. A narrative review of seven studies that met inclusion/exclusion criteria is followed by a preliminary meta‐analysis to provide insight into the strength of the association between reactive aggression and suicide‐related behaviors. Each of the seven studies reported a statistically significant association between reactive aggression and suicide‐related behaviors, including suicide, nonfatal suicide attempt, and suicide ideation. Results from the meta‐analysis indicated a consistent, medium‐sized association (k  = 7; N  = 4,693; rbar = .25). The narrative review and results of the preliminary meta‐analysis support the promise of pursuing future research on reactive aggression and suicide‐related behaviors in children and adolescents. A theoretical model is proposed to guide the development of future research.     

Clinical research on behavioral activation as treatment for post‐traumatic stress disorder: A brief review and meta‐analysis

Behavioral activation (BA), an effective treatment for depression, has recently been receiving attention as a possible intervention for PTSD. BA interventions could be particularly useful in treating underserved populations (i.e., individuals with lower socioeconomic status). A literature search was conducted, which identified seven outcome studies that examined the effectiveness of stand‐alone BA treatment for individuals with PTSD. All studies identified for this brief review demonstrated clinically significant reductions in PTSD symptoms using BA as an intervention. A meta‐analysis of these few studies revealed a nonsignificant effect (Cohen's d = 0.713, p = .512) despite reporting an average symptom reduction of 25.8%. Other studies utilizing BA treatment for PTSD do so in tandem with other interventions and were excluded from analysis. This brief review summarizes the literature on the use of BA as a stand‐alone treatment for PTSD and suggests that future research seek to confirm the usefulness of BA as a potential treatment modality for mental health‐care providers treating individuals with PTSD.