Allowing for correlations between correlations in random-effects meta-analysis of correlation matrices

Practical meta-analysis of correlation matrices generally ignores covariances (and hence correlations) between correlation estimates. The authors consider various methods for allowing for covariances, including generalized least squares, maximum marginal likelihood, and Bayesian approaches, illustrated using a 6-dimensional response in a series of psychological studies concerning prediction of exercise behavior change. Quantities of interest include the overall population mean correlation matrix, the contrast between the mean correlations, the predicted correlation matrix in a new study, and the conflict between the existing studies and a new correlation matrix. The authors conclude that accounting for correlations between correlations is unnecessary when interested in individual correlations but potentially important if concerned with a composite measure involving 2 or more correlations. A simulation study indicates the asymptotic normal assumption appears reasonable. Because of potential instability in the generalized least squares methods, they recommend a model-based approach, either the maximum marginal likelihood approach or a full Bayesian analysis.     

Reasonableness,bias, and the untapped power of procedure

I am grateful to Jeffrey Blustein, Dan Boone, and Michael Stocker for helpful comments. Special thanks to Catherine Elgin, particularly for her comments on Sections 5 and 8.1. This article was written under a fellowship from the National Endowment for the Humanities, to whom I extend my gratitude.     

A meta-analysis of empirical studies of weight-based bias in the workplace

For nearly 30 years researchers have investigated how bodyweight affects evaluative workplace outcomes, such as hiring decisions and performance appraisals. Despite this, no meta-analytic review has been undertaken to quantify the negative impact that bodyweight has on such outcomes. The results of this meta-analytic study suggest that in relation to non-overweight individuals in the workplace, overweight individuals may be disadvantaged across evaluative workplace outcomes (d = −.52). Further, differences in magnitude of the effects of weight-based bias were found for hiring (d = −.70) and performance (d = −.23) outcomes.     

Publication bias in psychological science: prevalence, methods for identifying and controlling, and implications for the use of meta-analyses

The issue of publication bias in psychological science is one that has remained difficult to address despite decades of discussion and debate. The current article examines a sample of 91 recent meta-analyses published in American Psychological Association and Association for Psychological Science journals and the methods used in these analyses to identify and control for publication bias. Of the 91 studies analyzed, 64 (70%) made some effort to analyze publication bias, and 26 (41%) reported finding evidence of bias. Approaches to controlling publication bias were heterogeneous among studies. Of these studies, 57 (63%) attempted to find unpublished studies to control for publication bias. Nonetheless, those studies that included unpublished studies were just as likely to find evidence for publication bias as those that did not. Furthermore, authors of meta-analyses themselves were overrepresented in unpublished studies acquired, as compared with published studies, suggesting that searches for unpublished studies may increase rather than decrease some sources of bias. A subset of 48 meta-analyses for which study sample sizes and effect sizes were available was further analyzed with a conservative and newly developed tandem procedure of assessing publication bias. Results indicated that publication bias was worrisome in about 25% of meta-analyses. Meta-analyses that included unpublished studies were more likely to show bias than those that did not, likely due to selection bias in unpublished literature searches. Sources of publication bias and implications for the use of meta-analysis are discussed.     

On the power of the test for cluster bias

Cluster bias refers to measurement bias with respect to the clustering variable in multilevel data. The absence of cluster bias implies absence of bias with respect to any cluster‐level (level 2) variable. The variables that possibly cause the bias do not have to be measured to test for cluster bias. Therefore, the test for cluster bias serves as a global test of measurement bias with respect to any level 2 variable. However, the validity of the global test depends on the Type I and Type II error rates of the test. We compare the performance of the test for cluster bias with the restricted factor analysis (RFA) test, which can be used if the variable that leads to measurement bias is measured. It appeared that the RFA test has considerably more power than the test for cluster bias. However, the false positive rates of the test for cluster bias were generally around the expected values, while the RFA test showed unacceptably high false positive rates in some conditions. We conclude that if no significant cluster bias is found, still significant bias with respect to a level 2 violator can be detected with an RFA model. Although the test for cluster bias is less powerful, an advantage of the test is that the cause of the bias does not need to be measured, or even known.     

Scientific activities of the associazione di studi psicoanalitici (ASP) (Milan) for the years 1995 and 1996

This paper discusses Freud's "Oedipus complex" both in its elaboration of the "u¨ber-ich" and from a broader point of view, which relates to the development of man's moral sense. It is a disturbing experience to watch the continuous twilight of the function of the father, either as the head of the family or as the belief in a God or in a Truth that establishes a well-defined morality. At the same time, the function of the father as Lawgiver is supplanted by the function of money as the only value and the measure of all things. Since Freud's days, the field of morality has been increasingly invaded by the discourse of experts and administrators who determine Good and Evil with the intention of reaching a maximization of the profits and a more complete domination of our bodies. This paper questions the actual validity of the Oedipus complex as the organizer of modern man's sense of morality through its provocative title: "do we still have anything to do with the old blind man?"     

Evaluation of publication bias in response interruption and redirection: A meta-analysis

Publication bias is the disproportionate representation of studies with large effects and statistically significant findings in the published research literature. If publication bias occurs in single-case research design studies on applied behavior-analytic (ABA) interventions, it can result in inflated estimates of ABA intervention effects. We conducted an empirical evaluation of publication bias on an evidence-based ABA intervention for children diagnosed with autism spectrum disorder, response interruption and redirection (RIRD). We determined effect size estimates for published and unpublished studies using 3 metrics, percentage of nonoverlapping data (PND), Hedges' g, and log response ratios (LRR). Omnibus effect size estimates across all 3 metrics were positive, supporting that RIRD is an effective treatment for reducing problem behavior maintained by nonsocial consequences. We observed larger PND for published compared to unpublished studies, small and nonsignificant differences in LRR for published compared to unpublished studies, and significant differences in Hedges' g for published compared to unpublished studies, with published studies showing slightly larger effect. We found little, if any, difference in methodological quality between published and unpublished studies. While RIRD appears to be an effective intervention for challenging behavior maintained by nonsocial consequences, our results reflect some degree of publication bias present in the RIRD research literature.     

Fisher transformation based confidence intervals of correlations in fixed- and random-effects meta-analysis

Meta-analyses of correlation coefficients are an important technique to integrate results from many cross-sectional and longitudinal research designs. Uncertainty in pooled estimates is typically assessed with the help of confidence intervals, which can double as hypothesis tests for two-sided hypotheses about the underlying correlation. A standard approach to construct confidence intervals for the main effect is the Hedges-Olkin-Vevea Fisher-z (HOVz) approach, which is based on the Fisher-z transformation. Results from previous studies (Field, 2005, Psychol. Meth., 10, 444; Hafdahl and Williams, 2009, Psychol. Meth., 14, 24), however, indicate that in random-effects models the performance of the HOVz confidence interval can be unsatisfactory. To this end, we propose improvements of the HOVz approach, which are based on enhanced variance estimators for the main effect estimate. In order to study the coverage of the new confidence intervals in both fixed- and random-effects meta-analysis models, we perform an extensive simulation study, comparing them to established approaches. Data were generated via a truncated normal and beta distribution model. The results show that our newly proposed confidence intervals based on a Knapp-Hartung-type variance estimator or robust heteroscedasticity consistent sandwich estimators in combination with the integral z-to-r transformation (Hafdahl, 2009, Br. J. Math. Stat. Psychol., 62, 233) provide more accurate coverage than existing approaches in most scenarios, especially in the more appropriate beta distribution simulation model.     

A meta-analysis of the effect of cognitive bias modification on anxiety and depression

Cognitive biases have been theorized to play a critical role in the onset and maintenance of anxiety and depression. Cognitive bias modification (CBM), an experimental paradigm that uses training to induce maladaptive or adaptive cognitive biases, was developed to test these causal models. Although CBM has generated considerable interest in the past decade, both as an experimental paradigm and as a form of treatment, there have been no quantitative reviews of the effect of CBM on anxiety and depression. This meta-analysis of 45 studies (2,591 participants) assessed the effect of CBM on cognitive biases and on anxiety and depression. CBM had a medium effect on biases (g = 0.49) that was stronger for interpretation (g = 0.81) than for attention (g = 0.29) biases. CBM further had a small effect on anxiety and depression (g = 0.13), although this effect was reliable only when symptoms were assessed after participants experienced a stressor (g = 0.23). When anxiety and depression were examined separately, CBM significantly modified anxiety but not depression. There was a nonsignificant trend toward a larger effect for studies including multiple training sessions. These findings are broadly consistent with cognitive theories of anxiety and depression that propose an interactive effect of cognitive biases and stressors on these symptoms. However, the small effect sizes observed here suggest that this effect may be more modest than previously believed.     

On the role of bias in dissociated phonological priming effects: A reply to Goldinger (1999)

Phonological priming studies have revealed two dissociated effects: low-similarity facilitation and highsimilarity interference (Hamburger & Slowiaczek, 1996; Slowiaczek & Hamburger, 1992). Because these two effects are influenced by different variables, they most likely reflect different processes that occur during auditory word recognition. Goldinger (1999) suggests that one bias is responsible for all phonological priming effects. In this reply, we argue against such a position. Although low similarity facilitation is likely the product of this bias, the data on phonological priming indicate that the dissociated highsimilarity interference cannot be produced by the same mechanism. Instead, the data indicate that high-similarity interference may reflect lexical processes.     

On the origin of illusory correlations

Empirical attempts to explain the genesis of illusory correlations have been largely confined to the demonstration of biased recall processes, although it has been acknowledged that perception and encoding processes may also contribute to the illusion. In the present research, illusory correlations between person types (a student versus a clerk) and educational attitudes (liberal versus authoritarian statements) are demonstrated under conditions where selective recall processes are highly unlikely. The cognitive bias that gives rise to the illusion is shown to already be effective when the stimulus information is perceived. Interestingly, there are marked interindividual differences between experimental participants. The results are discussed in the context of the literature on illusory correlations.     

Correcting for indirect range restriction in meta-analysis: testing a new meta-analytic procedure

Using computer simulation, the authors assessed the accuracy of J. E. Hunter, F. L. Schmidt, and H. Le's (2006) procedure for correcting for indirect range restriction, the most common type of range restriction, in comparison with the conventional practice of applying the Thorndike Case II correction for direct range restriction. Hunter et al.'s procedure produced more accurate estimates of both the mean and standard deviation in meta-analysis than the conventional procedure. Even when its key assumption that the effect of selection on a 3rd variable is fully mediated by the independent variable was violated, Hunter et al.'s procedure was still relatively more accurate than the conventional procedure. When applied to data from a previously published meta-analysis, the new procedure yielded results that led to different substantive conclusions.     

On the status of implicit memory bias in anxiety

The present study evaluated the status of mood congruent memory bias in implicit memory tasks for threat related information. A literature review complemented by three experiments on high and low trait anxiety participants found no implicit memory bias for threat-related information in anxious individuals on either word fragment completion or tachistoscopic word identification tasks. The theoretical implications of these results are discussed.     

情绪预测偏差的成因及干预

情绪预测偏差是一种对未来事件发生时情绪反应的预测和实际体验之间的分离现象。梳理该领域最近10年(2009~2019年)研究文献可知, 热点研究主题涉及偏差的现象、成因和干预, 相应呈现为三点主要发现: 情绪预测偏差十分普遍, 情绪预测偏差成因多源, 情绪预测偏差可以干预。未来研究应着力关注情绪预测偏差的发生模式和心理机制, 着力揭示具体偏差的神经心理机制, 并从进化和文化视角综合考察偏差的发生机制。     

An adaptive (tracking) procedure for measuring visual search

PEST, an adaptive (tracking) procedure originally developed for sensory research, was modified for cognitive studies with the multiple sequential frames paradigm and a letter-search task. The program which controlled stimulus presentation was designed to track the frame duration required for successful search on 75% of trials (the duration threshold). For each of the three subjects used, the threshold increased as a linear function of the number of sequentially presented frames, which varied between 1 and 10. Each tracking run was immediately followed by 40 trials with frame-exposure time fixed at the computer-selected threshold. Performance on these fixed level trials was close to the expected 75% correct. The Discussion addresses issues related to the use of the threshold measure in basic and applied cognitive research, explores the present findings about performance on fixed level trials at the computer-selected threshold, and examines the increase in duration threshold with the number of sequentially presented frames.     

Possible research area bias in the Excellence in Research for Australia (ERA) draft journal rankings

An analysis of the Excellence in Research for Australia (ERA) draft rankings of 661 psychology journals points to systematic differences between research areas in the distribution of ranks. Journals in experimental, biological and neuroscientific psychology obtained higher mean ranks, consistent with a tendency for “hard‐science” areas to have higher bibliometric journal impact. The ERA will influence the distribution of resources and rewards within psychology and create powerful incentives for institutions and researchers, so differences in ranks across research areas may alter the shape of the discipline. Although they do not necessarily imply bias, such differences raise the possibility that psychology researchers will not operate on a level playing field.