心理学研究中的可重复性问题:从危机到契机

可重复性问题是当前科学界面临的共同问题。最近,心理学研究领域的可重复性问题也受到广泛关注,引起了研究者的积极讨论与探索。通过对2008年发表的100项研究结果进行大规模重复实验,研究者发现,心理学研究的成功重复率约为39%,但该研究仍然存在着巨大的争议,不同的研究者对其结果的解读不尽相同。针对可重复性问题,研究者通过数据模拟、元分析以及调查等多种方法来分析和探索其原因,这些研究表明,可重复性问题本质上可能是发表的研究假阳性过高,可疑研究操作是假阳性过高的直接原因,而出版偏见和过度依赖虚无假设检验则是更加深层的原因。面对可重复性问题,研究者从统计方法和研究实践两个方面提出了相应的解决方案,这些方法与实践正在成为心理学研究的新标准。然而,要解决可重复性问题,还需要心理学研究领域的多方参与,尤其是在政策上鼓励公开、透明和开放的研究取向,避免出版偏见。心理学研究者为解决可重复性问题做出的努力,不仅会加强心理学研究的可靠性,也为其他学科解决可重复问题提供了借鉴,推动科学界可重复问题的解决。     

概化理论方差分量估计的跨分布分析

方差分量估计是进行概化理论分析的关键。采用MonteCarlo模拟技术,探讨心理与教育测量数据分布对概化理论各种方法估计方差分量的影响。数据分布包括正态、二项和多项分布,估计方法包括Traditional、Jackknife、Bootstrap和MCMC方法。结果表明:(1)Traditional方法估计正态分布和多项分布数据的方差分量相对较好,估计二项分布数据需要校正,Jackknife方法准确地估计了三种分布数据的方差分量,校正的Bootstrap方法和有先验信息的MCMC方法(MCMCinf)估计三种分布数据的方差分量结果较好;(2)心理与教育测量数据分布对四种方法估计概化理论方差分量有影响,数据分布制约着各种方差分量估计方法性能的发挥,需要加以区分地使用。     

Testing Process Factor Analysis Models Using the Parametric Bootstrap

Process factor analysis (PFA) is a latent variable model for intensive longitudinal data. It combines P-technique factor analysis and time series analysis. The goodness-of-fit test in PFA is currently unavailable. In the paper, we propose a parametric bootstrap method for assessing model fit in PFA. We illustrate the test with an empirical data set in which 22 participants rated their effects everyday over a period of 90 days. We also explore Type I error and power of the parametric bootstrap test with simulated data.     

Misspecification in Latent Change Score Models: Consequences for Parameter Estimation,Model Evaluation,and Predicting Change

Latent change score models (LCS) are conceptually powerful tools for analyzing longitudinal data (McArdle & Hamagami, 2001). However, applications of these models typically include constraints on key parameters over time. Although practically useful, strict invariance over time in these parameters is unlikely in real data. This study investigates the robustness of LCS when invariance over time is incorrectly imposed on key change-related parameters. Monte Carlo simulation methods were used to explore the impact of misspecification on parameter estimation, predicted trajectories of change, and model fit in the dual change score model, the foundational LCS. When constraints were incorrectly applied, several parameters, most notably the slope (i.e., constant change) factor mean and autoproportion coefficient, were severely and consistently biased, as were regression paths to the slope factor when external predictors of change were included. Standard fit indices indicated that the misspecified models fit well, partly because mean level trajectories over time were accurately captured. Loosening constraint improved the accuracy of parameter estimates, but estimates were more unstable, and models frequently failed to converge. Results suggest that potentially common sources of misspecification in LCS can produce distorted impressions of developmental processes, and that identifying and rectifying the situation is a challenge.     

Accounting for Missing Correlation Coefficients in Fixed-Effects MASEM

Meta-analytic structural equation modeling (MASEM) is increasingly applied to advance theories by synthesizing existing findings. MASEM essentially consists of two stages. In Stage 1, a pooled correlation matrix is estimated based on the reported correlation coefficients in the individual studies. In Stage 2, a structural model (such as a path model) is fitted to explain the pooled correlations. Frequently, the individual studies do not provide all the correlation coefficients between the research variables. In this study, we modify the currently optimal MASEM-method to deal with missing correlation coefficients, and compare its performance with existing methods. This study is the first to evaluate the performance of fixed-effects MASEM methods under different levels of missing correlation coefficients. We found that the often used univariate methods performed very poorly, while the multivariate methods performed well overall.     

Images of the disciplining of psychology, 1890–1940

Over the course of psychology’s first several decades, the language used to convey the subject matter gradually shifted from being free and literary to being strictly constrained and disciplined by increasingly focused theoretical demands. The project described here, “Disciplining Psychology,” aimed to depict this transformation by generating images of the faces of three highly influential psychologists—William James, Sigmund Freud, and B. F. Skinner. Each image is composed of the words used in one of each individual’s most important books. The tightening of the disciplinary vocabulary is revealed in the differences among the three arrays of words themselves, but I have also striven to reflect it in the aesthetic aspects of each image. The method used here could easily be extended to a wider array of authors, texts, and psychological topics.     

Developmental models for children's temperament: alternatives to chronometric polynomial curves

Partridge and Lerner (2007), in a secondary analysis of the New York Longitudinal Study, employed a chronometric polynomial growth curve model to argue that the developmental course of difficult temperament follows a non‐linear trajectory over the first 5 years of life. The free curve slope intercept (FCSI) growth curve model of Meredith and Tisak (1990) is presented as a preferable conceptual alternative because it contains a number of currently popular statistical models, including repeated measures multivariate analysis of variance, factor mean, linear growth, linear factor analysis, and hierarchical linear models as special cases. As such, researchers can compare the fit of each of these models relative to the FCSI model, and, at times, to each other. The present paper conducts a re‐analysis of the data, and establishes that fit of the FCSI model is arguably better than other statistical alternatives. The FCSI model is also used as the basis for identifying subgroups of individuals with their qualitatively distinct growth patterns within a growth mixture modeling framework. Copyright © 2010 John Wiley & Sons, Ltd.     

Contrast effects in typicality judgements: A hierarchical Bayesian approach

We examine the influence of contrast categories on the internal graded membership structure of everyday concepts using computational models proposed in the artificial category learning tradition. In particular, the generalized context model (Nosofsky, 1986), which assumes that only members of a given category contribute to the typicality of a category member, is contrasted to the similarity–dissimilarity generalized context model (SD-GCM; Stewart & Brown, 2005), which assumes that members of other categories are also influential in determining typicality. The models are compared in a hierarchical Bayesian framework in their account of the typicality gradient of five animal categories and six artefact categories. For each target category, we consider all possible relevant contrast categories. Three separate issue are examined: (a) whether contrast effects can be found, (b) which categories are responsible for these effects, and (c) whether more than one category influences the typicality. Results indicate that the internal category structure is codetermined by dissimilarity towards potential contrast categories. In most cases, only a single contrast category contributed to the typicality. The present findings suggest that contrast effects might be more widespread than has previously been assumed. Further, they stress the importance of characteristics particular of everyday concepts, which require careful consideration when applying computational models of representation of the artificial category learning tradition to everyday concepts.     

Caught on camera: Cross-race interactions captured in daily life

The present study examined the prevalence of cross-race interactions occurring in daily life using wearable camera technology that captures photographs of a participants’ immediate environment and social interactions. Coders used appearance-based cues to identify the number of interaction partners captured in the photos who appeared to be White or a racial minority. We found that 29.6% of Whites’ social interactions were with racial minorities and 23.9% of racial minorities’ social interactions were with Whites. Furthermore, we examined whether personality and other individual differences correlated with being captured in more cross-race interactions. We found that Whites who used more emotion-focused coping and less emotional suppression were more likely to be captured engaging in cross-race interactions.