Recommendations for Increasing Replicability in Psychology

Replicability of findings is at the heart of any empirical science. The aim of this article is to move the current replicability debate in psychology towards concrete recommendations for improvement. We focus on research practices but also offer guidelines for reviewers, editors, journal management, teachers, granting institutions, and university promotion committees, highlighting some of the emerging and existing practical solutions that can facilitate implementation of these recommendations. The challenges for improving replicability in psychological science are systemic. Improvement can occur only if changes are made at many levels of practice, evaluation, and reward. Copyright © 2013 John Wiley & Sons, Ltd.     

Interference resolution moderates the impact of rumination and reappraisal on affective experiences in daily life

Research has shown that cognitive control processes play a central role in emotion regulation. While most research has examined whether individual differences in such processes are related to the use of these strategies, a crucial next step involves examining whether such differences influence their impact on people's feelings, especially in normal daily life. The present study examined whether impairments in cognitive control (measured using an affective interference resolution task) moderate the impact of using rumination and reappraisal on affective experiences in everyday life (assessed using experience sampling methods). Multilevel analyses revealed that difficulties removing previously relevant negative information from working memory were associated with a larger increase in negative affect following rumination, and smaller increase and decrease in positive and negative affect, respectively, following reappraisal. These findings show that impaired interference resolution for negative information aggravates the deleterious effects of rumination and curbs the benefits of reappraisal in daily life.     

Dampening of positive affect prospectively predicts depressive symptoms in non-clinical samples

Past research has convincingly shown that a ruminative response style to negative affect (NA) predicts concurrent and prospective levels of depressive symptoms. Recent findings suggest that how people respond to positive affect (PA) might also be involved in the development of depressive symptoms, although this has heretofore not been tested prospectively. Participants from two non-clinical samples (total N=487) completed measures of depressive symptoms, response styles to NA (negative rumination) and response styles to PA (positive rumination and mood dampening) at two assessments separated by a 3-month (Sample 1) and 5-month period (Sample 2). Results in both samples showed that increased dampening responses to PA predict depressive symptoms at follow-up, even when taking into account baseline depressive symptoms and ruminative responses to NA. The results suggest that (dampening) responses to PA add useful information above and beyond (ruminative) responses to NA in predicting depression symptoms prospectively.     

A sentence completion procedure as an alternative to the Autobiographical Memory Test for assessing overgeneral memory in non-clinical populations

Overgeneral memory (OGM) has been proposed as a vulnerability factor for depression (Williams et al., 2007 Williams , J. M. G. , Barnhofer , T. , Crane , C. , Hermans , D. , Raes , F. , Watkins , E. , & Dalgleish , T. ( 2007 ). Autobiographical memory specificity and emotional disorder . Psychological Bulletin , 133 , 122 – 148 .[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) or depressive reactivity to stressful life-events (e.g., Gibbs & Rude, 2004 Gibbs, B. R. and Rude, S. S. 2004. Overgeneral autobiographical memory as depression vulnerability. Cognitive Therapy and Research, 28: 511–526. [Crossref], [Web of Science ®] , [Google Scholar]). Traditionally, a cue word procedure known as the Autobiographical Memory Test (AMT; Williams & Broadbent, 1986 Williams, J. M. G. and Broadbent, K. 1986. Autobiographical memory in suicide attempters. Journal of Abnormal Psychology, 95: 144–149. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) is used to assess OGM. Although frequently and validly used in clinical populations, there is evidence suggesting that the AMT is insufficiently sensitive to measure OGM in non-clinical groups. Study 1 evaluated the usefulness of a sentence completion method to assess OGM in non-clinical groups, as an alternative to the AMT. Participants were 197 students who completed the AMT, the Sentence Completion for Events from the Past Test (SCEPT), a depression measure, and visual analogue scales assessing ruminative thinking. Results showed that the mean proportion of overgeneral responses was markedly higher for the SCEPT than for the standard AMT. Also, overgeneral responding on the SCEPT was positively associated to depression scores and depressive rumination scores, whereas overgeneral responding on the AMT was not. Results suggest that the SCEPT, relative to the AMT, is a more sensitive instrument to measure OGM, at least in non-clinical populations. Study 2 further showed that this enhanced sensitivity is most likely due to the omission of the instruction to be specific rather than to the SCEPT's sentence completion format (as opposed to free recall to cue words).     

Role Satisfaction Mediates the Relation between Role Ambiguity and Social Loafing among Elite Women Handball Players

The aims of the study were to develop a questionnaire on self-reported social loafing (SRSLQ), and then to examine its relations with role ambiguity and role satisfaction in a sample of 110 women handball players competing at the elite level in Norway. Structural equation modeling analyses indicated that the SRSLQ was a psychometrically sound measure. In line with the expectations, role satisfaction fully mediated the positive relation between role ambiguity and self-reported social loafing: The more players experienced role ambiguity, the less satisfied they were with their role in the team, and the more social loafing they reported.     

When Your Team is Not Really Your Team Anymore: Identification with a Merged Basketball Club

In this questionnaire study it was tested to what extent identification with a merged basketball club could be predicted on the basis of six concepts derived from a social identity perspective on mergers. Respondents were 160 fans and 91 youth players of a Belgian first division basketball club that had merged the previous season. A direct multiple regression analysis indicated that, both for fans and youth players identification with the pre-merger club was the best predictor of identification with the new merger club, followed by the perceived success of the merger. Two other concepts emerged as significant, though modest, predictors of post-merger identification for fans and youth players: the perceived necessity of the merger and their satisfaction with the merger process. For the fans, the perceived continuity/representation of the in-group in the merger group was also a significant predictor. Together, the hypothesized predictors accounted for 70% of the total variance in their post-merger identification. This high percentage underlines the relevance of a social-psychological perspective on how sport fans' react to mergers. For youth players, 61% of the total variance in their post-merger identification was explained, which suggests that the processes that facilitate fans and youth players’ post-merger identification are quite similar.     

Transsaccadic integration of bystander locations

The present study investigated whether and how the location of bystander objects is encoded, maintained, and integrated across an eye movement. Bystander objects are objects that remain unfixated directly before and after the saccade for which transsaccadic integration is being examined. Three experiments are reported that examine location coding of bystander objects relative to the future saccade target object, relative to the saccade source object, and relative to other bystander objects. Participants were presented with a random‐dot pattern and made a saccade from a central source to a designated saccade target. During this saccade the position of a single bystander was changed on half of the trials and participants had to detect the displacement. Postsaccadically the presence of the target, source, and other bystanders was manipulated. Results indicated that the location of bystander objects could be integrated across a saccade, and that this relied on configurational coding. Furthermore the present data provide evidence for the view that transsaccadic perception of spatial layout is not inevitably tied to the saccade target or the saccade source, that it makes use of objects and object configurations in a flexible manner that is partly governed by the task relevance of the various display items, and that it exploits the incidental configurational structure in the display's layout in order to increase its capacity limits.     

Does personality disorder co-morbidity impact treatment outcome for patients with major depression? A multi-level analysis

In literature, there exists disagreement regarding the impact of comorbid personality disorder(s) (PD[s]) on treatment outcome for patients with major depressive disorder (MDD). The aim of this paper was to investigate whether statistical heterogeneity and inter-dependency are potential moderators of the effect of co-morbid PDs on outcome for patients with MDD. Clinician-rated MADRS scores and DSM-IV Axis II personality disorder diagnoses were obtained from 562 outpatients with MDD who received 6 months of combined psycho- and pharmacotherapy. Single-level regression showed significantly worse treatment outcome among patients with co-morbid PD, as compared to patients with no PD. After controlling for statistical heterogeneity and interdependency, treatment outcome was no longer significantly worse for patients with co-morbid PD. In conclusion, heteroscedasticity and inter-dependency should be considered as potentially compelling explanations for inconsistencies in findings on treatment outcome for depressed patients with co-morbid PDs.     

The validity of interpersonal skills assessment via situational judgment tests for predicting academic success and job performance

This study provides conceptual and empirical arguments why an assessment of applicants' procedural knowledge about interpersonal behavior via a video-based situational judgment test might be valid for academic and postacademic success criteria. Four cohorts of medical students (N = 723) were followed from admission to employment. Procedural knowledge about interpersonal behavior at the time of admission was valid for both internship performance (7 years later) and job performance (9 years later) and showed incremental validity over cognitive factors. Mediation analyses supported the conceptual link between procedural knowledge about interpersonal behavior, translating that knowledge into actual interpersonal behavior in internships, and showing that behavior on the job. Implications for theory and practice are discussed.     

Responses to Positive Affect Predict Mood Symptoms in Children Under Conditions of Stress: A Prospective Study

Rumination to negative affect has been linked to the onset and maintenance of mood disorders in adults as well as children. Responses to positive affect have received far less attention thus far. A few recent studies in adults suggest that responses to positive affect are involved in the development of both depressive and hypomanic symptoms, but thus far no study has investigated their role in childhood mood problems. The purpose of the present study was to validate a child version of the Responses to Positive Affect questionnaire and examine the extent to which responses to positive affect prospectively predict mood symptoms over a 3-month interval. The Responses to Positive Affect questionnaire for Children was found to assess two types of responses to positive affect: Positive Rumination and Dampening. Both subscales showed sufficient internal consistency and moderate stability over a 3-month interval. Low levels of positive rumination and high levels of dampening were concurrently associated with depressive symptoms, over and above responses to negative affect. Importantly, low levels of positive rumination also predicted increases in depressive symptoms over a 3-month interval over and above baseline symptoms in children reporting high levels of stress. Both positive rumination and dampening were positively related to concurrent hypomanic symptoms and high levels of positive rumination predicted increases in hypomanic symptoms over a 3-month interval over and above baseline symptoms in children reporting high levels of stress. The results underscore the added value of assessing responses to positive affect in addition to responses to negative affect.