Recommendations for Increasing Replicability in Psychology

Replicability of findings is at the heart of any empirical science. The aim of this article is to move the current replicability debate in psychology towards concrete recommendations for improvement. We focus on research practices but also offer guidelines for reviewers, editors, journal management, teachers, granting institutions, and university promotion committees, highlighting some of the emerging and existing practical solutions that can facilitate implementation of these recommendations. The challenges for improving replicability in psychological science are systemic. Improvement can occur only if changes are made at many levels of practice, evaluation, and reward. Copyright © 2013 John Wiley & Sons, Ltd.     

A time course analysis of the affective priming effect

The argument that automatic processes are responsible for affective/evaluative priming effects has been primarily based on studies that have manipulated the stimulus onset asynchrony (SOA; i.e., the interval between the onset of the prime and the onset of the target). Moreover, these SOA studies provide an insight in the time course of the activation processes underlying automatic affect/attitude activation. Based on a fine-grained manipulation of the SOA employing either the evaluative decision task (Experiment 1) and the pronunciation task (Experiment 2) we concluded that affective priming, and hence automatic affect activation, is based on fast-acting automatic processes. The results of Experiment 3 provide a valid explanation for an apparent discrepancy between the results of Experiments 1 and 2 and previous findings. Finally, the results of Experiment 3 support the prediction of Jarvis and Petty (1996) that affective priming effects should be stronger for participants who are more chronically engaged in conscious evaluations.     

Do smokers have a negative implicit attitude toward smoking?

Swanson, Rudman, and Greenwald (2001 Swanson, J. E., Rudman, L. A. and Greenwald, A. G. 2001. Using the Implicit Association Test to investigate attitude-behavior consistency for stigmatised behaviour. Cognition and Emotion, 15: 207–230. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) used an Implicit Association Test (IAT) to measure attitudes toward smoking and found that smokers have negative implicit attitudes toward smoking. In a first experiment, we replicated the results of Swanson et al. but showed that scores on an attitude IAT do discriminate between smokers and nonsmokers to the same extent than scores on an IAT that is designed to measure associations between smoking and approach or avoidance. In a second experiment, we did find positive implicit attitudes toward smoking in smokers when we used a personalised version of the IAT that was designed to be less susceptible to effects of societal views. Our results indicate that implicit attitudes should not be dismissed as a causal factor in the maintenance of smoking behaviour.     

Affective states leak into movement execution: Automatic avoidance of threatening stimuli in fear of spider is visible in reach trajectories

Several studies have shown that the attentional blink (AB; Raymond, Shapiro, & Arnell, 1992) is diminished for highly arousing T2 stimuli (e.g., Anderson, 2005). Whereas this effect is most often interpreted as evidence for a more efficient processing of arousing information, it could be due also to a bias to report more arousing stimuli than neutral stimuli. We introduce a paradigm that allows one to control for such a response bias. Using this paradigm, we obtained evidence that the diminished AB for taboo words cannot be explained by a response bias. This supports the idea that the emotional modulation of the AB is caused by attentional processes.     

Norms of valence, arousal, dominance, and age of acquisition for 4,300 Dutch words

This article presents norms of valence/pleasantness, activity/arousal, power/dominance, and age of acquisition for 4,300 Dutch words, mainly nouns, adjectives, adverbs, and verbs. The norms are based on ratings with a 7-point Likert scale by independent groups of students from two Belgian (Ghent and Leuven) and two Dutch (Rotterdam and Leiden-Amsterdam) samples. For each variable, we obtained high split-half reliabilities within each sample and high correlations between samples. In addition, the valence ratings of a previous, more limited study (Hermans & De Houwer, Psychologica Belgica, 34:115-139, 1994) correlated highly with those of the present study. Therefore, the new norms are a valuable source of information for affective research in the Dutch language.     

The Semantic Simon Effect

Three experiments are reported in which a semantic variant of the Simon paradigm was used. In Experiment 1, participants saw Dutch and English words that corresponded to names of animals (e.g. DOG) or occupations (e.g. TEACHER). Participants were instructed to respond by saying ANIMAL or OCCUPATION, depending on whether the presented word was a Dutch or English word (i.e. relevant stimulus feature) but irrespective of whether the word was the name of an animal or an occupation (i.e. irrelevant stimulus feature). Results showed that responses were facilitated when the correct response corresponded to the name of the semantic category of the presented word (e.g. saying 'ANIMAL' to DOG) compared to when it was the name of a different semantic category (e.g. saying 'OCCUPATION' to DOG), even though the semantic category of the presented word was irrelevant and had to be ignored. Category membership also influenced response times when letter case (upper- or lower-case: Experiment 2) and grammatical category (noun or adjective: Experiment 3) had to be determined in order to select a category label as a response. The semantic Simon effect offers a new tool that can be used to study automatic semantic processing.     

How farsighted are behavioral tendencies of approach and avoidance? The effect of stimulus valence on immediate vs. ultimate distance change

Research suggests that affective stimuli facilitate behavior that causes a compatible change in distance (i.e., approach positive and avoid negative stimuli). In natural settings, however, behavior often causes different consequences at different points in time. It is unclear whether affective stimuli interact with immediate or ultimate action-consequences (i.e., consequences that are more removed in time). To shed light on this, we tested whether stimulus valence facilitates behavior that ultimately causes a compatible change in distance, even when this behavior immediately causes an incompatible distance change. Participants moved a manikin on a computer screen toward or away from a positive or negative word. On half of the trials, moving the manikin ultimately in one direction required an initial movement in the opposite direction. Results from two studies showed that stimulus valence facilitated ultimate-compatible distance change regardless of the initial direction. This suggests that affective stimuli facilitate behavior that is relatively farsighted.     

A pictorial attitude IAT as a measure of implicit motives

We tested the hypothesis that a pictorial attitude variant of the Implicit Association Test (PA‐IAT) is a valid measure of implicit motives. The PA‐IAT aims to capture attitudes towards pictures that are related to implicit motives. In the first two studies, we showed that the pictorial attitude Implicit Association Test (IAT) correlated more highly with non‐IAT measures of implicit motives than other IAT variants. In the third study, we established the validity of the PA‐IAT experimentally and showed that the pictorial attitude IAT correlated with non‐declarative behavioural measures only if implicit motives were aroused. Copyright © 2010 John Wiley & Sons, Ltd.     

Context effects in evaluative conditioning of implicit evaluations

Propositional models of evaluative conditioning postulate that the impact of stimulus pairings on liking should depend not on the pairings themselves but on what the pairings imply about the relation between stimuli. Hence, context manipulations that change the implications of stimulus pairings should moderate evaluative conditioning. We manipulated context by varying the way in which context cues were paired with affective outcomes while keeping the pairings between target cues and affective outcomes constant. All participants saw one target cue compound that was followed by a positive outcome (XF+) and another target cue compound that was followed by a negative outcome (YG?). In condition Same, each context cue was consistently paired with a positive or negative outcome, regardless of whether it was presented alone or in compound with another cue (A+, B+, AB+; C?, D?, CD?). In condition Opposite, however, a context cue was paired with a certain outcome when presented alone and with an outcome of the opposite valence when presented in a compound with another cue (A+, B+, AB?; C?, D?, CD+). Employing several implicit measures, we assessed the implicit evaluations of the target cues X and Y. In all three studies, the outcome of the measurement procedure differed between conditions. In condition Same, the positively paired cue X was evaluated more positively than the negatively paired cue Y. In condition Opposite, however, this preference was not present. This pattern of results suggests that EC is determined not only by the objective pairings but also by the context in which these pairings occur. Implications for models of evaluative conditioning are discussed.     

Unintentional processing of motivational valence

Recent motivational affective priming studies (Moors & De Houwer, 2001; Moors, De Houwer, & Eelen, 2004) showed that primes that indicate success on a goal-inducing task facilitate positive target responses whereas primes that indicate failure on that task facilitate negative target responses. In the current studies, we examined whether these priming effects depend on consciously intentional processing of the motivational valence of the primes. In Experiment 1, the outcome of success or failure was presented not only immediately before the target (i.e., the prime) but also a second time after the target response. This should encourage participants to ignore the prime. In Experiment 2, participants were asked to respond to the targets within 600 ms after target onset. As a result, participants had little opportunity to process the motivational prime valence in a consciously intentional way. Nevertheless, strong affective priming effects were found in both studies. These results provide additional support for the claim that motivational valence can be processed without the conscious intention to do so.