Retest effects in working memory capacity tests: A meta-analysis

The repeated administration of working memory capacity tests is common in clinical and research settings. For cognitive ability tests and different neuropsychological tests, meta-analyses have shown that they are prone to retest effects, which have to be accounted for when interpreting retest scores. Using a multilevel approach, this meta-analysis aims at showing the reproducibility of retest effects in working memory capacity tests for up to seven test administrations, and examines the impact of the length of the test-retest interval, test modality, equivalence of test forms and participant age on the size of retest effects. Furthermore, it is assessed whether the size of retest effects depends on the test paradigm. An extensive literature search revealed 234 effect sizes from 95 samples and 68 studies, in which healthy participants between 12 and 70 years repeatedly performed a working memory capacity test. Results yield a weighted average of g =?0.28 for retest effects from the first to the second test administration, and a significant increase in effect sizes was observed up to the fourth test administration. The length of the test-retest interval and publication year were found to moderate the size of retest effects. Retest effects differed between the paradigms of working memory capacity tests. These findings call for the development and use of appropriate experimental or statistical methods to address retest effects in working memory capacity tests.     

On the relation between theory of mind and executive functioning: A developmental cognitive neuroscience perspective

Theory of mind (ToM) and executive functioning (EF) show marked interrelatedness across childhood, and developmental psychologists have long been interested in understanding the nature of this association. The present review addresses this issue from a cognitive neuroscience perspective by exploring three hypotheses regarding their functional overlap: (1) ToM relies on EF (EF→ToM); (2) EF relies on ToM (ToM→EF); and (3) ToM and EF are mutually related, owing to shared neural structures or networks (ToM?EF). Drawing on evidence from normative brain development, neurodevelopmental and neurodegenerative diseases, patient lesion studies, and brain-imaging studies, we suggest that only a strict version of the ToM?EF proposal of complete neural overlap can be confidently ruled out on the basis of existing evidence. The balance of evidence suggests that separable neurobiological mechanisms likely underlie ToM and EF, with shared mechanisms for domain-general processing that support both abilities. We highlight how future studies may empirically substantiate the nature of the ToM–EF relationship using various biobehavioral approaches.     

Characterizing belief bias in syllogistic reasoning: A hierarchical Bayesian meta-analysis of ROC data

The belief-bias effect is one of the most-studied biases in reasoning. A recent study of the phenomenon using the signal detection theory (SDT) model called into question all theoretical accounts of belief bias by demonstrating that belief-based differences in the ability to discriminate between valid and invalid syllogisms may be an artifact stemming from the use of inappropriate linear measurement models such as analysis of variance (Dube et al., Psychological Review, 117(3), 831–863, 2010). The discrepancy between Dube et al.’s, Psychological Review, 117(3), 831–863 (2010) results and the previous three decades of work, together with former’s methodological criticisms suggests the need to revisit earlier results, this time collecting confidence-rating responses. Using a hierarchical Bayesian meta-analysis, we reanalyzed a corpus of 22 confidence-rating studies (N =?993). The results indicated that extensive replications using confidence-rating data are unnecessary as the observed receiver operating characteristic functions are not systematically asymmetric. These results were subsequently corroborated by a novel experimental design based on SDT’s generalized area theorem. Although the meta-analysis confirms that believability does not influence discriminability unconditionally, it also confirmed previous results that factors such as individual differences mediate the effect. The main point is that data from previous and future studies can be safely analyzed using appropriate hierarchical methods that do not require confidence ratings. More generally, our results set a new standard for analyzing data and evaluating theories in reasoning. Important methodological and theoretical considerations for future work on belief bias and related domains are discussed.     

Leadership Developmental Level and Performance: An Investigation of Gender Differences

This study investigates the predictive ability of Leadership Developmental Levels (Constructive/Developmental Theory) in a model of leader performance. Using 67 executive leaders from a Leadership Development Consulting firm, Leadership Developmental Level was found to predict leader performance for males, but not for females. This study investigates potential sources of this discrepancy, including rater bias, Performance Differences, Developmental Differences, Interpersonal Connection Style, and Gender Moderation. It is found that the source of the gender distinction is in Interpersonal Connection Style.     

Adaptive memory: Is the animacy effect on memory due to emotional arousal?

Animate entities are often better remembered than inanimate ones. The proximal mechanisms underlying this animacy effect on recall are unclear. In two experiments, we tested whether the animacy effect is due to emotional arousal. Experiment 1 revealed that translations of the animate words used in the pioneering study of Nairne et al. (Psychological science, 24, 2099–2105, 2013) were perceived as being more arousing than translations of the inanimate words, suggesting that animacy might have been confounded with arousal in previous studies. In Experiment 2, new word lists were created in which the animate and inanimate words were matched on arousal (amongst several other dimensions), and participants were required to reproduce the animate and inanimate words in a free recall task. There was a tendency towards better memory for arousing items, but robust animacy effects were obtained even though animate and inanimate words were matched on arousal. Thus, while arousal may contribute to the animacy effect when it is not carefully controlled for, it cannot explain the memory advantage of animate items.     

Delay knowledge and trial set count modulate use of proactive versus reactive control: A meta-analytic review

The AX-continuous performance task (AX-CPT) and dot pattern expectancy (DPX) are the predominant cognitive paradigms used to assess the relative utilization of proactive versus reactive cognitive control. Experimental parameters vary widely between studies and systematically between different modalities (i.e., fMRI vs. EEG) with unknown consequences for the implementation of control. This meta-analytic review systematically surveyed these bodies of literature (k = 43, 73 data points) to resolve how cue–probe delay knowledge, delay length, and trial set count modulate the preferential use of proactive versus reactive control. In healthy young adults, delay knowledge and increasing trial set count each bias participants toward greater proactive control. Further, the interaction of delay knowledge and trial set count accounts for ~40% of variability in proactive/reactive control performance. As trial count varies reliably between experimental modalities, it is critical to understand how these parameters activate distinct cognitive processes and tap into different neural mechanisms for control. Subgroup analyses revealed important distinctions from our results in healthy young adults. Healthy, slightly older adults (ages 30–45 years) performed more reactively compared to healthy young adults. In addition, participants with schizophrenia showed evidence of more proactive control as trial set count increased. In light of this meta-analytic review, we conclude that delay knowledge and trial set length are important parameters to account for in the assessment of proactive versus reactive control. More broadly, this metaregression provides strong evidence that cognitive control becomes more reactive when timing demands are not known, and that both healthy persons and persons with schizophrenia shift toward proactive control with increasing repetitions of a task set.     

When attention is intact in adults with ADHD

Is covert visuospatial attention—selective processing of information in the absence of eye movements—preserved in adults with attention-deficit/hyperactivity disorder (ADHD)? Previous findings are inconclusive due to inconsistent terminology and suboptimal methodology. To settle this question, we used well-established spatial cueing protocols to investigate the perceptual effects of voluntary and involuntary attention on an orientation discrimination task for a group of adults with ADHD and their neurotypical age-matched and gender-matched controls. In both groups, voluntary attention significantly improved accuracy and decreased reaction times at the relevant location, but impaired accuracy and slowed reaction times at irrelevant locations, relative to a distributed attention condition. Likewise, involuntary attention improved accuracy and speeded responses. Critically, the magnitudes of all these orienting and reorienting attention effects were indistinguishable between groups. Thus, these counterintuitive findings indicate that spatial covert attention remains functionally intact in adults with ADHD.     

Systems Factorial Technology provides new insights on the other-race effect

The other-race effect refers to the difficulty of discriminating between faces from ethnic and racial groups other than one’s own. This effect may be caused by a slow, feature-by-feature, analytic process, whereas the discrimination of own-race faces occurs faster and more holistically. However, this distinction has received inconsistent support. To provide a critical test, we employed Systems Factorial Technology (Townsend & Nozawa in Journal of Mathematical Psychology, 39, 321–359, 1995), which is a powerful tool for analyzing the organization of mental networks underlying perceptual processes. We compared Taiwanese participants’ face discriminations of both own-race (Taiwanese woman) and other-race (Caucasian woman) faces according to the faces’ nose-to-mouth separation and eye-to-eye separation. We found evidence for weak holistic processing (parallel processing) coupled with the strong analytic property of a self-terminating stopping rule for own-race faces, in contrast to strong analytic processing (serial self-terminating processing) for other-race faces, supporting the holistic/analytic hypothesis.     

ELF: A new measure of response capture

Response capture is a widespread and extensively studied phenomenon, in particular in decision tasks involving response conflict. Its intensity is routinely quantified by conditional accuracy function (CAF). We argue that this method might be misleading, and propose an alternative approach, the error location function (ELF). While CAF provides the error rate by bins of reaction time (RT), ELF represents the share of total errors below each quantile of RT. We derive from ELF an index of response capture, the error location index (ELI), which represents the area below the ELF. Using simulations of computational models, we show that ELF and ELI specifically quantify variations in response capture. Finally, we illustrate the usefulness of ELF and ELI through experimental data and show that ELF and CAF can yield to contradictory conclusions.