The measurement of participant-reported memory across diverse populations and settings: a systematic review and meta-analysis of the Multifactorial Memory Questionnaire

ABSTRACT

The Multifactorial Memory Questionnaire (MMQ) is a participant-reported measure of memory satisfaction, ability, and strategy use. Initially validated with healthy older adults, it has since been used in many different populations and settings for a variety of purposes. We conducted a systematic review and meta-analysis of the measurement properties of the MMQ across multiple, diverse studies. Methods: The study was designed using the Consensus-Based Standards for the Selection of Health Measurement Instruments and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses. We calculated aggregate statistics and evaluated the methodological quality of 29 studies retrieved from PsycINFO, MEDLINE, EMBASE, and Web of Science. Results: Analyses revealed high-quality evidence for internal consistency, stability, measurement error, convergent validity, and known-groups validity of the three MMQ scales. There was moderate-quality evidence for responsiveness and structural validity, with some studies identifying separate factors for internal and external memory strategy use. Measurement properties were similar across languages, participant samples, and study designs. Conclusions: The MMQ is a valid, reliable, and responsive measure across diverse settings and populations. Future research is needed to determine whether more detailed information can be obtained from the scales, specifically, internal versus external strategy use.     

The relationship between testosterone and aggression: a meta-analysis

In non-human animals, the relationship between testosterone and aggression is well established. In humans, the relationship is more controversial. To clarify the relationship, Archer conducted three meta-analyses and found a weak, positive relationship between testosterone and aggression. Unfortunately, each of the analyses included only five to six studies. The aim of the present study was to re-examine the relationship between testosterone and aggression with a larger sample of studies. The present analyses are based on 45 independent studies (N=9760) with 54 independent effect sizes. Only studies that reported a p-value or effect size were included in the analyses and the sample may underestimate the proportion of non-significant findings in the population. Correlations ranged from −0.28 to 0.71. The mean weighted correlation (r=0.14) corroborates Archer's finding of a weak positive relationship.     

The paradox of intragroup conflict: a meta-analysis

Since the meta-analysis by De Dreu and Weingart (2003b) on the effects of intragroup conflict on group outcomes, more than 80 new empirical studies of conflict have been conducted, often investigating more complex, moderated relationships between conflict and group outcomes, as well as new types of intragroup conflict, such as process conflict. To explore the trends in this new body of literature, we conducted a meta-analysis of 116 empirical studies of intragroup conflict (n = 8,880 groups) and its relationship with group outcomes. To address the heterogeneity across the studies included in the meta-analysis, we also investigated a number of moderating variables. Stable negative relationships were found between relationship and process conflict and group outcomes. In contrast to the results of De Dreu and Weingart, we did not find a strong and negative association between task conflict and group performance. Analyses of main effects as well as moderator analyses revealed a more complex picture. Task conflict and group performance were more positively related among studies where the association between task and relationship conflict was relatively weak, in studies conducted among top management teams rather than non-top management teams, and in studies where performance was measured in terms of financial performance or decision quality rather than overall performance.     

The psychophysiology of posttraumatic stress disorder: a meta-analysis

This meta-analysis of 58 resting baseline studies, 25 startle studies, 17 standardized trauma cue studies, and 22 idiographic trauma cue studies compared adults with and without posttraumatic stress disorder (PTSD) on psychophysiological variables: facial electromyography (EMG), heart rate (HR), skin conductance (SC), and blood pressure. Significant weighted mean effects of PTSD were observed for HR (r = .18) and SC (r = .08) in resting baseline studies; eyeblink EMG (r = .13), HR (r = .23), and SC habituation slope (r = .21) in startle studies; HR (r = .27) in standardized trauma cue studies; and frontalis EMG (r = .21), corrugator EMG (r = .34), HR (r = .22), and SC (r = .19) in idiographic trauma cue studies. The most robust correlates of PTSD were SC habituation slope, facial EMG during idiographic trauma cues, and HR during all study types. Overall, the results support the view that PTSD is associated with elevated psychophysiology. However, the generalizability of these findings is limited by characteristics of the published literature, including its disproportionate focus on male veterans and neglect of potential PTSD subtypes.     

The relationship between divided attention and implicit memory: a meta-analysis

This article reports a meta-analysis comparing the size of repetition priming in full and divided-attention (DA) conditions. The main analysis included 38 effect sizes (ES) extracted from 21 empirical studies, for a total of 2074 (full-attention) and 2148 (divided-attention) participants. The mean weighted ES was 0.357 (95% CI = 0.278–0.435), indicating that divided attention produced a small, but significant, negative effect on implicit memory. Overall, the distinction between identification and production priming provided the best fit to empirical data (with the effect of DA being greater for production tests), whereas there was no significant difference between perceptual and conceptual priming. A series of focused contrasts suggested that word-stem completion might be influenced by lexical–conceptual processes, and that perceptual identification might involve a productive component. Implications for current theories of implicit memory are discussed.     

The illusion of group productivity: a reduction of failures explanation

It has consistently been found that people produce more ideas when working alone as compared to when working in a group. Yet, people generally believe that group brainstorming is more effective than individual brainstorming. Further, group members are more satisfied with their performance than individuals, whereas they have generated fewer ideas. We argue that this ‘illusion of group productivity’ is partly due to a reduction of cognitive failures (instances in which someone is unable to generate ideas) in a group setting. Three studies support that explanation, showing that: (1) group interaction leads to a reduction of experienced failures and that failures mediate the effect of setting on satisfaction; and (2) manipulations that affect failures also affect satisfaction ratings. Implications for group work are discussed. Copyright © 2005 John Wiley & Sons, Ltd.     

The relation of self-efficacy and interests: a meta-analysis of 60 samples

This study empirically synthesizes and evaluates studies that have examined the relation between vocationally relevant domains of self-efficacy and interests. We conducted a meta-analytic review of 60 empirical independent samples (N=39,154) in which relations between self-efficacy and interests had been examined. Fifty-three of these samples (N=37,829) included parallel measures of the constructs. Relations between parallel measures of Holland’s RIASEC themes, the specific dimensions of art, math, science and math/science combined, and traditionally female and male occupations are also presented. Results demonstrated that self-efficacy and interests are independent constructs that correlate moderately. Differences by sex, measure, and age group are noted. Future directions for research regarding links between self-efficacy and interests are discussed.     

Aging and task switching: a meta-analysis

A meta-analysis of 26 published articles (with 36 independent participant groups) was conducted to analyze the relationship between task-switching effects and aging. Latency served as the dependent measure. Multilevel modeling was used to test for additive and multiplicative complexity effects in local and global switch costs. Global task switching was found to add 1 or more stages to processing and resulted in a marked age deficit. Local task-switching costs, on the other hand, showed a multiplicative complexity effect but no specific attention-related age deficits. Cueing or switch predictability did not affect age differences.     

Aging and dual-task performance: a meta-analysis

The relations between dual-task effects and aging were examined through a meta-analysis of 33 studies (with 48 independent participant groups) using latency as the dependent measure and 30 studies (with 40 independent participant groups) focusing on accuracy. Brinley plots and state traces were derived, and a model to explicate different types of complexity (additive and multiplicative) was developed. The effects of dual-task processing on latency were additive, and this additive cost was larger in older adults than in younger adults and larger than predicted from general slowing. This cost was small and independent of task complexity. The effects of dual-task processing on logit-transformed accuracy were likewise additive, but no specific age deficit was associated with this dual-task cost.     

Aging and vocabulary scores: a meta-analysis

Vocabulary scores were examined in a total of 210 articles, containing 324 independent pairings of younger and older adults, from the 1986-2001 issues of Psychology and Aging. The average effect size, favoring the old, was 0.80 SD. Production tests yielded smaller effects (0.68 SD) than multiple-choice tests (0.93 SD). Both age and education were found to be partially independent determinants of performance in production tests; age effects disappeared in multiple-choice tests as soon as education was taken into account. In addition, the Wechsler Adult Intelligence Scale--Revised Vocabulary subtest (D. Wechsler, 1981) was also found to be sensitive to the Flynn effect (J. R. Flynn, 1987; i.e., increasing test scores with advancing birth year). The results question the approach of using age-group equality in vocabulary scores as a check on sample equivalence.     

The relative efficacy of avoidant and nonavoidant coping strategies: a meta-analysis

A casual review of the research literature on coping strategies suggests that strategies involving avoidant tactics are effective in reducing pain, stress, and anxiety in some cases, whereas nonavoidant strategies (called here attention), appear to be more effective in others. This article reports the results of a series of meta-analyses to ascertain whether there are systematic patterns in the empirical literature that describe when attention strategies are more or less effective than avoidant strategies. In particular, we consider the role of different kinds of attentional sets and also the role of time--whether some kinds of strategies work best in the early phases of the stress experience, and others are more efficacious in later phases of the stress experience. Results of an overall analysis of studies providing tests of attention versus avoidance indicated little evidence for one strategy's superiority. However, supplementary analyses, motivated by theoretical reasons, suggest there are boundary conditions that define the relative efficacy of a specific strategy. Overall, avoidance was associated with more positive adaptation in the short-run. However, attention was superior to avoidance if the former involved a focus on sensory schemata rather than emotional processing. If attention involved an emotional interpretational set or no explicit set, then it was associated with more negative outcomes than avoidance. In terms of long-term outcomes, avoidance indicates better outcomes initially, but with time, attention was associated with more positive outcomes. A final set of analyses found that both attention and avoidance facilitate adaptation as compared with no instruction controls. The meta-analyses suggest the important role of interpretational set and whether one looks at the immediate or at the long-term effects of coping. Limitations of the analyses and directions for future research are discussed.     

The Wartegg Zeichen Test: a literature overview and a meta-analysis of reliability and validity

All available studies on the Wartegg Zeichen Test (WZT; Wartegg, 1939) were collected and evaluated through a literature overview and a meta-analysis. The literature overview shows that the history of the WZT reflects the geographical and language-based processes of marginalization where relatively isolated traditions have lived and vanished in different parts of the world. The meta-analytic review indicates a high average interscorer reliability of rw = .74 and high validity effect size for studies with clear hypotheses of rw = .33. Although the results were strong, we conclude that the WZT research has not been able to establish cumulative knowledge of the method because of the isolation of research traditions.     

Psychopharmacological enhancement: a conceptual framework

The availability of a range of new psychotropic agents raises the possibility that these will be used for enhancement purposes (smart pills, happy pills, and pep pills). The enhancement debate soon raises questions in philosophy of medicine and psychiatry (eg, what is a disorder?), and this debate in turn raises fundament questions in philosophy of language, science, and ethics. In this paper, a naturalistic conceptual framework is proposed for addressing these issues. This framework begins by contrasting classical and critical concepts of categories, and then puts forward an integrative position that is based on cognitive-affective research. This position can in turn be used to consider the debate between pharmacological Calvinism (which may adopt a moral metaphor of disorder) and psychotropic utopianism (which may emphasize a medical metaphor of disorder). I argue that psychiatric treatment of serious psychiatric disorders is justified, and that psychotropics are an acceptable kind of intervention. The use of psychotropics for sub-threshold phenomena requires a judicious weighing of the relevant facts (which are often sparse) and values.     

The electronic spreadsheet as a professional productivity tool

One focus of this paper is on the use of a personal computer and its applications programs as a professional productivity tool. The intent is to illustrate ways faculty can use computer technology in managing complexity and change in their professional lives. After briefly reviewing some conventional uses of personal computer applications programs, the paper describes techniques by which an electronic spreadsheet can be used to contribute to professional productivity. Examples illustrate the use of an electronic spreadsheet as a memory aid and tool in monitoring work habits and setting task priorities. A second focus is on the study of human-computer interaction. After suggesting the generality of certain phenomena, the paper describes some implications for research and for the design of computer applications programs.     

Leader-member exchange and citizenship behaviors: a meta-analysis

This article provides a meta-analytic review of the relationship between the quality of leader-member exchanges (LMX) and citizenship behaviors performed by employees. Results based on 50 independent samples (N = 9,324) indicate a moderately strong, positive relationship between LMX and citizenship behaviors (rho = .37). The results also support the moderating role of the target of the citizenship behaviors on the magnitude of the LMX-citizenship behavior relationship. As expected, LMX predicted individual-targeted behaviors more strongly than it predicted organizational targeted behaviors (rho = .38 vs. rho = .31), and the difference was statistically significant. Whether the LMX and the citizenship behavior ratings were provided by the same source or not also influenced the magnitude of the correlation between the 2 constructs.     

Self-focused attention and negative affect: a meta-analysis

This meta-analysis synthesized 226 effect sizes reflecting the relation between self-focused attention and negative affect (depression, anxiety, negative mood). The results demonstrate the multifaceted nature of self-focused attention and elucidate major controversies in the field. Overall, self-focus was associated with negative affect. Several moderators qualified this relationship. Self-focus and negative affect were more strongly related in clinical and female-dominated samples. Rumination yielded stronger effect sizes than nonruminative self-focus. Self-focus on positive self-aspects and following a positive event were related to lower negative affect. Most important, an interaction between foci of self-attention and form of negative affect was found: Private self-focus was more strongly associated with depression and generalized anxiety, whereas public self-focus was more strongly associated with social anxiety.     

Relations between personality and coping: a meta-analysis

Personality may directly facilitate or constrain coping, but relations of personality to coping have been inconsistent across studies, suggesting a need for greater attention to methods and samples. This meta-analysis tested moderators of relations between Big Five personality traits and coping using 2,653 effect sizes drawn from 165 samples and 33,094 participants. Personality was weakly related to broad coping (e.g., Engagement or Disengagement), but all 5 traits predicted specific strategies. Extraversion and Conscientiousness predicted more problem-solving and cognitive restructuring, Neuroticism less. Neuroticism predicted problematic strategies like wishful thinking, withdrawal, and emotion-focused coping but, like Extraversion, also predicted support seeking. Personality more strongly predicted coping in young samples, stressed samples, and samples reporting dispositional rather than situation-specific coping. Daily versus retrospective coping reports and self-selected versus researcher-selected stressors also moderated relations between personality and coping. Cross-cultural differences were present, and ethnically diverse samples showed more protective effects of personality. Richer understanding of the role of personality in the coping process requires assessment of personality facets and specific coping strategies, use of laboratory and daily report studies, and multivariate analyses.     

The actor-observer asymmetry in attribution: a (surprising) meta-analysis

The actor-observer hypothesis (E. E. Jones & R. E. Nisbett, 1971) states that people tend to explain their own behavior with situation causes and other people's behavior with person causes. Widely known in psychology, this asymmetry has been described as robust, firmly established, and pervasive. However, a meta-analysis on 173 published studies revealed average effect sizes from d = -0.016 to d = 0.095. A moderator analysis showed that the asymmetry held only when the actor was portrayed as highly idiosyncratic, when hypothetical events were explained, when actor and observer were intimates, or when free-response explanations were coded. In addition, the asymmetry held for negative events, but a reverse asymmetry held for positive events. This valence effect may indicate a self-serving pattern in attribution, but across valence, no actor-observer asymmetry exists.