Meta-analytic Reviews in the Organizational Sciences: Two Meta-analytic Schools on the Way to MARS (the Meta-analytic Reporting Standards)

Purpose

The purpose of this study was to review the Meta-Analysis Reporting Standards (MARS) of the American Psychological Association (APA) and highlight opportunities for improvement of meta-analytic reviews in the organizational sciences.

Design/Methodology/Approach

The paper reviews MARS, describes “best” meta-analytic practices across two schools of meta-analysis, and shows how implementing such practices helps achieve the aims set forth in MARS. Examples of best practices are provided to aid readers in finding models for their own research.

Implications/Value

Meta-analytic reviews are a primary avenue for the accumulation of knowledge in the organizational sciences as well as many other areas of science. Unfortunately, many meta-analytic reviews in the organizational sciences do not fully follow professional guidelines and standards as closely as they should. Such deviations from best practice undermine the transparency and replicability of the reviews and thus their usefulness for the generation of cumulative knowledge and evidence-based practice. This study shows how implementing “best” meta-analytic practices helps to achieve the aims set forth in MARS. Although the paper is written primarily for organizational scientists, the paper’s recommendations are not limited to any particular scientific domain.     

Ophthalmic disorder may affect visuo-attentional performance in childhood

The aim of this study was to explore the visuo-attentional skills of children with an ophthalmic disorder. Twenty-four patients and 60 healthy controls between the ages 4 and 7 years, all right-handed with normal or corrected-to-normal close visual acuity, were divided into four age groups. Patients' diagnoses included refractive disorders (e.g., myopia, hypermetropia), strabismus, amblyopia, cataract, and nystagmus. All participants performed nine paper-and-pencil visuospatial tasks aiming to assess selective attention (cancellation tasks), spatial working memory (symbol orientation task), fine visual analysis (embedded figures test), and simple perceptual analysis (shape-matching task). In healthy children, the results showed that performance on all visuo-attentional tasks improved with age. While perception, orientation of attention, and visual working memory develop by the time children begin school (age 5), more sophisticated abilities such as attention disengagement and motor control continue to develop during late childhood. Moreover, a spatial bias in attention orienting appeared with reading acquisition (6–7 years). In ophthalmic children, at 4 years of age defects were observed in all assessed functions, but at 7 years an attentional deficit was virtually the only one remaining. Overall, the results demonstrate that children with an ophthalmologic disorder may experience difficulties with visuospatial tasks despite corrected-to-normal visual acuity.     

Multigroup confirmatory factor analysis and structural invariance with age of the Behavior Rating Inventory of Executive Function (BRIEF)—French version

The parent and teacher forms of the French version of the Behavioral Rating Inventory of Executive Function (BRIEF) were used to evaluate executive function in everyday life in a large sample of healthy children (N = 951) aged between 5 and 18.

Several psychometric methods were applied, with a view to providing clinicians with tools for score interpretation. The parent and teacher forms of the BRIEF were acceptably reliable. Demographic variables (such as age and gender) were found to influence the BRIEF scores. Confirmatory factor analysis was then used to test five competing models of the BRIEF's latent structure. Two of these models (a three-factor model and a two-factor model, both based on a nine-scale structure) had a good fit. However, structural invariance with age was only obtained with the two-factor model.

The French version of the BRIEF provides a useful measure of everyday executive function and can be recommended for use in clinical research and practice.     

Developmental changes in attentional performance in urban children from eight to thirteen years

Abstract

In an earlier study of an epidemiological sample of 435 urban 8-year-old children, factor analytically-derived components of attention, as assessed by neuropsychological tests, were identified and were found to be significantly related to adaptive functioning. In this study we followed that cohort longitudinally and assessed developmental changes in specific aspects of attentional function into early adolescence. Significant reductions in omission errors and improvements in reaction times were found from ages 8 to 13 years on different versions of the Continuous Performance Task, a measure of sustained attention, with the effects varying by task difficulty level and subjects' gender. Significant improvements across age also were found on measures of the ability to focus attention and execute a response, shift attentional focus, and encode information in memory. In general, the most rapid changes in attention occurred between ages 8 to 10 years with more gradual changes occurring between ages 10 to 13. The results highlight the importance of developmental epidemiological approaches for assessing and predicting the normal evolution of attentional function in school-aged children.     

Black Athena: Two views

Black Athena: The Afroasiatic Roots of Classical Civilization, vol. 1, The Fabrication of Ancient Greece, 1785–1985, by Martin Bemal, Free Association Books, 1987, 576 pages, hb £30, pb £15     

Adaptive midlife defense mechanisms and late-life health

A growing body of research suggests that personality characteristics relate to physical health; however, this relationship has primarily been tested in cross-sectional studies that have not followed the participants into old age. The present study utilizes data from a 70-year longitudinal study to prospectively examine the relationship between the adaptive defense mechanisms in midlife and objectively assessed physical health in late life. In addition to examining the direct effect, we test whether social support mediates this relationship. The sample consisted of 90 men who were followed for over seven decades beginning in late adolescence. Health ratings from medical records were made at three time points (ages 70, 75, and 80). Defense mechanisms were coded from narratives by trained independent raters (Vaillant, Bond, & Vaillant, 1986). Independent raters assessed social supports between ages 50 and 70. More adaptive defenses in midlife were associated with better physical health at all three time points in late life. These relationships were partially mediated by social support. Findings are consistent with the theory that defense maturity is important for building social relationships, which in turn contribute to better late-life physical health. Psychological interventions aimed at improving these domains may be beneficial for physical health.     

Are You Minority Enough? Language Ability Affects Targets' and Perceivers' Assessments of a Candidate's Appropriateness for Affirmative Action

In the present study, we focus on Spanish language ability as a predictor of the extent to which Latinos are viewed by both others and themselves as full-fledged minorities. Study 1 shows that perceivers viewed Latinos described as Spanish speakers as more appropriate for race-based affirmative action than Latinos who were unable to speak Spanish (controlling for intellectual competence evaluations). Moreover, the affirmative action advantage that the Spanish-speaking Latinos had over the non-Spanish-speaking Latinos was explained by perceivers viewing the Spanish speakers as having greater minority status. The results of Study 2 suggest that Spanish-speaking ability is related to self-perceptions of minority status among Latinos. Like their perceivers in Study 1, Latinos who have less Spanish-speaking ability feel less Latino and report reluctance to apply for race-based assistance in the form of academic minority scholarships.     

Emotion and appraisal: A study using ecological momentary assessment

This study employed Ecological Momentary Assessment to test predictions from appraisal theories of emotion about the relationships between emotions and appraisals, using a sample of police officers from Singapore. Strong support was obtained for the predictions, thus demonstrating ecological validity of appraisal theories while circumventing shortcomings of previously used methods in appraisal studies. The results also indicate that the emotions were accounted for by specific configurations of appraisals over and above those accounted for by individual constituent appraisals.     

Disgust: Sensory affect or primary emotional system?

We argue in this paper for the inclusion in the primary emotional systems enumerated by Panksepp of a neural system that organises disgust responses. The DISGUST system arose phylogenetically in response to danger to the internal milieu from pathogens and their toxic products. We suggest that the primitive emotive circuit, which originally provided defence by regulating consummatory behaviours, gave rise to a primary emotional system that facilitates evaluation of reinforcers. Unlike the sensory affect of distaste from which it is experimentally dissociable, disgust responses can involve flexible learned components triggered by several modalities. The anterior insula is implicated as playing a major role in the DISGUST system both in organising disgust responses in the individual and recognising disgust responses in others.