Meta-analytic Reviews in the Organizational Sciences: Two Meta-analytic Schools on the Way to MARS (the Meta-analytic Reporting Standards)

Purpose

The purpose of this study was to review the Meta-Analysis Reporting Standards (MARS) of the American Psychological Association (APA) and highlight opportunities for improvement of meta-analytic reviews in the organizational sciences.

Design/Methodology/Approach

The paper reviews MARS, describes “best” meta-analytic practices across two schools of meta-analysis, and shows how implementing such practices helps achieve the aims set forth in MARS. Examples of best practices are provided to aid readers in finding models for their own research.

Implications/Value

Meta-analytic reviews are a primary avenue for the accumulation of knowledge in the organizational sciences as well as many other areas of science. Unfortunately, many meta-analytic reviews in the organizational sciences do not fully follow professional guidelines and standards as closely as they should. Such deviations from best practice undermine the transparency and replicability of the reviews and thus their usefulness for the generation of cumulative knowledge and evidence-based practice. This study shows how implementing “best” meta-analytic practices helps to achieve the aims set forth in MARS. Although the paper is written primarily for organizational scientists, the paper’s recommendations are not limited to any particular scientific domain.     

The Effect of Commitment to a Learning Goal,Self-Efficacy,and the Interaction Between Learning Goal Difficulty and Commitment on Performance in a Business Simulation

The effect of commitment to a learning goal, self-efficacy, and the interaction between learning goal difficulty and goal commitment with performance was investigated using a highly complex business simulation. Participants (n?=?128) needed to acquire knowledge in order to perform the task effectively. The correlation between commitment to the learning goal and performance was positive and significant (r = .47, p < .001). Commitment was also a moderator of the learning goal–task performance effect. The relationship between self-efficacy and performance was partially mediated by commitment to the learning goal. Performance was a partial mediator of the relationship between goal commitment and self-efficacy. Seventy-five percent of the participants self-set a performance goal. The correlation between self-set performance goals and performance was positive and significant (r = .31, p < .001).     

Ophthalmic disorder may affect visuo-attentional performance in childhood

The aim of this study was to explore the visuo-attentional skills of children with an ophthalmic disorder. Twenty-four patients and 60 healthy controls between the ages 4 and 7 years, all right-handed with normal or corrected-to-normal close visual acuity, were divided into four age groups. Patients' diagnoses included refractive disorders (e.g., myopia, hypermetropia), strabismus, amblyopia, cataract, and nystagmus. All participants performed nine paper-and-pencil visuospatial tasks aiming to assess selective attention (cancellation tasks), spatial working memory (symbol orientation task), fine visual analysis (embedded figures test), and simple perceptual analysis (shape-matching task). In healthy children, the results showed that performance on all visuo-attentional tasks improved with age. While perception, orientation of attention, and visual working memory develop by the time children begin school (age 5), more sophisticated abilities such as attention disengagement and motor control continue to develop during late childhood. Moreover, a spatial bias in attention orienting appeared with reading acquisition (6–7 years). In ophthalmic children, at 4 years of age defects were observed in all assessed functions, but at 7 years an attentional deficit was virtually the only one remaining. Overall, the results demonstrate that children with an ophthalmologic disorder may experience difficulties with visuospatial tasks despite corrected-to-normal visual acuity.     

Profiles of Everyday Executive Function in Acquired and Developmental Disorders

The current study focused on the early development of inhibitory control in 5- to 7-year-old children attending kindergarten in two Eastern-European countries, Romania and Russia. These two countries share many aspects of child-rearing and educational practices, previously documented to influence the development of inhibitory control. Using the Lurian-based developmental approach offered by the Developmental Neuropsychological Assessment battery, the study aimed to contribute to cross-cultural developmental neuropsychology by exploring (a) early interrelationships between subcomponents of inhibitory control (response suppression and attention control) and generative fluency (verbal and figural) in these two cultures, as well as (b) the predictive value of external factors (culture and maternal education) and individual differences (age, gender, nonverbal intelligence, trait anxiety) on inhibitory control and fluency outcomes in children from both countries. First, findings in both culture samples suggest that even at this young age, the construct of inhibitory control cannot be considered a unitary entity. Second, differences in maternal education were not predictive of either inhibitory control or fluency scores. However, children’s attention control performance varied as a function of culture, and the direction of these cultural effects differed by whether the target outcome involved performance accuracy versus efficiency as an output. Findings also confirmed the previously documented intensive developmental improvement in preschoolers’ inhibitory control during this period, influencing measures of response suppression and particularly attention control. Finally, the results further stress the importance of individual differences effects in trait anxiety on attention control efficiency across cultures.     

Developmental changes in attentional performance in urban children from eight to thirteen years

Abstract

In an earlier study of an epidemiological sample of 435 urban 8-year-old children, factor analytically-derived components of attention, as assessed by neuropsychological tests, were identified and were found to be significantly related to adaptive functioning. In this study we followed that cohort longitudinally and assessed developmental changes in specific aspects of attentional function into early adolescence. Significant reductions in omission errors and improvements in reaction times were found from ages 8 to 13 years on different versions of the Continuous Performance Task, a measure of sustained attention, with the effects varying by task difficulty level and subjects' gender. Significant improvements across age also were found on measures of the ability to focus attention and execute a response, shift attentional focus, and encode information in memory. In general, the most rapid changes in attention occurred between ages 8 to 10 years with more gradual changes occurring between ages 10 to 13. The results highlight the importance of developmental epidemiological approaches for assessing and predicting the normal evolution of attentional function in school-aged children.     

Black Athena: Two views

Black Athena: The Afroasiatic Roots of Classical Civilization, vol. 1, The Fabrication of Ancient Greece, 1785–1985, by Martin Bemal, Free Association Books, 1987, 576 pages, hb £30, pb £15     

Adaptive midlife defense mechanisms and late-life health

A growing body of research suggests that personality characteristics relate to physical health; however, this relationship has primarily been tested in cross-sectional studies that have not followed the participants into old age. The present study utilizes data from a 70-year longitudinal study to prospectively examine the relationship between the adaptive defense mechanisms in midlife and objectively assessed physical health in late life. In addition to examining the direct effect, we test whether social support mediates this relationship. The sample consisted of 90 men who were followed for over seven decades beginning in late adolescence. Health ratings from medical records were made at three time points (ages 70, 75, and 80). Defense mechanisms were coded from narratives by trained independent raters (Vaillant, Bond, & Vaillant, 1986). Independent raters assessed social supports between ages 50 and 70. More adaptive defenses in midlife were associated with better physical health at all three time points in late life. These relationships were partially mediated by social support. Findings are consistent with the theory that defense maturity is important for building social relationships, which in turn contribute to better late-life physical health. Psychological interventions aimed at improving these domains may be beneficial for physical health.     

Are You Minority Enough? Language Ability Affects Targets' and Perceivers' Assessments of a Candidate's Appropriateness for Affirmative Action

In the present study, we focus on Spanish language ability as a predictor of the extent to which Latinos are viewed by both others and themselves as full-fledged minorities. Study 1 shows that perceivers viewed Latinos described as Spanish speakers as more appropriate for race-based affirmative action than Latinos who were unable to speak Spanish (controlling for intellectual competence evaluations). Moreover, the affirmative action advantage that the Spanish-speaking Latinos had over the non-Spanish-speaking Latinos was explained by perceivers viewing the Spanish speakers as having greater minority status. The results of Study 2 suggest that Spanish-speaking ability is related to self-perceptions of minority status among Latinos. Like their perceivers in Study 1, Latinos who have less Spanish-speaking ability feel less Latino and report reluctance to apply for race-based assistance in the form of academic minority scholarships.     

Emotion and appraisal: A study using ecological momentary assessment

This study employed Ecological Momentary Assessment to test predictions from appraisal theories of emotion about the relationships between emotions and appraisals, using a sample of police officers from Singapore. Strong support was obtained for the predictions, thus demonstrating ecological validity of appraisal theories while circumventing shortcomings of previously used methods in appraisal studies. The results also indicate that the emotions were accounted for by specific configurations of appraisals over and above those accounted for by individual constituent appraisals.     

Cognitive and temperamental vulnerability to depression: Longitudinal associations with regional cortical activity

Posterior cortical activity may be related to individual differences in temperamental emotionality, especially traits implicated in depression vulnerability. We previously reported that electroencephalographic (EEG) indices of cortical activity in posterior regions were associated with temperamental positive emotionality (PE) in early childhood. This project examined whether EEG indices of regional cortical activity, assessed at age 5–6, were associated with child temperament and cognitive vulnerability to depression, assessed at age 7. Asymmetry in posterior cortical activity measured at age 5–6 was associated with PE at follow-up at age 7, and with greater helplessness during a standardised laboratory task simulating a mild interpersonal rejection. Findings provide further support for the notion that low PE and depression are associated with similar patterns of cortical activity. Furthermore, these patterns of activity may have observable behavioural and cognitive correlates that are meaningfully linked to the phenomenology of depression.