Meta-analytic Reviews in the Organizational Sciences: Two Meta-analytic Schools on the Way to MARS (the Meta-analytic Reporting Standards)

Purpose

The purpose of this study was to review the Meta-Analysis Reporting Standards (MARS) of the American Psychological Association (APA) and highlight opportunities for improvement of meta-analytic reviews in the organizational sciences.

Design/Methodology/Approach

The paper reviews MARS, describes “best” meta-analytic practices across two schools of meta-analysis, and shows how implementing such practices helps achieve the aims set forth in MARS. Examples of best practices are provided to aid readers in finding models for their own research.

Implications/Value

Meta-analytic reviews are a primary avenue for the accumulation of knowledge in the organizational sciences as well as many other areas of science. Unfortunately, many meta-analytic reviews in the organizational sciences do not fully follow professional guidelines and standards as closely as they should. Such deviations from best practice undermine the transparency and replicability of the reviews and thus their usefulness for the generation of cumulative knowledge and evidence-based practice. This study shows how implementing “best” meta-analytic practices helps to achieve the aims set forth in MARS. Although the paper is written primarily for organizational scientists, the paper’s recommendations are not limited to any particular scientific domain.     

The Fakability of Bar-On's Emotional Quotient Inventory Short Form: Catch Me if You Can

We developed a method for estimating the dollar utility of changes in job performance associated with illnesses and their treatments. Then we applied this method to predict, for each job in the economy, the difference in productivity costs associated with the illness of Seasonal Allergic Rhinitis (SAR) and that due to the difference between 2 commonly used treatments of SAR. The findings suggest that workers are 5% less productive when affected by SAR, and that when workers treat their SAR with desloratadine (a nonsedating antihistamine) instead of diphenhydramine (an over-the-counter 1st-generation antihistamine), they are 7% more productive, translating to a daily productivity cost differential between the 2 treatments of $11 per day, or $2.6 billion annually. The jobs most affected require high amounts of selective attention and perceptual speed (e.g., Aircraft Pilots and Flight Engineers, and those in the fields of manufacturing, security, and emergency response).     

The Protective Influence of Relationship Commitment on the Effects of Facebook Addiction on Marital Disaffection

Abstract

Previous research has suggested that Facebook use can lead to adverse romantic relationship outcomes due to interpersonal conflicts, interactions with potential romantic alternatives, and jealousy. However, these associations have been explored mainly with undergraduates, focusing primarily on conflict rather than emotional disengagement. The current study examined the associations between Facebook addiction and marital disaffection (e.g., loss of love, emotional disengagement) amongst 138 (95 females and 43 males) cohabiting married Facebook users residing in the United States. The results revealed that Facebook addiction and marital disaffection were positively related, even after controlling for relationship commitment. Additionally, greater relationship commitment weakened the association between Facebook addiction and marital disaffection. There are likely multiple explanations for the current findings; however, results suggest that higher levels of relationship commitment may protect spouses against the negative relationship outcomes associated with Facebook addiction. Future longitudinal work with couples is needed to clarify the directionality of the relationship between Facebook addiction and marital disaffection.     

Unrecognized Posttraumatic Stress Disorder as a Treatment Barrier for a Gang-Involved Juvenile Offender

This study examines the case of GH, an 18-year-old Latino male participating in an employment-based delinquency intervention for gang-affiliated youth. Although postintervention measures revealed that GH showed gains on key outcomes (i.e., delinquency, employment), he experienced sporadic treatment setbacks (e.g., work absenteeism, fighting) that disrupted his progress. A comprehensive psychological assessment suggested that his aggressive, illegal behavior and difficulty maintaining employment could have been influenced by previously undiagnosed posttraumatic stress disorder (PTSD). Excerpts from counseling sessions illustrated how reactive aggression, hypervigilance, sleep disruptions, and emotional numbing could have interfered with treatment gains and ultimately contributed to GH's re-arrest. Implications for early, accurate identification of PTSD in delinquency interventions for gang youth are discussed.     

Structure-Making

Friends of states of affairs and structural universals appeal to a relation, structure-making, that is allegedly a kind of composition relation: structure-making ‘builds’ facts out of particulars and universals, and ‘builds’ structural universals out of unstructured universals. D. M. Armstrong, an eminent champion of structures, endorses two interesting theses concerning composition. First, that structure-making is a composition relation. Second, that it is not the only (fundamental) composition relation: Armstrong also believes in a mode of composition that he calls mereological, and which he takes to be the only kind of composition recognized by his philosophical adversaries, such as David Lewis. Armstrong, accordingly, is a kind of pluralist about compositional relations: there is more than one way to make wholes from parts. In this paper, I critically evaluate Armstrong's compositional pluralism.     

Receptivity’s Construction in Public Schools: a Component of Immigrant Integration in an Emerging Gateway

Community receptivity, a critical component in integration processes, is a place’s collective response to newcomers. It is a constructed context in which the experiences of settlement and adjustment for both immigrants and non-immigrants occur. Receptivity is fluid, shaped by multi-scalar components of a community’s political, economic, social, and cultural spheres. In traditional gateways, the evolving interplay of long-established forces guides receptivity. But in new gateways, front line providers that encounter the initial settlement needs of immigrants are the vanguard of constructing the broader community’s warmth of immigrant welcome. This case study of three elementary schools in Charlotte, NC demonstrates the role of public schools as a site of receptivity’s early construction within an emerging gateway. We argue that teachers are creating receptivity building blocks within their classrooms, guiding the construction of receptivity within their schools, among the school board, the school district, and the city as a whole.     

Developing an outcome-based assessment for family therapy training: the Rochester Objective Structured Clinical Evaluation (ROSCE)

This paper addresses a growing need for cost-effective, outcome-based assessment in family therapy training. We describe the ROSCE, a structured, evidence-informed, learner-centered approach to the assessment of clinical skills developed at the University of Rochester Medical Center. The ROSCE emphasizes direct observation of trainees demonstrating clinical competencies. The format integrates both formative and summative assessment methods. It can readily be adapted to a wide variety of educational and training settings.     

Dissociative effects of orthographic distinctiveness in pure and mixed lists: an item-order account

We apply the item-order theory of list composition effects in free recall to the orthographic distinctiveness effect. The item-order account assumes that orthographically distinct items advantage item-specific encoding in both mixed and pure lists, but at the expense of exploiting relational information present in the list. Experiment 1 replicated the typical free recall advantage of orthographically distinct items in mixed lists and the elimination of that advantage in pure lists. Supporting the item-order account, recognition performances indicated that orthographically distinct items received greater item-specific encoding than did orthographically common items in mixed and pure lists (Experiments 1 and 2). Furthermore, order memory (input–output correspondence and sequential contiguity effects) was evident in recall of pure unstructured common lists, but not in recall of unstructured distinct lists (Experiment 1). These combined patterns, although not anticipated by prevailing views, are consistent with an item-order account.     

State preferences for the ACT versus SAT complicates inferences about SAT-derived state IQ estimates: A comment on Kanazawa (2006)

Kanazawa [Kanazawa, S. (2006). IQ and the wealth of states. Intelligence, 34, 593–600.] offered estimates of state IQ derived from SAT data. The purpose of this commentary is to argue that state preferences for the use of the ACT versus the SAT create biased estimates of SAT-derived state IQ for states where the ACT is more frequently used than the SAT. This error can be reduced by using both ACT and SAT data to estimate state IQ. An IQ estimate based on a ACT-SAT composite and a NAEP-derived state IQ estimate were compared as predictors of three wealth variables. Both IQ estimates cause one to conclude that states with higher mean IQ have larger gross state product per capita, higher median incomes, and a lower percentage of their population in poverty.     

Model-guided search for optimal natural-science-category training exemplars: A work in progress

Psychonomic Bulletin & Review - Under the guidance of a formal exemplar model of categorization, we conduct comparisons of natural-science classification learning across four conditions in...