Back to Basics with Mixed-Effects Models: Nine Take-Away Points

Purpose

Multilevel mixed effects models are widely used in organizational behavior and organizational psychology to test and advance theory. At times, however, the complexity of the models leads researchers to draw erroneous inferences or otherwise use the models in less than optimal ways. We present nine take-away points intended to enhance the theoretical precision and utility of the models.

Approach

We demonstrate our points using two types of simulated data: one in which group membership is irrelevant, and the other in which relationships exist only because of group membership. We then demonstrate that the effects we observe in simulated data replicate in organizational data.

Findings

Little that we address will be new to methodology experts; nonetheless, we draw together a variety of points that we believe will help advance both theory and analytic rigor in multilevel analyses.

Implications

We make two points that run somewhat counter to conventional norms. First, we argue that mixed-effects models are appropriate even when ICC(1) values associated with the outcome data are small and non-significant. Second, we show that high ICC(2) values are not a prerequisite for detecting emergent multilevel relationships.

Originality/Value

The article is designed to be a resource for researchers who are learning about and applying mixed-effects (i.e., multilevel) models.

     

Reducing the Risk of Internalizing Symptoms among High‐risk Hispanic Youth through a Family Intervention: A Randomized Controlled Trial

Familias Unidas is an intervention that has been found to be efficacious in preventing and reducing substance use, sexual risk, and problem behaviors among Hispanic youth. While it does not specifically target youth internalizing symptoms, the intervention works to strengthen parenting and family factors associated with reduced risk of internalizing symptoms (i.e., depression, anxiety symptoms). This study examines the effects of Familias Unidas on internalizing symptoms among high‐risk youth, as well as the role of family level factors in the intervention's effects. A total of 242 12–17‐year‐old Hispanic youth with a history of delinquency and their primary caregivers were recruited from the school and juvenile justice systems, and randomly assigned to the Familias Unidas intervention or community practice control. A linear latent growth model was used to examine intervention effects on the trajectory of adolescent internalizing symptoms from baseline to 6 and 12 months post‐baseline. Results show that the Familias Unidas intervention was more efficacious than control in reducing youth internalizing symptoms. Baseline youth externalizing and internalizing symptoms did not moderate the intervention's effects on the trajectory of youth internalizing symptoms. While parent – adolescent communication did not significantly moderate the intervention's effects, changes in parent – adolescent communication mediated the intervention's effects on internalizing symptoms, showing stronger intervention effects for youth starting with poorer communication. Findings indicate that the Familias Unidas intervention can reduce internalizing symptoms among high‐risk Hispanic youth, and that improving parent – youth communication, a protective family factor, may be one of the mechanisms by which the intervention influences youth internalizing symptoms.     

The Role of Experiencing in Psychotherapy: Attending to the “Bodily Felt Sense” of a Problem Makes Any Orientation More Effective

Focusing-Oriented Theory defines a new aspect of client experiencing – the bodily felt sense of a situation or problem. The felt sense is vague at first, sensed directly but not yet in explicit words or images. It is neither drowning in strong emotions nor is it just thinking. The chapter shows examples of how to help a client find this level and how to respond to it. When the felt sense is responded to little steps inwardly arise directly from the client's own process. It is proposed that the Philosophy of the Implicit which underlies this model, can unify our different orientations by showing us how to use any theory experientially. The client is always invited to check any therapist suggested move for resonance in the body and a sense of life being carried forward.     

Agent-based modeling: a new approach for theory building in social psychology.

Most social and psychological phenomena occur not as the result of isolated decisions by individuals but rather as the result of repeated interactions between multiple individuals over time. Yet the theory-building and modeling techniques most commonly used in social psychology are less than ideal for understanding such dynamic and interactive processes. This article describes an alternative approach to theory building, agent-based modeling (ABM), which involves simulation of large numbers of autonomous agents that interact with each other and with a simulated environment and the observation of emergent patterns from their interactions. The authors believe that the ABM approach is better able than prevailing approaches in the field, variable-based modeling (VBM) techniques such as causal modeling, to capture types of complex, dynamic, interactive processes so important in the social world. The article elaborates several important contrasts between ABM and VBM and offers specific recommendations for learning more and applying the ABM approach.     

Emotional Triggers and Psychopathology Associated with Suicidal Ideation in Urban Children with Elevated Aggressive-Disruptive Behavior

8.6% suicidal ideation (SI) was found among 349 urban 6–9 year olds in the top tercile of aggressive-disruptive behavior. SI was associated with more self-reported depression, ODD, conduct problems, and ADHD symptoms (ES 0.70–0.97) and 3.5–5 times more clinically significant symptoms. Parents rated more symptoms in older children associated with SI compared to parents of similar age children without SI, including greater somatic and behavior problems in 8–9 year olds with SI. Parent ratings did not differentiate SI and non-SI in 6–7 year olds. SI frequently co-occurred with thoughts about death. Children described anger, dysphoria and interpersonal conflict as motivators/triggers for SI and worries about safety/health as motivator/triggers for thoughts about death, suggesting that problems managing emotionally challenging situations are a specific factor in initiating SI. Universal and indicated interventions for children to strengthen emotional self-regulation and behavioral control are recommended to complement the current emphasis on suicide prevention among adolescents.     

Stereotype strength and attentional bias: Preference for confirming versus disconfirming information depends on processing capacity

In two experiments, we investigated the relationships among stereotype strength, processing capacity, and the allocation of attention to stereotype-consistent versus stereotype-inconsistent information describing a target person. The results of both experiments showed that, with full capacity, greater stereotype strength was associated with increased attention toward stereotype-consistent versus stereotype-inconsistent information. However, when capacity was diminished, greater stereotype strength was associated with increased attention toward inconsistent versus consistent information. Thus, strong stereotypes may act as self-confirming filters when processing capacity is plentiful, but as efficient information gathering devices that maximize the acquisition of novel (disconfirming) information when capacity is depleted. Implications for models of stereotyping and stereotype change are discussed.     

Intrapersonal and Ecodevelopmental Factors Associated with Smoking in Hispanic Adolescents

We examined how relationships among intrapersonal (i.e., attitudes and beliefs about smoking) and ecodevelopmental (i.e., family, school, and peer) factors influence risk for lifetime smoking in immigrant Hispanic adolescents. Our sample was comprised of 223 immigrant Hispanic adolescents and their families and was drawn from 3 middle schools in a single school district. Data collected is a result of adolescent and parent completed questionnaires as well as county school data (i.e., GPA, teacher reported effort and conduct, absences). Results indicated only poor school functioning, peer smoking, and lack of perceived harm concerning smoking were directly related to adolescent lifetime smoking. Poor school functioning and peer smoking mediated the relationship between family functioning and adolescent smoking. Implications of these results for the design of smoking preventive interventions for immigrant Hispanic adolescents are discussed.