Generalizability theory: A practical guide to study design,implementation, and interpretation

Generalizability Theory (GT) offers increased utility for assessment research given the ability to concurrently examine multiple sources of variance, inform both relative and absolute decision making, and determine both the consistency and generalizability of results. Despite these strengths, assessment researchers within the fields of education and psychology have been slow to adopt and utilize a GT approach. This underutilization may be due to an incomplete understanding of the conceptual underpinnings of GT, the actual steps involved in designing and implementing generalizability studies, or some combination of both issues. The goal of the current article is therefore two-fold: (a) to provide readers with the conceptual background and terminology related to the use of GT and (b) to facilitate understanding of the range of issues that need to be considered in the design, implementation, and interpretation of generalizability and dependability studies. Given the relevance of this analytic approach to applied assessment contexts, there exists a need to ensure that GT is both accessible to, and understood by, researchers in education and psychology. Important methodological and analytical considerations are presented and implications for applied use are described.     

Persistent and stable biases in spatial learning mechanisms predict navigational style

A wealth of evidence in rodents and humans supports the central roles of two learning systems—hippocampal place learning and striatal response learning—in the formation of spatial representations to support navigation. Individual differences in the ways that these mechanisms are engaged during initial encoding and subsequent navigation may provide a powerful framework for explaining the wide range of variability found in the strategies and solutions that make up human navigational styles. Previous work has revealed that activation in the hippocampal and striatal networks during learning could predict navigational style. Here, we used functional magnetic resonance imaging to investigate the relative activations in these systems during both initial encoding and the act of dynamic navigation in a learned environment. Participants learned a virtual environment and were tested on subsequent navigation to targets within the environment. We observed that a given individual had a consistent balance of memory system engagement across both initial encoding and subsequent navigation, a balance that successfully predicted the participants’ tendencies to use novel shortcuts versus familiar paths during dynamic navigation. This was further supported by the observation that the activation during subsequent retrieval was not dependent on the type of solution used on a given trial. Taken together, our results suggest a model in which the place- and response-learning systems are present in parallel to support a variety of navigational behaviors, but stable biases in the engagement of these systems influence what solutions might be available for any given individual.     

Top Ten Questions Male Sexual Abuse Survivors Want to Know from Health Care Research

Sexual abuse is an often overlooked public health issue for boys and men. Given its prevalence and well-documented connection to mental and physical health disorders, the relevance of male survivor input and engagement in health care research is profound. Using a community-based participatory research design, an in-person focus group with male survivors of sexual abuse and researchers was conducted. This paper describes the top ten research questions male sexual abuse survivors would like to have answered. Survivors were most interested in knowing how sexual abuse and assault impact men’s emotional and sexual functioning, what factors are involved in preventing and treating sexual assault-related emotional distress, and what can be done to prevent sexual abuse of boys and men. The fact that some of the questions survivors expressed an interest in knowing about have actually previously been investigated by researchers suggests a disconnect in translating evidence-based findings. Clinical and research implications include designing outreach interventions and gender-specific psychoeducation to increase engagement and access to care for men.     

A Narrative Analysis of Sibling Grief

Sibling grief is linked to serious physical and mental health outcomes, yet remains the least researched of all family bereavement. This exploratory study created a shared sibling grief narrative. Open-ended interviews were conducted with 27 participants who lost a sibling. Primary themes included Shared Life: Identity Within the Sibling Arrangement; Sibling Death: Pivotal Moments in Time; Life After Sibling Loss: Emotional Suffering, Life After Sibling Loss: Missing Roles & Changing Relationships; and The Sibling Lives On. The following study findings clarify the overlooked impact that sibling death has on the surviving sibling and demonstrate the crucial need for more sibling loss research.     

The role of personal practice in therapist skill development: a model to guide therapists,educators, supervisors and researchers

Prior to 2000, personal practice (PP) for therapists mostly meant personal therapy. Recently a new landscape of PPs has emerged, with meditation-based programs and therapy self-practice/self-reflection (SP/SR) programs playing an increasing role in training and personal/professional development. The challenge now for practitioners and researchers is to refocus on the role of PPs in training and professional development. Are PPs of value - or not? Do they have a role in therapist development? How might PPs enhance therapist skilfulness? Do different PPs act in similar or different ways? Currently, the PP literature lacks a theoretical framework to guide practitioners in their choice of PPs or researchers in their choice of research questions and measures. The purpose of this article is to provide such a framework, the Personal Practice (PP) model. The PP model proposes primary impacts of PPs in four domains: personal development/wellbeing, self-awareness, interpersonal beliefs/attitudes/skills and reflective skills. The model also suggests a secondary impact on therapists’ conceptual/technical skills when therapists use reflection to consider the implications of their PP for their “therapist self”. We offer some suggestions to enhance the quality of future research, and conclude that PPs may play an important and perhaps unique role in therapist training.     

Vitalizing Enactment: A Relational Exploration

Drawing from her extensive work with deeply disturbed children Alvarez (2012) theorized a form of intervention termed “vitalization” in which the analyst actively reaches out to contact and “reclaim” her most inaccessible patients, engaging them in the world of emotions and relationships. In this paper I consider Alvarez’s ideas through the lens of Relational thought, reconceptualizing vitalization as a unique form of enactment that can draw the analytic dyad from deadened impasse into enlivened contact. In vitalizing enactment embryonic affects, hopes, and longings find expression and are potentiated for patient and analyst alike. This is a view of enactment as a progressive and creative lived experience, rather than an unconscious collision to be survived and symbolized. I contextualize vitalizing enactment in relation to Alvarez’s original formulations as well as relevant contemporary theories and present a clinical vignette to illustrate this paper’s themes.     

Intersectional experiences of discrimination in a low‐resource urban community: An exploratory latent class analysis

There have been increasing calls for the application of an intersectionality framework to understand and address discrimination and health inequities among diverse communities. Yet there have been theoretical debates regarding to whom intersectionality applies and how intersectional experiences of discrimination are associated with health outcomes. The current study aimed to contribute to these theoretical debates and inform practical applications to reduce health inequities. Data were drawn from a community health survey in New Haven, CT (N = 1,293 adults) and analysed using latent class analysis. Results yielded 4 classes. Members of the 4 classes were similar sociodemographically. Three classes of participants reported experiencing discrimination, and members of these classes had greater stress, higher rates of smoking and sleep disruption, and worse overall health than members of the class reporting no discrimination. Members of 2 classes made multiple, or intersectional, attributions for discrimination, and members of these classes reported the most frequent discrimination. Findings suggest that community members who are sociodemographically similar may have diverse discrimination experiences. Multilevel interventions that address multiple forms of discrimination (e.g., racism and sexism) may hold promise for reducing discrimination and, ultimately, health inequities within low‐resource urban community settings.     

Emotion Regulation in Families of Children with Behavior Problems and Nonclinical Comparisons

The current study compared parents’ emotion regulation (ER) in clinical (those with a child with externalizing behavioral problems) and low-risk comparison families. Additionally, mediation models were explored with parent ER predicting child behavior problems through child ER. Participants were 60 families with children (71.7% boys; 73% Caucasian) ages 2 through 8 years (M?=?4.62; SD?=?1.69) from a rural population in the United States: 34 clinical families referred for parent training and 26 nonclinical families. A blocking design was used to balance the two groups on key demographic characteristics. Parents’ and children’s ER was assessed using parent-report surveys and structured behavioral observations. Analyses indicated higher rates of parental emotion dysregulation (specifically, more difficulty when upset with achieving goal-directed behaviors, p?=?.01, d?=?0.67; controlling impulses, p?=?.01, d?=?0.64; limited use of ER strategies, p?=?.02, d?=?0.62; and more negative verbalizations to their child during the observed task, p?<?.01, d?=?0.73) and child emotion dysregulation (specifically, more difficulty as reported by parents, p?<?.01, d?=??2.42) in the clinical group. Mediational analyses indicated there were indirect paths from parental ER to children’s behavioral problems through child ER. Findings from this research suggest a need to measure and target ER in both parents and their children when working with families who are referred for treatment of child behavior problems.