Generalizability theory: A practical guide to study design,implementation, and interpretation

Generalizability Theory (GT) offers increased utility for assessment research given the ability to concurrently examine multiple sources of variance, inform both relative and absolute decision making, and determine both the consistency and generalizability of results. Despite these strengths, assessment researchers within the fields of education and psychology have been slow to adopt and utilize a GT approach. This underutilization may be due to an incomplete understanding of the conceptual underpinnings of GT, the actual steps involved in designing and implementing generalizability studies, or some combination of both issues. The goal of the current article is therefore two-fold: (a) to provide readers with the conceptual background and terminology related to the use of GT and (b) to facilitate understanding of the range of issues that need to be considered in the design, implementation, and interpretation of generalizability and dependability studies. Given the relevance of this analytic approach to applied assessment contexts, there exists a need to ensure that GT is both accessible to, and understood by, researchers in education and psychology. Important methodological and analytical considerations are presented and implications for applied use are described.     

Persistent and stable biases in spatial learning mechanisms predict navigational style

A wealth of evidence in rodents and humans supports the central roles of two learning systems—hippocampal place learning and striatal response learning—in the formation of spatial representations to support navigation. Individual differences in the ways that these mechanisms are engaged during initial encoding and subsequent navigation may provide a powerful framework for explaining the wide range of variability found in the strategies and solutions that make up human navigational styles. Previous work has revealed that activation in the hippocampal and striatal networks during learning could predict navigational style. Here, we used functional magnetic resonance imaging to investigate the relative activations in these systems during both initial encoding and the act of dynamic navigation in a learned environment. Participants learned a virtual environment and were tested on subsequent navigation to targets within the environment. We observed that a given individual had a consistent balance of memory system engagement across both initial encoding and subsequent navigation, a balance that successfully predicted the participants’ tendencies to use novel shortcuts versus familiar paths during dynamic navigation. This was further supported by the observation that the activation during subsequent retrieval was not dependent on the type of solution used on a given trial. Taken together, our results suggest a model in which the place- and response-learning systems are present in parallel to support a variety of navigational behaviors, but stable biases in the engagement of these systems influence what solutions might be available for any given individual.     

Describing suicidality: an investigation of qualitative SSF responses

Given the incidence and seriousness of suicidality in clinical practice, the need for new and better ways to assess suicide risk is clear. While there are many published assessment instruments in the literature, survey data suggest that these measure are not widely used. One possible explanation is that current quantitatively developed assessment instruments may fail to capture something essential about the suicidal patient's experience. The current exploratory study examined a range of open ended qualitative written responses made by suicidal outpatients to five assessment prompts from the Suicide Status Form (SSF)--psychological pain, press, perturbation, hopelessness, and self-hate. Two different samples of suicidal outpatients seeking treatment, including suicidal college students (n = 119) and active duty U.S. Air Force personnel (n = 33), provided a wide range of written responses to the five SSF prompts. A qualitative coding manual was developed through a step-by-step methodology; two naive coders were trained to use the coding system and were able to sort all the patients' written responses into the content categories with very high interrater reliability (Kappa > .80). Certain written qualitative responses of the patients were more frequent than others, both within and across the five SSF constructs. Among a range of specific exploratory findings, one general finding was that two thirds of the 636 obtained written responses could be reliably categorized under four major content headings: relational (22%), role responsibilities (20%), self (15%), and unpleasant internal states (10%). Theoretical, research, and clinical implications of the methodology and data are discussed.     

Specific phonological impairments in dyslexia revealed by eyetracking

Phonological deficits in dyslexia are typically assessed using metalinguistic tasks vulnerable to extraneous factors such as attention and memory. The present work takes the novel approach of measuring phonology using eyetracking. Eye movements of dyslexic children were monitored during an auditory word recognition task in which target items in a display (e.g., candle) were accompanied by distractors sharing a cohort (candy) or rhyme (sandal). Like controls, dyslexics showed slower recognition times when a cohort distractor was present than in a baseline condition with only phonologically unrelated distractors. However, unlike controls, dyslexic children did not show slowed recognition of targets with a rhyme distractor, suggesting they had not encoded rhyme relationships. This was further explored in an overt phonological awareness test of cohort and rhyme. Surprisingly, dyslexics showed normal rhyme performance but poorer judgment of initial sounds on these overt tests. The results implicate impaired knowledge of rhyme information in dyslexia; however they also indicate that testing methodology plays a critical role in how such problems are identified.     

Top Ten Questions Male Sexual Abuse Survivors Want to Know from Health Care Research

Sexual abuse is an often overlooked public health issue for boys and men. Given its prevalence and well-documented connection to mental and physical health disorders, the relevance of male survivor input and engagement in health care research is profound. Using a community-based participatory research design, an in-person focus group with male survivors of sexual abuse and researchers was conducted. This paper describes the top ten research questions male sexual abuse survivors would like to have answered. Survivors were most interested in knowing how sexual abuse and assault impact men’s emotional and sexual functioning, what factors are involved in preventing and treating sexual assault-related emotional distress, and what can be done to prevent sexual abuse of boys and men. The fact that some of the questions survivors expressed an interest in knowing about have actually previously been investigated by researchers suggests a disconnect in translating evidence-based findings. Clinical and research implications include designing outreach interventions and gender-specific psychoeducation to increase engagement and access to care for men.     

A Narrative Analysis of Sibling Grief

Sibling grief is linked to serious physical and mental health outcomes, yet remains the least researched of all family bereavement. This exploratory study created a shared sibling grief narrative. Open-ended interviews were conducted with 27 participants who lost a sibling. Primary themes included Shared Life: Identity Within the Sibling Arrangement; Sibling Death: Pivotal Moments in Time; Life After Sibling Loss: Emotional Suffering, Life After Sibling Loss: Missing Roles & Changing Relationships; and The Sibling Lives On. The following study findings clarify the overlooked impact that sibling death has on the surviving sibling and demonstrate the crucial need for more sibling loss research.