The detection and influence of problematic item content in ability tests: An examination of sensitivity review practices for personnel selection test development

In organizational and educational practices, sensitivity reviews are commonly advocated techniques for reducing test bias and enhancing fairness. In the present paper, results from two studies are reported which investigate how effective individuals are at detecting problematic test content and the influence such content has on important testing outcomes. In Study 1, signal detection analyses are used to examine the role of individual differences in the identification of insensitive test items, while Study 2 investigates the extent to which insensitivity differentially influences item performance and reactions. Results revealed small but significant differences in the overall accuracy and response tendencies of student test reviewers on the basis of demographics and key individual differences variables. Contrary to predictions however, problematic items did not exhibit differential item functioning across sex nor did their presence engender negative test taker reactions. Implications and suggestions for future research and sensitivity review practices are discussed.     

Comparing Paper-and-Pencil and Internet Survey Methods Conducted in a Combat-Deployed Environment

The Unit Behavioral Health Needs Assessment Survey (UBHNAS) is a tool used to aid behavioral health providers in assessing the needs of service members of a military unit. Traditionally, the survey has been administered by paper-and-pencil; however, implementing the survey via the Internet may be a faster and easier way to administer the survey. There are, however, potential drawbacks to Internet survey administration, and previous studies comparing the 2 methods have yielded inconsistent findings. Using a between-subjects design with a combat-deployed military sample, the present study compared the 2 survey administration methods. Specifically, we assessed comparability for (a) psychological constructs, (b) auxiliary measures (such as completion time, frequency of missing data, and length of written comments), and (c) ratings and perceptions of the UBHNAS, and preference in methodology. The method of survey administration did not predict differences in the psychological outcome variables. However, participants in the paper-and-pencil condition reported higher rates of comfort answering questions, belief that responses would remain anonymous, and frankness and honesty in answering questions. Nevertheless, participants in both conditions preferred to take the survey via the Internet as opposed to paper-and-pencil in the future. Finally, participants in the Internet condition completed the survey faster and tended to write longer comments, although in terms of the comments being informative, there was no difference between the groups. Based on our findings, we recommend the use of the Internet for administering the UBHNAS; however, we caution that there may be tradeoffs regarding concerns about comfort, honesty, and anonymity.     

Much ado about norming: The Behavior Rating Inventory of Executive Function

The Behavior Rating Inventory of Executive Function (BRIEF) is a rating scale designed to assess executive functions in everyday life that is widely used in school and clinical settings and in research studies. It has been recently suggested, however, that the limited geographic stratification of the standardization sample renders the measure overly sensitive. We evaluated this hypothesis by examining BRIEF scores across studies of typically developing children and adolescents. Thirty-nine studies were identified that included at least one of three possible index scores. Mean scores across studies were (a) within one to two T-score units from the standardization sample mean of 50, (b) tended to be slightly lower than 50, and (c) were unrelated to geographic location (US Census regions or internationally). These findings refute recent claims that the BRIEF is overly sensitive and further add to the large body of literature supporting the validity of the measure.     

Reasonable Hope: Construct, Clinical Applications, and Supports

To read this article's abstract in both Spanish and Mandarin Chinese, please visit the article's full-text page on Wiley InterScience ( http://interscience.wiley.com/journal/famp ).
Hope may be the most laden shorthand term of all time. Everyone wants it; few know how to articulate what it is. Although family therapists frequently work to restore hope with hopeless families, they have contributed little to the abundant literature on hope. I present a new conceptualization of hope—reasonable hope—that reflects how family therapists think and practice. By subscribing to reasonable hope, clinicians enhance their ability to offer accompaniment and bear witness to clients. I describe clinical practices that, informed by reasonable hope, also facilitate its cocreation. Finally, I suggest supports for clinicians who practice reasonable hope.     

The Evaluation of Family Functioning by the Family Assessment Device: A Systematic Review of Studies in Adult Clinical Populations

A large body of research, documenting the impact of a family's functioning on health outcomes, highlights the importance of introducing the evaluation of patients' family dynamics into clinical judgment. The Family Assessment Device (FAD) is a self‐report questionnaire designed to assess specific dimensions of family functioning. This qualitative systematic review, which follows PRISMA guidelines, aimed to identify the FAD's clinimetric properties and to report the incremental utility of its inclusion in clinical settings. A thorough literature search was performed, using both computerized and manual searches, yielding a total of 148 studies that were included in this review. The FAD has been extensively used in a variety of research contexts. In the majority of studies it was able to discriminate between clinical populations and controls and among groups of patients with different illnesses. The FAD also showed good test–retest and concurrent reliability, and modest sensitivity to change after treatment. FAD‐dysfunctional family functioning was related to several patient clinical outcomes, including lower recovery rates and adherence to treatment, longer recovery time, poorer quality of life, and increased risk of relapse and drop‐out. The present review demonstrates that the FAD is a suitable instrument for the evaluation of family functioning both in clinical and research settings.     

Reliability and Validity of a Short Version of the General Functioning Subscale of the McMaster Family Assessment Device

The General Functioning 12‐item subscale (GF12) of The McMaster Family Assessment Device (FAD) has been validated as a single index measure to assess family functioning. This study reports on the reliability and validity of using only the six positive items from the General Functioning subscale (GF6+). Existing data from two Western Australian studies, the Raine Study (RS) and the Western Australian Child Health Survey (WACHS), was used to analyze the psychometric properties of the GF6+ subscale. The results demonstrated that the GF6+ subscale had virtually equivalent psychometric properties and was able to identify almost all of the same families who had healthy or unhealthy levels of functioning as the full GF12 subscale. In consideration of the constraints faced by large‐scale population‐based surveys, the findings of this study support the use of a GF6+ subscale from the FAD, as a quick and effective tool to assess the overall functioning of families.     

Child Maltreatment in DSM‐5 and ICD‐11

Child maltreatment is widespread and has a tremendous impact on child victims and their families. Over the past decade, definitions of child maltreatment have been developed that are operationalized, face valid, and can be reliably applied in clinical settings. These definitions have informed the revised Diagnostic and Statistical Manual (American Psychiatric Association, 2013) and are being considered for the International Classification of Disease–11 (World Health Organization). Now that these definitions are available in major diagnostic systems, primary healthcare providers and clinicians who see children and families are poised to help screen for, identify, prevent, and treat child maltreatment. This article reviews the definitions of maltreatment in these diagnostic systems, along with assessment and screening tools, and empirically supported prevention and intervention approaches.     

Individual and Community Resilience Factors Among Lesbian,Gay, Bisexual,Queer and Questioning Youth and Adults in Israel

Drawing on resilience theories, this study examined the individual and community factors of Israeli lesbians, gays, bisexuals, queers, and questioning (LGBQs) that contribute to positive mental health and the degree to which individual and community protective factors mitigate the adverse effect of risk factors for poor mental health. Differences in resilience factors between LGBQ youth and adults were explored. Data were collected on 890 LGBQ youth and adults. Findings emphasize the role of community‐level resilience factors in the lives of LGBQs, and that these support systems differ slightly between the two age groups. Among youth, family support was both a strong predictor for well‐being and a protective factor for mental distress. Although family support was found as a resilience factor among adults as well, other community‐level factors (friends’ support, LGBT connectedness and having steady partner) were found as protective factors for poorer mental health. These findings suggest for efforts on fostering familial support for LGBQ youth and a multi‐level system that offers support at the familial, peer, relationship and community levels for both LGBQ youth and adults.     

Academic and Social Integration on Campus Among Sexual Minority Students: The Impacts of Psychological and Experiential Campus Climate

A heterosexist campus climate can increase risk for mental health problems for sexual minority students; however, the relationship between campus climate for sexual minorities and academic outcomes remains understudied. Using a sample of sexual minority respondents extracted from a campus climate survey conducted at a large university in the Midwest, we examine relationships between multiple dimensions of psychological and experiential campus climate for sexual minorities with academic integration (academic disengagement, grade‐point average [GPA]) and social integration (institutional satisfaction, acceptance on campus). We also investigate the protective role of engagement with informal academic and peer‐group systems. Findings suggest campus climate affects sexual minority students’ integration. In multivariate analyses, perceptions of whether lesbian, gay, and bisexual (LGB) people could be open about their sexual identity was positively associated with acceptance on campus; personal heterosexist harassment was positively associated with academic disengagement and negatively with GPA. Students’ informal academic integration (instructor relations) and informal social integration (LGB friends) demonstrated influential main effects but did not moderate any of the climate‐outcome relationships. Researchers should further explore the relationships between climate and academic outcomes among sexual minority students, both collectively and among specific sub‐groups, and address the role of other protective factors.     

Resilience and coping in trauma spectrum symptoms prediction: A structural equation modeling approach

Resilience is increasingly recognized as a relevant factor in shaping psychological response to natural disasters. Aim of the study is to examine in the context of a natural disaster the potential effects of resilience on the relation between coping and trauma spectrum symptoms, using structural equation modeling.A sample of 371 students who survived the earthquake in L’Aquila (Italy) were cross-sectionally evaluated using Resilience Scale for Adolescents, Brief Cope and Trauma and Loss Spectrum scale.The model shows a direct path of positive and emotional coping styles on resilience. Emotional coping shows also a direct impact on the outcome; positive and emotional coping results to be positively correlated as well as emotional and disengagement coping styles. Resilience directly affects the PTSD symptoms, partially mediating the impact of the coping styles. The model explains 30% of the variance in the outcome, i.e. the Post-Traumatic Stress Disorder (PTSD) symptoms, with very good fit indexes.Resilience operates as a protective factor from stress symptom development. It is likely that emotional and disengagement coping skills are rapidly involved after a traumatic exposure but when problem focused coping intervenes, resilience allows it to buffer the stressors or even guides toward a more successful outcome.