Compliance Disengagement in Research: Development and Validation of a New Measure

In the world of research, compliance with research regulations is not the same as ethics, but it is closely related. One could say that compliance is how most societies with advanced research programs operationalize many ethical obligations. This paper reports on the development of the How I Think about Research (HIT-Res) questionnaire, which is an adaptation of the How I Think (HIT) questionnaire that examines the use of cognitive distortions to justify antisocial behaviors. Such an adaptation was justified based on a review of the literature on mechanisms of moral disengagement and self-serving biases, which are used by individuals with normal personalities in a variety of contexts, including research. The HIT-Res adapts all items to refer to matters of research compliance and integrity rather than antisocial behaviors. The HIT-Res was administered as part of a battery of tests to 300 researchers and trainees funded by the US National Institutes of Health. The HIT-Res demonstrated excellent reliability (Cronbach’s alpha = .92). Construct validity was established by the correlation of the HIT-Res with measures of moral disengagement (r = .75), cynicism (r = .51), and professional decision-making in research (r = ?.36). The HIT-Res will enrich the set of assessment tools available to instructors in the responsible conduct of research and to researchers who seek to understand the factors that influence research integrity.     

Monitoring stress among internal medicine residents: an experience-driven,practical and short measure

Residents experience severely high levels of stress, depression and burnout, leading to perceived medical errors, as well as to symptoms of impairment, such as chronic anger, cognitive impairment, suicidal behavior and substance abuse. Because research has not yet provided a psychometrically robust population-specific tool to measure the level of stress of medicine residents, we aimed at building and validating such a measure. Using an inductive scale development approach, a short, pragmatic measure was built, based on the interviews of 17 medicine residents. The Internal Medicine Residency Stress Scale (IMRSS) was then administered in a sample of 259 internal medicine residents (199 females, 60 males, M_Age = 25.6) along with the Hospital Anxiety and Depression Scale, Maslach Burnout Inventory, Satisfaction With Life Scale and Ways of Coping Checklist. The IMRSS showed satisfactory internal reliability (Cronbach’s α = .86), adequate structural validity – studied through Confirmatory Factor Analysis (χ²/df = 2.51, CFI = .94; SRMR = .037, RMSEA = .076) – and good criterion validity – the IMRSS was notably strongly correlated with emotional exhaustion (r = .64; p < .001) and anxiety (r = .57; p < .001). Because of its short length and robust psychometric qualities, the use of the IMRSS is recommended to quickly and frequently assess and monitor stress among internal medicine residents.     

Psychometric Properties of Bully,Fighting, and Victimization Scales Among Clinically Referred Youth

Bullying involvement is a multidimensional issue and a significant concern for school-aged youth. However, research on bullying involvement within clinical samples is limited. The present study examines the psychometric properties of the University of Illinois Bully, Fighting, and Victimization Scales among children and adolescents presenting for mood symptoms at a behavioral health outpatient clinic. Patients (n = 165) with an age range of 8–18 years were included in this investigation. Item frequencies, internal consistency, and construct validity were examined while confirmatory and exploratory factor analyses were conducted. Results showed that the scales were low to moderately correlated with each other. Internal consistencies were acceptable for the Bully (α = .70), Fighting (α = .84), and Victimization (α = .88) Scales. Exploratory factor analysis revealed clean three-factor solutions with items loading on their intended factors and with few cross-loadings. Fit of the confirmatory factor analysis was good when items were treated as ordinal and two items were allowed to cross-load on more than one factor. The University of Illinois Bully, Fighting, and Victimization Scales show utility for use with clinically referred youth.     

Development and Psychometric Evaluation of the Utrecht Grief Rumination Scale

Two different types of ruminative coping, depressive rumination and grief rumination, negatively influence bereavement outcome. Although grief-specific rumination is likely to be relevant in the bereavement context no internationally validated scale to measure grief rumination exists. Therefore, the current contribution aims to validate the Utrecht Grief Rumination Scale (UGRS), a scale developed to measure grief-specific rumination, in an English sample. Psychometric properties of the English UGRS were compared with those in a Dutch sample. 204 British adults (89 % women, 11 % men), bereaved on average 16 months ago, and 316 Dutch adults (88 % women, 12 % men), bereaved on average 12 months ago, filled out online questionnaires. Different types of rumination (grief rumination, brooding, reflection, trait rumination) and symptoms of psychopathology (anxiety, depression, complicated grief) were measured. A correlated five factor model provided the best fit for the UGRS. Multi-group comparisons showed that the factor structures of the English and Dutch version of the UGRS were highly similar across language groups. The UGRS showed excellent reliability. Results further supported the construct, convergent, divergent and concurrent validity of the English UGRS. The psychometric properties of the Dutch UGRS corroborated these findings. The UGRS appears a valid instrument to assess grief-specific rumination in international research and may have potential applicability as a clinical instrument to assess rumination in individuals with problematic grief.     

Swedish Acceptance and Action Questionnaire (SAAQ): a psychometric evaluation

Psychological inflexibility and experiential avoidance are equivalent (with somewhat different connotations) concepts and refer to an unwillingness to remain in contact with particular private events. This concept is most often measured by the Acceptance and Action Questionnaire (AAQ-II) and is strongly related to psychopathology and behavioral effectiveness. In this study, the preliminary psychometric properties of the Swedish version of the AAQ-II (Swedish Acceptance and Action Questionnaire—SAAQ) are presented. The study is done in two steps. In the first step, the 10-item version of the AAQ-II is investigated through principal component analysis (n = 147). Secondly, due to problems with the component structure, the instrument is reduced to a six-item version and its validity and internal consistency are investigated (n = 154). The six-item version shows good concurrent and convergent validity as well as satisfying internal consistency (α = .85). Furthermore, the Swedish six-item version of the AAQ-II showed one strong component. Test–retest reliability was satisfactory (r = .80; n = 228). In future research, predictive and external validity would be important to investigate in order to further ensure that the SAAQ is a useful measure for clinical research. In conclusion, the SAAQ has satisfactory psychometric properties, but more data need to be gathered to further explore the possibilities for the instruments in Swedish contexts.     

The Patient–Doctor Relationship Questionnaire (PDRQ-9) in Primary Care: A Validity Study

This study assessed the validity of the Patient–Doctor Relationship Questionnaire-9 (PDRQ-9) in a primary care sample (N = 180). Convergent validity was assessed through a correlation between the patient-rated PDRQ-9 and the physician-rated Difficult Doctor Patient Relationship Questionnaire-10 (DDPRQ-10). Discriminant validity was assessed through correlations between the PDRQ-9 and patient age, patient- and physician-reported health and psychological distress. To determine if the PDRQ-9 could discriminate between groups, patient PDRQ-9 ratings were compared between patients who were treated by faculty physicians versus those who were treated by residents. An exploratory factor analysis confirmed that the PDRQ-9 was made up of a single factor. The PDRQ-9 scale was internally consistent (α = .96) and significantly and negatively correlated with the DDPRQ-10 (r = ?.22, p = .003) and was not significantly correlated with patient age, health, or psychological distress. PDRQ-9 ratings were statistically greater in patients who were treated by faculty physicians than those who were treated by residents (p = .01). This study provides additional support for the reliability and validity of the PDRQ-9 as a measure of the doctor–patient relationship in a primary care sample.     

The Short Dark Triad (SD3): Adaptation and Psychometrics among At-Risk Male and Female Youths

The dark triad is a term used to describe a constellation of three socially harmful personality traits: Machiavellianism, psychopathy, and narcissism. The main aim of the present study was to examine the psychometric properties of the Short Dark Triad (SD3) scale, a brief measure of the dark triad, among a sample (N = 412) of male (n = 200) and female (n = 212) at-risk Portuguese youths. Confirmatory factor analysis revealed the three-factor structure of the SD3 obtained an adequate fit, and measurement invariance across gender was demonstrated, although two items per dimension had to be removed. The Portuguese version of the SD3 scale demonstrated satisfactory psychometric properties, specifically the properties of internal consistency, convergent validity, discriminant validity, and known-groups validity, which overall justifies its use among this population. Findings are discussed in terms of the use of the SD3 scale with male and female at-risk youths.     

Construct validity for the verbal associated pairs screen

The present study introduces the Verbal Associated Pairs Screen (VAPS) as a new measure for assessing performance validity in pediatric populations. This study presents initial data on psychometric properties and establishes construct validity for the VAPS in a sample of 30 adolescent healthy controls and 206 youths with traumatic brain injury (TBI: moderate/severe, N = 30; mild, N = 176). The control group’s age (M = 14.93, SD = 1.8) was significantly higher than the moderate/severe TBI (M = 13.9, SD = 2.8), t(68.508) = ?3.038, p = .003, and mild TBI (mTBI) groups (M = 14, SD = 2.8), t(54.147) = 2.038, p = .046. The TBI groups were administered the VAPS in accord with other established performance validity tests (PVTs) and well-established memory tests as part of routine clinical evaluations. The healthy control group was administered the VAPS only. VAPS score distributions for the control group were negatively skewed and highly kurtotic. VAPS scores from the moderate/severe TBI and control groups were indistinguishable for Trial 2 (U = 274, p < .01) and the Delay (U = 396, p = .218). In the mTBI group, convergent and divergent validity was established with other well-validated PVTs and memory tests, respectively. ROC curve analyses identified optimal cutoff scores for the VAPS Total Score, with acceptable sensitivity (55%) and excellent specificity (100%), as well as strong detectability (AUC = .829, 95% CI: 0.731 – 0.928, p < .001). Clinical applications, limitations, and directions for future research with the VAPS are discussed.     

Psychometric Evaluation of the Rage Outbursts and Anger Rating Scale in an Outpatient Psychiatric Sample

The primary objective of this study was to examine the psychometric properties of a measure of anger/rage attacks—the Rage Outburst and Anger Rating Scale (ROARS)—in a sample of youth (n = 81, ages 7–17 years, 72.8 % male) receiving treatment at an outpatient pediatric psychiatric clinic. A trained rater completed the ROARS and Clinical Global Impression-Rage (CGI-Rage). Children completed the Spence Children’s Anxiety Scale for Children and Center for Epidemiological Studies Depression Scale. Parents completed the Spence Children’s Anxiety Scale for Parents. Internal consistency (α = .89), inter-rater reliability (κ = .94) and 1-week test–retest reliability (r = .72) were calculated for the ROARS. The ROARS was correlated with CGI-Rage (r = .68, ρ < .001), although not with parent- and child-rated anxiety symptoms or with child-rated depressive symptoms. Implications regarding clinical utility of the ROARS and directions for future research are discussed.     

Preliminary Validity of the Eyberg Child Behavior Inventory With Filipino Immigrant Parents

Filipinos are an understudied minority affected by significant behavioral health disparities. We evaluate evidence for the reliability, construct validity, and convergent validity of the Eyberg Child Behavior Inventory (ECBI) in 6- to 12-year-old Filipino children (N = 23). ECBI scores demonstrated high internal consistency, supporting a single-factor model (preintervention α = .91; postintervention α = .95). Results document convergent validity with the Child Behavior Checklist Externalizing scale at pretest (r = .54, p < .01) and posttest (r = .71, p < .001). We conclude that the ECBI is a promising tool to measure behavior problems in Filipino children.     

Adolescent Narcissism,Aggression, and Prosocial Behavior: The Relevance of Socially Desirable Responding

An important threat to validity in personality research pertains to an individual's motivation to respond in a socially desirable manner on self-report inventories. This issue was examined in this study in the context of narcissism, aggression, and prosocial behavior in a sample of at-risk adolescents. Participants were 161 adolescents (128 males, 29 females, 4 not reported) ranging in age from 16 to 19 years who were attending a residential program for youth who have dropped out of school. Overall, socially desirable response tendencies were negatively correlated with vulnerable narcissism and self-reported aggression. Moreover, low socially desirable responses strengthened the relation between narcissism and self-reported aggression. Socially desirable responding was not associated with self- or peer-reported prosocial behavior and did not moderate the relation between narcissism and prosocial behavior. These findings indicate that the relation between narcissism and aggression is attenuated by concerns with social desirability. However, further work is needed in broader samples of adolescents to more closely examine whether social desirability concerns actually mitigate aggression among some youth or signify underreporting of one's problem behaviors.     

Conceptualization and assessment of disengagement in romantic relationships

Research examining relationship distress and dissolution highlights the importance of romantic disengagement. Nevertheless, prior conceptualizations and measures of romantic disengagement have tended to combine disengagement with related but distinct constructs hindering the study of romantic disengagement. The present research used exploratory and confirmatory factor analyses to clarify the conceptualization of romantic disengagement and to develop a novel measure—the Romantic Disengagement Scale (RDS). The RDS demonstrated adequate fit across samples of dating individuals (n = 203), married couples (n = 77), and women in physically aggressive relationships (n = 42) from the Midwestern United States. The RDS also demonstrated strong divergent and incremental validity. The discussion focuses on implications for enhancing conceptual models, research methodology, and clinical interventions.     

Trait mindfulness at work: A meta-analysis of the personal and professional correlates of trait mindfulness

Popular and academic press alike have concluded that mindfulness significantly benefits healthy individuals as well as those suffering from physical and psychological problems. Workplace interventions, clinical therapies, and popular self-help programs aimed at enhancing mindfulness abound, and research has demonstrated the efficacy of such mindfulness interventions in enhancing mindful states. It is of importance to note that research also suggests the average frequency with which individuals experience states of mindfulness varies from person to person, underscoring the existence of a dispositional tendency toward mindfulness—trait mindfulness. We meta-analytically cumulate the results of 270 independent studies (N = 58,592 adults from nonclinical samples) of trait mindfulness in order to explore its personal and professional correlates. Results suggest the benefits of trait mindfulness extend to both personal and professional domains. With regards to personal benefits, trait mindfulness was found to be positively correlated with confidence (ρ = .39), mental health (ρ = .38), emotional regulation (ρ = .40), and life satisfaction (ρ = .36), and negatively correlated with perceived life stress (ρ = –.43), negative emotions (ρ = –.40), anxiety (ρ = –.34), and depression (ρ = –.38). Professionally, results suggest trait mindfulness may benefit job satisfaction (ρ = .29), performance (ρ = .34), and interpersonal relations (ρ = .31), while also reducing burnout (ρ = –.48) and work withdrawal (ρ = –.17). Meta-analytic regressions also suggest trait mindfulness adds incremental predictive variance over more traditional predictors of employee burnout and work performance.     

Cumulative neurological factors associated with long-term outcomes in adult survivors of childhood brain tumors

Prior research has demonstrated the reliability and validity of the Neurological Predictor Scale (NPS) in relation to childhood brain tumor survivor outcomes; however, its use has not been examined in adult long-term survivors. The current study examines the concurrent validity of the NPS with long-term intellectual and adaptive outcomes in adult survivors of childhood brain tumors relative to individual variables alone. A total of 68 adult survivors of childhood brain tumors (M = 24 years old, SD = 4) almost 16 years post diagnosis (SD = 6) completed intellectual evaluations using the Wechsler Abbreviated Scale of Intelligence (WASI). Survivors’ adaptive functioning skills were assessed via informant structured clinical interviews (SIB-R). NPS scores were computed from data acquired from medical records. The NPS was significantly associated with intellectual (R² = 0.208, p < .05) and adaptive outcomes (R² = 0.30, p < .05) over and above individual risk factors. Approximately 18% of long-term survivors were identified as impaired in intellectual outcomes, and 29% were identified as impaired in adaptive functioning in everyday life skills. The NPS quantifies the cumulative effects of treatment and neurological sequelae experienced by both short- and long-term survivors of childhood brain tumors. It is a useful and easy measure to employ in clinical research that focuses on quantifying the neurological risk factors associated with long-term intellectual and adaptive functioning outcomes in adult survivors of childhood brain tumors.     

Criminal Minds: Narcissism Predicts Offending Behavior in a Non-Forensic Sample

Narcissism has been associated with various offending behaviors; however, the majority of research has concentrated on men using forensic samples. This study (n = 632) investigated narcissism and how it relates to offending behaviors, including both sexes. Significant differences were found when comparing the relationship between narcissism and offending behavior, demonstrating that narcissism influences offending behavior differently in the two sexes. These new findings contribute to the very little we know about narcissism in women, suggesting that both sexes should be included in future research on narcissism and offending.     

Acute Stress,Depression, and Anxiety Symptoms Among English and Spanish Speaking Children with Recent Trauma Exposure

A growing literature suggests the clinical importance of acute stress disorder symptoms in youth following potentially traumatic events. A multisite sample of English and Spanish speaking children and adolescents (N = 479) between the ages of 8–17, along with their caregivers completed interviews and self-report questionnaires between 2 days and 1 month following the event. The results indicate that children with greater total acute stress symptoms reported greater depressive (r = .41, p < .01) and anxiety symptoms (r = .53, p < .01). Examining specific acute stress subscales, reexperiencing was correlated with anxiety (r = .47, p < .01) and arousal was correlated with depression (r = .50, p < .01) and anxiety (r = .55, p < .01). Age was inversely associated with total acute stress symptoms (r = ?.24, p < .01), reexperiencing (r = ?.17, p < .01), avoidance (r = ?.27, p < .01), and arousal (r = ?.19, p < .01) and gender was related to total anxiety symptoms (Spearman’s ρ = .17, p < .01). The current study supports the importance of screening acute stress symptoms and other mental health outcomes following a potentially traumatic event in children and adolescents. Early screening may enable clinicians to identify and acutely intervene to support children’s psychological and physical recovery.     

Primary and Secondary Caregiver Reports of Quality of Life in Pediatric Asthma: Are they Comparable?

This study aimed to compare primary and secondary caregiver QOL within families of children with asthma and determine the potential importance of including secondary caregiver QOL in clinical and research settings. Participants included 118 families of children with asthma that had primary and secondary caregivers. Families completed measures in a single research session. Caregivers reported on QOL, psychological functioning, and family burden; children completed a measure of QOL. Child lung function was determined from objective spirometry. Adherence to prescribed controller medication was measured for 6 weeks following the research visit. Primary caregiver QOL was significantly lower than secondary caregiver QOL (Mean overall QOL of 5.85 versus 6.17, p < .05). Better medication adherence was associated with higher primary caregiver QOL (ρ = .22, p = .02); secondary caregiver QOL, not primary caregiver QOL, was positively associated with child QOL (ρ = .20, p = .03). Families with discrepant QOL scores between caregivers (difference in scores of at least .50) were characterized by more family burden and primary caregiver psychological symptoms. Differences in QOL scores between caregivers may be a reflection of primary caregivers’ greater investment in daily asthma management. In families reporting low burden and few psychological difficulties in the primary caregiver, QOL assessments from either caregiver may may be informative and representative of how parents are adapting to child asthma. In families experiencing high levels of burden or more primary caregiver psychological difficulties, QOL reports from secondary caregivers may not be as clinically meaningful.     

Échelle de stigmatisation familiale dans la maladie d’Alzheimer (ESF-MA) : une adaptation et validation française

According to scientific research, individuals diagnosed with neurodegenerative dementia of the Alzheimer type and their surroundings (family, family caregiver), experience a phenomenon of family stigmatization of which there are many consequences. Not only can they experience emotional reactions such as fear, anxiety, more depressive symptoms, but they can also face discrimination with a sense of care giving burden and be the result of social relationships avoidance. These effects lead to reduce family life quality. At the same time, scientific studies reveal that stigma acts on a personal, associative (family), public and on a structural level. Their joint perception seems necessary to apprehend their synergy and to adapt interventions. However, in the AD context, no tool exists in the French language to measure perceived family stigma on different levels. To fill this gap, we analyzed the construct validity (intra-concept validity), an aspect of the divergent validity, concurrent validity as well as the reliability of the AD family stigma scale (ESF-MA) in the French context. The results of the principal component analysis (n = 263 family caregivers) reveal 10 factors divided into 3 dimensions (intra-personal, public and structural) that explain 57 % of the total variance. The validity of the construct like the reliability represents satisfying results. The measurement of the family stigma by the ESF-MA presents an opportunity to complete clinical observations among family caregivers of people diagnosed with AD.     

Psychometric Properties of the Shortened Chinese Version of the Family Resilience Assessment Scale

Family theory has refocused attention from deficits to family strengths, and interest in family resilience across cultures has become more widespread. However, few instruments were designed for quantitative research on family resilience. The Family Resilience Assessment Scale (FRAS) was designed to measure family resilience and has been administered in Western populations. The aim of this study was to adapt the FRAS for use with Chinese populations and examine its psychometric properties. The study was conducted using a sample of 991 university students in China (62.9 % female, mean age 20, SD = 1.12). First, the scale was translated and modified into Chinese, and good language equivalency was found. Next, confirmatory factor analysis was used to identify the best-fitting model. Results showed that the 3-factor model consisting of 32 items was an adequate fit. The goodness-of-fit index values for the model were χ ²/df = 5.97, CFI = .84, RMSEA = .08, SRMR = .05. Total scale reliability was α = .95. According to these values it can be said that the modified Chinese version of the FRAS was adapted successfully to the Chinese culture. Moreover, researchers and clinicians can use this instrument to assess family strengths when working with individuals in families experiencing adversity.     

Validation of Basic Empathy Scale: Exploring a Korean Version

The Basic Empathy Scale was designed to measure the multidimensional aspects of empathetic feelings, such as cognitive and affective empathy. The purpose of this study was to evaluate the reliability and validity of the Korean version of the Basic Empathy Scale (BES). The Korean version of BES was administered to a sample of early adolescents aged 12–14 (N = 1524). The result of confirmatory factor analysis showed a two-factor solution with method effects associated with negatively worded items to be the most adequate model. Empathy was positively correlated with the measure of attachment, negatively correlated with the measure of bullying problems, and exhibited satisfactory internal consistency. BES proved to be a reliable assessment tool for empathy in a Korean adolescent sample. Moreover, in line with the previous research, girls were found to score significantly higher in both cognitive and affective empathy than boys.