Preliminary Validity of the Eyberg Child Behavior Inventory With Filipino Immigrant Parents

Filipinos are an understudied minority affected by significant behavioral health disparities. We evaluate evidence for the reliability, construct validity, and convergent validity of the Eyberg Child Behavior Inventory (ECBI) in 6- to 12-year-old Filipino children (N = 23). ECBI scores demonstrated high internal consistency, supporting a single-factor model (preintervention α = .91; postintervention α = .95). Results document convergent validity with the Child Behavior Checklist Externalizing scale at pretest (r = .54, p < .01) and posttest (r = .71, p < .001). We conclude that the ECBI is a promising tool to measure behavior problems in Filipino children.     

Development and preliminary validation of the Paediatric Awareness Questionnaire for children and adolescents with traumatic brain injury

There is a lack of validated measures for assessing self-awareness of deficits after pediatric traumatic brain injury (TBI). The current study aimed to develop and examine the psychometric properties of the Paediatric Awareness Questionnaire (PAQ), and investigate factors related to self-awareness. The PAQ was administered to 32 children aged 8–16 years with mild to severe TBI (72% male, M age = 11.75, SD = 2.9), their parents, and treating clinicians, and to 32 age- and gender-matched typically developing controls and their parents. Children with TBI and their parents also completed the Knowledge of Injury Checklist (KIC), and parents completed the Depression Anxiety and Stress Scale 21. The PAQ was found to have fair to excellent (α = .79–.97) internal consistency for all versions across both groups and good concordance between parent and clinician total scores (ICC = .78). There was also evidence of convergent validity between the PAQ and KIC for both child (r = ?.45, p < .05) and parent ratings (r = ?.66, p < .001). Poorer self-awareness was significantly related to younger age at injury for the TBI group and lower parental education for the total sample. ANCOVA identified that children with TBI demonstrated significantly poorer awareness than controls after controlling for parental education. Children with TBI typically overestimated their functioning compared to their parents, whereas typically developing children tended to rate their functioning lower than their parents. These findings provide preliminary support for the reliability and validity of the PAQ for assessing self-awareness after pediatric TBI.     

Construct validity for the verbal associated pairs screen

The present study introduces the Verbal Associated Pairs Screen (VAPS) as a new measure for assessing performance validity in pediatric populations. This study presents initial data on psychometric properties and establishes construct validity for the VAPS in a sample of 30 adolescent healthy controls and 206 youths with traumatic brain injury (TBI: moderate/severe, N = 30; mild, N = 176). The control group’s age (M = 14.93, SD = 1.8) was significantly higher than the moderate/severe TBI (M = 13.9, SD = 2.8), t(68.508) = ?3.038, p = .003, and mild TBI (mTBI) groups (M = 14, SD = 2.8), t(54.147) = 2.038, p = .046. The TBI groups were administered the VAPS in accord with other established performance validity tests (PVTs) and well-established memory tests as part of routine clinical evaluations. The healthy control group was administered the VAPS only. VAPS score distributions for the control group were negatively skewed and highly kurtotic. VAPS scores from the moderate/severe TBI and control groups were indistinguishable for Trial 2 (U = 274, p < .01) and the Delay (U = 396, p = .218). In the mTBI group, convergent and divergent validity was established with other well-validated PVTs and memory tests, respectively. ROC curve analyses identified optimal cutoff scores for the VAPS Total Score, with acceptable sensitivity (55%) and excellent specificity (100%), as well as strong detectability (AUC = .829, 95% CI: 0.731 – 0.928, p < .001). Clinical applications, limitations, and directions for future research with the VAPS are discussed.     

Strengths use and deficit correction in organizations: development and validation of a questionnaire

Although the positive psychology tradition emphasizes the importance of a balanced approach regarding individual strengths and weaknesses, there is no valid instrument to measure these phenomena in organizations. The purpose of the present studies is to develop and validate an instrument that measures four dimensions, namely perceived organizational support (POS) for strengths use, POS for deficit correction, strengths use behaviour, and deficit correction behaviour. In study 1 and 2, the Strengths Use and Deficit COrrection (SUDCO) questionnaire was developed and tested for its factor structure, reliability, and convergent and criterion validity in two samples of South African employees (N = 338 and N = 361, respectively). In study 3, the convergent and criterion validity of the SUDCO were examined in a sample of Dutch engineers (N = 133). Results indicated that the intended dimensions of strengths use and deficit correction can be measured reliably with 24 items and showed convergent validity. Moreover, POS for strengths use and strengths use behaviour correlated positively with self- and manager-ratings of job performance, supporting the criterion validity of these scales. As expected, POS for deficit correction and deficit correction behaviour were unrelated to the performance ratings.     

Social identity uncertainty: Conceptualization,measurement, and construct validity

The following paper establishes a measurement of social identity uncertainty. Based on uncertainty-identity theory, we propose social identity uncertainty is a unique type of self-uncertainty related to group identification. We further believe social identity uncertainty is comprised of two components: identity-uncertainty (i.e., uncertainty about one’s group identity) and membership-uncertainty (i.e., uncertainty about being a group member). Study 1 (N = 314) and Study 2 (N = 299) explored and confirmed that two subcomponents exist within social identity uncertainty. Study 3 (N = 295) developed convergent validity using various social identity-related constructs, and discriminant validity using dispositional constructs. Overall, we found (a) identity-uncertainty and membership-uncertainty are distinct constructs, and (b) our measurements have both convergent and discriminant validity.     

Validity evidence of Emotional Quotient Inventory: Youth Version (Short) in a sample of Mexican adolescents / Evidencias de validez del Emotional Quotient Inventory: Youth Version (Short) en una muestra de adolescentes mexicanos

The aim of this study was to obtain evidence on the validity of the Emotional Quotient Inventory Youth Version-Short Form (EQ-i:YV-S) with a sample of Mexican adolescent participants. The sample comprised 375 adolescents, 183 males (48.8%), from years seven to 12 (M_age = 14.80, SD = 1.72). Different tests were carried out to provide evidence of the questionnaire’s validity: (1) reliability and internal consistency analyses; (2) exploratory and confirmatory analyses; and (3) correlational and predictive validity analyses through structural equation modelling. The four EQ-i:YV-S subscales (interpersonal, intrapersonal, stress management and adaptability) provided acceptable indexes of reliability. Exploratory factor analysis supported the multidimensionality of the questionnaire. The results of the confirmatory factor analysis showed that the hierarchical model that hypothesized four first-order factors and one second-order factor (social-emotional intelligence) had the best fit for the data. Finally, the positive correlations found between the four specific EQ-i:YV-S subscales, general self-concept and satisfaction with life, supported the convergent validity of the questionnaire; in addition, the questionnaire’s capacity to predict satisfaction with life corroborated its predictive validity. It can therefore be affirmed that the EQ-i:YV-S is a brief questionnaire that is suitable for measuring the emotional intelligence of Mexican adolescents.     

Swedish Acceptance and Action Questionnaire (SAAQ): a psychometric evaluation

Psychological inflexibility and experiential avoidance are equivalent (with somewhat different connotations) concepts and refer to an unwillingness to remain in contact with particular private events. This concept is most often measured by the Acceptance and Action Questionnaire (AAQ-II) and is strongly related to psychopathology and behavioral effectiveness. In this study, the preliminary psychometric properties of the Swedish version of the AAQ-II (Swedish Acceptance and Action Questionnaire—SAAQ) are presented. The study is done in two steps. In the first step, the 10-item version of the AAQ-II is investigated through principal component analysis (n = 147). Secondly, due to problems with the component structure, the instrument is reduced to a six-item version and its validity and internal consistency are investigated (n = 154). The six-item version shows good concurrent and convergent validity as well as satisfying internal consistency (α = .85). Furthermore, the Swedish six-item version of the AAQ-II showed one strong component. Test–retest reliability was satisfactory (r = .80; n = 228). In future research, predictive and external validity would be important to investigate in order to further ensure that the SAAQ is a useful measure for clinical research. In conclusion, the SAAQ has satisfactory psychometric properties, but more data need to be gathered to further explore the possibilities for the instruments in Swedish contexts.     

The development and initial validation of the Fatigue Sensitivity Questionnaire

ABSTRACT

Currently, there is poor understanding of fatigue and the possible psychological conditions that may underlie chronic fatigue. Although substantial work has been directed to better clinically address fatigue, no work has explored individual differences in expectations or perceptions of the negative consequences associated with fatigue-related symptoms. The goals of this study were to (a) develop and (b) validate a measure of expectations or perceptions of the negative consequences associated with fatigue-related symptoms (e.g. fatigue sensitivity) across two independent samples (N = 1,827; 73.1% female; M_age = 21.68; SD = 4.54) of young adults. Results supported a 10-item measure of fatigue sensitivity, entitled the Fatigue Sensitivity Questionnaire (FSQ). The FSQ demonstrated unidimensionality, excellent internal consistency, and strong convergent and discriminant validity. Overall, the 10-item scale offers a single score that can be employed to measure fatigue sensitivity. Clinically, the FSQ may be a brief, informative, and easily disseminated measure in better understanding and capturing expectations or perceptions about the negative consequences of fatigue. As a research tool, the use of the FSQ may provide broader understanding of vulnerability factors that may influence fatigue-related health outcomes. Future research is needed to test the validity of the FSQ in other samples.     

Psychometric Evaluation of the Spanish Versions of the Perceived Religious Influence on Health Behavior Scale and the Illness as Punishment for Sin Scale in a Sample of Churchgoing Latinas

The present study evaluated the psychometric properties of the Spanish versions of the Perceived Religious Influence on Health Behavior scale and the Illness as Punishment for Sin scale in a sample of churchgoing Latina women (N = 404). For the Perceived Religious Influence on Health Behavior scale, confirmatory factor analysis provided support for the expected one-factor model, internal consistency reliability was good, and there was evidence of convergent validity. For the Illness as Punishment for Sin scale, confirmatory factor analysis provided support for the expected one-factor model, but on a revised seven-item version of the measure. Internal consistency reliability and convergent validity for this revised version were good. It is recommended that future studies use the Perceived Religious Influence on Health Behavior scale and the revised Illness as Punishment for Sin scale when examining these constructs among Latina women.     

Validation of a reflective thinking instrument for third-year undergraduate nursing students participating in high-fidelity simulation

Background: nursing students are required to think reflectively in both real and simulated clinical practice. Although the Reflective Thinking instrument is reliable in its measurement of reflective thinking, its validity is unknown. Method: confirmatory factor analysis was undertaken in an iterative manner within a non-equivalent control-group study to measure nursing students’ reflective thinking and satisfaction with high-fidelity simulation. The validity and reliability of the Reflective Thinking instrument was tested. Results: the resulting instrument consisted of 15 items across four factors. The final model was plausible as it demonstrated ‘goodness of fit’; however, it had neither convergent or discriminatory validity, nor reliability. Internal consistency was fair to reasonable for the four subscales. Conclusion: the testing of the Reflective Thinking instrument using confirmatory factor analysis is a vital initial step in the modification of this instrument. Further development using exploratory factor analysis will enhance the instrument’s relevance within high-fidelity simulation.     

The Short Dark Triad (SD3): Adaptation and Psychometrics among At-Risk Male and Female Youths

The dark triad is a term used to describe a constellation of three socially harmful personality traits: Machiavellianism, psychopathy, and narcissism. The main aim of the present study was to examine the psychometric properties of the Short Dark Triad (SD3) scale, a brief measure of the dark triad, among a sample (N = 412) of male (n = 200) and female (n = 212) at-risk Portuguese youths. Confirmatory factor analysis revealed the three-factor structure of the SD3 obtained an adequate fit, and measurement invariance across gender was demonstrated, although two items per dimension had to be removed. The Portuguese version of the SD3 scale demonstrated satisfactory psychometric properties, specifically the properties of internal consistency, convergent validity, discriminant validity, and known-groups validity, which overall justifies its use among this population. Findings are discussed in terms of the use of the SD3 scale with male and female at-risk youths.     

Cumulative neurological factors associated with long-term outcomes in adult survivors of childhood brain tumors

Prior research has demonstrated the reliability and validity of the Neurological Predictor Scale (NPS) in relation to childhood brain tumor survivor outcomes; however, its use has not been examined in adult long-term survivors. The current study examines the concurrent validity of the NPS with long-term intellectual and adaptive outcomes in adult survivors of childhood brain tumors relative to individual variables alone. A total of 68 adult survivors of childhood brain tumors (M = 24 years old, SD = 4) almost 16 years post diagnosis (SD = 6) completed intellectual evaluations using the Wechsler Abbreviated Scale of Intelligence (WASI). Survivors’ adaptive functioning skills were assessed via informant structured clinical interviews (SIB-R). NPS scores were computed from data acquired from medical records. The NPS was significantly associated with intellectual (R² = 0.208, p < .05) and adaptive outcomes (R² = 0.30, p < .05) over and above individual risk factors. Approximately 18% of long-term survivors were identified as impaired in intellectual outcomes, and 29% were identified as impaired in adaptive functioning in everyday life skills. The NPS quantifies the cumulative effects of treatment and neurological sequelae experienced by both short- and long-term survivors of childhood brain tumors. It is a useful and easy measure to employ in clinical research that focuses on quantifying the neurological risk factors associated with long-term intellectual and adaptive functioning outcomes in adult survivors of childhood brain tumors.     

Triarchic Model of Psychopathy: A Brief Measure Among Detained Female Youths

The present study examined the psychometric properties of a brief measure of the Triarchic model of psychopathy based on the Youth Psychopathic Traits Inventory (YPI-Tri-S) among a forensic sample of detained female youth offenders (M = 16.41 years; SD = 1.19 years) from Portugal. Results supported the expected three-factor structure and cross-gender measurement invariance. The YPI-Tri-S showed good psychometric properties in terms of factor structure, internal consistency, convergent validity, discriminant validity, and criterion-related validity. Findings suggest that the YPI-Tri-S is a valid and reliable measure of the Triarchic model of psychopathy, which can be used to assess female juvenile offenders.     

A comparison of the diagnostic accuracy of the AD8 and BCAT-SF in identifying dementia and mild cognitive impairment in long-term care residents

We compared the accuracy of the Brief Cognitive Assessment Tool—Short Form (BCAT-SF) and AD8 in identifying mild cognitive impairment (MCI) and dementia among long-term care residents. Psychometric analyses of 357 long-term care residents (n = 228, nursing home; n = 129, assisted living) in Maryland referred for neuropsychological evaluation evidenced robust internal consistency reliability and construct validity for the BCAT-SF. Furthermore, hierarchical logistic regression and receiver operating characteristic curve analyses demonstrated superior predictive validity for the BCAT-SF in identifying MCI and dementia relative to the AD8. In contrast, previously reported psychometric properties or cut scores for the AD8 could not be cross-validated in this long-term care sample. Based on these findings, the BCAT-SF appears to be a more reliable and valid screening instrument than the AD8 for rapidly identifying MCI and dementia in long-term care residents.     

Measuring moral reasoning using moral dilemmas: evaluating reliability,validity, and differential item functioning of the behavioural defining issues test (bDIT)

ABSTRACT

We evaluated the reliability, validity, and differential item functioning (DIF) of a shorter version of the Defining Issues Test-1 (DIT-1), the behavioural DIT (bDIT), measuring the development of moral reasoning. About 353 college students (81 males, 271 females, 1 not reported; age M = 18.64 years, SD = 1.20 years) who were taking introductory psychology classes at a public University in a suburb area in the Southern United States participated in the present study. First, we examined the reliability of the bDIT using Cronbach’s α and its concurrent validity with the original DIT-1 using disattenuated correlation. Second, we compared the test duration between the two measures. Third, we tested the DIF of each question between males and females. Findings reported that first, the bDIT showed acceptable reliability and good concurrent validity. Second, the test duration could be significantly shortened by employing the bDIT. Third, DIF results indicated that the bDIT items did not favour any gender. Practical implications of the present study based on the reported findings are discussed.     

Differential attrition in health behaviour change trials: A systematic review and meta-analysis

Objective: Attrition is a common problem in health behaviour change (HBC) trials. When the degree of attrition differs between treatment conditions, then this is called differential attrition and is regarded as a major threat to internal validity. The primary research question of this study was: how often and to what degree does differential attrition occur in HBC trials?

Design: A systematic review and meta-analysis of a random selection of HBC trials (k = 60). We meta-analysed the relative attrition rates using a random-effects model and examined the relationship between the relative attrition rates and the potential moderators: the amount of human contact in delivery and the intensity of the intervention/control condition, the type of control condition, and the follow-up intensity and duration.

Main outcome measures: Relative attrition rates.

Results: The average attrition rate was 18% (SD = .15; M = .15) in the intervention and 17% (SD = .13; M = .13) in the control conditions. The estimated average relative attrition rate was 1.10 (95% CI: 1.01–1.20, p = .02), suggesting an overall higher attrition rate of 10% in the intervention conditions. This relative attrition rate was not related to any of the potential moderators.

Conclusion: There is indication of a slightly higher amount of attrition on average in the intervention conditions of HBC trials.     

Psychometric properties of the Insomnia Catastrophizing Scale (ICS) in a large community sample

ABSTRACT

The purpose was to investigate the psychometric properties of the Insomnia Catastrophizing Scale (ICS) including factorial validity and internal consistency as well as discriminative and convergent validity. Associations with sleep parameters and daytime impairment are also examined. Drawn from a randomly selected sample of the general population, 1615 participants completed a survey on insomnia-related nighttime and daytime symptoms, health outcomes and psychological processes, including the ICS. A one-factor solution was supported for both the nighttime catastrophizing (11 items) and daytime catastrophizing (6 items) subscales. Both subscales displayed high internal consistencies (α > 0.90) and accounted for 59.1–70.1% of the variance. The insomnia disorder group had significantly higher scores than participants without insomnia on the two subscales and on the individual items. Cutoffs were established for both subscales with acceptable sensitivity and specificity. Both subscales displayed adequate convergent validity with measures indexing worry, cognitive pre-sleep arousal and anxiety. The two subscales were also significantly associated with nighttime and daytime insomnia symptoms. The ICS is a reliable and valid scale for the assessment of insomnia-related catastrophizing. Future research is needed to examine the test-retest reliability and treatment sensitivity of the ICS.     

The positive eating scale: relationship with objective health parameters and validity in Germany,the USA and India

Objective: The prevailing focus regarding eating behaviour is on restriction, concern, worry and pathology. In contrast, the purpose of the present studies was to focus on a positive relationship with eating in non-clinical samples from Germany, the USA and India.

Design: In Study 1, the Positive Eating Scale (PES) was tested and validated in a large longitudinal sample (T1: N = 772; T2: N = 510). In Study 2, the PES was tested in online samples from the USA, India and Germany (total N = 749).

Main Outcome Measures: Health risk status was measured in Study 1 with objective health parameters (fasting serum glucose, triglycerides, high-density lipoprotein cholesterol, blood pressure, waist circumference, BMI).

Results: Study 1 revealed acceptable psychometric properties of the PES, internal consistency (α = .87), as well as test–retest reliability after six months (r = .67). Importantly, a positive relationship with eating was associated with decreased health risk factors six months later. In Study 2, the structure of the PES was confirmed for German, Indian and US-American adults, suggesting validity across remarkably different eating environments.

Conclusion: A positive relationship with eating might be a fruitful starting point for prevention and intervention programmes promoting physical and psychological health.     

Introduction

This article reports a comprehensive meta-analysis of the criterion-oriented validity of the Big Five personality dimensions assessed with forced-choice (FC) inventories. Six criteria (i.e., performance ratings, training proficiency, productivity, grade-point average, global occupational performance, and global academic performance) and three types of FC scores (i.e., normative, quasi-ipsative, and ipsative) served for grouping the validity coefficients. Globally, the results showed that the Big Five assessed with FC measures have similar or slightly higher validity than the Big Five assessed with single-stimulus (SS) personality inventories. Quasi-ipsative measures of conscientiousness (K = 44, N = 8794, ρ = .40) are found to be better predictors of job performance than normative and ipsative measures. FC inventories also showed similar reliability coefficients to SS inventories. Implications of the findings for theory and practice in academic and personnel decisions are discussed, and future research is suggested.     

Rating Scales for the Assessment of Empathic Communication in Medical Interviews (REM): Scale Development,Reliability, and Validity

Empathy has been shown to affect the quality of care by enhancing the physician–patient relationship and promoting effective communication. In this study, the newly developed Rating Scales for the Assessment of Empathic Communication in Medical Interviews (REM), designed to assess empathy and confrontation in physician–patient interactions, were subjected to preliminary psychometric testing. Particular attention was paid to face validity, reliability, sensitivity, and practicality. A total of 118 volunteers were asked to assess transcribed interactions between physicians and a standardized patient using the REM. In order to assess the convergent validity of the REM, the Motivational Interviewing Treatment Integrity Code (MITI) and the Behavior Change Counseling Index (BECCI) were used. Factor analysis identified two subscales, reflecting empathy and confrontation. Interrater reliability coefficients for items ranged from r = .82 to .97; Cronbach’s alphas for the two subscales were .89 and .88, respectively. The convergent validity was supported by substantial correlations between the REM scores and the MITI scores and by significant correlations between the REM scores and the BECCI score. The REM demonstrated good psychometric properties suggesting the rating scales might be useful in clinical practice, research endeavors, and medical education. Further research is necessary to assess the test-retest reliability as well as the predictive validity of this instrument.