Development and initial validation of validity scales for the NEO-Five Factor Inventory

Based upon the methodology established by Schinka, Kinder, and Kremer (Schinka, J. A., Kinder, B. N., & Kremer, T. (1997). Research validity scales for the NEO-PI-R: Development and initial validation. Journal of Personality Assessment, 68, 127–138), a set of validity scales were developed for the NEO-Five Factor Inventory (NEO-FFI, Costa, P. T., & McCrae, R. R. (1992). Revised NEO Personality Inventory and NEO Five Factor Inventory Professional Manual. Odessa, FL: Psychological Assessment Resources). In Study 1, 111 undergraduates completed the NEO-FFI and item means, standard deviations, and intercorrelations were used to construct measures of Positive Impression Management, Negative Impression Management, and Inconsistent Responding. In Study 2, 146 participants completed the NEO-FFI under one of five instructional sets (control, fake good, fake bad, graduate psychology and police academy admissions). A set of randomly produced NEO-FFI profiles were added to this data set. ANOVA results provided support for the utility of the validity scales, as they were differentially sensitive to random responding, positive and negative impression management in hypothesized ways.     

Development and initial validation of brief public domain RIASEC marker scales

Although commercially developed interest measures based on Holland’s RIASEC types are effectively used in a variety of applied settings, these measures have somewhat limited research utility due to their length and copyright restrictions placed by the test publishers. In the present study, two sets of 8-item RIASEC scales were developed using activity-based items selected from the 30-item RIASEC scales of the Interest Profiler, and two sets of 8-item RIASEC scales were developed using sets of 30 occupational job titles selected from the O∗NET database representing each Holland type. Responses to the items were obtained from three samples of college students with a total of 1024 female and 639 male participants. Results obtained in the initial development and validation process suggest that the sets of brief activity- and occupational-based RIASEC scales developed in the current study retain acceptable levels of reliability and convergent validity. The development of these brief public domain RIASEC interest measures addresses the copyright and length limitations of current scales and may be useful when conducting integrative research examining the inter-relations between Holland’s types and other individual differences measures.     

Research validity scales for the NEO-PI-R: development and initial validation

The purpose of this investigation was to develop a set of research validity scales for use with the NEO Personality Inventory-Revised (NEO-PI-R; Costa & McCrae, 1992b). In study 1 we used the existing NEO-PI-R item pool to select items for three validity scales: positive presentation management, negative presentation management, and inconsistency. Several iterative item and scale analyses were conducted, using multiple criteria for item selection. These analyses resulted in 10-item scales. In Study 2, the internal consistency, interscale relationships, and normative characteristics were examined in a separate sample of working adults. In Study 3, the validity of the scales was examined by contrasting five sets of NEO-PI-R protocols: from a separate sample of working adults, from a sample of 100 NEO-PI-R protocols with randomly produced responses, and from three samples of undergraduates completing the NEO-PI-R under different instructional sets. Analyses revealed that both the research validity scales and the NEO-PI-R domain scales were sensitive to group differences. issues relating to the appropriate use of the scales are discussed.     

Development and initial validation of the anti-racism behavioral inventory (ARBI)

This investigation reports on the development and initial validation of the anti-racism behavioral inventory, a measure designed to assess anti-racism awareness and behavior among students in counseling and counseling psychology programs within the United States (US). Data from 513 participants were collected over three related studies. Factor analyses suggested that the 21-item scale was best represented as a bifactor model with one general anti-racism behavior factor and three domain-specific factors, namely individual advocacy, awareness of racism, and institutional advocacy. Additional validity was supported through inverse associations with measures of symbolic racism and color-blind racial attitudes, as well as positive associations with scores on the Quick Discrimination Index. Potential utility of the measure and future directions for ongoing development is discussed.     

Development and initial validation of the Role Strain Questionnaire for Junior Athletes (RSQ-JA)

In a series of related studies, the relevance of a role strain framework to interpret the difficulties junior elite athletes experience in their multiple life domains was assessed. Here, the Role Strain Questionnaire for Junior Athletes (RSQ-JA) was developed to measure the role strain experienced by junior athletes. In Study 1, role strain was explored via interviews with 20 elite junior athletes. Based on themes emerging from these interviews, an initial 65-item pool for the RSQ-JA was created and subjected to an exploratory factor analysis in Study 2. The factors derived in Study 2 were tested for factorial validity using confirmatory factor analysis in Study 3. Results supported a 22-item five factor structure for the RSQ-JA. These factors reflected the salient sources of role strain, namely; (i) overload in school, (ii) overload in sport and between roles, (iii) between-role conflict, (iv) underload, and (v) ambiguity. The RSQ-JA therefore provides the initial validation of the first measure of role strain experienced by junior elite athletes.     

Development and initial validation of the Classroom Motivational Climate Questionnaire (CMCQ)

Research on classroom goal-structures (CGS) has shown the usefulness of assessing the classroom motivational climate to evaluate educational interventions and to promote changes in teachers' activity. So, the Classroom Motivational Climate Questionnaire for Secondary and High-School students was developed. To validate it, confirmatory factor analysis and correlation and regression analyses were performed. Results showed that the CMCQ is a highly reliable instrument that covers many of the types of teaching patterns that favour motivation to learn, correlates as expected with other measures of CGS, predicts satisfaction with teacher's work well, and allows detecting teachers who should revise their teaching.     

Development and initial validation of the Brief Adolescent Life Event Scale (BALES)

We report initial validity analyses of the Brief Adolescent Life Event Scale (BALES). This instrument addresses negative and positive events pertinent to the well being of adolescent boys and girls, and is designed for use in studies utilizing an extended research protocol. Selection of items was guided by emerging perspectives on positive psychology , action theory , and personality vulnerability , as well as by new developments in statistical modeling theory. The 36 items of the scale tap negative and positive events, each of which addresses interpersonal and achievement life domains. Using a large sample of early-adolescents ( N = 895), we confirmed the hypothesized structure that includes four domain-level latent factors (i.e., negative interpersonal events, negative achievement events, positive interpersonal events, positive achievement events), and two overarching factors (negative events and positive events). Indices of positive and negative events predicted adolescent depressive symptoms in expected ways, and positive events buffered the effect of negative events on depressive symptoms. These findings encourage an informed use of the BALES and highlight considerations involved in the development of brief measures of stress and coping processes.     

Development and initial validation of the Multidimensional Empathy Scale for Adolescents

Adolescence is a transitional phase in psychosocial development in which individuals learn to navigate their social worlds. The need to socialize, connect with, and empathize with others is especially pronounced in this phase. This study aimed to develop and validate a self-report empathy measure for adolescents, the Multidimensional Empathy Scale for Adolescents (MESA). Based on the theories and research on empathy, we created 24 items to measure six dimensions of empathy (cognitive, affective, positive, negative, majority, and minority). The dimensional structure of the MESA was examined in two independent samples of adolescents. The hypothesized six-factor model of the MESA showed a good fit for both samples. Reliability analyses demonstrated that the MESA had high internal consistency and test–retest reliability. Furthermore, the MESA showed high convergent, discriminant, and incremental validity, as indicated by positive correlations with existing measures of empathy, idiocentrism–allocentrism, and social interest scales. The MESA, as a unique measure of six types of empathy, can be a valuable tool to assist adolescents in developing a balanced sense of empathy.     

Spanish validation of the Parental Acceptance Questionnaire (6-PAQ)

Background/ObjectivePsychological flexibility is an ability with positive effects in health, also in the field parenting. The aim of this study is to validate the Parental Acceptance Questionnaire (6-PAQ) in Spanish sample.MethodA total of 426 parents (96.3% female), with an average age of 38.25 years (SD = 5.76) and with at least one child between 3 and 16 years old participated. Participants completed the 6PAQ and other instruments assessing experiential avoidance, thought suppression, satisfaction with life and symptoms of anxiety and depression.ResultsIn comparison with the original model, the three-factor structural solution with 16 items obtained a better adjustment (CFI = .996; GFI = .998; TLI = .995; RMSE = .016) that refer to response styles related to psychological flexibility (open, aware and active). The 6-PAQ adaptation has shown good internal consistency, with a Cronbach alpha of .81 and a McDonald's omega of .86 for the scale, and evidence of convergent validity with significant correlations with measure of avoidance, thought suppression, satisfaction with life and anxiety.ConclusionsThe Spanish version of the 6-PAQ with the three-factor structure presents psychometric property to be considered a reliable measure and a valid instrument for the evaluation of parental psychological flexibility.     

The tenacious goal pursuit and flexible goal adjustment scales: a validation study

The flexible goal adjustment (FLEX) and tenacious goal pursuit (TEN) scales are used regularly in aging research. The current study examined their validity in a sample of 517 women (30-75 years) in multiple ways. Overall, the findings show that the scales do not clearly distinguish between FLEX and TEN. The direction in which the items were formulated was just as important as what was being measured. Moreover, face validity of the inversely phrased items in particular appeared to be weak. On the basis of these findings, the authors recommend a revision of the concept definitions as well as of the items.     

Development and validation of the Granada Burnout Questionnaire in Spanish police

The goal of the present study is to develop a questionnaire, with proper psychometric properties and current norms, to evaluate the burnout syndrome in Spain. The operative definition of burnout proposed by Maslach and Jackson is used to define three dimensions (Emotional exhaustion, Depersonalization and Personal accomplishment). A total of 2,403 national Spanish police participated. Evidence of construct validity was checked through cross validation (showing a good fit of the three factors model to the data). Using the MBI, NEO-FII and CECAD evidence of convergent validity and criteria validity were developed (showing that the relations are similar to the ones that appear in other research). The discrimination, mean, standard deviation, and typical error of the average of the items composing the various dimensions were analyzed. Both the Cronbach's alpha coefficient and the conditional standard error of measurement (CSEM) were calculated for each of the dimensions. The results showed good internal consistency (all α values > .85). Finally, the questionnaire was scaled using T scores. The psychometrical properties reported here support the use of this new questionnaire for the burnout evaluation in Spanish police.     

Development and validation of Swedish classical and modern sexism scales

In two studies we develop and validate a Classical--overt or direct--and a Modern--covert or subtle--Sexism Scale concerning attitudes toward women, for a Swedish (Scandinavian) context. Further, we examine whether these two forms of prejudice are distinguishable. Confirmatory factor analyses showed that, although highly correlated, classical and modern sexism are distinguishable. The construct validations showed that men had higher means on modern and classical sexism scores than women, and that our scales were related to other constructs as expected. In a third study, we analyzed the knowledge and the content of cultural stereotypes about women. There were no differences in the knowledge of cultural stereotypes between men and women or between high- and low-sexist individuals. The findings are discussed in relation to previous international studies that examine people's modern and/or classical sexism.     

Development and initial validation of the job loss grief scale

Background: Research on complicated grief (CG) symptoms following job loss is surprisingly rare. Involuntary job loss can turn someone’s world upside down and can result in loss of identity, social contacts, and self-worth. In this study, we drew on the literature on major life events in conceptualizing involuntary job loss as a significant and potentially devastating life event.

Objectives: The aim of this study was to develop and evaluate an instrument that measures job loss-related CG symptoms, the Job Loss Grief Scale (JLGS). The purpose of the JLGS is to foster systematic research on CG symptoms following job loss.

Design: A cross-sectional study

Methods: We recruited Dutch workers who had lost their job, 130 men and 158 women with an average age of 49.6 years. To examine the psychometric properties of the JLGS and its associations with other concepts we conducted correlational and confirmatory factor analyses.

Results: CFA revealed that the JLGS was a one-dimensional instrument, and that CG symptoms were distinguishable from depression and anxiety symptoms.

Conclusion: The JLGS is a reliable and valid instrument to measure job loss-related CG symptoms. The availability of the JLGS could stimulate systematic research on the antecedents and consequences of involuntary job loss.     

Development and initial validation of the medical fear survey-short version

The present investigation employs item response theory (IRT) to develop an abbreviated medical fear survey (MFS). Application of IRT analyses in study 1 (n = 931) to the original 50-item MFS resulted in a 25-item shortened version. Examination of the location parameters also resulted in a reduction of the Likert-type scaling of the MFS by removing the last response category ("terror"). The five subscales of the original MFS were highly correlated with those of the MFS-short version. The short version also displayed comparable convergent and discriminant validity with the original MFS in relation to measures of fear, disgust, and anxiety. Confirmatory factor analysis in Study 2 revealed that the five-factor structure of the MFS-short form fit the data well in U.S. (n = 283) and Dutch (n = 258) samples. The short form also had comparable convergent and discriminant validity with the original MFS in relation to domains of disgust in both samples. Receiver operating characteristic (ROC) analysis in Study 3 demonstrated that the subscales of the short version were comparable with the original MFS in classifying participants high (n = 40) and low (n = 40) in blood/injection phobia. Last, structural equation modeling in Study 4 (n = 113) revealed that the MFS-short form demonstrated excellent convergent/discriminant validity with strong associations with injection fear and no association with spider fear. These findings suggest that the MFS-short form has considerable strengths, including decreased assessment time, while retaining sound psychometric properties.     

Development and initial validation of the Self-harm Behavior Questionnaire.

Evaluation of suicide-related behaviors and thoughts about suicide with a newly developed self-report instrument is described. The Self-Harm Behavior Questionnaire (SHBQ; Gutierrez, 1998) generates detailed clinical information from an easy to administer and score self-report form. A sample of 342 participants were drawn from university undergraduate students enrolled in various psychology courses. Participants were then divided into a severe suicidal ideation group (n = 20) and a nonsuicidal control group (n = 20) to conduct subgroup and criterion-related validity analyses. Preliminary analyses indicate this new questionnaire is both valid and reliable when used with young adults drawn from a nonclinical population. The questionnaire should be of use to both clinicians and researchers due to the flexibility of the data generated.     

Dependence and physical exercise: Spanish validation of the Exercise Dependence Scale-Revised (EDS-R)

The purpose of this study was to validate the Spanish version of the Exercise Dependence Scale-Revised (EDS-R). To achieve this goal, a sample of 531 sport center users was used and the psychometric properties of the EDS-R were examined through different analyses. The results supported both the first-order seven-factor model and the higher-order model (seven first-order factors and one second-order factor). The structure of both models was invariant across age. Correlations among the subscales indicated a related factor model, supporting construct validity of the scale. Alpha values over .70 (except for Reduction in Other Activities) and suitable levels of temporal stability were obtained. Users practicing more than three days per week had higher scores in all subscales than the group practicing with a frequency of three days or fewer. The findings of this study provided reliability and validity for the EDS-R in a Spanish context.     

Development and validation of a Rasch-derived CES-D short form

The current study presents a Rasch-derived short form of the Center for Epidemiologic Studies-Depression scale (CES-D) for use as a depression screening tool in the general population. In contrast to short forms developed with reliance on classical measurement techniques, those developed using techniques based on item response theory produce a measure that offers true interval scaling, provide enhanced information about responders with extreme scores, and expand understanding of the underlying latent structure. Cross-validation of the Rasch-derived CES-D short form supported its utility and structural validity across samples. Tests of structural validity using latent variable modeling methodology indicated that a hierarchical, single-factor model of depression had the best fit for the original full form and the Rasch-derived short form of the CES-D. This finding challenges depression researchers and theorists to reconsider the interfactor relationships in the study and assessment of depression.     

English validation of the short form of the Physical Self-Inventory (PSI-S)

The study examined the psychometric properties of scores on the English version of the short Physical Self-Inventory (PSI-S) among 1368 English-Speaking and 224 French-Speaking adolescents. Participants completed the original PSI-S and a revised version including positively-worded reformulations of the original negatively-worded items. The results supported the a priori factor structure, composite reliability, and test-retest reliability (7–8 months) of scores on the revised PSI-S, and its equivalence with the French version. Compared to confirmatory factor analyses, exploratory structural equation modeling resulted in a superior solution, and more cleanly differentiated factors. PSI-S responses were longitudinally invariant across 7–8 months, and presented no evidence of differential item functioning as a function of age, gender, body mass index (BMI) and physical activity. The results showed latent mean differences as a function of gender, BMI (linear and curvilinear effects), and physical activity, supporting the criterion-related validity of the PSI-S factors.     

Development and initial validation of the inventory of Microaggressions Against Black Individuals

The present article describes the development and initial validation of the Inventory of Microaggressions Against Black Individuals (IMABI) using a sample of 385 undergraduates who self-identified as Black or African American. The IMABI is a 14-item, unidimensional measure of racial microaggressions that captures both microinsults and microinvalidations. The present findings support the IMABI as a reliable and valid measure of microaggressions that was associated with general distress and perceived stress. Importantly, the association between the IMABI and psychological adjustment persisted even when social desirability and another measure of race-related stress were included in the analyses. Discussion focuses on the potential implications of the IMABI for understanding the daily experiences and psychological adjustment of Black individuals.