An Analysis of the Convergent and Discriminant Validity of the Transformational Leadership Questionnaire

This article sets out to provide evidence of the convergent and discriminant validity of a recently developed leadership questionnaire to support the assessment and development of leadership in organizations, the Transformational Leadership Questionnaire (TLQ). The TLQ was developed on the basis of eliciting constructs of leadership from managers working at different levels (executive, top, senior, middle) in two large parts of the UK public sector, using a Grounded Theory approach. Evidence is presented that eight scales which measure different aspects of transformational leadership are significantly correlated with each of five criterion variables, even when the instrument is used in a public sector different from the one in which it was developed. Discriminant analysis indicated, however, that the relationship between the scales and the criterion variables is not consistent for the different groups and sub-groups of managers, divided by level, by sex, and by level x sex. These latter data were interpreted, in the light of the ‘range of convenience’ corollary of Kelly's Personal Construct Theory, and of the concept of ‘substitutes for leadership’, as evidence that certain TLQ scales have particular relevance to certain groups and sub-groups of managers, and thus of the discriminant validity of the instrument, and further evidence of its construct validity.     

Development of a measure of workplace deviance

The purpose of this research was to develop broad, theoretically derived measure(s) of deviant behavior in the workplace. Two scales were developed: a 12-item scale of organizational deviance (deviant behaviors directly harmful to the organization) and a 7-item scale of interpersonal deviance (deviant behaviors directly harmful to other individuals within the organization). These scales were found to have internal reliabilities of .81 and .78, respectively. Confirmatory factor analysis verified that a 2-factor structure had acceptable fit. Preliminary evidence of construct validity is also provided. The implications of this instrument for future empirical research on workplace deviance are discussed.     

Structure of the Objectified Body Consciousness Scale: Reevaluated 20 Years later

The Objectified Body Consciousness Scale (OBCS) is a prominent measure of key constructs in the body image literature. Despite the impact and popularity of the OBCS, however, investigations of its factor structure have been limited. To our knowledge, the present study is the first since the instrument’s development 20 years ago to provide a detailed evaluation of the replicability of the factor structure of OBCS data in a sample of U.S. college women, the population for which the measure was originally developed and is used most frequently. Specifically, we used confirmatory factor analyses to evaluate the structure of OBCS data and identify areas for measure refinement. Internal consistency reliability and convergent validity were also examined. A sample of 368 U.S. college women completed the OBCS along with measures of body esteem and thin-ideal internalization as convergent validity indicators. Findings revealed that OBCS Control Beliefs items were poor indicators of the factor. A two-factor structure composed of Body Surveillance and Body Shame was supported. Support for internal consistency reliability and convergent validity was also garnered. Additionally, abbreviated versions of the Body Surveillance and Body Shame subscales produced good model-data fit without sacrificing reliability or validity. These results support the use of the OBCS Body Surveillance and Body Shame subscales to assess critical aspects of body image in research and practice contexts; the abbreviated versions of these subscales can address demands for brevity in these contexts.     

Validation of a reflective thinking instrument for third-year undergraduate nursing students participating in high-fidelity simulation

Background: nursing students are required to think reflectively in both real and simulated clinical practice. Although the Reflective Thinking instrument is reliable in its measurement of reflective thinking, its validity is unknown. Method: confirmatory factor analysis was undertaken in an iterative manner within a non-equivalent control-group study to measure nursing students’ reflective thinking and satisfaction with high-fidelity simulation. The validity and reliability of the Reflective Thinking instrument was tested. Results: the resulting instrument consisted of 15 items across four factors. The final model was plausible as it demonstrated ‘goodness of fit’; however, it had neither convergent or discriminatory validity, nor reliability. Internal consistency was fair to reasonable for the four subscales. Conclusion: the testing of the Reflective Thinking instrument using confirmatory factor analysis is a vital initial step in the modification of this instrument. Further development using exploratory factor analysis will enhance the instrument’s relevance within high-fidelity simulation.     

Development of the Parent Emotion Regulation Scale (PERS): Factor Structure and Psychometric Qualities

This study aims to develop a self-report measure based on a multidimensional conceptualization of the regulation of negative emotions in the context of parenting. We examined the factor structure, factorial invariance, internal consistency and construct validity of the newly developed measure, the Parent Emotion Regulation Scale (PERS). The sample was composed of 254 mothers of children aged 3 to 15 years old (M?=?8.54, SD?=?3.53) who participated in an online study. Exploratory factor analysis of the PERS yielded a four-factor structure with the following factors: parents’ orientation to the child’s emotions, parents’ avoidance of the child’s emotions, parents’ lack of emotional control and parents’ acceptance of the child’s and their own emotions. Confirmatory factorial analysis supported the four-factor model, showing an adequate fit for this structure. Additionally, the model displayed configural, metric, scalar and residual invariance across the children’s sex groups. Cronbach’s alpha values and mean inter-item correlations indicated an adequate internal consistency. Correlations between the PERS scale and the Coping with Children’s Negative Emotions Scale (CCNES) indicated that the different dimensions of parents’ emotion regulation were significantly associated with both positive and negative reactions to the children’s negative emotions. Furthermore, the emotion regulation dimensions showed incremental validity in the prediction of the child’s adjustment. This study provides preliminary support for the adequacy of this newly developed measure, although further studies are needed to establish its psychometric qualities in more diverse populations.     

TENI: A comprehensive battery for cognitive assessment based on games and technology

TENI (Test de Evaluación Neuropsicológica Infantil) is an instrument developed to assess cognitive abilities in children between 3 and 9 years of age. It is based on a model that incorporates games and technology as tools to improve the assessment of children’s capacities. The test was standardized with two Chilean samples of 524 and 82 children living in urban zones. Evidence of reliability and validity based on current standards is presented. Data show good levels of reliability for all subtests. Some evidence of validity in terms of content, test structure, and association with other variables is presented. This instrument represents a novel approach and a new frontier in cognitive assessment. Further studies with clinical, rural, and cross-cultural populations are required.     

Psychometric evaluation and further validation of the Hagedoorn et al. modified EVLN measure

The aim of the present study was to evaluate and further validate a modified Exit, Voice, Loyalty and Neglect (EVLN) instrument (Hagedoorn, Van Yperen, Van de Vliert & Buunk, 1999), in a Swedish sample (n= 792). To test the underlying scaling assumptions, the convergent and divergent validity, a multitrait/multi-item analysis was conducted and factor analyses were used to evaluate the factor structure. The concurrent validity was tested by using the modified EVLN instrument as predictor and three different forms of justice as criteria in the analysis. The criterion-related validity was tested and an association between exit behavioral response and actual exit behavior was found (predictive validity). The results showed that the instrument may be considered to be a valid measure with the exception of the aggressive voice scale.     

Validity and Reliability of the TGMD-2 for Brazilian Children

ABSTRACT The Test of Gross Motor Development (TGMD-2) is broadly used in research and clinical settings. The author aimed to translate and investigate the content, criteria, and construct validity and reliability of the TGMD-2 for Brazilian children. The study involved translators, experts, and 3,124 Brazilian children from several states of Brazil. Results confirmed language clarity and pertinence of the TGMD-2. Appropriate indices of the confirmatory factorial validity (root mean square error of approximation = .06; comparative fit index = .88; Tucker-Lewis index = .83; normed fit index = .09; goodness-of-fit index = .98; adjusted goodness-of-fit index = .95), test-retest (values from .83 to .91) and inter- and intrarater reliability were found. Concurrent validity between TGMD-2 and Movement Assessment Battery for Children was weak. The TGMD-2 is a validity and reliability instrument for Brazilian children.     

Achievement Emotions Questionnaire-Mathematics (AEQ-M) in adolescents: Factorial structure,measurement invariance and convergent validity with personality

ABSTRACT

The Achievement Emotions Questionnaire-Mathematics (AEQ-M) is a self-report measure of emotions experienced in class, when self-studying, and during tests for the domain of mathematics. Our aim was to present a Portuguese version of this instrument for use with adolescents and to test its reliability, factorial structure, measurement invariance, and construct validity with personality dimensions. Our sample comprised 1,387 Portuguese students from the 7th, 8th and 9th grades (mean age = 13.2 years). Student responses to the AEQ-M were found to be reliable. Confirmatory factor analysis validated a seven-emotion × three-setting factorial structure. This model demonstrated measurement invariance across gender and grade. As a demonstration of construct validity, the emotions measured by the AEQ-M showed a pattern of associations with psychobiological personality dimensions that were in line with theoretical predictions. These results validate the AEQ-M as a suitable instrument for assessing adolescents’ mathematics-related achievement emotions and their associations with personality.     

The factor structure and psychometric properties of the Italian version of the Acceptance of Cosmetic Surgery Scale

The current study examined the validity of the Italian version of the Acceptance of Cosmetic Surgery Scale (ACSS; Henderson-King & Henderson-King, 2005) in a sample of 378 Italian adult women. A series of confirmatory factor analyses were conducted. A three-factor solution provided the best fit to the data and confirmed the Intrapersonal, Social, and Consider dimensions. The three factors were strongly inter-correlated. Cronbach's alphas were high (all alphas > .86). The scale showed good convergent and discriminant validity (estimated by Composite Reliability and the Average Variance Extracted). The nomological validity of the Italian version of the ACSS was confirmed by its significant correlations with participants’ body dissatisfaction and sociocultural influences (internalization of thin ideals and perceived media pressure). The ACSS seems to be a useful measure of acceptance of cosmetic surgery in the Italian context. This instrument can be used with Italian speakers for research, health promotion, and preventive interventions.     

Psychometric Properties and Factorial Structure of the Spence Children's Anxiety Scale (SCAS) in Spanish Adolescents

The Spence Children's Anxiety Scale is an instrument widely applied in the assessment of the most common anxiety disorders in children and adolescents. This study examines its psychometric properties and the factorial structure in a large community sample of Spanish-speaking adolescents (N = 1,374) aged 13 to 17 years. The scale demonstrated strong internal consistency and good convergent and discriminant validity. Factor analysis confirmed the 6-factor original model, providing a good fit of the data for the Spanish sample. The good psychometric properties support its use by clinicians and researchers, adding evidence to the international empirical support for this measure.     

Incremental validity of person-organization fit over the Big Five personality measures

Few studies have provided the validity evidence of a measure of objective person-organization fit (P-O fit) as a selection tool. The present study used a concurrent validation design to examine the criterion-related validity and the incremental validity of a P-O fit measure beyond the validity of the Big Five personality test for predicting job performance (task performance and organizational citizenship behavior) and employee commitment (organizational commitment and supervisory commitment) for a group of high-tech professional employees in Taiwan. Results showed that P-O fit predicted the contextual component of overall job performance and was significantly related to two types of employee commitment. Moreover, P-O fit had an incremental validity beyond that of the personality measures for predicting some of our outcome variables.     

Validation d’une mesure d’orientations envers les buts au travail auprès de participants à une évaluation du potentiel et des compétences

IntroductionGoal orientations are a characteristic of the personality explaining different reactions in achievement and learning situations. So far, no French instrument exists to measure this variable in a professional context.ObjectiveThe purpose of this article is to validate a French translation of the VandeWalle instrument (1997) measuring goal orientation at work, with a sample of workers participating in a potential and skills assessment (PSA).MethodThe instrument has been translated using the parallel-blind method suggested by Usunier (1992) and adapted by Lauzier and Haccoun (2010). Confirmatory factorial analyses were conducted to verify the factor structure of the translated version and correlational analyses were performed to assess its nomological validity. The study was conducted with workers (n = 263) from various organizational backgrounds who were subjected to a PSA.ResultsThe three-dimensional factor structure of the Work Goal Orientation Scale (WGOS), consistent with the one proposed by VandeWalle (1997), shows a good fit to the data. The learning, performance-approach and performance-avoidance orientations mainly show the expected associations with three correlates: self-esteem, the anticipated benefits of the PSA and the intention to develop one's skills following the feedback.ConclusionThe measure has a satisfactory nomological validity and can be used to study people's reactions towards learning situations in the workplace.     

The Moral Metacognition Scale: Development and Validation

Scholars have advocated for the inclusion of metacognition (i.e., the extent to which one thinks about one’s thinking) in our understanding of the ethical decision making process and in support of moral learning. An instrument to measure metacognition as a domain-specific capacity related to ethical decision making (i.e. moral metacognition) is not found in the current literature. This research describes the development and validation of the 20-item Moral Metacognition Scale (MMS). Psychometric properties of the scale were assessed by exploration (Study 1) and confirmation (Study 2) of the factor structure, and the demonstration of convergent (Studies 3 and 4), discriminant (Studies 3 and 4), and predictive (Study 4) validity. Moral metacognition, as measured by the MMS, was significantly correlated with ethical awareness and ethical judgment. Limitations of our research, suggestions for future exploration, and practical implications are discussed.     

The Experiences in Close Relationship Scale (ECR)-short form: reliability, validity, and factor structure

We developed a 12-item, short form of the Experiences in Close Relationship Scale (ECR; Brennan, Clark, & Shaver, 1998) across 6 studies. In Study 1, we examined the reliability and factor structure of the measure. In Studies 2 and 3, we cross-validated the reliability, factor structure, and validity of the short form measure; whereas in Study 4, we examined test-retest reliability over a 1-month period. In Studies 5 and 6, we further assessed the reliability, factor structure, and validity of the short version of the ECR when administered as a stand-alone instrument. Confirmatory factor analyses indicated that 2 factors, labeled Anxiety and Avoidance, provided a good fit to the data after removing the influence of response sets. We found validity to be equivalent for the short and the original versions of the ECR across studies. Finally, the results were comparable when we embedded the short form within the original version of the ECR and when we administered it as a stand-alone measure.     

Functions of Identity in the Context of Being a Student: Development and Validation of the Functions of Student Identity Scale

A promising approach to the understanding of identity is the identity functions framework. However, its developmental specificities associated with adolescence remain unexplored. The aim of this study was to develop and test a new measure of the functions of identity as they relate to being a student. Consistent with the theoretical framework, an exploratory analysis with a subsample of high school students revealed five identity functions. A confirmatory analysis with a second subsample found that a higher-order model incorporating these five subscales demonstrated good fit to the data. A bifactor model and statistical indices indicated that it is appropriate to interpret a total student identity score using this instrument. The five subscales, and total scale, demonstrated good convergent validity with a measure of academic behavioral change. These preliminary results suggest that this new instrument presents good psychometric properties and that it is a suitable assessment instrument for the measurement of students’ processes and outcomes. For example, its associations with academic performance stages of changes suggest that this instrument will be useful for identifying students at risk for poor academic trajectories.     

The development of an instrument to measure teachers' use of fear appeals in the GCSE classroom

Background Previous work has suggested that teachers of General Certificate of Secondary Education classes may use fear appeals as a motivational device but these may have unwanted consequences by increasing examination‐related anxiety in students. Aim To facilitate future work in this area, an instrument was developed to measure teachers' use of fear appeals in the course of normal classroom instruction. Samples Students in their final 2 years of compulsory schooling in England: 192 in Study 1 and 133 in Study 2. Method A construct validity approach was used in the development of this instrument. Study 1 reports the development and piloting of this measure. Study 2 reports refinement of this measure and relations with other constructs. Results A three‐factor structure provided a reasonable model fit and all factors demonstrated acceptable reliability. Factors 1 and 2 described the perceived frequency of fear appeals made in relation to educational/occupational consequences and the third factor described the perceived threat of fear appeals. Conclusion This instrument has demonstrated sufficient convergent and discriminant validity and reliability to be used in subsequent research, although the validation process should continue and it is hoped that the instrument will be adapted for use in other contexts.     

Validity and Reliability of the Parenting Stress Index Short Form (PSI-SF) Applied to a Chilean Sample

The Parenting Stress Index was developed in response to the need for a measure to assess the parent-child system. Its abbreviated version, the Parenting Stress Index Short Form, is an instrument with multiple clinical applications and is useful for research and intervention purposes. The Parenting Stress Index Short Form was standardized for use with parents of children ranging from 1 month to 12 years old. Several validation studies are available, most of them not supporting the original structure of three factors. No validation studies for this instrument currently exist in Latin America for a socially vulnerable population. The purpose of this study was to evaluate both the validity and internal consistency of Parenting Stress Index Short Form in a Chilean sample including 336 dyads (mean age of mothers 21.4 years; SD?=?7.38; and mean age of children 84.8 days; SD?=?78.0), demonstrating risk for negative health outcomes and who attend public primary health care. An exploratory factor analysis showed a three-factor structure that was compatible with the original version and explained 41.45?% of the variance. Internal consistency was high both for the total scale (Cronbach’s α?=?0.92) and the three subscales (0.81: Parenting Distress; 0.89: Parent–Child Dysfunctional Interaction and 0.88: Difficult Child). The Goldberg General Health Questionnaire was used to assess external criterion related validity and a positive and statistically significant correlation was found (0.86). The evidence suggests that the Parenting Stress Index Short Form can be used as an instrument to measure the relationship between parenting and stress. Due to its psychometric characteristics, it can be applied to a vulnerable Chilean population. The contribution of this study is the validation of this instrument in a Spanish speaking population with characteristics of social vulnerability.     

Psychometric Properties of Maternal Self-Efficacy Questionnaire in a Population of Iranian Mothers

Self-efficacy is an important indicator of a woman’s successful transition to her maternal role and an important predictor of a mother’s infant care behavior. This study aimed to evaluate the validity of the maternal self-efficacy scale in Iranian mothers. This cross-sectional study was conducted on 437 newly delivered mothers who were referred to health care centers in Bonab, Iran. A simple random sampling was performed. The research instrument included maternal self-efficacy. Translation validity was performed using the forward and backward translation method. Content validity was determined in qualitative (assessment of experts’ opinions) and quantitative areas using the content validity ratio (CVR) and Content Validity Index (CVI). Face validity was determined on 30 newly delivered mothers. To determine the construct validity, exploratory factor analysis was used. The reliability was determined in terms of reproducibility via Intra-class correlation coefficient (ICC) by test–retest and internal consistency (Cronbach’s alpha). CVI and CVR were 0.91 and 0.94 respectively. Further, the reliability was approved both in terms of reproducibility (ICC = 0.98) and internal consistency (α = 0.89). Construct validity was confirmed using exploratory factor analysis (KMO = 0.90, Bartlett’s test p < 0.001) for the scale. The findings supported the validity and reliability of the research instrument. Therefore, it is recommended that the instrument can be used in both clinical practice and research.     

Psychometric Properties of the Parent Cognition Scale in a Clinical Sample of Parents of Children With Disruptive Behavior

The Parent Cognition Scale (PCS; Snarr, Slep, & Grande, 2009) is a self-report measure of parental attributions of child behavior that has demonstrated validity in community samples. However, its psychometric properties have not been examined in a clinical sample of parents of children with disruptive behavior. Examining the psychometric properties of the PCS in this population is important given research linking parent attribution with childhood disruptive behavior. The present study aimed to: (a) examine the psychometric properties of the PCS in a sample of parents whose children were clinic-referred for disruptive behavior problems; and (b) investigate the concurrent validity of the PCS and its factors using correlations with parent reports of children’s emotional and behavioral difficulties, and parenting skills (i.e., discipline, supervision). A confirmatory factor analysis was run on 225 parents’ responses on the PCS, and revealed that a two-factor structure of the PCS fit the data well. Significant correlations were found between Parent Causal Attributions (Factor 1) and parent-reported parenting difficulties. Child Responsible Attributions (Factor 2) were correlated with elevations in children’s emotion, attention, and conduct difficulties. The results provide information on the utility of the PCS for parents of children with disruptive behavior and its potential clinical relevance.