Incremental Validity of Time Urgency and Other Type A Subcomponents in Predicting Behavioral and Health Criteria1

Although previous studies have revealed relationships between Type A behavior pattern (TABP) measures and behavioral indexes of time urgency, such studies utilized global TABP measures that have been criticized for their lack of construct validity. The present study linked recently developed measures of time urgency and other TABP subcomponents (e. g., impatience‐irritability) to observable temporal behaviors and health outcomes. In a sample of 194 undergraduate students, the results indicated that the TABP subcomponents provided incremental validity above the contribution of the global TABP measure in predicting behavioral and health criteria. Applied implications and future directions for research on time urgency and other TABP subcomponents are discussed.     

EXPECTATIONS OF BEHAVIORALLY ANCHORED RATING SCALES

Behaviorally anchored rating scales (BARS) are reviewed from two perspectives. First, the particular BARS methodology is assessed on the basis of its fulfilling three broad categories of "criteria for criteria:" (1) utilization criteria, (2) qualitative criteria, and (3) quantitative or psychometric criteria. These three broad categories are composed of 14 specific criteria by which performance evaluation methodologies can be assessed. The second perspective involves an evaluation of BARS in terms of psychometric criteria but with the literature broken down into studies concerned with (1) development of BARS, (2) utilization of BARS, (3) comparison of BARS to other methods, and (4) rater training in BARS use. Conclusions from these reviews indicate that BARS is no better or worse than other methods when assessed on a quantitative basis whereas it has greater potential when assessed on the utilization and qualitative criteria. Suggestions are offered for extending BARS research to process questions and to domains other than performance appraisal perse     

REACTION OF EMPLOYEES TO PERFORMANCE APPRAISAL INTERVIEWS AS A FUNCTION OF THEIR PARTICIPATION IN RATING SCALE DEVELOPMENT

A substantial amount of research has been conducted on the performance appraisal feedback interview. The purpose of the present field study was to see whether employee involvement in the development of rating scales used in the feedback interview affected ratees' perceptions of the interview. Behaviorally anchored rating scales (BARS) were developed for five job families in a midwestem hospital. A participation group consisted of employees from each of the job families who were involved in all phases of BARS construction. A nonparticipation group involved an equal number of employees from each of the job families who were not involved in the BARS development. The results showed that participation in BARS construction led to favorable perceptions regarding the performance appraisal interview process as well as positive outcomes.     

Urgency and negative emotions: Evidence for moderation on negative alcohol consequences

Prior research had shown that impulsivity may enhance the impact of negative emotions on alcohol related problems. However, these studies used broad measures of both negative emotions and impulsivity that may have obscured the effects of more specific constructs of impulsivity or negative emotions. One such construct is urgency, which is defined as the tendency to act impulsively in the face of strong positive emotions (positive urgency) or negative emotions (negative urgency). The present study tested whether urgency moderated the association between separate negative emotions (anger, depression and anxiety) and alcohol related problems. Data were obtained from a large online sample of currently drinking college students attending a large Northwestern university (n = 442). Findings indicated that alcohol related problems were directly associated with anger and both urgency facets. Additionally, positive urgency, but not negative urgency, enhanced the effects of depression, while the buffering effects of positive urgency on the anxiety-consequences association approached significance. These results suggest the importance of emotional context in understanding how dispositions towards rash action may lead to problematic alcohol use.     

Withholding Effort in Organizations: Toward Development and Validation of a Measure

Field research into the topic of withholding effort and its variants (shirking, loafing, free riding, and job neglect) has been limited due to a lack of measures that are applicable to organizational settings. This study used a multi-phase process to ascertain a measure of withholding effort that can be used in organizational settings. Items were generated through literature review and discussions with practitioners; culled by the authors; and tested in a field study in multiple, diverse organizations. Exploratory and confirmatory factor analyses found the construct of withholding effort to be multidimensional, but not necessarily as previous theoretical work in the area would suggest. Correlations of the various dimensions of withholding effort scales with existing scales tapping a wide range of employee attitudes were consistent with a priori expectations. Implications for the use of these scales in future workplace research and their practical application in organizations are discussed.     

Validation of scales measuring attitudes and norms related to mammography screening in women veterans.

Validation of psychosocial measures for use in mammography screening research has been given inadequate attention in the literature. The authors report on the validation of 5 measures examining 4 attitudinal constructs (i.e., pros, cons, outcome expectations, and cancer worries) and 1 social influence construct (i.e., subjective norms) in a 22-item inventory. The study participants consisted of a national, randomly sampled population of women veterans (n = 2,910). After minor revision of scales, the authors found independent measures for 4 constructs: pros, cons, cancer worries, and subjective norms. The authors concluded that these scales have acceptable psychometric properties; support construct validity; and provide brief, reliable, and valid measures of attitudes toward and norms regarding mammography screening. These scales may be useful for intervention research.     

Locus of control in aging research: a case for multidimensional and domain-specific assessment

Do locus of control beliefs change in later life? Is locus of control related to aging-relevant outcomes involving intelligence and health? In past research on these topics, the use of unidimensional and generalized measures of locus of control has led to a set of inconsistent findings. Three studies were conducted to examine the usefulness of multidimensional and domain-specific measures of locus of control for examining age differences and correlates. College students and elderly adults were compared on Levenson's multidimensional and generalized (internal, chance, and powerful others) locus of control scales and two domain-specific versions related to intelligence and health. As predicted, no age differences were found with generalized measures, but the elderly were more external on intelligence- and health-specific locus of control dimensions. Age differences were found most often on the chance and powerful others control dimensions, suggesting that the elderly acknowledge the importance of external sources of control and at the same time preserve their sense of internal control. In addition, the domain-specific scales were better predictors of behavioral outcomes within their respective domains for the elderly but not for the young. The findings suggest that multidimensional and domain-specific conceptions of control are advantageous for aging research.     

A CRITICAL ANALYSIS OF STUDIES COMPARING BEHAVIORALLY ANCHORED RATING SCALES (BARS) AND OTHER RATING FORMATS1

All published studies comparing behaviorally anchored rating scales (BARS) with other rating formats were reviewed. Results indicate that BARS and other formats appear to differ relatively little (if at all) with regard to psychometric characteristics (leniency, halo, interrater agreement, ratee discriminability, validity and “accuracy”). Other variables, such as degree of rater participation in scale construction and rater preferences for different rating scale formats, also exhibited relatively little differences between BARS and other formats. A close examination of the studies, however, reveals numerous methodological problems confounding interpretations of results, making conclusions about the superiority or inferiority of BARS quite tenuous. Suggestions are made for more appropriate research directions and questions which seem more appropriate for rating scale investigations.     

Combining Trait Models of Impulsivity to Improve Explanation of Substance Use Behaviour

The UPPS‐P model of impulsivity is gaining popularity among personality and substance use researchers, but questions remain as to whether its five facets have incremental validity in explaining substance use over a more parsimonious model specifying only two facets: reward drive and rash impulsiveness. In three cross‐sectional studies (total N = 486), we investigated whether the novel components of the UPPS‐P model (negative Urgency, Premeditation, Perseverance, Sensation seeking, Positive urgency) predicted typical and problematic alcohol and cannabis use after accounting for reward drive, rash impulsiveness and trait neuroticism (assessed with the Eysenck Personality Questionnaire). Reward drive and rash impulsiveness scores were calculated using principal components analysis of multiple scales, including UPPS‐P premeditation and sensation seeking. Results showed that rash impulsiveness was a robust predictor of typical and problematic substance use. The novel facets of the UPPS‐P did not improve prediction of typical substance use. The urgency scales inconsistently predicted problematic use. Specifically, negative urgency predicted one of three measures of negative consequences from alcohol use, and positive urgency only predicted negative consequences from cannabis use. Results suggest that the three novel facets of the UPPS‐P model add little over a two component model in explaining substance use, although may provide preliminary evidence for the utility of a revised global urgency construct in explaining problematic substance use. Copyright © 2017 European Association of Personality Psychology     

Five scales in search of a construct: exploring continued attachment to parents in college students

The multitude of measures and differences across self-report indices of continued parental attachment raise questions regarding the validity and meaning of these scales. The purpose of this study was to examine the convergent and construct validity of 5 measures of continued parental attachment. Five attachment scales and 6 personality scales were administered to 216 undergraduate students. Factor analyses and correlational analyses indicate that the 5 attachment measures differentiate healthy from pathological bonding with parents, the construct being assessed has multiple dimensions, and scores on these attachment measures are correlated with personify variables as would be expected. These attachment scales appear to assess a construct that is related to attachment, although they may be more illustrative of the general affective quality of relationships. Subsequent assessment efforts should employ more specific ratings and measure concrete behavioral manifestations of attachment to most effectively examine the construct.     

The cognitive-somatic anxiety questionnaire: Psychometric and validity data

The Cognitive-Somatic Anxiety Questionnaire (CSAQ) is a 14-item self-report inventory that is divided into two 7-item scales (Cognitive and Somatic) that appear to reflect cognitive or somatic anxiety. In an attempt to evaluate the construct validity of this multidimensional instrument, the CSAQ was administered to 109 college students along with several other measures of physical and psychological symptoms. The results suggest that (a) despite considerable overlap between the Cognitive and the Somatic scales (r=.62), an exploratory factor analysis is able to identify a single large somatic factor along with three lesser cognitive-appearing factors, and (b) the correlations with concurrent measures of related constructs provide some limited evidence of the construct validity of the CSAQ. For males, both the Cognitive and the Somatic scales of the CSAQ correlated significantly with several anxietyrelated measures. However, for females CSAQ scores correlated less consistently with the other test scales, although Somatic scale scores for females were positively related to measures of health and exercise involvement. Suggestions for improving the CSAQ are offered.     

Validation of the BRIEF-P in a sample of Canadian preschool children

The Behavior Rating Inventory for Executive Function-Preschool (BRIEF-P) is an instrument designed to assess preschoolers’ executive function (EF) in the context of where the behavior occurs. The present study examined the psychometric properties and measurement structure of the BRIEF-P using parents’ and teachers’ reports on 625 typically developing children aged 25 to 74 months. Results indicated that the BRIEF-P scales had good internal consistency and convergent validity in this sample of children. However, the measurement models examined exhibited poor fit statistics and showed that the EF construct was not unidimensional but rather multidimensional with interrelated subconstructs. Further analyses showed that three of the clinical scales (Emotional Control, Plan/Organize, and Working Memory) were unidimensional and invariant across informant. The other two clinical scales (Inhibit and Shift) were multidimensional and differed by informant. Results support a multidimensional construct of EF and, accordingly, different measurement models are proposed by informant.     

Avoidance and depression: the construction of the cognitive-behavioral avoidance scale

Previous research has demonstrated a relationship between avoidance and depression, although the nature of this relationship has been confused by inconsistent definitions of avoidance. Following a review of the construct of avoidance and an examination of past research, a new multidimensional measure of avoidance was developed and validated using an undergraduate student sample (245 females and 146 males). Four reliable factors reflecting combinations of cognitive/behavioral and social/nonsocial dimensions of avoidance were obtained from the factor analysis of the new scale, entitled the "Cognitive-Behavioral Avoidance Scale" (CBAS). The scale showed the predicted relationships with convergent and divergent measures used for construct validation. As predicted, subscales of the CBAS, as well as the overall scale score, were significantly related to the depression and anxiety criterion measures. The findings from this study suggest that avoidance may be an important construct in the psychosocial conceptualization of depression. In addition, this integrated measure of avoidance has potential utility for depression researchers. Suggestions for further scale development and research are provided.     

On the Discriminant Validity of Burnout,Depression and Anxiety: A Re-examination of the Burnout Measure

We investigated the discriminant validity of the frequently used Burnout Measure (BM) (Pines et al ., 1981), in relation to depressive symptomatology and anxiety. Following Russell's (1980) work on the multidimensional space of affective states, BM's items were hypothesized to reside in three separate regions of that space, labeled anxiety, depression, and wornout, with wornout representing a combination of physical and emotional exhaustion. Respondents were 704 senior army officers, who completed a questionnaire that included BM items, standard measures of depression and anxiety, and measures of military-related stresses. Their responses to the BM items and to the depression and anxiety scales were subjected to multidimensional scaling analysis. Excepting an unexpected finding related to a fourth construct, loss of vigor, the results were supportive of the hypothesis and led to the construction of three unidimensional measures, respectively gauging anxiety, depression, and wornout. The correlations of the three measures with the stress measures supported their discriminant validity. We suggest that future research using the BM should focus on the set of items that were found to load on the dimension of wornout, to the exclusion of items tapping depression and anxiety.     

Measuring meaning in life: An examination of three scales

Meaning in life is an important construct for psychological theory which has received little empirical investigation, partly because of uncertainty about measurement scales. This paper examines the factor structure of three scales to measure meaning in life, the purpose in life (PIL) test, the life regard index (LRI) and the sense of coherence (SOC) scale. Results suggest that meaning in life can be regarded as a multidimensional construct, with meaning able to be attained in several different ways. Oblique factor solutions were accepted, and higher-order analyses conducted for all three scales. A general second-order meaning in life dimension was identified only for PIL and it is suggested that this scale may be the best general measure of the construct. It is concluded that further work should be undertaken to explore the specific dimensions of meaning in life.     

Anxiety: The cognitive perspective,by Michael W. Eysenck Hove,UK: Lawrence erlbaum; 1992; 195 pp.

Abstract

The purpose of the study was twofold: To investigate the structure of the test anxiety construct. and to compare the psychometric properties of rating scales versus questionnaire scales of test anxiety.

The intercorrelations among fourteen test anxiety measures, representing the one-, two-and four-dimensional models were examined as well as the correlations between those scales and eight measures of test-related perceptions.

The sample consisted of 172 undergraduate and graduate students of education. The results indicated that the underlying structure of the test anxiety construct consists of four primary factors. It was noted that the pattern of the relationships among the test anxiety measures remained intact when the broader context, which included also test-related perceptions, was studied. Based on the intra- and intercorrelations among the test anxiety and the test-related perceptions, a speculative causal model for explaining the effect of test anxiety on performance was suggested.

The findings regarding the format issue seemed to support the contention that rating scales are at least as valid measures of a simple single trait as questionnaire scales. However, it was stressed that further research is needed in order to find out whether or not rating scales are robust enough to be considered valid measures in situations that elicit social desirability distortion.     

Validity Evidence for the Different Item Styles of Overt Honesty Measures

Overt honesty measures have been shown to be multidimensional. The multidimensionality of those tests rests, in part, on the different kinds of item styles that make up the measures such as items referring to admissions of dishonesty, temptations to be dishonest, and rationalizations about dishonest behavior. The purpose of the study presented here was to determine the extent to which these item styles measure the same underlying construct by examining their intercorrelations and their differential ability to predict actual dishonest behaviors. The results suggest that the different item styles found in overt honesty measures may not be measuring the same construct.     

Measurement and correlates of sport-specific cognitive and somatic trait anxiety: The sport anxiety scale

Abstract

Previous research indicates the viability of a distinction between cognitive and somatic components of the anxiety response, and multidimensional anxiety scales have proven useful in relating cognitive and somatic anxiety to behavioral outcomes. This article describes the development and validation of a sport-specific measure of cognitive and somatic trait anxiety. The Sport Anxiety Scale measures individual differences in Somatic Anxiety and in two classes of cognitive anxiety, Worry and Concentration Disruption. Both exploratory and confirmatory factor analyses supported these dimensions in several different athlete samples. Psychometric properties of the Sport Anxiety Scale are described, as are its relations with other psychological measures and with precompetition affective state measures. In the last of the four studies reported, scores on the Concentration Disruption scale were negatively related to the performance of college football players over the course of a season. The studies suggest that the Sport Anxiety Scale may be useful in defining sport-related anxiety more sharply and assessing how the cognitive and somatic anxiety components relate to performance and other outcome measures in sport.     

Time Theft in Organizations: The development of the Time Banditry Questionnaire

Time banditry has recently been introduced as a conceptually distinct construct in the counterproductive work behavior literature. An employee is engaged in time banditry if s/he pursues unsanctioned and/or unethical nonwork activities during work time. An analysis of the time banditry construct would be facilitated by the rigorous development of a measure of this construct. The purpose of this research was to develop and refine a multidimensional measure of time banditry. Items were generated through an extensive literature review and numerous workplace discussions with a diverse sample of employees. Through this process, we developed a 45‐item time banditry scale (Time Banditry Questionnaire; TBQ) and utilized it with a diverse sample. Exploratory and confirmatory factor analyses indicated that the construct of time banditry is multidimensional, exhibiting three distinct factors (classic, technology, and social). The TBQ demonstrated an internal consistency reliability of .90. Implications for the use of the TBQ in future research and application in organizations are discussed. The most salient suggestion in this study is that time banditry is more closely related to situational variables and personality variables than it is related to demographic variables.