The multidimensionality of test anxiety: A test of different models

Abstract

Confirmatory factor analysis was employed to test the multidimensional structure of test anxiety. Starting with the traditional two-factor model, it was of interest whether additional dimensions could still be represented by a single higher-order factor of test anxiety or whether the additional dimensions represented correlates of test anxiety. The Revised Test Anxiety (RTA) scale and the German Test Anxiety Inventory (TAI-G) were combined collecting data from a binational sample of 218 American and 218 German university students. Considering the statistical and theoretical aspects of model fit, they indicated that a model consisting of three primary factors (worry, emotionality, and lack of confidence) fit the data best. While distraction and self-efficacy may be regarded as correlates of test anxiety, lack of confidence was substantiated as a component of test anxiety. Implications for the conceptualization of the content domain and hence area of test anxiety were discussed.     

Cross-sectional and longitudinal confirmatory factor models for the german test anxiety inventory: A construct validation

Construct validity of the German Test Anxiety Inventory (TAI-G) was tested in two respects. Firstly, the purported four-dimensional structure of the TAI-G (comprising subscales Emotionality, Worry, Interference, and Lack of Confidence) as well as relations of the test anxiety dimensions to self-efficacy were tested. Secondly, the trait conception of the TAI-G was tested within the framework of Latent State-Trait theory. The TAI-G was given to a student sample (N=302) on three occasions with a time interval of 2 weeks along with a study-specific self-efficacy scale on occasion 1. Dimensionality assumptions as well as relations with self-efficacy were tested using cross-sectional second-order confirmatory factor analysis. The trait conception was tested separately for TAI-G subscales by specifying longitudinal confirmatory factor models (Latent State-Trait models) and by calculating variance proportions of manifest variables (Latent State-Trait coefficients) referring to different sources of systematic variance (person, situation, and method) based on parameter estimates of the models. Results were supportive of both the purported four-dimensional structure and hypothesized relationships to self-efficacy (i.e., acceptable model fit) as well as of the trait conception of test anxiety (i.e., acceptable model fit and high proportion of variance due to person component). Implications for further validation studies were discussed.     

Measuring decentering as a unidimensional construct: The development and initial validation of the Decentering Scale for Sport

Decentering, the ability to observe one's thoughts and feelings from a detached view, has gained increased attention in recent years. With this renewed interest comes a need for a reliable and valid tool to measure decentering in sport contexts. Therefore, in this multi-study paper we report the development and initial validation of a sport-specific self-report measure of decentering, the Decentering Scale for Sport (DSS). Based on an initial pool of context-specific items with acceptable content validity, a unidimensional decentering construct was confirmed in four independent athletic samples (n = 1255). Satisfactory internal consistency reliability and partial measurement invariance across gender and sport type was demonstrated. Convergent and concurrent validity of the DSS was established by showing positive and medium to large associations with mindfulness, well-being, flow, vitality, enjoyment and positive affect, and negative and medium to large associations with cognitive fusion, experiential avoidance, anxiety and negative affect. Discriminant validity of decentering with mindfulness and self-compassion was also established. Findings suggest that the DSS is a reliable and valid measure of decentering in sport contexts, and can be applied in future research and applied practice to measure decentering.     

Servant Leadership Behaviour Scale: A hierarchical model and test of construct validity

Servant leadership is widely believed to be a multidimensional construct. However, existing measures of servant leadership typically suffer from highly correlated dimensions, raising concerns over discriminant validity. We set out in this study to examine the dimensionality of the hypothesized six-factor Servant Leadership Behaviour Scale (SLBS) and validate a hierarchical model of servant leadership. Using structural equation modelling, convergent and discriminant validity of the higher-order servant leadership construct was examined in relation to measures of character-related behaviour, Machiavellian leadership orientation, and social desirability. Our findings suggest that the SLBS assesses a single, higher-order construct of servant leadership with evidence of construct validity and absence of social desirability bias. The high correlation between servant leadership and character-related behaviour supports our expectation that servant leadership reflects in large part the character strength of the leader.     

Measuring sport fantasy proneness and deflated reality in sport and performance: Development and validation of two context-specific instruments

Fantasy-prone personalities and generalized states of pessimism and hopelessness have been linked to various behavioural, cognitive, and health related outcomes in the general population. Nevertheless, to date, knowledge of sport-specific fantasy proneness and athletes’ perception of deflated reality in sport is scarce, possibly due to a lack of appropriate psychometric instruments to examine these two important context-specific constructs. In this research, we developed the Sport Fantasy Proneness Scale (SFPS) and the Deflated Reality in Sport Scale (DRSS), first assessing the content validity of items for the instruments following a rigorous process. Through two cross-sectional samples (Study 1: Sample 1 N = 255, Sample 2 N = 260) and one longitudinal sample (Study 2: Sample 3 N = 118) of competitive athletes in the UK, we then examined factorial, convergent, discriminant, and concurrent validity and measurement invariance (Study 1), as well as internal consistency, and test-retest reliability (Study 2) of the two new scales. Results revealed robust construct validity and reliability of scores on the two instruments and suggested very good invariance when implementing the new scales to athletes from different sports and competitive levels and good invariance for cross-gender comparisons. The new scales fill a gap in the sport psychology literature and provide researchers and practitioners with robust psychometric instruments to examine new research questions and tackle issues relevant to athletes’ sport-specific fantasy proneness and perceptions of deflated reality.     

Beyond test anxiety: Development and validation of the test emotions questionnaire (TEQ)

Measures of test emotions other than test anxiety are lacking. In a series of six studies, we developed a multi-scale questionnaire assessing test-related joy, hope, pride, relief, anger, anxiety, shame, and hopelessness (Test Emotions Questionnaire, TEQ). Consisting of subscales measuring affective, cognitive, physiological, and motivational emotion components, the scales can be used to identify both trait and state test emotions, and are available in German- and English-language versions. Using a rational-empirical strategy of test construction, we first developed theoretical models of the component structures, antecedents, and effects of different test emotions. We then conducted two exploratory, qualitative studies on the occurrence and structures of these emotions. Finally, based on theory and our exploratory data, we constructed, analyzed, and revised the scales of the TEQ in four quantitative studies. Findings of correlational and confirmatory factor analysis indicate that the scales are reliable, structurally valid in terms of representing different test emotions and components within emotions, and externally valid in terms of correlating significantly with personality, learning, academic achievement, and perceived health problems. Many of these correlations proved to be stronger for test emotions other than anxiety, implying that test anxiety is neither the only relevant test emotion, nor necessarily the most important one.     

The physical activity and sport anxiety scale (PASAS): Scale development and psychometric analysis

Research suggests that social anxiety may be elicited in athletic or sporting situations, resulting in decreased physical activity due to avoidance behavior. Given the myriad physical and psychological health consequences of a non-active lifestyle, valid assessment of social anxiety and avoidance in this domain is warranted. However, none of the common measures of social anxiety appear to assess social anxiety in physical activity or sporting domains. Therefore, the purpose of this study was to develop and evaluate a brief measure of social anxiety in physical activities and sports. A 16-item self-report questionnaire, the Physical Activity and Sport Anxiety Scale (PASAS), was extracted from a larger pool on empirical and theoretical grounds. The PASAS demonstrated excellent internal consistency across a number of samples, and excellent temporal stability. The PASAS also demonstrated good convergent and divergent validity, and is related to self-perceived performance biases as postulated by cognitive-behavioral models of social anxiety.     

The work-related flow inventory: Construction and initial validation of the WOLF

The WOrk-reLated Flow inventory (WOLF) measures flow at work, defined as a short-term peak experience characterized by absorption, work enjoyment, and intrinsic work motivation. Results of Study 1 among 7 samples of employees (total N = 1346) from different occupational groups offer support for the factorial validity and reliability of the WOLF. Study 2 examined the validity of the WOLF in more detail among some of the samples. Positive correlations between a general flow index and the three flow dimensions confirm the convergent validity of the WOLF. In addition, the findings of Study 2 provide evidence for the construct and predictive validity of the WOLF using five job characteristics as predictors of flow, and other-ratings of performance as outcomes.     

The support appraisal for work stressors inventory: Construction and initial validation

In order to better understand the role of perceived available support in buffering the negative effects of workplace stressors, a new multidimensional measure of perceived available support, the SAWS, was developed. Initial item development and content validation were conducted, followed by scale evaluation and validation. Two samples of 190 and 170 nursing staff supported the hypothesized structure of the scale, and provided evidence for discriminant validity amongst the sub-constructs of source of support (e.g., support from supervisor) and supportive function (e.g., emotional support). Criterion-related validity of the SAWS constructs were supported by measures of network orientation and relationship closeness. Evidence for predictive validity was provided by examining the moderating effects of the SAWS constructs on the relationship between work-family conflict and adjustment outcomes. The final SAWS inventory assesses three sources of support, and within each source, assesses four distinct supportive functions.     

A better state-of-mind: deep breathing reduces state anxiety and enhances test performance through regulating test cognitions in children

A pre-test/post-test, intervention-versus-control experimental design was used to examine the effects, mechanisms and moderators of deep breathing on state anxiety and test performance in 122 Primary 5 students. Taking deep breaths before a timed math test significantly reduced self-reported feelings of anxiety and improved test performance. There was a statistical trend towards greater effectiveness in reducing state anxiety for boys compared to girls, and in enhancing test performance for students with higher autonomic reactivity in test-like situations. The latter moderation was significant when comparing high-versus-low autonomic reactivity groups. Mediation analyses suggest that deep breathing reduces state anxiety in test-like situations, creating a better state-of-mind by enhancing the regulation of adaptive-maladaptive thoughts during the test, allowing for better performance. The quick and simple technique can be easily learnt and effectively applied by most children to immediately alleviate some of the adverse effects of test anxiety on psychological well-being and academic performance.     

The Purpose-in-Life Scale (PILS): internal consistency reliability,concurrent validity and construct validity among Catholic priests in Italy

ABSTRACT

The Purpose in Life Scale was designed to provide a 12-item unidimensional measure of purpose in life employing a five-point Likert rating for each item. The present study supports the psychometric properties of the Italian translation of this instrument among 155 Catholic priests (mean age?=?46 years, SD?=?12.16). Internal consistency reliability generated an alpha coefficient of .90. The first factor generated by principal component analysis accounted for 49.5% of variance. Concurrent validity against the Purpose in Life Test was supported by a correlation of .63. Construct validity was supported by a correlation of .54 with the Satisfaction in Ministry Scale and by a correlation of ?.51 with the Scale of Emotional Exhaustion in Ministry. These properties commend the scale for future use among Catholic priests.     

Construction and validation of a japanese adaptation of the test anxiety inventory

This study describes the construction and validation of a Japanese adaptation of Spielberger's (1980) Test Anxiety Inventory (TAI) and presents evidence of the reliability and validity of this new instrument. The items for the Japanese TAI (TAI-J) were selected on the basis of content validity and itemremainder correlations, which were .40 or higher for both sexes. Alpha reliability coefficients for the TAI-J Total scores were .90 or higher for both high school and college students; test-retest stability over a three-week interval was .89. Mean TAI-J Total scores for Japanese high school females were significantly higher than those of Japanese college students, whose scores were slightly lower than those reported for American undergraduates. TAI-J Total scores correlated .72 with a Japanese trait anxiety measure. Significant negative correlations were found between TAI-J Total scores and measures of academic achievement. Implications of these results for the measurement of test anxiety in Japanese students are discussed from a cross-cultural perspective.     

Development and validation of the Material Values Scale for children (MVS-c)

The aim of this study was to develop a scale to measure materialism among children while relying on insights from research conducted among adults. Although research among adults suggests that materialism is a second-order construct with three underlying factors (i.e., material centrality, material happiness, and material success), existing materialism scales for children include only one or two of these factors. Hence, we adapted the items of the well-established Material Values Scale (MVS) of Richins and Dawson (1992) to make them appropriate for use among children. We then administered the Material Values Scale for children (MVS-c) to 1001 8- to 11-year-olds. Structural equation modeling confirmed the presumed second-order structure of the MVS-c. Based on these findings, we created 6- and 3-item versions in addition to the full-length, 18-item MVS-c. All three versions performed well in terms of test–retest reliability and construct validity.     

Ethical leadership: A social learning perspective for construct development and testing

Leaders should be a key source of ethical guidance for employees. Yet, little empirical research focuses on an ethical dimension of leadership. We propose social learning theory as a theoretical basis for understanding ethical leadership and offer a constitutive definition of the ethical leadership construct. In seven interlocking studies, we investigate the viability and importance of this construct. We develop and test a new instrument to measure ethical leadership, examine the proposed connections of ethical leadership with other constructs in a nomological network, and demonstrate its predictive validity for important employee outcomes. Specifically, ethical leadership is related to consideration behavior, honesty, trust in the leader, interactional fairness, socialized charismatic leadership (as measured by the idealized influence dimension of transformational leadership), and abusive supervision, but is not subsumed by any of these. Finally, ethical leadership predicts outcomes such as perceived effectiveness of leaders, followers’ job satisfaction and dedication, and their willingness to report problems to management.     

Measuring rail passenger crowding: Scale development and psychometric properties

Research on rail passenger crowding often tacitly subscribes to a measurement of crowding based on density (i.e. physical conditions involving space limitations) and rarely considers the possible role psychological factors may play in measuring this construct. This paper describes the development of an instrument that captures the dimensionality of rail passenger crowding and its relationship to the experience of stress and feelings of exhaustion. The proposed instrument is a 20-item self-rating questionnaire consisting of three sub-scales designed to assess subjective crowding experiences among rail users (n = 525). Findings from the factor analyses generally support the hypothesised three-factor structure of the measurement model (evaluation of the psychosocial aspects of the crowded situation, evaluation of the ambient environment of the crowded situation, and affective reactions to the crowded situation). All sub-scales demonstrate excellent internal consistency and construct validity as well as good convergent and discriminant validity values. The instrument was further tested using structural equation modelling to examine the impact of crowding on commuters’ stress and feelings of exhaustion. With the addition of the “passenger density” variable as an indicator of objective measurement of crowding operating in tandem with the crowding sub-scales, the results reveal that: (1) commuters’ evaluations of the psychosocial aspects of the crowded situation and of its ambient environment, alongside their rating of passenger density, significantly predict affective reactions to the crowded situation; (2) these affective reactions, in turn, significantly predict stress and feelings of exhaustion; and (3) evaluations of the psychosocial aspects of the crowded situation and of its ambient environment as well as passenger density do not directly predict stress and feelings of exhaustion. The link between rail passenger crowding and the negative outcomes therefore does not appear as a simple, direct relationship, but is mediated by affective feelings of crowdedness. Overall, these results provide satisfactory psychometric properties for the proposed instrument and support its use as an assessment tool for measuring crowding experience in the rail setting.     

Identifying correlates of self-stigma in adults who stutter: Further establishing the construct validity of the Self-Stigma of Stuttering Scale (4S)

PurposeThis study was set up to further establish the construct validity of the Self-Stigma of Stuttering Scale (4S) by demonstrating its associations with other established scales and replicating its original factor structure and reliability estimates.MethodWeb surveys were completed by 354 adults who stutter recruited from Board Certified Specialists in Fluency Disorders, and adult chapters of the National Stuttering Association. Participants completed a series of psychometrically validated scales measuring self-stigma, hope, empowerment, quality of life, social support, anxiety, depression, and self-rated speech disruption.ResultsHigher subscale and total stigma scores on the 4S were associated with significantly lower levels of hope, empowerment, quality of life, and social support, and significantly higher levels of anxiety, depression, and self-rated speech disruption. The original factor structure of the 4S was replicated, and reliability estimates of the subscales ranged from adequate to excellent.ConclusionsThe findings of this study support the construct validity of the 4S and its use by clinicians and researchers intending to measure the construct of self-stigma in adults who stutter.Educational objectives: Readers should be able to: (a) distinguish between the various components of self-stigma; (b) describe how the various components of the self-stigma model relate to hope, empowerment, quality of life, and social support, self-rated speech disruption, anxiety, and depression; (c) summarize the psychometric properties of the Self-Stigma of Stuttering Scale (4S) in terms of reliability, factor structure, and construct validity; (d) discuss how the 4S could be used in research and clinical practice.     

The surgical anxiety questionnaire (SAQ): development and validation

Objective: Preoperative anxiety is often assessed using general anxiety measures; existing specific measures might lack content coverage and/or are not psychometrically validated. This study aimed to develop a new self-report measure of surgery-specific anxiety and test its psychometric properties.

Design: The surgical anxiety questionnaire (SAQ) was developed from themes identified in qualitative research and reviewed by an interdisciplinary expert team. It was administered preoperatively to 135 patients (56% female, mean age 51) on the day of surgery alongside additional measures of preoperative anxiety, state anxiety, perceived stress, depression and social desirability. Follow-up assessment was conducted immediately post-surgery and two weeks post-surgery (n?=?114) to examine recovery and predictive validity of the scale.

Results: Factor analysis revealed a three component structure, including: concerns about health (six items), concerns about recovery (four items) and concerns about procedures (four items). Three additional items of relatively high concern were retained in the total score (17 items). The SAQ displayed good reliability, validity (content, construct and predictive) and adequate overall psychometric properties.

Conclusions: Preliminary results suggest that the SAQ is a promising tool for measuring preoperative anxiety and predicting recovery. Recommendations for future research include employing a confirmatory factor analysis and examining test-retest reliability.     

Construct validity of the Sivik Psychosomaticism test and test of Operational style: Correlations with four Minnesota Multiphasic Personality Inventory (MMPI) subscales

To evaluate the construct validity (convergent and divergent) of the Sivik Psycho Somaticism test (SPS) and test of Operationality (OPER), Pearson correlation coefficients between SPS scales and subscales, OPER and Minnesota Multiphasic Personality Inventory (MMPI) subscales Hypochondria (Hs), Depression (D), Hysteria (Hy) and Alexithymia (Al) were calculated. Eighty-eight healthy individuals and 285 psychosomatic patients completed the SPS and OPER tests and MMPI; Hs, D, Hy and Al. The results show that most of the SPS subscales and OPER are significantly correlated to several MMPI subscales in both a normal and a psychosomatic population. The results are in concordance with the theoretical hypotheses and confirm the validity of the SPS and OPER constructs.     

Text anxiety on cognitive ability test can result in differential predictive validity of academic performance

This paper investigates whether test anxiety leads to differential predictive validity in academic performance. Our results show that the predictive validity of a cognitive ability test, using final exam performance as a criterion, decreased a small amount as Worry (the cognitive aspect of anxiety) increased but was unaffected by Emotionality (the physiological aspect of anxiety). These results suggest that cognitive ability tests may be more useful as predictors of performance for low anxiety test-takers. These findings are discussed in the context of the interference and deficit perspectives of test anxiety.     

The Flow-Clutch Scale: Development and preliminary validation in sport and exercise

ObjectivesThe Integrated Model of Flow and Clutch States describes two overlapping psychological states that underlie exceptional performance and rewarding exercise experiences. However, research based on this model is currently hampered because no validated measure has yet been developed. Therefore, the aim of this multi-study paper was to develop and provide preliminary validation of the Flow-Clutch Scale in sport and exercise.DesignUsing two independent adult samples (n = 280; n = 264), three studies were conducted to develop and establish preliminary validity of the Flow-Clutch Scale.MethodIn Study 1, we developed an initial version of the scale and established content validity using an expert panel. In Study 2, we employed exploratory factor analysis to: identify the most appropriate factor structure; examine the scale’s internal consistency; test whether the scale differentiated between individuals who experience flow, clutch, or neither state; and examine relationships with the Flow State Scale-2. In Study 3, we aimed to replicate findings of Study 2 with an independent sample, and employed confirmatory factor analysis to confirm the factor structure, internal consistency, and relationships with the Flow State Scale-2.ResultsThe results provide preliminary validation of the four-factor, 22-item Flow-Clutch Scale.ConclusionsThese studies indicate the Flow-Clutch Scale represents a useful scale for researchers interested in examining flow and/or clutch states in sport and exercise. Recommendations are provided for further research to continue testing, and accumulating evidence for, the validity and reliability of the Flow-Clutch Scale.