Validation of physical activity habit strength with subjective and objective criterion measures

ObjectivesA German version of the Self-reported Habit Strength Index (SRHI) for both sports and everyday physical activity (PA) was validated against subjective and objective criterion measures of PA.Design and methodData were obtained from 260 participants (21.4% women) in study 1 and 86 participants (58.1% women) in study 2. Both studies assessed habit strength for PA (sports and everyday PA) by the SRHI and PA by the Baecke Questionnaire (Sport, Leisure and Work Index) as subjective criterion measure, as well as by accelerometry (Step Activity Monitor or GTM1 Actigraph) as objective criterion measure. Bivariate correlations as well as path analyses were computed for the associations between the SRHI scores and subjective and objective criterion measures of PA.ResultsHighest associations for subjective criterion measure were found for habit strength for sports and the Sport Index in both studies. The Leisure Index was predicted by habit strength for sports and everyday PA. For objective criterion measures, habit strength for sports was most significantly associated with total PA in study 1 and moderate intense PA in study 2. Habit strength for everyday PA was a significant predictor of moderate intense and total PA in study 1 and low intense PA in study 2.ConclusionThe present studies replicated high internal consistencies of the SRHI for sports and everyday PA and could partially confirm their validity with subjective and objective criterion measures. The SRHI for sports seems to be more robust than the SRHI for everyday physical activity.     

Examining the reliability and predictive validity of performance assessments by soccer coaches and scouts: The influence of structured collection and mechanical combination of information

Soccer coaches and scouts typically assess in-game soccer performance to predict players’ future performance. However, there is hardly any research on the reliability and predictive validity of coaches’ and scouts’ performance assessments, or on strategies they can use to optimize their predictions. In the current study, we examined whether robust principles from psychological research on selection – namely structured information collection and mechanical combination of predictor information through a decision-rule – improve soccer coaches’ and scouts’ performance assessments. A total of n = 96 soccer coaches and scouts participated in an elaborate within-subjects experiment. Participants watched soccer players’ performance on video, rated their performance in both a structured and unstructured manner, and combined their ratings in a holistic and mechanical way. We examined the inter-rater reliability of the ratings and assessed the predictive validity by relating the ratings to players’ future market values. Contrary to our expectations, we did not find that ratings based on structured assessment paired with mechanical combination of the ratings showed higher inter-rater reliability and predictive validity. In contrast, unstructured-holistic ratings yielded the highest reliability and predictive validity, although differences were marginal. Overall, reliability was poor and predictive validities small-to-moderate, regardless of the approach used to rate players’ performance. The findings provide insights into the difficulty of predicting future performance in soccer.     

The Hall index of mystical spirituality: an exploration in constructing a short scale of mystical spirituality

ABSTRACT

The aim of this study was to propose a new nine-item measure of mystical spirituality which would be [as easy as possible] for “ordinary” people (those with little or no theological education) to complete. The measure was developed and tested on data provided by 602 participants within an on-line survey. The Hall Index of Mystical Spirituality displayed excellent properties of internal consistency reliability (reporting an alpha coefficient of .93) and good construct validity, in terms of its location within the four components of psychological space, defined by psychological type theory (reporting a correlation of .30 within the measure of intuition). As a new measure of mystical spirituality further research is needed to test the usefulness of this short scale.     

Validation d’une mesure de santé psychologique au travail

IntroductionThere is currently no instrument developed to measure the two dimensions of psychological health, namely psychological well-being and distress, in organizational settings.ObjectiveThe aim of this study is to validate a work frame-of-reference version of two instruments initially developed to measure general psychological health.MethodIn order to adapt the questionnaires to the work domain, 561 Quebec workers from various work sectors completed measures of psychological well-being and distress adapted for the work context. For nomological networking purpose, they also completed optimism, organizational justice and climate measures.ResultsAdapting psychological health constructs for the work domain revealed, for both psychological well-being at work and psychological distress at work, a three-fold structure based on the worker's relationship with himself, others and work. Predictions based on the nomological network were all confirmed, reinforcing the validity of adapting the construct for a work-specific context. Furthermore, the psychometric properties of the scales are satisfactory.DiscussionResults suggest the relevance to adapt measures of psychological health for the work domain.     

Emotion Regulation Questionnaire for use with athletes

ObjectivesThree studies examine the factorial validity, internal consistency, test–retest stability, and criterion validity of the Emotion Regulation Questionnaire (ERQ: Gross & John, 2003) for use with athletes.DesignFactorial validity, internal consistency, test–retest stability and criterion validity of the ERQ were examined over three stages, using three separate samples.MethodIn stage 1 the factorial validity and internal consistency of the ERQ subscales were examined based on responses from 433 sport participants. In stage 2, 176 sport participants completed the ERQ on two occasions separated by an interval of two weeks. In stage 3, the criterion validity of the ERQ was examined. Sport participants (n = 88) completed the ERQ and reported the intensity, frequency and direction of a range of emotions experienced when competing in sport.ResultsConfirmatory factor analysis results lend some support to a two-factor model when reappraisal and suppression are allowed to correlate. Alpha coefficients were acceptable. Test–retest stability analyses indicated poor agreement and a greater influence of situational, as opposed to trait factors, in the variance of item scores on the second test administration. In addition, results were partially consistent with findings of Gross and John (2003): reappraisal scores were associated with pleasant emotions, but suppression scores were not associated with unpleasant emotions.ConclusionResults provide mixed support for the validity of the ERQ in sport. Because the ERQ is intended to assess stable patterns of emotion regulation, the instability of items is a concern and reasons for this require further investigation.     

Capturing autonomy,competence, and relatedness at work: Construction and initial validation of the Work‐related Basic Need Satisfaction scale

The satisfaction of the basic psychological needs for autonomy, competence, and relatedness, as defined in Self‐Determination Theory, has been identified as an important predictor of individuals' optimal functioning in various life domains. The study of work‐related need satisfaction seems, however, hampered by the lack of a validated measure. To assist future research, the present study aimed to develop and validate a Work‐related Basic Need Satisfaction scale (W‐BNS). Using four Dutch‐speaking samples, evidence was found for the three‐factor structure of the scale, the discriminant validity, and the reliability of the three need satisfaction subscales as well as their criterion‐related and predictive validity. The W‐BNS may therefore be considered as a promising tool for future research and practice.     

Development and validation of the Zurich Meeting Questionnaire (ZMQ)

Introduction and objectivesResearch highlights the importance of identifying and examining crucial meeting characteristics and procedures. Thus, the aim of the present research is to develop and validate the Zurich Meeting Questionnaire (ZMQ), an instrument that assesses meeting attendees’ perceptions of meeting design characteristics and task- and relational-oriented procedures during the meeting.MethodThree independent samples (n₁ = 474, n₂ = 464, n₃ = 311) were used to test the psychometric properties, factorial structure, criterion validity, and construct validity of the ZMQ.ResultsResults of confirmatory factor analyses confirmed the assumed two-dimensional structure of meeting procedures. Furthermore, the results provided criterion validity evidence regarding meeting satisfaction and perceived meeting effectiveness. Finally, the pattern of correlations with external variables (team climate inventory, psychological safety, and social desirability) provided initial evidence of construct validity.ConclusionThe ZMQ is a short and psychometrically sound measure of meeting design characteristics and procedures during meetings and is suitable for use in organizational research and the evaluation of meetings in practice.     

Measuring psychological need states in sport: Theoretical considerations and a new measure

ObjectivesResearch guided by Self-determination Theory (Deci & Ryan, 1985; Ryan & Deci, 2017) has repeatedly demonstrated the importance of focusing on both the bright (satisfaction) and dark (frustration) sides of the three basic psychological needs. Recently, researchers have also argued for the utility of assessing a third need state, that of “unfulfillment”. In this paper, we outline an effort to develop and provide initial validity evidence for scores of a new multidimensional and sport-specific measure, the Psychological Need States in Sport-Scale (PNSS-S), to assess the satisfaction, frustration, and unfulfillment of all three needs.MethodIn Study 1, we developed 46 candidate items, and tested evidence for the factorial structure of the responses to the newly developed items, internal consistency and discriminant validity of the subscale scores. Following refinement, the replication of the favored model was tested using an independent sample of athletes in Study 2. Evidence for the nomological network of the subscales of the new measure was also demonstrated in Study 2.ResultsFactor models incorporating all three need states showed poor fit with the data. However, following post-hoc modifications, a six-factor model assessing the need states of satisfaction and frustration, separately for autonomy, competence, and relatedness, was found to have good fit to the data. After refinement, the 29-item six-factor model was found to demonstrate good fit, good standardized factor loadings, factor correlations in the expected directions, and acceptable estimates of internal consistency in Study 2. Tests of nomological networks showed that the six need states were significantly predicted by contextual autonomy, competence, and relatedness support/thwarts as expected. Autonomy and competence need satisfaction were significantly associated with engagement; and competence and relatedness need satisfaction were significantly associated with positive affect. In addition, autonomy and competence need frustration were significantly associated with exhaustion and all three need frustration states significantly predicted negative affect.ConclusionsA tripartite conceptualization of the need states was not empirically supported. Nevertheless, the PNSS-S makes a unique contribution to the sport literature, as it represents the first sport-specific measure of six distinct, yet, correlated states of the satisfaction and frustration of autonomy, competence, and relatedness needs.     

Examining the validity of self‐reports on scales measuring students' strategic processing

Background. Self‐report inventories trying to measure strategic processing at a global level have been much used in both basic and applied research. However, the validity of global strategy scores is open to question because such inventories assess strategy perceptions outside the context of specific task performance. Aims. The primary aim was to examine the criterion‐related and construct validity of the global strategy data obtained with the Cross‐Curricular Competencies (CCC) scale. Additionally, we wanted to compare the validity of these data with the validity of data obtained with a task‐specific self‐report inventory focusing on the same types of strategies. Sample. The sample included 269 10th‐grade students from 12 different junior high schools. Methods. Global strategy use as assessed with the CCC was compared with task‐specific strategy use reported in three different reading situations. Moreover, relationships between scores on the CCC and scores on measures of text comprehension were examined and compared with relationships between scores on the task‐specific strategy measure and the same comprehension measures. Results. The comparison between the CCC strategy scores and the task‐specific strategy scores suggested only modest criterion‐related validity for the data obtained with the global strategy inventory. The CCC strategy scores were also not related to the text comprehension measures, indicating poor construct validity. In contrast, the task‐specific strategy scores were positively related to the comprehension measures, indicating good construct validity. Conclusion. Attempts to measure strategic processing at a global level seem to have limited validity and utility.     

Development and initial validation of the coaching life skills in sport questionnaire

ObjectivesResearchers have advocated for coaches to intentionally teach life skills to their athletes given the accrued developmental benefits. The purpose of this research was to develop and offer initial evidence of validity and reliability for a measure assessing the extent to which coaches are intentional in their approaches to teaching life skills through sport.DesignUsing two independent samples (n = 623; n = 817), three studies were conducted to develop and initially validate the Coaching Life Skills in Sport Questionnaire (CLSS-Q).MethodIn study one, the scale development and content validity processes of the initial measure were conducted. In study two, the factorial validity of the CLSS-Q was tested through exploratory structural equation modeling and confirmatory factor analyses. Moreover, scale invariance, discriminant and convergent validity, and construct reliability were assessed. In study three, concurrent validity was assessed with the combined sample (N = 1440) using two theoretically linked constructs.ResultsThe results of the three studies provide initial evidence for the validity and reliability of the 5-factor 36-item CLSS-Q.ConclusionsThe CLSS-Q represents a useful scale for researchers interested in examining levels of intentionality in coaches' teaching of life skills through sport. As scale development is an ongoing process, further research is needed to continue to accumulate evidence for the validity and reliability of the CLSS-Q.     

Understanding concussion in socio-cultural context: A media analysis of a National Hockey League star's concussion

ObjectivesSport psychology researchers have yet to explore the socio-cultural context of concussion. The aim with this study was to explore the contribution of one socio-cultural context (i.e., sport media) toward understanding the construction of meaning(s) of a sport celebrity's concussion and the implications for sport psychology.DesignA qualitative approach was used to explore concussion as a socio-cultural issue shaped by cultural narratives (i.e., news media). The meanings and implications for how sport concussion is understood and “constructed” through a key media incident were of interest.MethodAn ethnographic content analysis (see Altheide, 1996) of the mediation of the National Hockey League's (NHL) star player Sidney Crosby's concussion from January 1, 2011 (when the concussion occurred) to June 30, 2011 (end of the NHL season) was undertaken on North American news data.ResultsThe ethnographic content analysis of 68 articles revealed that Crosby's concussion and its associated meanings were constructed within a central narrative: a culture of risk and its impact on athletes. Multiple meanings of concussion within the risk narrative emerged depending on three sub-narratives: (a) Crosby's concussion as a cautionary tale, (b) Crosby's concussion as a political platform, and (c) concussion as ambiguous.ConclusionsThe culture of risk narrative raises awareness of the physical risks, physiological effects and the politics of concussion. These cultural meanings do not acknowledge/include the psychological implications/effects of concussion. This study furthers understandings of sport concussion within a socio-cultural context.     

Development and initial validation of an indirect measure of transformational leadership integrity

An indirect measure of transformational leadership integrity was developed across three studies. In Study 1, the transformational leadership integrity implicit association test (TLI-IAT) was developed and tested with 65 leaders across heterogeneous organizational contexts. Study 2 involved 51 coaches from 18 sports. Results from Studies 1 and 2 supported the construct validity of the instrument, providing evidence of the instrument's convergent and discriminant validity. Study 3 involved 32 coaches and 133 players from six sports. Findings supported the criterion validity of the measure, providing evidence for the instrument's predictive validity. In sum, evidence is presented that supports the TLI-IATs construct and criterion validity. As such, the present research has made significant advancements to the transformational leadership integrity literature and provides researchers with an indirect measure of automatic transformational leadership integrity self-attitudes.     

Examining the home advantage in the National Hockey League: Comparisons among regulation,overtime, and the shootout

ObjectivesTo investigate the magnitude of the home advantage in the National Hockey League (NHL) as games proceeded from regulation, to overtime, to the shootout, while adjusting for team quality.DesignArchival.MethodBinary logistic regression analyses were conducted using data from the 2005–2006 through 2013–2014 NHL seasons (N = 10,534 games) to compare home teams’ odds of winning in regulation, overtime, and the shootout.ResultsCompared to games decided in regulation, higher quality home teams' odds of winning were slightly lower when games concluded in either overtime or the shootout. Further, regardless of team quality, home teams’ odds of winning were moderately lower when games concluded in the shootout rather than overtime.ConclusionsThe shootout may affect home team players' psychological and behavioural states, generally resulting in a decrease in home teams’ odds of winning in the shootout relative to overtime.     

Validation d’une mesure de climat de groupe chez des adolescentes en centre de réadaptation : le vécu éducatif partagé au travers de trois dimensions essentielles

Introduction and objectiveThe present study examines the construct validity and reliability of a group climate measure (QCGCR), associated to real life intervention, in a sample of 153 girls (M age = 15.2 years) placed in Canadian residential care centers.MethodConfirmatory factor analysis have been performed on three distinctive factors of group climate measure: “peer relation”, “relation with educators” and “educative practices”.ResultsThe results show an adequate fit to the data, indicating construct validity of this measure of group climate. Cronbach's alpha reliability coefficients are also good for all the 12 associated scales.ConclusionsThis measure of group climate reflects the life in units of residential care centers, through these three distinctive factors, and fits to re educative context links to adolescents in social re adaptation.     

Differentiating conscientious from indiscriminate responders in existing NEO-Five Factor Inventory-3 data

The mean Inter-Item Standard Deviation (M-ISD; i.e., the mean of several single-scale ISDs) is a post-hoc validity index that statistically differentiates conscientious responders (CRs) from indiscriminate responders (IRs) in psychological questionnaire data. We compared the M-ISD’s effectiveness against four other post-hoc indexes and an embeddable validity scale in three sets of NEO-Five-Factor Inventory-3 data. Results showed the M-ISD has superior classification ability over all other post-hoc indexes and even outperformed the embeddable validity scale. The average classification accuracy of the M-ISD and embeddable scale was 97% and 93%, respectively, whereas only one of the four remaining post-hoc indexes exceeded our classification accuracy criterion of 80%. These findings suggest researchers can use the M-ISD to differentiate valid from invalid data.     

Three-dimensional model of performance anxiety: Tests of the adaptive potential of the regulatory dimension of anxiety

ObjectivesTo predict the complex anxiety-performance dynamics, Cheng and associates (Cheng, Hardy, & Markland, 2009, 2011; Cheng, Hardy, & Woodman, 2011) proposed a three-dimensional model of anxiety that highlighted the adaptive potential of anxiety, and was supported with regard to cross-cultural factorial validity and predictive validity in the context of sports performance. In particular, this anxiety model included a regulatory dimension (reflected by perceived control) in addition to the conventional intensity-oriented dimensions of cognitive and physiological anxiety.DesignTo further examine the characteristics of the hypothesized adaptive potential of the regulatory dimension of anxiety, a series of three studies were conducted to investigate the relationship mainly between the regulatory dimension and three psychological variables proposed to be related to performance and stress, namely, perfectionism, self-talk and coping strategy.MethodChinese sports participants and dancers completed self-report measures. Hierarchical multiple regression was adopted for data analysis.ResultsThe findings showed that the regulatory dimension of anxiety was positively predicted by relatively adaptive dimensions of perfectionism (personal standards) and self-talk (motivational and instructional self-talk), and positively predicted approach coping.ConclusionsOverall, these data support the hypothesized characteristics of the adaptive potential underlying the regulatory dimension of anxiety. Future research and applied implications are suggested.     

Validation française du test des émotions réflexives (French-TOSCA-3) : une mesure des tendances émotionnelles de honte et de culpabilité

IntroductionThis study sought to validate a French version of the Test of self-conscious affect-3 (TOSCA-3) (Tangney et al., 2000), which is a self-reporting measure of self-conscious emotions such as shame and guilt.MethodA sample of 431 undergraduates completed the French TOSCA-3 and other related psychological constructs.ResultsThe TOSCA-3 exhibited satisfactory internal, test-retest, and discriminant validity similar to the original American version. Moreover, the gender difference in shame and guilt was replicated.DiscussionThis dispositional measure of shame and guilt was the first made available in French and offers acceptable psychonometric qualities.     

Psychometric properties of the mini-social phobia inventory (Mini-SPIN) in a large online treatment-seeking sample

The Mini-Social Phobia Inventory (Mini-SPIN) is a brief, three-item measure designed as a screening tool for social anxiety disorder (SAD). This study investigated the Mini-SPIN’s psychometric properties in a series of trials of Internet-delivered treatment. Participants were 993 people seeking Internet-delivered cognitive behavioural therapy for a range of anxiety and mood disorders. Participants completed the Mini-SPIN, and were diagnosed using the Mini International Neuropsychiatric Interview Version 5.0.0 (MINI). They also completed measures of depression, general anxiety, panic, neuroticism and general impairment. The Mini-SPIN’s ability to discriminate between people with and without SAD, within a large sample of people seeking treatment for a range of psychological disorders, was assessed at initial assessment and three-month follow-up. The Mini-SPIN’s criterion group validity, internal consistency, test–retest reliability, construct validity and responsiveness to treatment were also examined. Results demonstrated that the Mini-SPIN has an excellent ability to discriminate between those with and without SAD in a highly comorbid clinical sample, and also has good criterion group validity. The Mini-SPIN also exhibited excellent internal consistency, good test–retest reliability, and was responsive to treatment. These results highlight the Mini-SPIN’s potential as an efficient and reliable measure of SAD in heterogenous populations.     

Types of Aggression among Incarcerated Juveniles: The Roles of Gender and Offense Type

A new instrument, the Psychological Maltreatment Review (PMR), is introduced and its psychometrics are described. The PMR examines adult retrospective reports of child psychological abuse, psychological neglect, and psychological support, measured separately for maternal and paternal figures. Male and female participants (N?=?1,051) completed the PMR and a measure of adult attachment, the Revised Experiences in Close Relationships scale (Fraley, Waller, &; Brennan, 2000). The three scales of the PMR demonstrated very good internal consistency. The structural validity of the PMR was supported by both exploratory and confirmatory factor analyses, as was the notion of an independent parental support/nonsupport variable. Indicative of the construct validity of this measure, all PMR scales were significantly correlated with anxious and avoidant attachment in close relationships. Hierarchical multiple regression analyses indicated that paternal neglect and maternal psychological abuse predicted participants' anxious attachment, whereas less paternal and maternal support was associated with avoidant attachment.