Psychometric Analysis and Tentative Shortening of Survey of Personal Beliefs

The Survey of Personal Beliefs (SPB) is a frequently used measure of irrational beliefs, but can display less than ideal psychometric properties. In the first study of the present project, the five subscales of the SPB correlated as expected with higher levels of perfectionism, shame, and guilt. A confirmatory factor analysis, nevertheless, revealed that these subscales did not adequately describe responding on the SPB, and internal reliability for some subscales was poor. An abbreviated 12-item version of the SPB was more reliable than the subscales and generally as valid as the full 50-item instrument. With a second data set, the shortened version of the SPB was more consistent than the full 50-item scale in correlating positively with at least some measures of maladjustment that included depression, anxiety, neuroticism, and alexithymia. Future researchers may want to utilize the shorter 12-item version of the SPB as a more convenient and psychometrically acceptable measure of irrational beliefs.     

The assessment of social intimacy

Research exploring the psychological importance of closeness with others has been hampered by the absence of a reliable and valid measure of this variable. The development of the Miller Social Intimacy Scale (MSIS), a 17-item measure of the maximum level of intimacy currently experienced, is presented. Evidence for internal consistency and test-retest reliability as well as for convergent, discriminant and construct validity is discussed in the context of the need for further scientific exploration of this important phenomenon.     

The Mathematics Anxiety Rating Scale,a brief version: psychometric data

As a measure of mathematics anxiety, the Mathematics Anxiety Rating Scale (MARS) has been a major scale used for research and clinical studies since 1972. Despite the usefulness of the original scale, researchers have sought a shorter version of the scale partly to reduce the administration time of the original 98-item scale. This study created a shorter version of the MARS and provides reliability and validity information for the new version. The Cronbach alpha of .96 indicated high internal consistency, while the test-retest reliability for the MARS 30-item was .90 (p<.001). The validity data confirm that the MARS 30-item test is comparable to the original MARS 98-item scale.     

Development of a short form of the Treatment Evaluation Inventory for acceptability of psychological interventions

The Treatment Evaluation Inventory of Kazdin, French, and Sherick is a 19-item measure of the perceived acceptability of behavioural treatments. Development of two brief forms was based on data from two sources. For Study 1, data from 218 completed questionnaires were used to develop internally consistent brief scales. In Study 2 internal consistency and the validity of the brief forms were estimated for a set of 131 questionnaires. Item reduction was achieved by analysis of item-total minus item correlations. Brief forms with 3, 6, 9, and 12 items were proposed. Their internal consistency (Cronbach alpha) and construct validity were based on correlations of scores on each short form with the full scale scores and on comparing means of different forms. Discriminant validity was based on the difference between two groups (estimated effect size 0.7). Scores for all forms showed high internal consistency and correlated highly with total scale scores. Only the 12-item brief scale yielded mean scores similar to the full scale. The 3-item form could be used as a quick screen, and the 12-item form for more intensive purposes as it is most similar to the full-scale.     

The Children's Behavior Questionnaire very short scale: psychometric properties and development of a one-item temperament scale

Little research has been conducted on the psychometrics of the very short scale (36 items) of the Children's Behavior Questionnaire, and no one-item temperament scale has been tested for use in applied work. In this study, 237 United States caregivers completed a survey to define their child's behavioral patterns (i.e., Surgency, Negative Affectivity Effortful Control) using both scales. Psychometrics of the 36-item Children's Behavior Questionnaire were examined using classical test theory, principal factor analysis, and item response modeling. Classical test theory analysis demonstrated adequate internal consistency and factor analysis confirmed a three-factor structure. Potential improvements to the measure were identified using item response modeling. A one-item (three response categories) temperament scale was validated against the three temperament factors of the 36-item scale. The temperament response categories correlated with the temperament factors of the 36-item scale, as expected. The one-item temperament scale may be applicable for clinical use.     

The mini-IPIP scales: tiny-yet-effective measures of the Big Five factors of personality

The Mini-IPIP, a 20-item short form of the 50-item International Personality Item Pool-Five-Factor Model measure (Goldberg, 1999), was developed and validated across five studies. The Mini-IPIP scales, with four items per Big Five trait, had consistent and acceptable internal consistencies across five studies (= at or well above .60), similar coverage of facets as other broad Big Five measures (Study 2), and test-retest correlations that were quite similar to the parent measure across intervals of a few weeks (Study 4) and several months (Study 5). Moreover, the Mini-IPIP scales showed a comparable pattern of convergent, discriminant, and criterion-related validity (Studies 2-5) with other Big Five measures. Collectively, these results indicate that the Mini-IPIP is a psychometrically acceptable and practically useful short measure of the Big Five factors of personality.     

Measuring activism regarding the nuclear arms race

A 14-item questionnaire measure of activism regarding the nuclear arms race is described. Scale development analyses were conducted on 227 subjects, and internal consistency reliabilities ranged from .56 to .91 for scales assessing four aspects of activism on this issue. High correlations were obtained between these brief scales and corresponding measures derived from a 50-item long form. Responses of five subject groups were also compared: workers in defense industries, participants in a Republican party meeting, graduate students in psychology, religious teachers, and peace activists. Applications of this measure for study of the behavioral component of responses to the nuclear arms race are discussed.     

Development and validation of the Delaying Gratification Inventory

Deficits in gratification delay are associated with a broad range of public health problems, such as obesity, risky sexual behavior, and substance abuse. However, 6 decades of research on the construct has progressed less quickly than might be hoped, largely because of measurement issues. Although past research has implicated 5 domains of delay behavior, involving food, physical pleasures, social interactions, money, and achievement, no published measure to date has tapped all 5 components of the content domain. Existing measures have been criticized for limitations related to efficiency, reliability, and construct validity. Using an innovative Internet-mediated approach to survey construction, we developed the 35-item 5-factor Delaying Gratification Inventory (DGI). Evidence from 4 studies and a large, diverse sample of respondents (N = 10,741) provided support for the psychometric properties of the measure. Specifically, scores on the DGI demonstrated strong internal consistency and test-retest reliability for the 35-item composite, each of the 5 domains, and a 10-item short form. The 5-factor structure fit the data well and had good measurement invariance across subgroups. Construct validity was supported by correlations with scores on closely related self-control measures, behavioral ratings, Big Five personality trait measures, and measures of adjustment and psychopathology, including those on the Minnesota Multiphasic Personality Inventory-2-Restructured Form. DGI scores also showed incremental validity in accounting for well-being and health-related variables. The present investigation holds implications for improving public health, accelerating future research on gratification delay, and facilitating survey construction research more generally by demonstrating the suitability of an Internet-mediated strategy.     

The Psychosocial Adjustment to Illness Scale--Self-Report: factor structure and item stability

The Psychosocial Adjustment to Illness Scale--Self-Report (PAIS-SR; Derogatis & Derogatis, 1990), a frequently used measure of adjustment in medically ill adults, was subjected to several exploratory factor analyses, with principal-axes factor extractions and varimax rotation procedures. The sample consisted of kidney, heart, liver, lung, and bone marrow transplant candidates (N = 280). The final analysis yielded a six-factor, 26-item instrument accounting for 59% of the variance. Coefficient alpha for the 26-item measure was .87, and internal consistency estimates for the factors ranged from .50 to .86. Strong correlations with other adjustment measures commonly used in the assessment of adults with chronic physical conditions support the validity of the PAIS-SR.     

Career Adapt-Abilities Scale-Italian Form: Psychometric properties and relationships to breadth of interests,quality of life,and perceived barriers

The Career Adapt-Abilities Scale (CAAS)-Italian Form consists of four 6-item scales, which measure concern, control, curiosity, and confidence as psychosocial resources for managing occupational transitions, developmental tasks, and work traumas. The 24-item CAAS-Italian Form is identical to the International Form 2.0. The factor structure was similar to the one computed for combined data from 13 countries. Internal consistency estimate for the four subscale and total scores was good. Concurrent validity evidence was collected on perceived internal and external barriers, breadth of interests, and quality of life. Correlations resulted as predicted and showed adaptability related negatively to perceived barriers and positively to breadth of interests and quality of life. As expected, analyses of variance showed that adolescents with higher adaptability perceive fewer barriers, express a broader range of interests, and report a higher quality of life.     

Development of a brief measure of college stress: the college student stress scale

The study included assessment of the psychometric properties of an 11-item measure of perceived stress and control in 273 first-year college students. Results indicated good internal consistency and stability over a 5-week interval, and the total score was highly correlated with another measure of perceived stress. Principal components analysis with varimax rotation indicated two possible factors which explained 55% of the variance. However, given the small number of items and low internal consistency of the second factor (alpha=.60), use of the Total score is recommended.     

DEVELOPMENT AND TESTING OF THE ATTITUDES TOWARD FEMINISM AND THE WOMEN'S MOVEMENT (FWM) SCALE

This article outlines the development and testing of the Attitudes Toward Feminism and the Women's Movement (FWM) Scale, a brief measure of affective attitudes toward the feminist movement. Thurstone's (1959) method of equal-appearing intervals was used initially to create the final 10-item summated rating (Likert) scale. Establishment of internal consistency reliability and construct (convergent and discriminant) validity was determined on a sample of 117 female and male college students. Results suggested a highly internally consistent and valid attitudinal measure. Additional evidence for the validity of the FWM is discussed in terms of research in which it has been successfully used.     

Mindfulness and Emotion Regulation: The Development and Initial Validation of the Cognitive and Affective Mindfulness Scale-Revised (CAMS-R)

As interest grows in mindfulness training as a psychosocial intervention, it is increasingly important to quantify this construct to facilitate empirical investigation. The goal of the present studies was to develop a brief self-report measure of mindfulness with items that cover the breadth of the construct and that are written in everyday language. The resulting 12-item measure demonstrated acceptable internal consistency and evidence of convergent and discriminant validity with concurrent measures of mindfulness, distress, well-being, emotion-regulation, and problem-solving approaches in three samples of university students. To address potential construct contamination in two items, data are also presented on an alternate 10-item version of the measure.

The development and initial validation of the Fatigue Sensitivity Questionnaire

ABSTRACT

Currently, there is poor understanding of fatigue and the possible psychological conditions that may underlie chronic fatigue. Although substantial work has been directed to better clinically address fatigue, no work has explored individual differences in expectations or perceptions of the negative consequences associated with fatigue-related symptoms. The goals of this study were to (a) develop and (b) validate a measure of expectations or perceptions of the negative consequences associated with fatigue-related symptoms (e.g. fatigue sensitivity) across two independent samples (N = 1,827; 73.1% female; M_age = 21.68; SD = 4.54) of young adults. Results supported a 10-item measure of fatigue sensitivity, entitled the Fatigue Sensitivity Questionnaire (FSQ). The FSQ demonstrated unidimensionality, excellent internal consistency, and strong convergent and discriminant validity. Overall, the 10-item scale offers a single score that can be employed to measure fatigue sensitivity. Clinically, the FSQ may be a brief, informative, and easily disseminated measure in better understanding and capturing expectations or perceptions about the negative consequences of fatigue. As a research tool, the use of the FSQ may provide broader understanding of vulnerability factors that may influence fatigue-related health outcomes. Future research is needed to test the validity of the FSQ in other samples.     

The NPI-16 as a short measure of narcissism

Narcissism has received increased attention in the past few decades as a sub-clinical individual difference with important everyday consequences, such as self-enhancement in perceptions of one’s own behavior and attributes. The most widespread measure used by non-clinical researchers, the 40-item Narcissistic Personality Inventory or NPI-40, captures a range of different facets of the construct but its length may prohibit its use in settings where time pressure and respondent fatigue are major concerns. In this article, we draw from the NPI-40 set of items to create and validate a shorter, unidimensional measure, the NPI-16. In five studies, we show that this short NPI closely parallels the NPI-40 in its relation to other personality measures and dependent variables. We conclude that the NPI-16 has notable face, internal, discriminant, and predictive validity and that it can serve as an alternative measure of narcissism when situations do not allow the use of longer inventories.     

The Children’s Yale-Brown Obsessive Compulsive Scale: Reliability and Validity for Use Among 5 to 8 Year Olds with Obsessive-Compulsive Disorder

The Children’s Yale-Brown Obsessive Compulsive Scale (CY-BOCS) is the instrument of choice for assessing symptom severity in older children (i.e., 8–18 years) diagnosed with obsessive-compulsive disorder (OCD). The reliability and validity of this measure for use among younger children (i.e., 5–8 years of age), however, has never been examined. The primary aim of this study was to examine this scale’s use among those presenting with early childhood OCD. Forty-two children with OCD between the ages of 4 and 8 years of age were recruited as part of a larger treatment outcome study, and the reliability and validity of the CY-BOCS was examined. Results revealed questionable reliability for the measure’s 5-item Obsessions subscale but good reliability (i.e., internal consistency, temporal stability) for the 5-item Compulsions subscale and 10-item total scale. Results also revealed that the CY-BOCS total scale demonstrated mixed discriminant validity but strong convergent validity and sensitive to change. Collectively, the 10-item, CY-BOCS total score yields a reliable and valid scale for the assessment of symptom severity in early childhood OCD. However, we urge caution in use of the Obsessions subscale in isolation for either clinical or research purposes. Limitations and future areas of research are discussed including the potential benefit of developing a measure of OCD-related symptom severity specifically for younger children with greater attention to developmental differences among children within this population.     

Psychometric properties of a European Spanish version of the Perceived Stress Scale (PSS)

This paper presents evidence from a heterogeneous sample of 440 Spanish adults, for the reliability and validity of a European Spanish version of the Perceived Stress Scale (PSS), designed to measure the degree to which situations in one's life are appraised as stressful. The European Spanish version PSS (14-item) demonstrated adequate reliability (internal consistency, alpha = .81, and test-retest, r = .73), validity (concurrent), and sensitivity. Additional data indicate adequate reliability (alpha = .82, test-retest, r = .77), validity, and sensitivity of a 10-item short version of the PSS.     

Testing the Internal Consent Scale for Measurement Invariance Across Women and Men

The Internal Consent Scale (ICS) was created to measure feelings associated with a person’s willingness to engage in partnered sexual activity. Although previous studies using the ICS have assessed gender differences, evidence has not been provided to suggest that the ICS functions similarly for women and men. Using data from an online cross-sectional survey of adults (N = 874; 53.1% women), we subjected the 25-item ICS to tests of measurement invariance across gender. We found that only partial measurement invariance was tenable, which indicated that direct comparisons across gender should be interpreted with caution when using the ICS. Therefore, we created a gender-invariant short form. In support of construct validity, we found that this 15-item ICS–Short Form demonstrated similar associations with measures of sexual consent communication as the full 25-item ICS. If researchers aim to compare women and men on internal sexual consent, we recommend using the 15-item ICS–Short Form. Cognitive interviews should be conducted to further understand how women and men might differentially interpret ICS items.

     

Test-retest reliability of the Holyoake Codependency Index with Australian students

The Holyoake Codependency Index is a 13-item self-report measure of three aspects of codependency: External Focus, Self-sacrifice, and a sense of being overwhelmed by another person's problematic behavior (termed Reactivity). Previous studies have supported internal validity and the internal consistency and construct validity of the subscales. The present scores for 59 students indicate full scale test-retest reliability of .88 and for subscales (.76 to .82) over a 3-wk. interval.     

Development of a questionnaire to measure concern for dental appearance.

100 adults, selected for cosmetic dental treatment in a general dental practice, completed a 42-item questionnaire designed, on the basis of previous research and the author's clinical experience, to measure concern for dental appearance. This had high internal consistency and was reduced to a questionnaire of 23 items with internal consistency shown by a standardised Cronbach alpha of .84. An exploratory factor analysis with varimax rotation identified six factors, the main one appearing to be a measure of concern for dental appearance. The high internal consistency suggests that the total score for the revised questionnaire is a measure of a construct, concern for dental appearance. Although the simplest measure of that may be contained in the items for the first factor, a much larger sample would be necessary to confirm the complex factor structure and so the questionnaire's total score is probably the more reliable measure at present. A study is summarised showing that the total score provides a measure that, in statistical regression analysis, may predict the intentions of adults to take care of the appearance of their teeth.