Does the Test of Self-Conscious Affect (TOSCA) measure maladaptive aspects of guilt and adaptive aspects of shame? An empirical investigation

The purpose of this study was to examine whether the Test of Self-Conscious Affect (TOSCA; Tangney, J. P., Wagner, P. E., & Gramzow, R. (1989). The Test of Self-Concious Affect. Fairfax, VA: George Mason University) measures maladaptive forms or aspects of guilt and adaptive aspects of shame that have been described in the literature. First, a judgmental and logical analysis showed that the TOSCA primarily measures mild and adaptive forms and aspects of guilt and maladaptive aspects of shame. Next, principal components analyses (PCAs) in a student (N=328) and adult (N=542) sample showed that items that had a high loading on the guilt factor primarily were items that referred to reparative behavior, while items that had high loadings on the shame factor consisted primarily of items that referred to low self-esteem. To investigate to which extent these items were responsible for correlations found with the TOSCA, we constructed a revised guilt scale containing only items that referred to reparative behavior and a revised shame scale consisting of items that only referred to negative self-esteem, and related these to indices of interpersonal and intrapersonal functioning. The revised TOSCA scales reproduced both the pattern and magnitude of correlations obtained with the original TOSCA scales. Thus, taken together, the results of this study support the interpretation of the TOSCA guilt scale as a measure of mild and adaptive forms of guilt and the TOSCA shame scale as a measure of maladaptive aspects associated with shame. Implications of these findings for further research on the nature of guilt and shame are discussed.     

Physicians' Reactions to Uncertainty: Refining the constructs and scales

The Physicians' Reactions to Uncertainty (PRU) scales were developed to measure physicians' affective reactions to uncertainty. However, the structural (factor) model for the two PRU scales has not been cross validated on an independent sample of physicians. We surveyed 337 physicians in internal medicine at Indiana University to test the structural model for the PRU scales using confirmatory factor analysis and, if necessary, to refine the constructs and scales. The structural model of the original PRU scales did not fit the data (X²=559.26,p<.001) provided by the 265 (79%) respondents. Based on models suggested by 15 volunteers, we refined the constructs and scales. The four new scales are Anxiety Due to Uncertainty (five items,=.85), Concern about Bad Outcomes (three items,=.74), Reluctance to Disclose Uncertainty to Patients (five items,=.76), and Reluctance to Disclose Mistakes to Physicians (two items,=.75). The revised structural models have greater conceptual clarity, better fit to the data, and shorter scale measures than the original PRU model.This research was supported in part by National Research Service Award HS00032 from the Agency for Health Care Policy and Research.     

An Examination of the Factor,Convergent, and Discriminant Validity of the Behavioral Inhibition System and Behavioral Activation System Scales

The Behavioral Inhibition System and Behavioral Activation System Scales (BIS/BAS scales) are the most widely used measures designed to assess Gray’s Reinforcement Sensitivity Theory. However, questions remain regarding its factor, convergent, and discriminant validity. We assessed these properties in two samples of undergraduates (N = 723, N = 103). In Study 1, confirmatory factor analysis supported previous findings that suggested removal of several items, resulting in acceptable fit for a four-factor model. Convergent and discriminant validity were assessed for the original and revised scales. In Study 2, a public speaking task was used to assess validity of the scales in reference to positive/negative affect. Convergent and discriminant validity for the revised scales were not substantially different from the original scales. We suggest that future researchers should consider the use of the revised measure we describe. We also suggest that the creation of a revised BIS/BAS scale using new items may be warranted.     

Shyness and Social Anxiety Assessed Through Self-Report: What Are We Measuring?

The distinction between shyness and social anxiety remains unclear in the literature. In an attempt to shed further light on this issue, our research evaluated whether shyness and social anxiety were the same construct underlying various measurement scales. Participants (N = 801, M_age = 36.21, range = 18–74, female = 53.10%) responded to 10 questionnaires assessing either shyness or social anxiety. Evidence indicated that the scales were highly correlated and loaded onto 1 factor. Confirmatory factor analysis corroborated this finding. A second exploratory factor analysis revealed that all the shyness and social anxiety items best loaded together onto 3 factors: one corresponding to fear of negative evaluation, embarrassment, self-consciousness, scrutiny, authority, interaction anxiety, and shyness (71.0%); a second comprised of primarily interaction anxiety and shyness (17.7%); and a third associated with performance anxiety (7.5%). All scales were similarly discriminated from sociability. Overall, the constructs of shyness and social anxiety were not differentiated from each other. Researchers should carefully consider what items are included in shyness and social anxiety scales if these constructs are to be distinguished from one another.     

Using Shortened Scales in Sales Research: Risks,Benefits, and Strategies

Increasing the number of items in a scale may increase reliability and reduce measurement error while revealing finer distinctions between respondents and stronger relationships between constructs. However, longer scales take more effort to complete, which may reduce response rates and data quality or limit the number of constructs that can be measured in a survey. To address this conundrum, many researchers have begun to reduce the number of items collected forindividual scales. This paper reviews the trade-offs associated with short-form scales, both pro and con, along with strategies for employing or developing shortened scales. Empirical examples illustrate multiple approaches to the analysis ofsplit surveys, which use multiple forms to include more total items while limiting the burden on respondents in each group.     

Effectiveness of the Hamilton Anxiety Rating Scale with Older Generalized Anxiety Disorder Patients

To expand the collection of instruments available for assessment of anxiety in the elderly, this report examined the original and revised Hamilton anxiety scales in a sample of 50 older adults diagnosed with Generalized Anxiety Disorder (GAD) and 93 normal community participants (ages 55–82). Although the revised anxiety scale had better discriminant validity (lower correlation with the revised Hamilton depression scale) than the original anxiety and depression scales, a considerable amount of shared variance still existed (41% shared variance, GAD sample alone; 17% control sample alone; 74% shared variance, both samples combined). Near-perfect group classification was possible using 7 items from the original anxiety scale and 10 items from the revised anxiety scale. Results are discussed in light of their implications for use of the Hamilton anxiety rating scale with older anxiety-disordered patients.     

Upward and downward physical appearance comparisons: Development of scales and examination of predictive qualities

Despite good theoretical and empirical rationale for assessing tendencies to make upward and downward physical appearance comparisons no measure for these specific constructs exists. The present work developed and tested the psychometric properties of upward and downward physical appearance comparison scales. The scales were administered to participants (N = 224) along with measures of general appearance comparison tendencies, body image, disordered eating, Antifat and Antigay attitudes. The scales displayed good psychometric properties. Importantly, the upward but not downward physical appearance comparison scale predicted lower Appearance Evaluation and higher EAT-26 scores. Conversely, the downward but not upward physical appearance comparison scale predicted higher Appearance Evaluation and greater Antifat Attitudes (Dislike). The scales were unrelated to a nonappearance related construct. These new measures fill a gap in the literature and may be of benefit to researchers interested in body image, appearance concerns, eating disorders, social comparison, and obesity prejudice.     

A sexual and a marital defensiveness scale for each sex

Abstract

A scale to measure defensiveness about the marital relationship and another to measure defensiveness about the sexual relationship of couples were developed for each sex. Defensiveness was defined as the tendency to endorse socially desirable items which are unlikely to occur and deny socially undesirable items which characterize most honest responders. The social desirability scale value of the items was empirically determined, and a traditional cross-validation design with two independent groups was used in the item analyses. Cronbach's alpha reliability coefficient ranged between. 75 and 93 for the male and female versions of the scales. The scales correlated higher with another defensiveness scale than with a social desirability scale. Clinicians' ratings of the items in the scales suggested that the scales were not diagnostic of sexual or marital psychopa-thology. Evidence is presented to support that these content specific scales surpass a global defensiveness scale as a measure of defensiveness regarding the sexual or marital relationship of couples.     

Measuring tolerance of ambiguity: Item polarity,dimensionality, and criterion validity

Research involving tolerance of ambiguity (TA) has produced inconsistent findings for half a century. Some of this inconsistency may be due to the psychometric shortcomings of the TA measures. In this investigation, the Budner (1962) and McLain (1993) TA scales were examined using confirmatory factor analyses. Both scales were tested against a single-factor model, a two-factor model, a two-factor correlated model, and a two-method/single-trait model with method defined by item polarity (positive and negative). Results demonstrated that the two-method/single trait model was the best fit for both scales. However, whereas the McLain scale demonstrated adequate psychometric integrity, the Budner items failed to load sufficiently on the trait factor suggesting a weakness in validity. Correlations with verbal ability and inconsistent regression results with respect to the Budner scale support the choice of the McLain scale in future work.     

Development and validation of a test on Anasakti (non-attachment): an Indian model of well-being

Deriving our theoretical model from the Hindu religious text Srimad Bhagvad Gita, gaps in the existing frameworks on the concept of Anasakti (non-attachment) were found. The purpose of the study was to develop and test psychometric properties of a scale based on this Indian concept. We pooled 46 items which included items from existing scales as well as new items. The data were collected from 366 students (236 females and 130 males; mean age?=?23.55 years, SD?=?8.30 years). The final scale consists of 22 items comprising six subscales: Outcome Vulnerability, Faith in God, Empathy, Frustration Tolerance, Effort Orientation and Emotional Equipoise. The scale is psychometrically robust, explaining 50.79 per cent of variance and also acceptable levels of reliability (α?=?.70). We tested for convergent validity by correlating the new scale with the Scale of Positive and Negative Experiences (SPANE), the Mental Health Continuum (MHC) and the Flourishing Scale (FS). The new scale demonstrated acceptable convergent validity showing significant positive correlation with SPANE-P, SPANE-B, FS and MHC (.23?<?r?<?.38, p?<?.01) and a significant negative correlation with SPANE-N (r?=??.29, p?<?.01).     

Development of the Multidimensional Peer Victimization Scale–Revised (MPVS-R) and the Multidimensional Peer Bullying Scale (MPVS-RB)

Peer victimization is a frequent occurrence for many adolescents; however, some of the psychometric properties of self-report scales assessing these experiences remain unclear. Furthermore, with an increase in access to technology, electronic aggression should also be considered. The authors examined the psychometric properties of the Multidimensional Peer Victimization Scale (MPVS; Mynard & Joseph, 2000), and developed versions to include the assessment of electronic aggression according to whether the adolescent was the target or perpetrator of peer victimization. A total of 371 (191 girls and 180 boys; M_age = 13 years 4 months, SD_age = 1 year 2 months) adolescents in the United Kingdom completed the MPVS including five newly developed items assessing electronic aggression, a version of the MPVS designed to assess victimization perpetration, and a measure of self-esteem. Confirmatory factor analyses yielded a five-factor structure comprising: Physical, social manipulation, verbal, attacks on property, and electronic for both scales. Convergent validity was established through negative associations between the victimization scales and self-esteem. Sex differences also emerged. One revised scale and one new scale are subsequently proposed: The MPVS–Revised and the Multidimensional Peer Bullying Scale.     

Psychometric Evaluation and Revision of Carver and White's BIS/BAS Scales in a Diverse Sample of Young Adults

The psychometric properties of the Behavioral Inhibition System and Behavioral Activation System (BIS/BAS) scales (Carver & White, 1994) were evaluated in a large, racially diverse sample of undergraduate students. Findings from this study indicate that the BIS/BAS scales work differently (i.e., are multidimensional and lack configural invariance) when assessing BIS and BAS in a diverse sample. Numerous model modifications were needed to obtain adequate fitting models for the total sample and individual racial groups. The findings suggest that this is due to items that assess multiple constructs differently across self-reported race categories. As part of this research, a revised version of the BIS/BAS scales was constructed that appears to be invariant across self-reported race category and simultaneously addresses the other psychometric concerns associated with the original scale. Caution should be used when applying the BIS/BAS scales as originally specified to assess behavioral inhibition and activation in a racially diverse sample. Researchers might want to use this revised version of the scale as an alternative.     

Can we differentiate sensory over‐responsivity from anxiety symptoms in toddlers? perspectives of occupational therapists and psychologists

Suppose a toddler becomes distressed after hearing a loud noise or when getting messy; are these indicators of sensory over‐responsiveness or indicators of anxiety? There is little evidence regarding the distinction between sensory over‐responsivity and anxiety disorders in toddlers. This construct validity study examined differences between occupational therapists' and psychologists' judgments of behaviors as representing sensory processing disorders (SPD) versus anxiety disorders. Twenty‐four occupational therapists and 25 psychologists completed a mailed survey, rating items from sensory and anxiety scales as representing sensory and/or anxiety disorders in toddlers, and analyzing cases of toddlers with these disorders. Occupational therapists were more likely to rate items as representing SPD than psychologists, and occupational therapists were more certain of the distinction of the sensory scales from anxiety. For the case designed to present a general anxiety disorder and the one designed to present sensory over‐responsivity, more occupational therapists diagnosed as sensory over‐responsive, while more psychologists diagnosed with a general anxiety disorder. The overlap in judgments of sensory over‐responsivity and anxiety supports the notion that these constructs in part reflect different professionals' perspectives upon behaviors as well as the difficulty in distinguishing these constructs in toddlers.     

Analysing multitrait–multimethod data with structural equation models for ordinal variables applying the WLSMV estimator: What sample size is needed for valid results?

Convergent and discriminant validity of psychological constructs can best be examined in the framework of multitrait–multimethod (MTMM) analysis. To gain information at the level of single items, MTMM models for categorical variables have to be applied. The CTC(M?1) model is presented as an example of an MTMM model for ordinal variables. Based on an empirical application of the CTC(M?1) model, a complex simulation study was conducted to examine the sample size requirements of the robust weighted least squares mean‐ and variance‐adjusted χ² test of model fit (WLSMV estimator) implemented in Mplus. In particular, the simulation study analysed the χ² approximation, the parameter estimation bias, the standard error bias, and the reliability of the WLSMV estimator depending on the varying number of items per trait–method unit (ranging from 2 to 8) and varying sample sizes (250, 500, 750, and 1000 observations). The results showed that the WLSMV estimator provided a good – albeit slightly liberal – χ² approximation and stable and reliable parameter estimates for models of reasonable complexity (2–4 items) and small sample sizes (at least 250 observations). When more complex models with 5 or more items were analysed, larger sample sizes of at least 500 observations were needed. The most complex model with 9 trait–method units and 8 items (72 observed variables) requires sample sizes of at least 1000 observations.     

Revision of the self-monitoring scale

Snyder's (1974) Self-Monitoring Scale exhibits a stable factor structure that does not correspond to the five-component theoretical structure he presents. Sets of face-valid items that better approximate the theoretical structure are described. Correlations between these sets of items and measures of other constructs reveal that four of the five components are positively related to social anxiety. Effective social interaction is supposedly the high self-monitor's forte, and social anxiety appears to be incompatible with this. The correlational results therefore question the entire theory and indicate the need for a narrower definition of the construct. Adopting such a definition from Snyder's review article (1979), we present a 13-item Revised Self-Monitoring scale which measures only sensitivity to the expressive behavior of others and ability to modify self-presentation. A 20-item Concern for Appropriateness scale is also described. This scale measures 2 variables that are directly associated with social anxiety--cross-situational variability and attention to social comparison information. Both scales have acceptable internal consistency, and both yield 2 subscale scores as well as a total score. Prospective users of either scale are advised to treat the 3 scores separately.     

Adult Attachment Ratings (AAR): An Item Response Theory Analysis

The Adult Attachment Ratings (AAR) include 3 scales for anxious, ambivalent attachment (excessive dependency, interpersonal ambivalence, and compulsive care-giving), 3 for avoidant attachment (rigid self-control, defensive separation, and emotional detachment), and 1 for secure attachment. The scales include items (ranging from 6–16 in their original form) scored by raters using a 3-point format (0 = absent, 1 = present, and 2 = strongly present) and summed to produce a total score. Item response theory (IRT) analyses were conducted with data from 414 participants recruited from psychiatric outpatient, medical, and community settings to identify the most informative items from each scale. The IRT results allowed us to shorten the scales to 5-item versions that are more precise and easier to rate because of their brevity. In general, the effective range of measurement for the scales was 0 to +2 SDs for each of the attachment constructs; that is, from average to high levels of attachment problems. Evidence for convergent and discriminant validity of the scales was investigated by comparing them with the Experiences of Close Relationships–Revised (ECR–R) scale and the Kobak Attachment Q-sort. The best consensus among self-reports on the ECR–R, informant ratings on the ECR–R, and expert judgments on the Q-sort and the AAR emerged for anxious, ambivalent attachment. Given the good psychometric characteristics of the scale for secure attachment, however, this measure alone might provide a simple alternative to more elaborate procedures for some measurement purposes. Conversion tables are provided for the 7 scales to facilitate transformation from raw scores to IRT-calibrated (theta) scores.     

Short Forms of the Social Interaction Anxiety Scale and the Social Phobia Scale

Mattick and Clarke's (1998) Social Interaction Anxiety Scale (SIAS) and Social Phobia Scale (SPS) are commonly used self-report measures that assess 2 dimensions of social anxiety. Given the need for short, readable measures, this research proposes short forms of both scales. Item-level analyses of readability characteristics of the SIAS and SPS items led to the selection of 6 items from each scale for use in the short forms. The SIAS and SPS short forms had reading levels at approximately the 6th and 5th grade level, respectively. Results using nonclinical (Study 1: N = 469) and clinical (Study 2: N = 145) samples identified these short forms as being factorially sound, possessing adequate internal consistency, and having strong convergence with their full-length counterparts. Moreover, these short forms showed convergence with other measures of social anxiety, showed divergence from measures assessing related constructs, and predicted concurrent interpersonal functioning. Recommendations for the use of these short forms are discussed.     

Personality as Predictor of Work-Related Outcomes: Test of a Mediated Latent Structural Model1

The role of personality in predicting work-related outcomes was examined using structural equation modeling. Data were taken from a national United States sample (n= 1,098) of accounting professionals. Latent personality constructs based on scales from the California Psychological Inventory (Gough, 1957) were specified and tested in a confirmatory measurement model, along with the attitudinal constructs of communication adequacy, role stress, job satisfaction, and propensity to quit. The results of confirmatory factor analyses indicated that the hypothesized personality constructs of extraversion, control, and flexibility were adequately supported by the data, as were each of the attitudinal constructs. Results from the tested structural model indicated that personality effects on propensity to quit were fully mediated by role stress and job satisfaction. Results are discussed in terms of successfully modeling completely latent, multifaceted personality constructs and better understanding the propensity to quit.     

The effects of mediated word lists on false recall and recognition

False memory effects were explored using unrelated list items (e.g., slope, reindeer, corn) that were related to mediators (e.g., ski, sleigh, flake) that all converged upon a single nonpresented critical item (CI; e.g., snow). In Experiment 1, participants completed either an initial recall test or arithmetic problems after study, followed by a final recognition test. Participants did not falsely recall CIs on the initial test; however, false alarms to CIs did occur in recognition, but only following an initial recall test. In Experiment 2, participants were instructed to guess the CI, followed by a recognition test. The results replicated Experiment 1, with an increase in CI false alarms. Experiment 3 controlled for item effects by replacing unrelated recognition items from Experiment 1 with both CIs and list items from nonpresented lists. Once again, CI false alarms were found when controlling for lexical characteristics, demonstrating that mediated false memory is not due simply to item differences.