Deriving childhood temperament measures from emotion-eliciting behavioral episodes: scale construction and initial validation

The authors describe the development and initial validation of a home-based version of the Laboratory Temperament Assessment Battery (Lab-TAB), which was designed to assess childhood temperament with a comprehensive series of emotion-eliciting behavioral episodes. This article provides researchers with general guidelines for assessing specific behaviors using the Lab-TAB and for forming behavioral composites that correspond to commonly researched temperament dimensions. We used mother ratings and independent postvisit observer ratings to provide validity evidence in a community sample of 4.5-year-old children. 12 Lab-TAB behavioral episodes were employed, yielding 24 within-episode temperament components that collapsed into 9 higher level composites (Anger, Sadness, Fear, Shyness, Positive Expression, Approach, Active Engagement, Persistence, and Inhibitory Control). These dimensions of temperament are similar to those found in questionnaire-based assessments. Correlations among the 9 composites were low to moderate, suggesting relative independence. As expected, agreement between Lab-TAB measures and postvisit observer ratings was stronger than agreement between the Lab-TAB and mother questionnaire. However, for Active Engagement and Shyness, mother ratings did predict child behavior in the Lab-TAB quite well. Findings demonstrate the feasibility of emotion-eliciting temperament assessment methodologies, suggest appropriate methods for data aggregation into trait-level constructs and set some expectations for associations between Lab-TAB dimensions and the degree of cross-method convergence between the Lab-TAB and other commonly used temperament assessments.     

The appraisal of social concerns scale: psychometric validation with a clinical sample of patients with social anxiety disorder

The Appraisal of Social Concerns (ASC) Scale was created by Telch et al. (2004) to improve upon existing self-report measures of social anxiety–related cognition. In a largely nonclinical sample, the ASC was found to possess three factors and was psychometrically sound. In a smaller clinical sample, the ASC demonstrated sensitivity to the effects of cognitive behavioral therapy. In the present study, the psychometric properties of the ASC were examined in a larger sample of patients with social anxiety disorder. In this sample, the ASC exhibited a 2-factor structure; the nature of the factors was similar to the primary factors originally reported by Telch et al. The ASC also demonstrated strong validity, internal consistency, and sensitivity to treatment effects. It is concluded that the ASC may be useful in the assessment of cognition and cognitive change in patients with social anxiety disorder.     

The abbreviated multidimensional acculturation scale: empirical validation with two Latino/Latina samples

Two studies were conducted to develop and examine internal consistencies and validate the Abbreviated Multidimensional Acculturation Scale. Study 1 participants were 156 Latino/Latina college students. Findings indicated good internal reliabilities for all 3 subscales. Adequate concurrent validity was established with length of residence in the United States. The scale also showed adequate convergent and discriminant validity. Study 2 participants were 90 Latino/Latina community members. The subscales were also reliable and showed adequate concurrent validity with length of residence in the United States. Convergent and discriminant validity were also adequate. Construct validity was further demonstrated through factorial analyses of the combined samples (N = 246). Three separate factors emerged: cultural identity, language competence, and cultural competence.     

The support appraisal for work stressors inventory: Construction and initial validation

In order to better understand the role of perceived available support in buffering the negative effects of workplace stressors, a new multidimensional measure of perceived available support, the SAWS, was developed. Initial item development and content validation were conducted, followed by scale evaluation and validation. Two samples of 190 and 170 nursing staff supported the hypothesized structure of the scale, and provided evidence for discriminant validity amongst the sub-constructs of source of support (e.g., support from supervisor) and supportive function (e.g., emotional support). Criterion-related validity of the SAWS constructs were supported by measures of network orientation and relationship closeness. Evidence for predictive validity was provided by examining the moderating effects of the SAWS constructs on the relationship between work-family conflict and adjustment outcomes. The final SAWS inventory assesses three sources of support, and within each source, assesses four distinct supportive functions.     

The firefighter coping self-efficacy scale: measure development and validation

The authors evaluated the psychometric properties of the Firefighter Coping Self-Efficacy (FFCSE) Scale, a new measure developed to assess firefighters' perceived competence in managing stressful and traumatic experiences encountered on the job. Two samples of firefighters completed the FFCSE Scale at two different time points. Exploratory factor analysis yielded a unidimensional structure, which was further supported with confirmatory factor analysis using a second sample. Internal consistency of the measure was excellent. Analysis of cross-sectional data indicated FFCSE was positively associated with measures of psychological well-being and social support, and negatively associated with work-related stress and psychological distress. FFCSE also uniquely contributed to the variance in psychological distress, over and above variables previously shown to be associated with distress among this population. Implications and suggestions for future research are discussed.     

The behavioral activation for depression scale-short form: development and validation

Following a landmark component analysis of cognitive therapy by Jacobson and colleagues (1996), there has been renewed interest in behavioral activation (BA) treatments for depression. The Behavioral Activation for Depression Scale (BADS) was developed to measure when and how clients become activated over the course of BA treatment. Multiple studies have provided initial support for the BADS but have also identified several potential problems. Four studies were conducted in order to develop and provide initial evaluation of a short form of the BADS that addresses these concerns. In Study 1, an exploratory factor analysis was conducted on existing data using the original BADS in order to identify items to retain for the short form. In Study 2, these items were administered to a new sample of college students with elevated depressive symptoms and were analyzed with exploratory and confirmatory factor analyses. Study 3 examined the predictive validity of the BADS-SF by examining the BADS-SF and depression scores in relation to activity tracking and reward-value ratings over the course of 1 week. Study 4 examined BADS-SF data over the course of BA treatment for two clients using cross-lagged panel correlations. With one client, changes in BADS-SF scores led changes in depression scores by 1 week, whereas with the other client changes in BADS-SF and depression scores occurred concurrently. These studies resulted in a nine-item scale that demonstrated good item characteristics as well as acceptable internal consistency reliability, construct validity, and predictive validity.     

The negative self-portrayal scale: development, validation, and application to social anxiety

The Negative Self-Portrayal Scale (NSPS) is a new questionnaire designed to assess the extent to which individuals are concerned that specific self-attributes they view as being deficient will be exposed to scrutiny and evaluation by critical others in social situations. These concerns have been proposed to drive symptoms of social anxiety and account for individual differences in social fears and avoidance behaviors (Moscovitch, 2009). Here, we introduce the NSPS and examine its factor structure and psychometric properties across two large samples of North American undergraduate students with normally distributed symptoms of social anxiety. Exploratory and confirmatory factor analyses supported a 3-factor solution representing concerns about (a) social competence; (b) physical appearance; and (c) signs of anxiety. The NSPS was found to have good internal consistency and test-retest reliability, strong convergent validity, and adequate discriminant validity. In addition, NSPS total scores accounted for a significant proportion of unique variance in self-concealment (i.e., safety) behaviors over and above established symptom measures of social interaction anxiety, social performance anxiety, and depression. Results are discussed in relation to theoretical models of social anxiety and the potential utility of the NSPS for both clinical research and practice.     

The effects of an appraisal manipulation: Affect,intrusive cognitions,and performance for two cognitive tasks

We examined the relationship between trait measures of general appraisal and test anxiety, state measures of stress appraisals, affect, and intrusive cognition, and performance measures on two cognitive tests (mental math and Raven matrices). Participants were randomly assigned to threat, challenge, or control conditions that were created by manipulating both primary and secondary appraisals. We predicted that the threat condition would lead to more negative affect, stress appraisals, intrusive cognitions, and more errors. While our manipulated conditions led to inconsistent effects, path analyses tended to confirm predictions that negative task appraisals and trait test anxiety lead to negative affect and to intrusive cognitions, and that for mental math test performance a path from intrusive cognitions to test errors was established. The importance of understanding dispositionaland situational variables and their interactions during stress encounters are discussed, as is future research involving the general appraisal dimension. The authors wish to thank the many students who acted as experimenters and helped with data entry. Thanks go to James Johnson, Ann Schuller, and Brandon Vancura for all their hard work. Special thanks go to Roger Lott for his expert performance as the main investigator in the threat and challenge conditions. An enormous debt of gratitude also goes to my wife Kathy for all her patience and support, and for her help with the audio tapes used in this study. This study was completed as partial fulfillment of the requirements for a Master’s Degree for the first author. Portions of this work will be presented at the annual meeting of the Midwestern Psychological Association, 1997.     

Construct validation of scales derived from the Rorschach method: a review of issues and introduction to the Rorschach rating scale

I suggest the main goal of Rorschach validation should be a refined understanding of what each score means. Toward this end, I review general issues in construct validity, hurdles unique to the Rorschach, and general limitations with validation criteria. I then recommend two approaches for improving criteria so they can begin approximating the gold standards that are necessary for a refined understanding of what scores actually measure. The first is a method for improving expert clinical judgment, and the second is a method for aggregating data across diverse judges. Finally, the Rorschach Rating Scale (RRS) is presented as a criterion tool to be used with either of these approaches to validation. The RRS is a fairly comprehensive summary of the constructs thought to be measured by various Rorschach scoring systems. The utility of the RRS for research and training are discussed, as are other practical, theoretical, and psychometric issues in its application.     

The family of origin scale: A construct validation study

Data from 69 women and 63 men along with ratings from a panel of expert judges were used to assess the construct validity of the Family Of Origin Scale as a measure of family health. Loevinger's conception of construct validity, focusing on the substantive, structural, and external components of validity, was employed to organize the research procedures followed and the data analytic techniques used. Results showed that the instrument appears to be a useful measure of a warmth-coldness affect dimension in the family of origin, but the multi-dimensional structure of the test, as a measure of family-of-origin health, could not be validated. Suggestions for use, score interpretation, and further development are discussed.     

The physician values in practice scale: Construction and initial validation

Measures of values typically appraise the construct globally, across life domains or relative to a broad life domain such as work. We conducted two studies to construct and initially validate an occupation- and context-specific values measure. Study 1, based on a sample of 192 medical students, describes the initial construction and item analysis of the physician values in practice scale (PVIPS), which produced a 15-factor model. Study 2 reports on a further analysis and refinement of the instrument with a national sample of 644 medical students. Results supported the basic psychometric properties of the PVIPS items. Exploratory factor analysis in Study 2 extracted six factors consistent with a theoretical model of values (Dawis, 1991) and accounting for 61% of the variance: Prestige, Service, Autonomy, Lifestyle, Management, and Scholarly Pursuits. The PVIPS shows promise as a values measure for medical students and physicians encountering career specialty and medical practice style decisions. Interested researchers may construct similar scales for other occupations to promote contextualized appraisals of values.     

The pain behavior scale: Modification and validation for outpatient use

The present study investigated the validity of an inpatient pain behavior rating scale modified for outpatient use. A series of 43 consecutive outpatients referred for evaluation of chronic pain was examined using the Pain Behavior Scale (PBS) and other psychometric instruments. Analyses revealed significantly higher Pain Behavior Scale scores for low back and multiple pain-site groups. The results also indicated a high degree of internal consistency of the scale. A multiple regression analysis, predicting observed pain behavior from reported pain behavior, indicated that decreased activity accounted for 32% of the variance in the PBS score. A similar regression for pain experience found that the pain level and the sensory scale score on the McGill Pain Questionnaire accounted for 39% of the PBS variance. Psychological characteristics including disease conviction, self-control, depression, and anxiety explained 45% of the variability in the PBS score. Thus, the scale is related to pain intensity, interference with activities, and a variety of psychological characteristics. The scale provides a measure of observable pain behavior that is also relatively independent of these clinical data sources. The Pain Behavior Scale as modified for outpatient use provides a brief index of pain behavior with potential use in the comprehensive evaluation of the pain patient.     

Responses to formal performance appraisal feedback: the role of negative affectivity

This study examined the effects of performance appraisal feedback on job and organizational attitudes of tellers (N = 329) in a large international bank. Negative affectivity moderated the link between favorable appraisal feedback and job attitudes. Among the higher rated performers, attitudes were improved 1 month after being notified of favorable appraisal results (Time 2). Improved attitudes persisted 6 months after the performance appraisal (Time 3) among tellers with low negative affectivity but not among those with high negative affectivity. Among the lower rated performers, mean levels of attitudes did not change significantly during the study.     

The effects of appraisal system redesign on perceptions of and satisfaction with performance appraisal: A quasi-experiment

A case study investigation of the effects of a change in a performance appraisal system was described. The nature of a recently implemented appraisal system was briefly outlined. Five hundred forty-seven employees of a 300-bed hospital returned mail questionnaires which asked them to respond to questions about the hospital's performance appraisal system. Two groups of employees were formed on the basis of their experience or lack of experience with the new system. It was found that the employees who had experience with the new system had more favorable perceptions of their supervisors' appraisal behaviors and were more satisfied with the appraisal process.