Construct validity and content analysis

We clarify points of agreement and disagreement with Schnurr, Rosenberg, and Oxman, as put forth in their article appearing this issue. Speech samples elicited under different conditions may or may not be interchangeable. This is a matter of empirical research, but it is also dependent upon the meaningfulness of the content categories. used in the analysis. We prefer a theory-driven, construct validational approach that employs well validated coding schemes to assess psychologically meaningful concepts.     

Construct validity of the medical specialty preference inventory: A critical analysis

The Medical Specialty Preference Inventory (MSPI; Zimny, G.H. (1979). Manual for the Medical Specialty Preference Inventory. St. Louis, MO: St. Louis University School of Medicine), a measure of medical students’ interests, was substantively and empirically examined to identify an underlying factor structure. A factor model for the original MSPI based on 38 factors in five general areas was evaluated on a national sample of 1014 medical students and yielded poor fit to the data. Exploratory factor analyses at the item level utilizing the full pool of MSPI items produced an 11 factor solution with 88 items. Sub-scales were identified within this model and an 11-18 higher-order model and an 18 sub-scale model also were proposed. The relative fits of the three models were evaluated by confirmatory factor analysis with the 18 sub-scale model shown to be superior. This model was cross-validated on a separate sample of 1016 medical students and fit the data well. All sub-scales exhibited adequate internal consistency across samples. These findings support the need for a revised MSPI based on 18 scales. Implications of these findings for MSPI scoring practices are discussed along with future directions.     

Construct validity and case validity in assessment

Clinical assessment relies on both construct validity, which focuses on the accuracy of conclusions about a psychological phenomenon drawn from responses to a measure, and case validity, which focuses on the synthesis of the full range of psychological phenomena pertaining to the concern or question at hand. Whereas construct validity is grounded in understanding causal influences of a distinct phenomenon on responses to various measures and life contexts, case validity encompasses the joint influences of multiple phenomena on individuals' responses. Two sets of distinctions essential to understanding psychological phenomena, hence to understanding construct validity, are (a) implicit and explicit versions of personality constructs and (b) ability and personality as versions of constructs measured by performance tests presenting maximal and typical conditions, respectively. Since both implicit and explicit versions of constructs interface with maximal or typical performance conditions, case validity requires systematic inclusion of these distinctions in assessment protocols.     

Construct validity of a competitive reaction-time aggression paradigm

This study tested the construct validity (convergent and discriminant) of a competitive reaction-time aggression paradigm. Seventy-nine males completed three trait aggression questionnaires and then competed on a reaction-time task whereby they received and delivered shocks to a fictitious opponent. Results demonstrated strong positive relationships between shock intensity administered and the trait measures of overt aggression but not with the measures unrelated to overt aggression. Results are discussed with regard to their contribution to the construct validity of the aggression paradigm used in this study. © 1995 Wiley-Liss, Inc.     

大五人格问卷的结构效度分析

目的:检验大五人格问卷(BF)I的结构效度。方法:分别对258名和640名大学生进行施测,采用验证性因素分析和探索性因素分析对问卷的结构效度进行检验。结果:对问卷进行两次验证性因素分析的RMSEA分别为0.072和0.099,其余模型拟合指数都达到可接收水平。同时,项目的反向计分方式会在一定程度上影响问卷结构的效度。结论:中文版大五人格问卷具有较好的结构效度。     

Construct validity of psychopathy in a community sample: a nomological net approach.

The construct validity of psychopathy was examined within a sample of 326 male and female university students. The interpersonal circumplex served as a nomological net for the examination of convergences between psychopathy measures and convergent and discriminant validity with a measure of personality disorders was examined using a matrix approach. Measures included: (a) Antisocial scale of the Personality Assessment Inventory (Morey, 1991); (b) Self-Report Psychopathy scale (Hare, 1991); (c) Psychopathic Personality Inventory (Lilienfeld & Andrews, 1996); (d) Personality Diagnostic Questionnaire-4 (Hyler, 1994); and (e) Interpersonal Adjective Scales Revised-Big 5 (Trapnell & Wiggins, 1991). Results indicated (a) substantial convergence between psychopathy measures; (b) high convergent validity between psychopathy measures and antisocial personality disorder; and (c) high discriminant validity from other personality disorders. The prevalence of psychopathy within this non-forensic sample is also discussed.     

Construct validity of the relationship profile test: a self-report measure of dependency-detachment

This study evaluated the construct validity of the Relationship Profile Test (RPT; Bornstein & Languirand, 2003), a 30-item self-report measure of dependency-detachment that yields three subscale scores: (a) destructive overdependence, (b) dysfunctional detachment, and (c) healthy dependency. Scores on the RPT subscales generally showed the expected patterns of intercorrelations and gender differences, and comparison of RPT scores with scores on other tests supported the convergent and discriminant validity of each RPT subscale. Results of internal and retest reliability analyses were generally supportive as well, and suggested that the three RPT subscales assess aspects of the traits they purport to measure     

The social phobia and anxiety inventory: Construct validity

The Social Phobia and Anxiety Inventory (SPAI) is a new instrument composed of social phobia and agoraphobia subscales. The latter scale is used to detect social anxiety that may result from agoraphobia. The SPAI's construct validity was assessed through several procedures. First, confirmatory factor analyses were conducted to validate the existence of the two subscales. Second, exploratory factor analyses examined the underlying structure of the social phobia subscale. Third, a Q factor procedure determined if different anxiety diagnostic groups could be differentiated by their SPAI response pattern. The results confirmed the utility of the two SPAI subscales and identified a number of dimensions contained within the social phobia subscale which differed depending upon the specific subject sample. In addition, the complaints of social phobies appeared more homogeneous than those of an agoraphobic comparison group. The results are discussed in terms of construct validity and the sensitivity of the SPAI to various dimensions of social phobia fears.This study was supported in part by NIMH Grants 41852, 30915, 18269, and 16884.     

Construct validity of the Life Orientation Test

The Life Orientation Test (LOT; Scheier & Carver, 1985) is a common measure of optimism. Previous studies of the convergent and discriminant (vis-à-vis neuroticism) validity of the LOT have relied solely on questionnaires. Our Study 1 was a multitrait, multimethod investigation of the LOT incorporating Gottschalk and Gleser's (1969) method of content analysis of speech samples as a nonquestionnaire assessment method. The LOT did not correlate significantly with the Gottschalk Hope Scale (Gottschalk, 1974) derived from speech samples. Study 2 was an initial attempt to determine the nature of the differences between these alternate measures of optimism. In particular, it was hypothesized and found that the LOT was more fakable than the Hope Scale. Participants who received special instructions to "fake good" scored significantly higher on the LOT than did control participants who received no special instructions. Faking instructions did not significantly affect scores on the Hope Scale.     

Construct validity of the Rosenzweig Picture-Frustration Study

Projective and semiprojective techniques are both tools and tests. A schema for assessing the validity of projective devices is proposed: (1) Primary, consisting of (a) construct validity i.e., the soundness of the techniques vis-a-vis its underlying concepts; and (b) criterion-related validity, i.e., the concordance between tool results and specified external criteria. (2) Secondary, viz., pragmatic validity, i.e., the usefulness of the instrument in applied fields. Discussion then focuses on the construct validity of the conceptually-based, semiprojective Rosenzweig P-F Study. specifically the evidence on (a) the self-consistency of its conceptual dimensions; (b) the sequential. social development of the Types and Directions of Aggression; (c) levels of behavior elicited; (d) sensitivity to scorable changes after induced frustration: and (e) physiological correlates oft he aggression categories. In each of these areas evidence exists in support of the validity of the P-F Study.     

Construct validity of Wechsler factor scores.

The construct validity of the Verbal Comprehension. Perceptual Organization, and Freedom from Distractibility factor scores was examined in a sample of school-aged referred children. Examination of correlations between factor scores and neuropsychological and achievement tests generally supported the construct validity of the factors. The Verbal Comprehension factor was associated with verbal, quantitative, and concept-formation abilities. The Perceptual Organization factor was related to nonverbal concept formation, tactual performance, and visual attention. The Freedom from Distractibility factor demonstrated a complex pattern of correlations and appeared to reflect a range of abilities including quantitative, language, attentional, and concept formation.     

Construct validity of voluntary and involuntary absenteeism

Construct validity of voluntary and involuntary employee absenteeism is examined in this study. Canonical correlation analysis of absenteeism measures and organizational, personal and attitudinal variables is used to assess empirically the discriminant validity of voluntary and involuntary absenteeism. The empirical results provide evidence consistent with the interpretation that voluntary and involuntary absenteeism are distinct constructs that are associated differentially with subsets of organizational, personal and attitudinal variables. Further study of causal absenteeism models that include voluntary and involuntary absenteeism constructs and organizational, personal and attitudinal variables is needed to more clearly explicate the antecedents of absenteeism.Research support for Collin J. Watson was provided by a Faculty Fellow Research Award from the University of Utah Research Committee, a Graduate School of Business Research Award, and a sabbatical leave.     

Construct validity of a measure of acculturative stress in African Americans

The properties of the main measure of acculturative stress have not been systematically examined. The authors conducted a study of the construct validity of the Social, Attitudinal, Familial, and Environmental Acculturative Stress Scale (A. M. Padilla, Y. Wagatsuma, & K. J. Lindholm, 1985) in a sample of 248 African American university students (156 of whom attended a historically Black college). After controlling for general life stress, the authors found that the relations of acculturative stress to depressive and anxious (but not suicidal) symptoms remained. Also, African American students at a historically Black college reported less acculturative stress than African American students at a large state university. These findings clarify the nature of a key construct and measure of acculturative stress.     

Construct validity and test-retest reliability of a date rape decision-latency measure

In two studies, the construct (convergent and discriminant) validity and test-retest reliability of a date rape decision-latency measure was examined. In Study 1, 174 college men completed measures related to sexual aggression and listened to an audiotaped simulation of a date rape, during which cues of nonconsent and force gradually escalated over time. Participants were instructed to respond, by pressing a button which recorded the latency of their decisions in seconds, if and when they believed the man depicted in the scenario should stop his sexual advances. Results demonstrated positive associations between prolonged decision latencies and sexually aggressive behavior, calloused sexual beliefs, acceptance of interpersonal violence, and sexual promiscuity. In Study 2, initial results were cross-validated in a sample of 102 college men, and discriminant validity was established as decision latencies were unassociated with measures of social desirability, alcohol consumption and drug use. Test-retest reliability assessed over a 2-week interval was .87.The authors wish to thank Alan Gross and Brian Marx for providing the audiotaped stimulus materials, Richard Marsh for writing the decision-latency computer program, Jason Hicks for assisting with programming, and the undergraduate research assistants for serving as experimenters.     

Construct validity of the Psychopathic Personality Inventory in a correctional sample

The relations between the Psychopathic Personality Inventory (PPI; Lilienfeld & Andrews, 1996) and 4 theoretically related constructs (empathy, aggression, work ethic, and borderline personality disorder) were examined. Additionally, the relation between the PPI and heroism was explored. One hundred male inmates were administered the PPI, the Questionnaire Measure of Emotional Empathy (Mehrabian & Epstein, 1972), the Aggression Questionnaire (Buss & Perry, 1992), the Protestant Ethic Scale (Mirels & Garrett, 1971), the Self-Report for Borderline Personality Scale (Oldham et al., 1985), and the Activity Frequency Inventory (Lilienfeld, 1998). As predicted, the PPI was significantly negatively correlated with empathy and significantly positively related to aggression and borderline personality. Contrary to prediction, the correlation between the PPI and work ethic was not significant. Eight of 11 hypotheses regarding the relations of the PPI subscales to these 4 constructs were corroborated. Results support the construct validity of the PPI in a correctional sample. The exploratory analysis of the relation between the PPI and heroism revealed no significant relations.