Criterion-related validity of self-report measures of female heterosocial functioning

Common measures of female heterosocial functioning, the Survey of Heterosocial Interactions for Females (SHI-F) and dating frequency questions, were validated against the criterion of male liking, i. e., how well men like a woman. The SHI-F was unrelated to the criterion and to the other measures of heterosocial activity. The dating frequency and satisfaction questions were moderately related to the criterion. It was concluded the self-reported ability to initiate contact with men (as measured by the SHI-F) may not be related to female heterosocial functioning. Self-reported dating frequency and satisfaction appear to be a valid measure of female heterosocial functioning.The data were collected while the first author was at Louisiana State University.     

Reliability and validity of two self-report measures of psychopathy

The present study assessed the psychometric properties and construct validity of two self-report measures of psychopathy in a male-college sample: the Levenson Psychopathy scales (LPS; Levenson, Kiehl, & Fitzpatrick, 1995) and the Psychopathic Personality Inventory (PPI; Lilienfeld & Andrews, 1996). Both the LPS and the PPI demonstrated good internal consistency, although selected items from the PPI correlated weakly with their respective factor scores, suggesting the need for further investigation of the factors' item content. The PPI showed stronger validity than the LPS in terms of convergent and discriminant validity of its factor scores and factor associations with two criterion variables, aggression, and anxiety. Overall, the current study provides greater support for the use of the PPI over the LPS in studies investigating psychopathic traits in nonclinical and nonforensic samples.     

The concurrent validity of three self-report measures of borderline personality

The recent accumulation of self-report measures of borderline personality disorder (BPD) affords the opportunity to evaluate both the construct validity of the concept and the quality of these measures. This study examines the relationship among three recently developed self-report instruments for assessing BPD from the Personality Assessment Inventory (PAI; Morey, 1991), the MMPI Personality Disorders Scales (MPD; Morey, Waugh, & Blashfield, 1985), and the Bell Object Relations Inventory (BORI: Bell, Billington, & Becker, 1986). Data on the three measures were provided by 119 undergraduate subjects from a southeastern university. A correlational analysis addresses the convergence of these measures of BPD, their divergence from measures of different but related traits, and their independence from variance due to method. Application of the Campbell-Fiske (1959) criteria indicates adequate convergence for all the BPD measures but a lack of discriminant validity for the BORI scales. The fit of the data to a structural model of construct validity is tested using confirmatory factor analysis, and these results are consistent with the hypothesis of a latent borderline trait factor independent of measurement method factors. In sum, the construct validity of the borderline personality concept using self-report methodologies receives support, and a strong association between borderline personality and paranoid phenomena is also suggested.     

Children's social behavior: Reliability and concurrent validity of two self-report measures

In this study the psychometric qualities of Deluty's Children's Action Tendency Scale (CATS) and Michelson and Wood's Children's Assertive Behavior Scale (CABS) were assessed with 157 Dutch children. Both instruments are designed to assess children's self-reported responses to interpersonal situations, whereby aggressive, assertive, and submissive scores are obtained. In general acceptable psychometric properties were obtained for both the CATS and the CABS, except for the assertive scale of the CATS. Furthermore, it was found that the ability of both the CATS and the CABS to discriminate between submissiveness and assertiveness was low. Important gender differences that were found regarding the relations with measures of perceived competence and social desirability are offered as a possible explanation for the relative failure of the CABS and the CATS to unbind submissive from assertive behavior. The parent version of the CABS is offered as a possible alternative or additional source of information for the assessment of children's submissiveness. Recommendations for future applications and research are presented.This research was supported by Grant 2843 from the NFGV to the second author.     

Revisiting the predictive validity of emotional intelligence: self-report versus ability-based measures

In response to general press assertions that training emotionally intelligent children will lead to great rewards, this study examined the relationship between emotional intelligence (EI) and academic achievement in college students, using both self-report and ability-based measures of EI. Specifically, the Mayer, Salovey, Caruso Emotional Intelligence Test (MSCEIT, an ability-based measure) and the Bar-On Emotional Quotient Inventory (EQ-i, a self-report measure) were used to predict academic achievement. Achievement was operationalized as the respondents’ cumulative GPA. Results indicated that EI is not a strong predictor of academic achievement regardless of the type of instrument used to measure it. However, a construct validity examination revealed that the MSCEIT correlated highly with indices of cognitive ability but minimally with personality dimensions. In contrast, the EQ-i failed to correlate with indices of cognitive ability but correlated substantially with numerous personality dimensions.     

Psychopathic features in a juvenile diversion population: reliability and predictive validity of two self-report measures

The reliability and predictive validity of two experimental self-report versions of two measures of psychopathic features in youth, the Antisocial Process Screening Device (APSD: Frick & Hare, 2001) and a modified version of the Child Psychopathy Scale (CPS: Lynam, 1997) were examined in a sample of 69 arrested youth (M age = 14.4 years) referred to a juvenile diversion program. Parents or legal guardians completed parent-rating versions of the same measures. Reliability indicators for the APSD total measure were satisfactory although internal consistency indices (coefficient alpha) for the Callous/Unemotional and Impulsive/Conduct Problems scales were slightly lower than desirable. Reliability indicators for the CPS were excellent after deleting items that had poor corrected item-to-CPS total score correlations. Positive and statistically significant correlations for all measures were obtained with prospective measures of program failure (range 0.22-0.36) and rearrest at 1 year follow-up (range 0.33-0.56). Although further research is needed prior to the clinical use of these measures, these results signal the potential of such measures to inform clinical judgments regarding treatment compliance and risk with justice-involved youth.     

On-line versus memory-based orientations and self-report validity

A partial replication of a study by Nisbett and Bellows (1977) to which a memorization condition was added showed that subjects did not have introspective access to the determinants of their judgments, but did so only in the impression-formation condition. In the memorization condition, the subjects' self-reports matched the observed experimental effects. An analysis of the results showed that this was probably because the subjects' judgments in the latter condition were based on causal theories. ©1997 John Wiley & Sons, Ltd.     

Matching components of self-report and peer-nomination personality measures

Two common methods of measuring personality variables are examined with respect to the ways in which they control respondent biases. A form of the mental-test theory model is developed which makes explicit differences in score components that result from different methodological constraints imposed by the two methods. From the model, it is possible to specify the operations necessary to provide equivalent information from the two sets of data. Performance of these operations in an empirical test supports the model by producing generally higher correlations between the variables having score components which are more closely matched.     

Improving self-report measures of non-adherence to HIV medications

The aim of this article is to clarify what factors should be measured to assess non-adherence to an antiretroviral medication regimen among individuals with the Human Immunodeficiency Virus (HIV). In order to consider a patient as non-adherent, a clear operational definition of medication non-adherence should be formulated. This definition should specify the medication to be taken, the medical advice to be followed as well as the behaviors a patient should adopt in a given period of time. Techniques aimed at reducing the influence of several potential biases in self-report questionnaires, such as forgetfulness and social desirability, are also reviewed.     

Response bias in self-report measures of general health

This study set out to examine the susceptability of two widely used, self-report, psychiatric inventories to response set bias. Subjects were requested to either fake well (physically and psychologically fit), fake psychologically ill, fake physically ill or respond honestly on the General Health Questionnaire (GHQ) and the Langner Scale of Distress (L-22). Predictably subjects who faked well had significantly lower scores than either of the other two experimental groups, however there was no difference between the Fake Well and Control group on the GHQ total or the Somatic and Depression scales. Subjects who faked psychologically ill showed 4 out of 11 significant differences between those who faked physically ill. All of the comparisons between the two Fake Ill groups, and the Well and Control groups, were statistically significant the former reporting higher incidences of distress than the latter. The results are discussed in terms of questionnaire design, subject motivation and alternative methods of assessing mental health.     

Temporal stability of self-report measures in agoraphobia research

Forty subjects, meeting DSM-III criteria for agoraphobia completed, on two occasions, a comprehensive assessment battery. Measures encompassed anxiety, phobia, depression and general symptomatology dimensions of functioning, and consisted of instruments widely employed as outcome measures in agoraphobia research. The test-retest time periods were divided into 4-, 10- and 16-week intervals to ascertain their temporal stability, an often ignored parameter of reliability. The results indicate that agoraphobia, anxiety, depression and general symptomatology measures were temporally stable. However, test-retest reliabilities of the scales' subscores were generally inferior to those of the total score. The findings are discussed, with recommendations for more programmatic psychometric research in the assessment of anxiety disorders.     

Factorial validity of imagery measures

Two correlational studies and related factor analyses (N = 70. N = 76) were addressed to four psychometric hypotheses derived from the imagery-desensitization literature. Consistent with prior research, self-ratings of imaginal vividness correlated moderately positively across sense modalities. Vividness ratings were inconsistently related to imagery control scores however. The question of the extent to which imagery scales reflect the influences of response sets and general intelligence has been raised recently in this journal Behav. Res. and Therapy 10, 137 (1972). Acquiescence tendency does not appear to influence imagery questionnaire results and there is only a small contamination effect from the social desirability response style, thus suggesting that these questionnaires are substantially free of response bias invalidation. Verbal intelligence is unrelated to researched imaginal attributes, as measured by self-report scales and several behavioral measures, including location memory and spatial visualization. These behavioral measures, in turn, do not correlate with ratings of imagery characteristics, a finding in accord with previous literature. Although self-report imagery questionnaires stand up better to psychometric scrutiny than might have been expected, and thus prior research employing them cannot be dismissed summarily, it is argued that these questionnaires may not tap the variables most relevant to desensitization outcome or mediation. The necessity of using state rather than trait measures, and of relating these to physiological indices, is highlighted.     

A comparison of the validity of the five-factor model (FFM) personality disorder prototypes. Using FFM self-report and interview measures

Recent studies have demonstrated that personality disorders (PDs) can be assessed via a prototype-matching technique, which enables researchers and clinicians to match an individual's five-factor model (FFM) personality profile to an expert-generated prototype. The current study examined the relations between these prototype scores, using interview and self-report data, and PD symptoms in an outpatient sample (N = 115). Both sets of PD prototype scores demonstrated significant convergent validity with PD symptom counts, suggesting that the FFM PD prototype scores are appropriate for use with both sources of data.     

Alcohol and correspondence between self-report and physiological measures of anxiety

The present study was designed to determine the main effects of alcohol intoxication on self-report and physiological measures of anxiety. Second, we aimed to assess the role of the Marlowe-Crowne Social Desirability (MCSD) scale in predicting the relationship between self-report and physiological indices of anxiety irrespective of drink content. A final purpose of the study was to determine whether the MCSD could account for discrepancies in the effects of alcohol on the two anxiety response systems. Subjects were male social drinkers who received an 0.70 g/kg dose of alcohol or placebo. Results indicated that irrespective of drink content, subjects with high MCSD scores reported lower levels of anxiety than did subjects with low MCSD scores. This relationship was not evident for heart rate. These results for measures of anxiety were not influenced by drink content.     

A psychometric evaluation of behavioral inhibition and approach self-report measures

Despite the putative applicability and unquestioned heuristic value of capturing individual variation in behavioral inhibition (BIS) and approach system (BAS) sensitivities, the field has yet to achieve widespread agreement regarding a self-report instrument of choice. The current study evaluates perhaps the two strongest candidates, the BIS/BAS scales (Carver & White, 1994) and the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ; Torrubia, Avila, Molto, & Caseras, 2001). Using both confirmatory and exploratory factor analytic techniques in two university samples, we determined that neither measure achieved adequate fit to our data set, and both contain multiple items we deemed to be problematic. Models trimmed of the poor items achieved better fit than the full models. However, even after trimming the data, model fit was marginal at best. Caution is urged in the continued use of both measures on conceptual and psychometric grounds.