A psychometric evaluation of behavioral inhibition and approach self-report measures

Despite the putative applicability and unquestioned heuristic value of capturing individual variation in behavioral inhibition (BIS) and approach system (BAS) sensitivities, the field has yet to achieve widespread agreement regarding a self-report instrument of choice. The current study evaluates perhaps the two strongest candidates, the BIS/BAS scales (Carver & White, 1994) and the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ; Torrubia, Avila, Molto, & Caseras, 2001). Using both confirmatory and exploratory factor analytic techniques in two university samples, we determined that neither measure achieved adequate fit to our data set, and both contain multiple items we deemed to be problematic. Models trimmed of the poor items achieved better fit than the full models. However, even after trimming the data, model fit was marginal at best. Caution is urged in the continued use of both measures on conceptual and psychometric grounds.     

Unobtrusive measures in behavioral assessment

A major distinguishing characteristic of behavioral assessment is the direct assessment of overt behavior. Direct assessment is assumed to provide a sample of behavior that reflects client performance in the situation in which behavior is assessed, even if the assessment procedures were not implemented. Yet, in the majority of investigations, behavioral assessment procedures are obtrusive, i.e., subjects are aware that their behavior is being assessed. The potential problem with obtrusive assessment is that it may be reactive, i.e., affect how subjects perform. Recent research has demonstrated that obtrusive observations often are reactive and that behaviors assessed under obtrusive and unobtrusive conditions bear little relation. From methodological and applied perspectives, additional attention needs to be given to unobtrusive measures of behavior change. The present paper illustrates unobtrusive measures in behavior modification including direct observations, archival records, and physical traces of performance. In addition, validation and assessment problems, questions about the obtrusiveness of the measures, and ethical issues are discussed.     

An assessment of the fakeability of self-report and implicit personality measures

Researchers are focusing on developing implicit measures of personality to address concerns related to the faking of self-report measures. The present study examined the validity and fakeability of Implicit Association Test (IAT) measures of personality self-concept in a repeated-measures design (N = 33). People’s predictions about how they represented themselves on the measures were also assessed. Results indicated that participants were able fake self-report measures when instructed to do so and that they could accurately predict how they represented themselves on these measures. Participants were also able to fake an IAT measure of Extraversion, but were unable to fake an IAT measure of Conscientiousness or predict how they represented themselves on either IAT measure.     

Measuring depressive symptomatology of patients referred to a behavioral medicine clinic: Concordance of self-report measures

We measured depressive symptomatology of 134 outpatient veterans treated within a Behavioral Medicine Clinic utilizing three reliable instruments with depression subscales: Minnesota Multiphasic Personality Inventory (MMPI), Derogatis Stress Profile (DSP), and Symptom Checklist 90—Revised (SCL-90-R). Results indicate that although the instruments correlate significantly, they differ in sensitivity to depression and are clinically discordant. The MMPI classified a substantially higher number of patients as depressed than either the DSP or SCL-90-R. The present study argues that the discrepancy in clinical concordance and sensitivity of the three depression scales has considerable implications for psychologists concerned with the assessment and treatment of depression.     

Level validity of self-report whole-family measures

This article introduces an approach to testing the level validity of family assessment instruments (i.e., whether a family instrument measures family functioning at the level of the system it purports to assess). Two parents and 2 adolescents in 69 families rated the warmth in each of their family relationships and in the family as a whole. Family members' ratings of whole-family warmth assessed family functioning not only at the family level (i.e., characteristics of the family as a whole) but also at the individual level of analysis (i.e., characteristics of family members as raters), indicating a lack of level validity. Evidence was provided for the level validity of a latent variable based on family members' ratings of whole-family warmth. The findings underscore the importance of assessing the level validity of individual ratings of whole-family functioning.     

Matching components of self-report and peer-nomination personality measures

Two common methods of measuring personality variables are examined with respect to the ways in which they control respondent biases. A form of the mental-test theory model is developed which makes explicit differences in score components that result from different methodological constraints imposed by the two methods. From the model, it is possible to specify the operations necessary to provide equivalent information from the two sets of data. Performance of these operations in an empirical test supports the model by producing generally higher correlations between the variables having score components which are more closely matched.     

Reliability and validity of two self-report measures of psychopathy

The present study assessed the psychometric properties and construct validity of two self-report measures of psychopathy in a male-college sample: the Levenson Psychopathy scales (LPS; Levenson, Kiehl, & Fitzpatrick, 1995) and the Psychopathic Personality Inventory (PPI; Lilienfeld & Andrews, 1996). Both the LPS and the PPI demonstrated good internal consistency, although selected items from the PPI correlated weakly with their respective factor scores, suggesting the need for further investigation of the factors' item content. The PPI showed stronger validity than the LPS in terms of convergent and discriminant validity of its factor scores and factor associations with two criterion variables, aggression, and anxiety. Overall, the current study provides greater support for the use of the PPI over the LPS in studies investigating psychopathic traits in nonclinical and nonforensic samples.     

A self-report typology of behavioral adjustment for young children

A large, national U.S. sample of children rated their own behavior and emotions using the Self-Report of Personality-Child version (SRP-C) of the Behavior Assessment System for Children (C. R. Reynolds & R. W. Kamphaus, 1992). Cluster analysis was used to group 4,981 self-reports (SRP-C) of children between the ages of 8 and 11 years. Theoretical and empirical considerations were used to identify a 10-cluster solution. Internal validation procedures revealed that the 10-cluster solution was well replicated by independently classifying 2 large subsamples of participants. External validation evidence revealed that only 2 of the 10 clusters could be differentiated by parent and teacher ratings of behavior problems. Peer ratings of social status and behavior, however, proved far better than adult ratings at differentiating the clusters. These findings suggest that the realm of intraindividual adjustment is not well understood by parents and teachers of these same children.     

Alcohol and correspondence between self-report and physiological measures of anxiety

The present study was designed to determine the main effects of alcohol intoxication on self-report and physiological measures of anxiety. Second, we aimed to assess the role of the Marlowe-Crowne Social Desirability (MCSD) scale in predicting the relationship between self-report and physiological indices of anxiety irrespective of drink content. A final purpose of the study was to determine whether the MCSD could account for discrepancies in the effects of alcohol on the two anxiety response systems. Subjects were male social drinkers who received an 0.70 g/kg dose of alcohol or placebo. Results indicated that irrespective of drink content, subjects with high MCSD scores reported lower levels of anxiety than did subjects with low MCSD scores. This relationship was not evident for heart rate. These results for measures of anxiety were not influenced by drink content.     

Response bias in self-report measures of general health

This study set out to examine the susceptability of two widely used, self-report, psychiatric inventories to response set bias. Subjects were requested to either fake well (physically and psychologically fit), fake psychologically ill, fake physically ill or respond honestly on the General Health Questionnaire (GHQ) and the Langner Scale of Distress (L-22). Predictably subjects who faked well had significantly lower scores than either of the other two experimental groups, however there was no difference between the Fake Well and Control group on the GHQ total or the Somatic and Depression scales. Subjects who faked psychologically ill showed 4 out of 11 significant differences between those who faked physically ill. All of the comparisons between the two Fake Ill groups, and the Well and Control groups, were statistically significant the former reporting higher incidences of distress than the latter. The results are discussed in terms of questionnaire design, subject motivation and alternative methods of assessing mental health.     

The assessment of protective behavioral strategies: Comparing prediction and factor structures across measures

Protective behavioral strategies (PBS), or drinking control strategies, are specific behaviors one can utilize to minimize the harmful consequences of alcohol consumption. As there is not currently a standard measure of PBS, the goal of the present study was to examine the factor structure and concurrent validity of three scales designed to assess PBS: Protective Behavioral Strategies Scale (PBSS; Martens, M. P., Ferrier, A. G., Sheehy, M. J., Corbett, K., Anderson, D. A., & Simmons, A., 2005 Development of the Protective Behavioral Strategies Survey. Journal of Studies on Alcohol, 66, 698-705), Protective Behavioral Strategies Measure (Novik, M. G., & Boekeloo, B. O., 2011, Dimensionality and psychometric analysis of an alcohol protective behavioral strategies scale. Journal of Drug Education, 41, 65-78. doi:10.2190/DE.41.1.d), and the Strategy Questionnaire (SQ); (Sugarman, D. E., & Carey, K. B., 2007), The relationship between drinking control strategies and college student alcohol use. Psychology of Addictive Behaviors, 21, 338-345. doi:10.1037/0893-164X.21.3.338). In a sample of college students (n = 291), we used confirmatory factor analysis to examine the proposed factor structures of each scale. Although the theorized three-factor structure fit the data moderately well for the PBSS, the theorized factor structures for the Protective Behavioral Strategies Measure and SQ did not fit the data well. Further, the composite scores from the PBSS were all significantly negatively correlated with alcohol-related problems, whereas the composites of the SQ were not significantly correlated with alcohol-related problems. Although we have evidence in favor of 1 PBS measure over others, we discuss broader issues related to assessment of PBS. We consider the different instructions, response scales, and time intervals for various PBS measures in terms of how they relate to the advancement of PBS research. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

Temporal stability of self-report measures in agoraphobia research

Forty subjects, meeting DSM-III criteria for agoraphobia completed, on two occasions, a comprehensive assessment battery. Measures encompassed anxiety, phobia, depression and general symptomatology dimensions of functioning, and consisted of instruments widely employed as outcome measures in agoraphobia research. The test-retest time periods were divided into 4-, 10- and 16-week intervals to ascertain their temporal stability, an often ignored parameter of reliability. The results indicate that agoraphobia, anxiety, depression and general symptomatology measures were temporally stable. However, test-retest reliabilities of the scales' subscores were generally inferior to those of the total score. The findings are discussed, with recommendations for more programmatic psychometric research in the assessment of anxiety disorders.     

Improving self-report measures of non-adherence to HIV medications

The aim of this article is to clarify what factors should be measured to assess non-adherence to an antiretroviral medication regimen among individuals with the Human Immunodeficiency Virus (HIV). In order to consider a patient as non-adherent, a clear operational definition of medication non-adherence should be formulated. This definition should specify the medication to be taken, the medical advice to be followed as well as the behaviors a patient should adopt in a given period of time. Techniques aimed at reducing the influence of several potential biases in self-report questionnaires, such as forgetfulness and social desirability, are also reviewed.     

Measurement of higher-order family dimensions across self-report and behavioral observational methods

This study used a community sample of 192 intact families to examine two issues related to conceptualization and measurement of family functioning. First, a confirmatory factor model supported the adequacy of using dyadic-level self-report measures (e.g., mother-child, child-father) to identify three family level constructs of Family Affect, Family Control, and Family Shared Activity. Second, data derived from behavioral observations during dyadic interactions identified two factors, Family Positivity and Family Negativity. Correlations among the self-report and behavioral observation factors indicated high Family Positivity was significantly associated with higher Family Affect and lower Family Control, and Family Negativity was significantly associated with lower Family Affect and with lower Family Shared Activity. Findings are discussed in terms of limitations and directions for research.     

Relationships between perfectionism,self-report impulsivity measures and delay discounting

Perfectionism and impulsivity are multidimensional constructs. While different perfectionism dimensions are exclusively measured through self-reports, different impulsivity dimensions can be measured through self-report or behaviour via preferences for different rewards. This study explored differential associations between perfectionism and impulsivity based on both dimension and measurement modality (self-report/behavioural). We then examined whether adaptive or maladaptive perfectionism would be differentially associated with impulsivity. Two-hundred and six students completed two perfectionism and three impulsivity measures (two self-report; one behavioural). Two self-report impulsivity measures were associated with specific perfectionism dimensions, whereas the behavioural measure was not associated with perfectionism. Maladaptive perfectionism was associated with decreasing impulsivity, whereas adaptive perfectionism was associated with increasing impulsivity. Perfectionism related to impulsivity differently depending on how each construct was measured.