The GRIMS. A psychometric instrument for the assessment of marital discord

Research in marital therapy has been disadvantaged by the lack of a good, short and recent psychometric questionnaire to objectively assess the state of a marriage for research, demographic and clinical purposes. The Golombok Rust Inventory of Marital State (GRIMS) is a companion questionnaire to the Golombok Rust Inventory of Sexual Satisfaction (GRISS), and concentrates on aspects other than the sexual in a dyadic relationship between two adults living together. It is a 28 item psychometrically constructed inventory designed to produce a single scale along which changes in a marriage may develop as marital therapy progresses. It has been shown to be valid for this purpose, and to have a good reliability.     

Reliability and validity of scores from the Singer-Loomis Type Deployment Inventory

This paper focuses on the Singer-Loomis Type Deployment Inventory (SL-TDI), which is an alternative to the Myers-Briggs Type Indicator (MBTI). The SL-TDI utilizes a continuous, non-forced choice format and therefore is a more accurate representation of Jung's personality theory of psychological types. The purpose of the study reported here is to evaluate the reliability and validity of scores from the SL-TDI. Specifically, the goals were to (a) provide estimates of the internal consistency of SL-TDI scores; (b) evaluate the divergent validity of SL-TDI scores by examination of their relationships with the scores on a social desirability responding measure; and (c) examine the test-retest stability of scores from the SL-TDI. Strong support was found for both the reliability and validity of SL-TDI scores.     

Fear of Success,Need Achievement,and Fear of Failure: A factor analytic study

Several tests of Fear of Success (FOS), Fear of Failure (FOF), and Need Achievement (nAch), plus Taylor's Manifest Anxiety Scale and a social desirability scale were administered to 104 males and 101 females. FOS, FOF, and nAch did not show factor validity. Results for predictive validity were also poor. Anxiety defined the first factor in the factor analysis. All first-factor tests negatively predicted female grade point average and American College Test scores. All the first-factor tests showed sex differences, with females scoring higher. A clarifying role for anxiety in the study of sex differences in achievement is indicated.     

Socially desirable responding and its elusive effects on the validity of personality assessments

Past studies of socially desirable self-reports on the items of personality measures have found inconsistent effects of the response bias on the measures' predictive validities, with some studies reporting small effects and other studies reporting large effects. Using Monte Carlo methods, we evaluated various models of socially desirable responding by systematically adding predetermined amounts of the bias to the simulated personality trait scores of hypothetical test respondents before computing test-criterion validity correlations. Our study generally supported previous findings that have reported relatively minor decrements in criterion prediction, even with personality scores that were massively infused with desirability bias. Furthermore, the response bias failed to reveal itself as a statistical moderator of test validity or as a suppressor of validity. Large differences between some respondents' obtained test scores and their true trait scores, however, meant that the personality measure's construct validity would be severely compromised and, more specifically, that estimates of those individuals' criterion performance would be grossly in error. Our discussion focuses on reasons for the discrepant results reported in the literature pertaining to the effect of socially desirable responding on criterion validity. More important, we explain why the lack of effects of desirability bias on the usual indicators of validity, moderation, and suppression should not be surprising.     

Construct validity and test-retest reliability of a date rape decision-latency measure

In two studies, the construct (convergent and discriminant) validity and test-retest reliability of a date rape decision-latency measure was examined. In Study 1, 174 college men completed measures related to sexual aggression and listened to an audiotaped simulation of a date rape, during which cues of nonconsent and force gradually escalated over time. Participants were instructed to respond, by pressing a button which recorded the latency of their decisions in seconds, if and when they believed the man depicted in the scenario should stop his sexual advances. Results demonstrated positive associations between prolonged decision latencies and sexually aggressive behavior, calloused sexual beliefs, acceptance of interpersonal violence, and sexual promiscuity. In Study 2, initial results were cross-validated in a sample of 102 college men, and discriminant validity was established as decision latencies were unassociated with measures of social desirability, alcohol consumption and drug use. Test-retest reliability assessed over a 2-week interval was .87.The authors wish to thank Alan Gross and Brian Marx for providing the audiotaped stimulus materials, Richard Marsh for writing the decision-latency computer program, Jason Hicks for assisting with programming, and the undergraduate research assistants for serving as experimenters.     

Differential validity of the Gottschalk-Gleser Anxiety Scales: is gender a moderator variable?

It can be hypothesized that affects like anxiety can be measured by content analysis of speech due to the phenomenon of mood congruent memory, which is found predominantly in females. To assess the effect of gender on the validity of the Gottschalk-Gleser Anxiety Scales, the standard procedure for obtaining verbal samples was followed and self-report measurements of comparable emotional constructs were applied concurrently. Measures of state and trait emotions were administered to 25 female and 25 male university students. In the female group 18 significant convergent validity coefficients were found. For males, content analytic anxiety scores showed four significant correlations with concurrent self-report scales. These results suggest that content analytic anxiety scores from female subjects may allow a more accurate prediction of state and trait emotions than anxiety scores from male subjects. Thus, gender might have a differential effect on the validity of the Gottschalk-Gleser Anxiety Scales.     

Validity of the SDS-17 measure of social desirability in the American context

In Germany, Stober et al. (1999, 2001) presented evidence for the validity of the SDS-17, a new measure of social desirability bias. In the current investigation, three experiments (n = 800) assessed the SDS-17’s validity in the US environment. In all conditions SDS-17 scores correlated highly with Marlowe–Crowne scores. In Study 1, a group administration of a paper and pencil booklet, SDS-17 scores of 327 college students were higher under Fake Good than Standard conditions, and both were higher than scores in the Honest condition. Study 2, an online survey of a demographically diverse adult sample (n = 257), showed that the increase in SDS-17 scores under Fake Good conditions occurs also in a Web survey and that SDS-17 scores were unrelated to one’s demographic profile. Study 3, a group administration to 216 college students, revealed again that scores under Fake Good were higher than those under Standard administration and that SDS-17 scores correlated more highly with the Impression Management than with the Self-Deception subscales of the BIDR. The SDS-17 appeared valid for the US environment as a measure of socially desirable responding. The evidence, however, encourages its further assessment as an index of social desirability bias per se.     

On the validity of narrow and broad personality traits: A response to

Salgado, Moscoso, and Berges (2013) have recently commented on the issue of the comparative validity of broad factor-level personality traits and narrow facet-level personality traits, providing arguments and data suggesting superior validity for the former. In response, we first clarify some of our previous points that were discussed by Salgado et al. and comment on some other aspects of their article. We then provide an empirical example in which a facet-level personality scale does better in predicting a delinquency criterion than does the factor-level personality scale that contains that facet. We also use CFA to demonstrate that it was the specific trait variance in our narrow predictor that added significantly to predictive validity, above and beyond the validity achieved by the common factor variance contained within the trait measure. These results support our previous conclusion that exclusive reliance on broad factor measures can be counterproductive for understanding and predicting behavior.     

Validity of Adolescents' Report of Maternal Age

Examined the validity of adolescents' reports of their mother's age. Most research on the validity of self-report focuses on personal behaviors such as alcohol and substance use, or response bias due to social desirability. Few studies investigate the validity of adolescents reporting of nonsensitive information. Data from 80 mother–adolescent pairs were collected. The sample included 9th graders from four high school English classes, equal numbers of males and females, and 15% African Americans. The correlation between mothers' reports and youths' reports of mother's age was .99, and 95% of the youth were within a year of their mother's correct age. No race or gender differences were found. These results allow researchers to examine adolescent outcomes for youth born to teen mothers without the expense of also collecting data from their mothers. Results also suggest that adolescents' self-reports of other nonsensitive familial data may also be valid.     

Field validity of the Psychopathy Checklist-Revised in sex offender risk assessment

Several studies have concluded that scores from Hare's (2003) Psychopathy Checklist-Revised (PCL-R) predict reoffense among sexual offenders, but most of those studies examined the predictive validity of scores from trained research staff, not clinicians in the field scoring the measure as part of actual forensic assessments. Therefore, we examined the field validity of PCL-R scores that forensic evaluators assigned to 333 male sexual offenders who underwent evaluations during a civil commitment selection process. Overall, no PCL-R score was a significant predictor of sexually violent recidivism. Facet 4 was the only PCL-R score with an area under the curve (AUC) greater than .50 (AUC = .53, p = .85) and the only PCL-R score that approached statistical significance for predicting the combined category of violent or sexually violent offending (AUC = .63, p = .08). However, scores from a subset of evaluators revealed stronger predictive effects, indicating that predictive validity was higher for scores from some evaluators than others. Overall, these results suggest that the stronger predictive validity values in controlled research studies may not apply to all evaluators when the PCL-R is administered in the field.     

Psychometric Properties of the Emotion Awareness Questionnaire for Children in a French-Speaking Population

In this study, we investigated the psychometric properties of the French version of the Emotion Awareness Questionnaire (EAQ30; Rieffe et al., 2008). The EAQ30 was administered to 707 French-speaking children aged 8 to 16 years old. The original 6-factor structure was replicated in our data. The internal consistency coefficients of the EAQ30 subscales were satisfactory. We found small significant differences for gender and age. Regarding convergent validity, we found positive correlations between EAQ30 scores and emotional intelligence and negative correlations between EAQ30 scores and alexithymia. There was preliminary evidence of discriminant validity, with EAQ30 scores being weakly related to school performance, and concurrent validity, with EAQ30 scores being negatively related to somatic complaints, depression, and anxiety. Finally, except for 1 dimension, EAQ30 scores were not susceptible to social desirability. Although some weaknesses of the scale remain to be addressed, these findings support the use of the EAQ30 for research and clinical purposes.     

Individual differences in processing styles: validity of the Rational-Experiential Inventory

In Study 1 (N= 203) the factor structure of a Swedish translation of Pacini and Epstein's Rational-Experiential Inventory (REI-40) was investigated using confirmatory factor analysis. The hypothesized model with rationality and experientiality as orthogonal factors had satisfactory fit to the data, significantly better than alternative models (with two correlated factors or a single factor). Inclusion of "ability" and "favorability" subscales for rationality and experientiality increased fit further. It was concluded that the structural validity of the REI is adequate. In Study 2 (N= 72) the REI-factors were shown to have theoretically meaningful correlations to other personality traits, indicating convergent and discriminant validity. Finally, scores on the rationality scale were negatively related to risky choice framing effects in Kahneman and Tversky's Asian disease task, indicating concurrent validity. On the basis of these findings it was concluded that the test has satisfactory psychometric properties.     

Probing item social desirability by correlating personality items with Balanced Inventory of Desirable Responding (BIDR): A validity examination

Researchers often include a social desirability measure in personality measures, commonly the Balanced Inventory of Desirable Responding (BIDR), and correlate it with personality items to probe for social desirability of the items. A strong correlation between BIDR scores and a personality item would indicate high item social desirability. The current research assesses the validity of this practice. Results showed that these correlations have high validity only when BIDR scores are calculated as a continuous variable rather than as dichotomized item scores. In addition, self-deception scores have higher validity for detecting item social desirability than do impression management scores. The current research supported the use of the self-deception scores, in particular, to detect highly desirable or undesirable items.     

Research Validity Scales for the NEO-PI-R: additional evidence for reliability and validity

We examined the reliability and validity of the research validity scales (Schinka, Kinder, & Kremer, 1997) for the NEO-Personality Inventory-Revised (NEO-PI-R) in a clinical sample. The Negative Presentation Management (NPM) and Positive Presentation Management (PPM) scales were found to have satisfactory internal consistency reliability. Support for the validity of these scales was provided by the pattern of convergent and discriminant correlations with respective Personality Assessment Inventory (PAI) validity scales. Finally, PAI profiles of individuals with invalid NPM scores were found to differ significantly from those with valid NPM scores. Comparisons of the invalid profiles with profiles from other clinical samples provided additional support for the use of the NPM scale as a measure of negative impression management.     

Using the Implicit Association Test to Assess Risk Propensity Self‐concept: Analysis of its Predictive Validity on a Risk‐taking Behaviour in a Natural Setting

The present work analyses the predictive validity of measures provided by several available self‐report and indirect measurement instruments to assess risk propensity (RP) and proposes a measurement instrument using the Implicit Association Test: the IAT of Risk Propensity Self‐Concept (IAT‐RPSC), an adaptation of the prior IAT‐RP of Dislich et al. Study 1 analysed the relationship between IAT‐RPSC scores and several RP self‐report measures. Participants' risk‐taking behaviour in a natural setting was also assessed, analyzing the predictive validity of the IAT‐RPSC scores on risk‐taking behaviour compared with the self‐report measures. Study 2 analysed the predictive validity of the IAT‐RPSC scores in comparison with other indirect measures. Results of these studies showed that the IAT‐RPSC scores exhibited good reliability and were positively correlated to several self‐report and indirect measures, providing evidence for convergent validity. Most importantly, the IAT‐RPSC scores predicted risk‐taking behaviour in a natural setting with real consequences above and beyond all other self‐report and indirect measures analysed. Copyright © 2013 European Association of Personality Psychology     

Servant Leadership Behaviour Scale: A hierarchical model and test of construct validity

Servant leadership is widely believed to be a multidimensional construct. However, existing measures of servant leadership typically suffer from highly correlated dimensions, raising concerns over discriminant validity. We set out in this study to examine the dimensionality of the hypothesized six-factor Servant Leadership Behaviour Scale (SLBS) and validate a hierarchical model of servant leadership. Using structural equation modelling, convergent and discriminant validity of the higher-order servant leadership construct was examined in relation to measures of character-related behaviour, Machiavellian leadership orientation, and social desirability. Our findings suggest that the SLBS assesses a single, higher-order construct of servant leadership with evidence of construct validity and absence of social desirability bias. The high correlation between servant leadership and character-related behaviour supports our expectation that servant leadership reflects in large part the character strength of the leader.     

One-year temporal stability and predictive and incremental validity of the Body,Eating, and Exercise Comparison Orientation Measure (BEECOM) among college women

This study examined the one-year temporal stability and the predictive and incremental validity of the Body, Eating, and Exercise Comparison Measure (BEECOM) in a sample of 237 college women who completed study measures at two time points about one year apart. One-year temporal stability was high for the BEECOM total and subscale (i.e., Body, Eating, and Exercise Comparison Orientation) scores. Additionally, the BEECOM exhibited predictive validity in that it accounted for variance in body dissatisfaction and eating disorder symptomatology one year later. These findings held even after controlling for body mass index and existing measures of social comparison orientation. However, results regarding the incremental validity of the BEECOM, or its ability to predict change in these constructs over time, were more mixed. Overall, this study demonstrated additional psychometric properties of the BEECOM among college women, further establishing the usefulness of this measure for more comprehensively assessing eating disorder-related social comparison.     

On the myth and the reality of the temporal validity degradation of general mental ability test scores

Claims of changes in the validity coefficients associated with general mental ability (GMA) tests due to the passage of time (i.e., temporal validity degradation) have been the focus of an on-going debate in applied psychology. To evaluate whether and, if so, under what conditions this degradation may occur, we integrate evidence from multiple sub-disciplines of psychology. The temporal stability of construct validity is considered in light of the evidence regarding the differential stability of g and the invariance of measurement properties of GMA tests over the adult life-span. The temporal stability of criterion-related validity is considered in light of evidence from long-term predictive validity studies in educational and occupational realms. The evidence gained from this broad-ranging review suggests that temporal degradation of the construct- and criterion-related validity of ability test scores may not be as ubiquitous as some have previously concluded. Rather, it appears that both construct and criterion-related validity coefficients are reasonably robust over time and that any apparent degradation of criterion-related validity coefficients has more to do with changes in the determinants of task performance and changes in the nature of the criterion domain rather temporal degradation per se (i.e., the age of the test scores). A key exception to the conclusion that temporal validity degradation is more myth than reality concerns decision validity. Although the evidence is sparse, it is likely that the utility of a given GMA test score for making diagnostic decisions about an individual deteriorates over time. Importantly, we also note several areas in need of additional and more rigorous research before strong conclusions can be supported.     

A longitudinal study of the predictive validity of the Bayley-III scales and subtests

Abstract

The purpose of the present study was to examine the predictive validity of all scales and subtests from the Bayley-III. The sample consisted of 55 normal children who were assessed at six time points between 4 and 36 months. Significant correlations ranging from .28 to .79 were found for all ages and scales/subtests, but the three main scales differed with respect to predictive validity. The Cognitive Scale was predictive from 7–10, 7–13 and 10–13 months but not from 13 months and onwards. The Language Scale was predictive from 10 months and onwards and the Motor Scale was predictive at all ages, but only with respect to adjacent and not distant assessment points.     

Differential construct validity of intelligence as popularly measured: Correlations of age with raw scores on the WISC-R for Blacks Whites, males, and females

Raw scores on the 12 WISC-R subtests and the verbal, performance, and full scale IQ scales were correlated with age in years separately for 938 White males, 137 Black males, 927 White females, and 153 Black females. Highest and lowest correlations from the four groups were then contrasted for each of the 15 WISC-R variables to determine whether the magnitude of the relationship between age and performance on current tests of intelligence is constant across race and sex. Regression coefficients between age and raw scores were also contrasted across groups. None of the 15 comparisons of corrections yielded differences that were statistically significant. Regression coefficients differed only with respect to the Full Scale IQ, showing smaller incremental changes with age for Black males than for other groups. The results indicated that the relationship between age and intelligence test performance is relatively constant across race and sex and supports the construct validity of the WISC-R as a measure of children's intelligence for Blacks, Whites, males, and females, though some evidence was found to indicate slower development of “g” in Black males as compared to the other groups.