Diagnostic validity of the MMPI and two short forms

The ability of the Faschingbauer Abbreviated MMPI (FAM) and the MMPI-168 to substitute for the full Minnesota Multiphasic Personality Inventory (MMPI) in broad psychiatric diagnosis was examined in a sample of 514 psychiatric inpatients. Each sex was randomly divided and multiple discriminant functions derived using long form scales as predictors. The discriminant functions were cross-validated on the other same-sex group using long and short form scales as predictors. All three forms achieved a 46% "hit" rate overall. No significant differences among the three forms were found.     

Parallel short forms of the family of origin scale: Evidence of their reliability and validity

Two parallel short forms of the Family of Origin Scale were developed from data provided by 69 women and 63 men who completed the full Family of Origin Scale along with a variety of measures of family-of-origin characteristics. Data on the reliability and validity of the short forms are provided and discussed. The results indicate that both short forms are strongly and significantly correlated with each other and with the full-scale version of the FOS and that they share its reliability and validity characteristics to a very high degree.     

The validity of the Rorschach for assessing cognitive and affective changes

Exner's (1985) Rorschach norms of children 5 to 16 years old were used to test predictions based on developmental theory, previous cognitive studies, and Achenbach and Edelbrock's (1981) norms on behavior problems in children. In the cognitive realm, the Rorschach scores reflected the predicted increase in complexity, integration, and precision of thinking; richness of ideas; conformity to socially acceptable ways of thinking; and the concomitant decrease in unrealistic, egocentric ideas. In the affective realm, the Rorschach scores reflected the predicted decrease in uncontrolled expression of affect, increase in controlled expression of affect, and increase in inwardness. However, the Rorschach scores failed to reflect the predicted decrease in anxiety and increase in depression. Finally, there was no evidence of increased accuracy of perception.     

The validity of composite photographs for assessing masculinity preferences

Among non-human animals, exaggerated male traits may signal immunocompetence and are often attractive to females. This finding has not been reliably replicated in human populations, however, where preferences for feminised male faces are often observed in experiments. Some authors have suggested that certain experimental approaches, and in particular the use of 'composite', or averaged, photographs, may lack ecological validity and elicit misleading responses. This may account for reports of preferences for femininity. To date, however, experiments have varied on numerous, often confounded, methodological dimensions, making the contribution of different factors difficult to assess. To address this, we conducted an experiment to examine the influence of stimulus type on participant responses. Masculinity preferences were measured using both composite photographs and the photographs from which they were composed, while all other methodological variables were held constant. In contrast to predictions by previous authors, composites elicited significantly stronger overall preferences for masculinity, especially when textural information was reduced during the averaging process. The existence of preferences for feminised male faces is unlikely to be explained by the use of composite photographs alone.     

A short and very short form of the physical self-inventory for adolescents: Development and factor validity

ObjectivesThe Physical Self-Inventory (PSI)—a French adaptation of the Fox and Corbin's [1989. The Physical Self-Perception Profile: Development and preliminary validation. Journal of Sport and Exercise Psychology, 11, 408–430] Physical Self-Perception Profile—was originally developed for use with adults and no study has systematically verified its psychometric properties in adolescent populations. Additionally, this instrument remains too long to be efficiently completed in combination with multiple other instruments within extensive longitudinal or idiographic studies. The purpose of the present investigation was thus threefold: (a) testing the factor validity and reliability of the original PSI in a sample of adolescents; (b) developing and testing the factor validity and reliability of a very short (i.e., two items per scale) form of the PSI in a sample of adolescents; and (c) testing the equivalence of the factor pattern, structural parameters, latent mean structure, and criterion-related validity of both forms of the PSI.DesignStructural equation modeling approach.MethodTwo samples participated in this series of studies. In Study 1, a sample of 1018 adolescents completed the adult PSI (25 items) and was randomly split in two sub-samples. In Study 2, a new sample of 320 adolescents completed a very short form of the PSI (PSI-VSF). Factorial validity and gender and multigroup invariance of these instruments (PSI, PSI-VSF) were tested using confirmatory factorial analysis (CFA) and structural equation modeling (SEM).ResultsIn Study 1, CFA and SEM analyses provided evidence for the factor validity and reliability of a short (PSI-SF: 18 items) and very short (PSI-VSF: 12 items) form of the PSI for adolescents. In Study 2, CFAs and SEMs supported the equivalence of the factor pattern, structural parameters, latent mean structure, and criterion-related validity of both forms of the PSI (i.e., PSI-SF, PSI-VSF).ConclusionThe present results thus provide preliminary evidence regarding the reliability and validity of a short and a very short form of the PSI for French adolescents.     

Development of short and very short forms of the Children's Behavior Questionnaire

Using data from 468 parents and taking into account internal consistency, breadth of item content, within-scale factor analysis, and patterns of missing data, we developed short (94 items, 15 scales) and very short (36 items, 3 broad scales) forms of the Children's Behavior Questionnaire (CBQ; Rothbart, Ahadi, & Hershey, 1994; Rothbart, Ahadi, Hershey, & Fisher, 2001), a well-established parent-report measure of temperament for children aged 3 to 8 years. We subsequently evaluated the forms with data from 1,189 participants. In mid/high-income and White samples, the CBQ short and very short forms demonstrated both satisfactory internal consistency and criterion validity, and exhibited longitudinal stability and cross-informant agreement comparable to that of the standard CBQ. Internal consistency was somewhat lower among African American and low-income samples for some scales. Very short form scales demonstrated acceptable internal consistency for all samples, and confirmatory factor analyses indicated marginal fit of the very short form items to a three-factor model.     

Predictive validity of an Implicit Association Test for assessing anxiety

The Implicit Association Test (IAT) was adapted to measure anxiety by assessing associations of self (vs. other) with anxiety-related (vs. calmness-related) words. Study 1 showed that the IAT-Anxiety exhibited good internal consistency and adequate stability. Study 2 revealed that the IAT-Anxiety was unaffected by a faking instruction. Study 3 examined the predictive validity of implicit and explicit measures and showed that the IAT-Anxiety was related to changes in experimenter-rated anxiety and performance decrements after failure. Study 4 found that several behavioral indicators of anxiety during a stressful speech were predicted by the IAT. Taken together, these studies show that the IAT-Anxiety is a reliable measure that is able to predict criterion variables above questionnaire measures of anxiety and social desirability.     

The reliability and concurrent validity of alternative methods for assessing ego development

This study demonstrates that an unstructured interview (INT) and the Thematic Apperception Test (TAT) are suitable alternatives to Loevinger's Sentence Completion Test of Ego Development. Seventy subjects were solicited from six groups varying widely with respect to age and education level. Each subject was asked to complete the SCI, an INT and the TAT. Two raters using Loevinger and Wessler's self-training exercises and Loevinger, Wessler, and Redmore's scoring manual rated subjects' responses to each instrument. Reliability was found between raters and concurrent validity between instruments. Subjects scoring high on the SCT were found to score higher on the INT and TAT.     

The theory of test validity and correlated errors of measurement

In the theory of test validity it is assumed that error scores on two distinct tests, a predictor and a criterion, are uncorrelated. The expected-value concept of true score in the calssical test-theory model as formulated by Lord and Novick, Guttman, and others, implies mathematically, without further assumptions, that true scores and error scores are uncorrelated. This concept does not imply, however, that error scores on two arbitrary tests are uncorrelated, and an additional axiom of “experimental independence” is needed in order to obtain familiar results in the theory of test validity. The formulas derived in the present paper do not depend on this assumption and can be applied to all test scores. These more general formulas reveal some unexpected and anomalous properties of test validty and have implications for the interpretation of validity coefficients in practice. Under some conditions there is no attenuation produced by error of measurement, and the correlation between observed scores sometimes can exceed the correlation between true scores, so that the usual correction for attenuation may be inappropriate and misleading. Observed scores on two tests can be positively correlated even when true scores are negatively correlated, and the validity coefficient can exceed the index of reliability. In some cases of practical interest, the validity coefficient will decrease with increase in test length. These anomalies sometimes occur even when the correlation between error scores is quite small, and their magnitude is inversely related to test reliability. The elimination of correlated errors in practice will not enhance a test's predictive value, but will restore the properties of the validity coefficient that are familiar in the classical theory.     

A system for assessing personal responsibility: validity, reliability and rater trainability

Summary: Sixty-two subjects completed the California Psjrchological Inventory, the Rotter External-Internal locus of control scale and an audio-taped discussion of their personal problems. The audio-taped problems were rated on a five-point level of personal responsibility scale and were compared wi.th the scores on the California Personality Inventory and the Internal-External locus of control scale in a correlation matrix which was subjected to a factor analysis. The results from these analyses suppovted the hypothesis that the Personal Responsibility Rating System has construct validity as a measure of psychological health. Study I1 assessed the trainability of the Personal Responsibility System. With a four-hour training program it was found that graduate students could be taught to rate personal responsibility in a reliable manner.     

Dyadic short forms of the Wechsler Adult Intelligence Scale-III

Various short forms of the Wechsler Adult Intelligence Scale (WAIS)/WAIS-R have been developed to obtain estimates of overall intellectual level, although little research of WAIS-III short forms has been published to date. Full Scale IQ (FSIQ) estimatesfromfour WAIS-III dyadic short forms were obtained by entering selected subtest scores from a mixed neurologic/ psychiatric sample (n = 196) into regression equations. Results were cross validated on a second sample (n = 57). Within both samples, WAIS-III FSIQ scores were highly correlated (r = .90-.92, p < .001) with estimated FSIQ scores. Estimated FSIQ fell within 5 points of actual FSIQ in 49% to 74% of cross-validation cases and within 10 points of actual FSIQ in 81% to 93% of the sample. Comparable to findings from previous short-form investigations, actual and estimated FSIQ classification levels agreed in 46% to 67% of cases in the cross-validation sample. These dyadic WAIS-III forms appear appropriate for obtaining gross estimates of FSIQ in similar populations, although caution is recommended in interpreting estimated IQ scores.     

Note on the sampling error of the difference between correlated proportions or percentages

Two formulas are presented for judging the significance of the difference between correlated proportions. The chi square equivalent of one of the developed formulas is pointed out.     

Regarding some short forms of the Marlowe-Crowne Social Desirability Scale

A program of Marlowe-Crowne Social Desirability Scale research is described, focusing on the distinction between positively keyed and negatively keyed items. Balanced short forms exist for the measurement of an overall social desirability construct, but evidence suggests the use as well of separate subscales. These subscales are seen to correlate differentially with the substantive personality variable neuroticism, with content-free measures of semantic style, and with self-peer agreement. A simple procedure for the concomitant measurement of possible tendency to acquiesce is also described.     

Evaluating the validity of short witness reports using behavioral and psychophysiologic parameters]

Within the context of credibility assessment, the impact of behavioral and physiological adaptation and response patterns of truly and falsely testifying eyewitnesses was examined in a laboratory study. It was further examined statements concerning characteristics of the delict and the experimental situation itself. 20 subjects were instructed to truly or falsely testify after having witnessed a willful destruction. Eye movements, respiration, heart rate and skin conductance were recorded and analyzed by computer. Witnesses instructed to falsely testify showed elevated skin conductance responses and an increased variability of horizontal eye movements at the beginning of the session. Additionally, they also showed stronger responses in eye-blink rate, respiration rate and variability of skin conductance and heart rate to questions related to the behavior in the experimental situation. Reactivity to questions concerning the culprit was less pronounced. Results are discussed in terms of their application within the German law system.