Velocity discrimination: reliability and construct validity in older adults

The aim of this study was to determine whether a test of velocity discrimination is a reliable and valid measure of proprioception in healthy older adults. Results revealed excellent test-retest reliability over a 2-week period. Velocity discrimination also indicated good construct validity with modest correlations with center of pressure sway outcomes in eyes open and closed conditions as well as stair climbing time. Good construct validity was identified by velocity discrimination sensitivity to age with a higher mean value for the older participants than for the younger participants. These findings suggest velocity discrimination is a valid and reliable measure of velocity sense, which may be included with measures of position and movement sense to enhance the proprioceptive testing repertoire among researchers. Implications of these results are discussed in terms of evaluation of proprioceptive training programs aimed to enhance postural control.     

Pervasive developmental disorders rating scale: development and construct validity

The Pervasive Developmental Disorders Rating Scale was designed for use in screening of pervasive developmental disorders. This paper describes the rationale and development of the scale and assesses its construct validity with ratings from a sample of 362 children ranging in age from 1 to 12 years and diagnosed with autistic disorder. The hypothesized heirarchical factor model and two competing models were examined through confirmatory factor analysis. The analysis supported the factor structure of the hypothesized model in this particular sample of children with autistic disorder. Limitations and areas for research are discussed.     

Brazilian-Portuguese empathy quotient: evidences of its construct validity and reliability

Empathy is the ability to read other's mind and understand their intentions. This paper examines the psychometric properties of the Brazilian-Portuguese version of a short form of the empathy quotient (EQ, 15 items). The EQ-15 was administered to 237 participants from the general population from Jo?o Pessoa, Brazil. Confirmatory factor analyses supported the tripartite model with cognitive, emotional and social empathy factors. In line with other studies, gender differences were only observed for the first two factors, with female participants scoring higher on both, which suggests that the social factor might not constitute a truly dimension of empathy. Strong evidence for convergent and discriminant validity was only observed for the cognitive factor. The poor psychometric parameters of the emotional and social factors are argued to reflect the complexity and contrasting ideas of their items. The possibility of elaborating specific items for the emotional and social factors is also discussed.     

The Japanese version of the revised Life Orientation Test: reliability and construct validity

The Japanese translation of the revised Life Orientation Test was completed by 223 Japanese college students. Factor analysis yielded two factors, namely, Optimism and Pessimism. These factor scales showed adequate reliability and construct validity.     

The Narcissistic Personality Inventory: alternative form reliability and further evidence of construct validity

The aim of this study was twofold: (a)to measure the alternate form reliability of the Narcissistic Personality Inventory, and (b)to determine its construct validity by correlating it with the four scales of the Eysenck Personality Questionnaire (EPQ). The alternate form reliability was .72. The Extraversion and Psychoticism scales of the EPQ were positively and significantly correlated with the narcissism measure, and the Lie scale showed a significant negative correlation. The Neuroticism scale showed a nonsignificant relationship with narcissism. In addition, the combined Extraversion and Psychoticism scales produced[ a Multiple R with the narcissism measure that accounted for significantly more of the variance in narcissism than did either measure alone.     

Assessor training strategies and their effects on accuracy, interrater reliability, and discriminant validity

This study compares the effects of data-driven assessor training with schema-driven assessor training and control training. The sample consisted of 229 industrial and organizational psychology students and 161 managers who were randomly assigned to 1 of these training strategies. Participants observed and rated candidates in an assessment center exercise. The data-driven and schema-driven assessor training approaches outperformed the control training on all 3 dependent variables. The schema-driven assessor training resulted in the largest values of interrater reliability, dimension differentiation, and accuracy. Managers provided significantly more accurate ratings than students but distinguished less between the dimensions. Practical implications regarding the design of assessor trainings and the composition of assessor teams are proposed.     

The new MAACL scales with adolescents: preliminary reliability and validity determinations

This study reports on the reliability and concurrent validity of both the trait and state forms of the Multiple Affect Adjective Check List (MAACL) with a high school population, age range of 14-16 years and educational range of 9th and 10th grades (N = 403). Alphas of the four scales (anxiety, depression, hostility, and positive affect) ranged from .67 to .91. Correlations with a check-list of stress-related symptoms and an inventory of the number of extracurricular activities in which the students participated were significant and in the expected direction. Means and standard deviations on the MAACL scales were similar to those of college students. Sex differences were found on some of the scales. The findings indicate that the MAACL is sufficiently reliable and valid to warrant additional use with an adolescent population.     

Sociotropy and autonomy: preliminary evidence for construct validity using TAT narratives

In this investigation, we evaluated the construct validity of sociotropy and autonomy as assessed by the revised Personal Style Inventory (PSI; Robins et al., 1994). Stories given to 6 cards of the Thematic Apperception Test (Murray, 1943) were coded for need for Achievement (McClelland, Atkinson, Clark, & Lowell, 1953) and need for Affiliation (Heyns, Veroff, & Atkinson, 1958). These scores were correlated with PSI Sociotropy and Autonomy, along with their component subscales. The construct validity of Sociotropy, Autonomy, and 5 of 6 component subscales were supported as hypoth sized. Consistent with past research, there was no support for the construct validity of the Perfectionism/Self-Criticism subscale of Autonomy. In addition, separate analyses by gender suggested that the construct validity of sociotropy may be greater for women than for men. The results represent an important finding in that nonquestionnaire measures of interpersonal and achievement-related concerns were found to support the validity of the PSI, a need identified by the questionnaire's authors.     

Measuring socioeconomic status: reliability and preliminary validity for different approaches

This study investigated issues related to commonly used socioeconomic status (SES) measures in 140 participants from three cities (Atlanta, Boston, and Toronto) in two countries (United States and Canada). Measures of SES were two from the United States (four-factor Hollingshead scale, Nakao and Treas scale) and one from Canada (Blishen, Carroll, and Moore scale). Reliability was examined both within (interrater agreement) and across (intermeasure agreement) measures. Interrater reliability and classification agreement was high for the total sample (ranger = .86 to .91), as were intermeasure correlations and classification agreement (range r = .81 to .88). The weakest agreement across measures was found when families had one wage earner who was female. Validity data for these SES measures with academic and intellectual measures also were obtained. Some support for a simplified approach to measuring SES was found. Implications of these findings for the use of SES in social and behavioral science research are discussed.     

The interrater reliability of DSM III in children

A total of 195 admissions to a child psychiatric inpatient unit were diagosed independently by two to four clinicians on the basis of case presentations at the first wardround after admission. The DSM HI as a whole and the major categories were of high or acceptable reliability, though a few were clearly unreliable. The results are generally consistent with other studies. Unlike other studies, the subcategories were examined and found to vary widely in reliability both as a whole across the system and within parent major categories, throwing considerable doubt upon their utility. The results indicate the need both for improved diagnostic datagathering techniques in child psychiatry and for more betterdesigned studies of reliability and, most necessarily, of validity.     

The construct validity of burnout

Considerable confusion exists in the burnout literature about the similarities and separateness among the constructs of burnout, depression and job satisfaction. This study examined the construct validity of burnout using Campbell & Fiske's multitrait-multimethod approach. The constructs of burnout, depression and orderliness (chosen as a discriminant construct) were assessed by three types of self-report instruments. Data were analysed for 181 females and 139 male faculty members who spent at least 50 per cent of their time in teaching. Results indicated that measures of burnout largely met Campbell & Fiske's criteria for construct validity: burnout measures possessed adequate to good internal reliability and convergent validity. However, burnout measures also correlated substantially with measures of depression. Results are discussed in terms of possible explanations for the substantial overlap that has been demonstrated among measures of burnout, depression and job satisfaction.     

Evidence of the construct validity of developmental ratings of managerial performance

The construct validity of developmental ratings of managerial performance was assessed by using 2 data sets, each based on a different 360 degrees rating instrument. Specifically, the authors investigated the nature of the constructs measured by developmental ratings, the structural relationships among those constructs, and the generalizability of results across 4 rater perspectives (boss, peer, subordinate, and self). A structure with 4 lower order factors (Technical Skills, Administrative Skills, Human Skills, and Citizenship Behaviors) and 2 higher order factors (Task Performance and Contextual Performance) was tested against competing models. Results consistently supported the lower order constructs, but the higher order structure was problematic, indicating that the structure of ratings is not yet well understood. Multisample analyses indicated few practically significant differences in factor structures across perspectives.     

Measures of Hindu pathways: development and preliminary evidence of reliability and validity

The authors examined religious practices of Hindus in the United States and developed measures of their religious pathways. Based on reviews of the psychology of religion, Hindu literature, and interviews with Hindus (N=15), 4 religious pathways were identified: devotion, ethical action, knowledge, and physical restraint/yoga. Items reflecting these pathways were generated and administered to a pilot sample (N=42) and then mailed to a sample across the United States (N=182). Consistent with Hindu theology, participants endorsed 4 religious pathways. Results indicated that the measures of the religious pathways possessed adequate psychometric properties and were predictive of mental and physical well-being. Additional findings emphasized the need to attend to age, marital status, and acculturation when studying religious practices among Hindus.     

Personal problem-solving system for scoring TAT responses: preliminary validity and reliability data

Personal problem solving has emerged as an important construct in the cognitive-behavioral literature, yet there is a lack of clinically useful, performance-based measures practitioners can use to assess the personal problem-solving skills of their clients. Two studies evaluated the validity and reliability of a scoring system for measuring personal problem-solving processes via the Thematic Apperception Test (TAT; Morgan & Murray, 1935). In Experiment 1, undergraduate students (N = 87) completed two measures of personal problem solving, as well as three TAT cards, which were scored using the Personal Problem-Solving System (PPSS; Renan, 1990). In Experiment 2, an additional group of undergraduates (N = 56) responded to three TAT cards on two separate occasions and also completed a different measure of personal problem solving. Results from both studies supported the use of the PPSS for scoring TAT responses to assess personal problem-solving processes. Suggestions for future research are highlighted.     

Computing interrater reliability on the Apple Macintosh computer

A program is described for computing interrater reliability by averaging, for each rater, the correlations between one rater’s ratings and every other rater’s ratings. For situations in which raters rate more than one ratee, raters’ reliabilities can be computed for either each item or each ratee. The program reads data from a text file and puts the reliability coefficients in a text file. The standard Macintosh interface is implemented. The Quick-BASIC program is distributed both as a listing and in compiled form; it can be run with advantage with math coprocessors.     

An empirical look at the Defense Mechanism Test (DMT): reliability and construct validity

Although the Defense Mechanism Test (DMT) has been in use for almost half a century, there are still quite contradictory views about whether it is a reliable instrument, and if so, what it really measures. Thus, based on data from 39 female students, we first examined DMT inter-coder reliability by analyzing the agreement among trained judges in their coding of the same DMT protocols. Second, we constructed a "parallel" photographic picture that retained all structural characteristic of the original and analyzed DMT parallel-test reliability. Third, we examined the construct validity of the DMT by (a) employing three self-report defense-mechanism inventories and analyzing the intercorrelations between DMT defense scores and corresponding defenses in these instruments, (b) studying the relationships between DMT responses and scores on trait and state anxiety, and (c) relating DMT-defense scores to measures of self-esteem. The main results showed that the DMT can be coded with high reliability by trained coders, that the parallel-test reliability is unsatisfactory compared to traditional psychometric standards, that there is a certain generalizability in the number of perceptual distortions that people display from one picture to another, and that the construct validation provided meager empirical evidence for the conclusion that the DMT measures what it purports to measure, that is, psychological defense mechanisms.     

The Mosher Guilt Scales: a construct validity extension

The three subscales of the Mosher Guilt Scales (sex guilt, hostility guilt, and morality conscience guilt) and several personality and attitude measures were ad ministered to college subjects in an effort to examine the construct validity of the Mosher Guilt Scales. The variables that were compared with the guilt subscales were hostility, anxiety, religious orthodoxy, self-esteem, and the importance of religious and economic values in one's life. The results indicated that both the construct validity of the Mosher Guilt Scales and the need for the continued use of its three subscales were supported. Among the most crucial findings of the study were that both of the religiosity measures were positively correlated with all three guilt subscales, and that economic values were negatively correlated with both sex guilt and morality-conscience guilt.