A comparative investigation of seven indirect attitude measures

We compared the psychometric qualities of seven indirect attitude measures across three attitude domains (race, politics, and self-esteem) with a large sample (N?=?23,413). We compared the measures on internal consistency, sensitivity to known effects, relationships with indirect and direct measures of the same topic, the reliability and validity of single-category attitude measurement, their ability to detect meaningful variance among people with nonextreme attitudes, and their robustness to the exclusion of misbehaving or well-behaving participants. All seven indirect measures correlated with each other and with direct measures of the same topic. These relations were always weak for self-esteem, moderate for race, and strong for politics. This pattern suggests that some of the sources of variation in the reliability and predictive validity of the indirect measures is a function of the concepts rather than the methods. The Implicit Association Test (IAT) and Brief IAT (BIAT) showed the best overall psychometric quality, followed by the Go–No-Go association task, Single-Target IAT (ST-IAT), Affective Misattribution Procedure (AMP), Sorting Paired Features task, and Evaluative Priming. The AMP showed a steep decline in its psychometric qualities when people with extreme attitude scores were removed. Single-category attitude scores computed for the IAT and BIAT showed good relationships with other attitude measures but no evidence of discriminant validity between paired categories. The other measures, especially the AMP and ST-IAT, showed better evidence for discriminant validity. These results inform us on the validity of the measures as attitude assessments, but do not speak to the implicitness of the measured constructs.     

Validity of the Rey Visual Design Learning Test in primary and secondary school children.

The Rey Visual Design Learning Test (Rey, 1964, cited in Spreen & Strauss, 1991, Wilhelm, 2004) assesses immediate memory span, new learning, delayed recall and recognition for nonverbal material. Two studies are presented that focused on the construct validity of the RVDLT in primary and secondary school children. In the first study, primary school children performed the RVDLT and the Biber Figural Learning Test, as well as the WISC-R Block design Test, Boston Naming Test, and the Trailmaking Test, to assess discriminant validity. In the second study, the age range was expanded and the subtest Visual Reproductions of the Wechsler Memory Scale with a Delayed recall phase was used to assess the construct validity. A test for visual-motor integration and a test for attention, concentration, and speed of information processing were also added to complete the test battery for assessing discriminant validity. Moderate to high correlations were found between scores on the RVDLT and the tests used to assess construct validity. The correlational pattern of RVDLT scores and the scores on the discriminant tests is discussed.     

Assessment of Working Memory Capacity in Preschool Children Using the Missing Scan Task

The purpose of this study was to investigate the feasibility and validity of a modified version of Buschke's missing scan methodology, the Missing Scan Task (MST), to assess working memory capacity (WMC) and cognitive control processes in preschool children 3–6 years in age. Forty typically developing monolingual English‐speaking children between 36 and 84 months in age participated in the study. The children were tested on measures of WMC (MST), verbal and nonverbal memory (NEPSY Narrative Memory and Memory for Designs subtests), and language skills (Peabody Picture Vocabulary Test, fourth edition). Children showed increased working memory capacity scores with age, as measured by the MST, with significant differences between 3‐ and 5‐year‐olds and 3‐ and 6‐year‐olds. Significant correlations were also found between the MST and language and verbal and nonverbal memory scores. MST scores still remained significantly correlated with the other measures of memory even after age and global language were accounted for in a regression analysis, demonstrating that the MST captures unique variance related specifically to WMC and cognitive control processes used to retrieve and scan information in short‐term memory (STM). The results of this study demonstrate that the MST is a feasible and valid methodology for assessing WMC in preschool children as young 3 years of age. Copyright © 2014 John Wiley & Sons, Ltd.     

Measuring an Individual's Tendency to Take Risks: The Risk Propensity Scale1

A new, short, and easily administered Risk Propensity Scale (RPS) is introduced that measures general risk‐taking tendencies. This paper investigates the reliability and discriminant validity of the RPS. The RPS provided scores that yielded a good internal reliability coefficient and adequate test–retest reliability, and the scores correlated moderately to well with those of the Everyday Risk Inventory and the short Sensation‐Seeking Scale. The correlation with the scores from other scales (Need for Cognition scale, Need for Structure scale, and 2 self‐esteem scales) was low to moderate, indicating good discriminant validity. The findings are discussed in relation to risk‐perception research using gambling experiments and in relation to their usefulness for risky decision‐making research.     

The category test perseveration, loss of set, and memory scales: three new scales and their relationship to executive functioning measures

The Category Test (CT) is a neuropsychological measure that taps into multiple domains of complex reasoning but yields a single error score, limiting the use of the test. In this study, three new CT scales were developed to assess specific aspects of executive dysfunction: Perseveration, Failure to Maintain Cognitive Set, and Inability to Recall and Re-Initiate Past Behavior. The relationship of these scales to well-established neuropsychological measures was examined in head-injured individuals and schizophrenia patients. The CT Perseveration score was correlated with the Wisconsin Card Sorting Test (WCST) Perseverative Responses score, but also with measures from the Wechsler Memory Scale-Revised and the California Verbal Learning Test. The CT Memory score correlated with other memory measures, but also with the WCST Perseveration measure. Although future studies designed to test discriminant and convergent validity are warranted, these scales may be useful in determining specific aspects of impaired CT performance.     

Further validation of a measure of irrational belief

Malouff and Schutte (1986) developed a measure of irrational belief intended to be shorter and more content valid than other such measures and reported preliminary evidence of reliability and validity for the measure. The present two studies examined further the validity of the new measure. Study 1 produced evidence of construct validity in that a significant correlation was found between scores on the Malouff & Schutte measure and scores on a measure of hostility, which is a theoretically related construct. Study 2 produced evidence of construct validity in that scores on the Malouff & Schutte measure were found to be correlated with scores on two measures of theoretically related constructs: anxiety and irrational tendencies/beliefs. Study 2 also produced evidence of discriminant validity in that scores on the Malouff & Schutte measure were found to be significantly more highly correlated with scores on the more theoretically similar irrational tendencies/beliefs scale than with scores on the anxiety measure.     

The Femininity Ideology Scale: Factor Structure, Reliability, Convergent and Discriminant Validity, and Social Contextual Variation

This study reports on the psychometric properties of the Femininity Ideology Scale (FIS) from the responses of 407 undergraduate participants in the USA. Factor analysis supported the five factor structure. Cronbach alpha coefficients of the factors and total scale were adequate. Support for discriminant validity was found after examining the relationship between the FIS and the Bem Sex Role Inventory, which measures feminine traits. Support for convergent validity was found after examining, first, with the entire sample, the relationships between the FIS and the Male Role Norm Inventory, and second, with the female sample, the relationships between the FIS and the Feminist Identity Development Scale. We also found that FIS scores vary in relationship to the social contextual variables of race/ethnicity and sex.     

Validity of the SF-12 in a Canadian Old Order Mennonite Community

To assess the validity of the Physical and Mental Component Summary scores (PCS-12 and MCS-12) of the SF-12 Health Survey (SF-12) in an Old Order Mennonite (OOM) community in Ontario, Canada. Most SF-12 validation studies have focused on general populations or clinical groups. This paper adds to the SF-12 literature by validating the instrument in a minority population. Sixty percent of the adult OOM population (n?=?1,171) completed a survey which had the SF-12 embedded within it. The survey also included questions on health determinants and the prevalence of chronic conditions. Factor analysis was used to confirm the two-factor structure of the SF-12. Item-scale correlations were calculated to assess convergent and discriminant validity. PCS-12 and MCS-12 variability by known subgroups were also explored. Factor analysis confirmed the two-factor structure and hypothesized loadings on the latent physical and mental health factors. Item-scale correlations demonstrated satisfactory convergent and discriminant validity. SF-12 summary scores distinguished well, and in the expected manner, between groups of respondents for gender, age, income adequacy, marital status, self-reported health measures, and other health determinants such as coping, trust, social interaction, and spirituality. PCS-12 and MCS-12 scores were lower in those with various chronic conditions compared to those without.The SF-12 appears to be a valid instrument for measuring health status in this minority population. Future SF-12 studies in OOMs and other populations may benefit from using Version 2 of the SF-12, where the dichotomous questions have been replaced by questions offering respondents more choice.     

Individual Differences in Work Motivation: Further Explorations of a Trait Framework

Empirical evidence on the conceptual and construct validity of the motivational trait taxonomy proposed by Kanfer and Heggestad is presented. 228 adults completed a shortened form of the Motivational Trait Questionnaire (MTQ), along with a battery of personality and ability measures. Relationships of the MTQ with personality measures show evidence of convergent and discriminant validity for trait constructs of Personal Mastery, Competitive Excellence, and Motivation Related to Anxiety. In addition, MTQ scale scores were generally unrelated to composite measures of fluid and crystallised intelligence. Examination of age differences showed a pattern of developmental decline in the achievement trait complex, but not the anxiety complex.     

Construct validity of the relationship profile test: three-year retest reliability and links with core personality traits, object relations, and interpersonal problems

The Relationship Profile Test (RPT; Bornstein & Languirand, 2003) is a 30-item self-report measure of destructive overdependence, dysfunctional detachment, and healthy dependency. Previous research has shown that the 3 RPT subscales have adequate internal consistency, good retest reliability over 23 and 85 weeks, and good convergent and discriminant validity with respect to measures of attachment style, relatedness, gender role, self-concept, alexithymia, locus of control, need for approval, and life satisfaction. In this investigation, we assessed the 3-year retest reliability of RPT scores in a northeastern liberal arts college student sample (Study 1) and evaluated the convergent and discriminant validity of RPT scores in a southern university sample (Study 2). Results generally supported the long-term stability and convergent and discriminant validity of RPT scores but also pointed to some limitations of the measure. We discuss implications of these results and describe future research directions.     

Brief report: Relationship between performance testing and parent report of attention and executive functioning profiles in children following perinatal arterial ischemic stroke

Children with perinatal arterial ischemic stroke (PAIS) have increased rates of attention and executive functioning (EF) weaknesses. Research in other pediatric disorders has documented poor consistency between parent report of these skills and performance-based measures. We compared these data sources in children with PAIS. Forty full-term (≥37 weeks) children ages 3–16 (median = 7.2 years; 58% male) with PAIS completed neuropsychological testing and composite scores were created for seven attention and EF domains (Processing Speed; Attention; Working Memory; Verbal Retrieval; Inhibitory Control; Flexibility/Shifting; Planning). Parents completed “real-world” functioning questionnaires (ADHD Rating Scale-IV, BRIEF). Correlational analysis were used to compare parent and performance measures. Correlations between ADHD Rating Scale-IV scores and the performance-based Attention and Inhibition composite scores were nonsignificant. Significant negative correlations were found between the BRIEF GEC and performance-based Verbal Retrieval and Processing Speed composites, but remaining GEC/composite comparisons were nonsignificant. Analyses between parent report BRIEF index scores and the corresponding performance-based domain identified one significant negative correlation between the BRIEF Working Memory Index and the Working Memory composite score. While children with PAIS demonstrate difficulties in attention and EF on both parent report and performance measures, little significance was found in comparisons of these two types of measures. There may be several explanations for this dissociation: measures assessing different aspects of the same underlying construct; performance-based measures lacking ecological validity; and parents underestimating/underreporting their child’s deficits. Thus, multiple sources of informant and performance data are necessary to make more accurate conclusions about functioning in these domains.     

The problem of confounding social support and depressive symptoms: A brief report on a college sample

The problem of confounding social support and depressive symptoms was addressed by examining the convergent and discriminant validity of interview and questionnaire measures of social support and depression using the multitrait-multimethod matrix approach. Participants were 40 late-adolescent college students with half the sample selected on the basis of mild to moderate scores on self-reported depressive symptoms. Measures of depression displayed excellent convergent and discriminant validity, and measures of objective features of social networks were found to have moderate convergent and discriminant validity. However, the subjective measures of satisfaction with social support used were found to have neither adequate convergent nor discriminant validity. Implications for the conceptualization and assessment of social support are highlighted.     

Children's perceptions of parental behaviors

Children's perceptions of positive and negative parental behaviors were assessed using a newly-developed scale, the Parent Perception Inventory (PPI). Reliability and validity were examined across a sample of 75 children aged 5 to 13 using additional measures administered to the children and measures completed by their parents. The scale showed acceptable levels of internal consistency. No effects of children's age were apparent, but effects of the child's and parent's gender were found. Boys reported more positive parental behaviors, particularly for fathers, and children reported more negative (disciplinary) behaviors by mothers. PPI scores were predictably related to child's self-concept and behavior problems (convergent validity) and generally unrelated to measures of child's achievement (discriminant validity). As predicted by family systems theory, children from nondistressed families viewed their parents as behaving more similarly on the PPI than did children from distressed families.     

The Value of Certain Non-Intellectual Factors for Direct and Differential Prediction of Academic Success

Summary

To examine the convergent and discriminant validity of an attitudinal questionnaire measure of traditionalism-modernism in Thai exchange students, questionnaire scores were correlated with self and peer measures of traditionalism-modernism and with a measure of “culture-shock.” For the latter, it was anticipated that high scores on modernism would inversely correlate with culture-shock scores. Results indicated that the questionnaire measures were positively correlated with self and peer measures at significant levels; however, the relationship was not very substantial. Thus, there appears to be only a tenuous degree of convergent validity for questionnaire measures of traditionalism-modernism. The results further indicate a marginal amount of discriminant validity as measured by the relationship between the traditionalism-modernism questionnaire and the culture-shock questionnaire. Caution was suggested in using unvalidated attitudinal questionnaire measures of traditionalism-modernism, and the need for recognizing the multidimensional rather than unidimensional nature of traditionalism-modernism as a personality characteristic was pointed out.     

Validation of a measure of perfectionism

This article describes perfectionism, or the holding of and striving for unrealistically high standards, and presents two studies undertaken to investigate the convergent, discriminant, and predictive validity of the Perfectionism Scale (PS; Burns, 1980). College students in the first study completed the PS, several other measures of high standards, and measures of constructs that, conceptually, are differentially related to perfectionism. Correlational analyses indicated that the Perfectionism Scale has convergent and discriminant validity and seems to measure self-oriented perfectionism. The second study attempted to determine the predictive validity of the PS by testing a vulnerability model of subclinical depression outlined in Hewitt and Dyck (1986). PS scores were used to predict depressed mood changes in female college students following failure on important and unimportant tasks. As expected, the results indicated that perfectionism interacted with failure on important versus unimportant tasks to produce dysphoric mood. Evidence for the predictive validity of the PS was thus shown. Several directions for future research are discussed.     

The Sexual Compulsivity Scale: further development and use with HIV-positive persons

We examined the reliability and validity of the Sexual Compulsivity Scale for use in assessing HIV-positive men and women. Measures collected from 287 men and women recruited from the community, the majority of whom were African American and over the age of 30, showed that the Sexual Compulsivity Scale was reliable for men (alpha = .89) and women (alpha = .92). Correlations with measures of sexual behaviors and numbers of sex partners supported the concurrent validity of the Sexual Compulsivity Scale for men and women. Results of discriminant function analyses that included participant age, use of nonalcohol drugs, the Sexual Compulsivity Scale, and scores on measures of trait anxiety, obsessive-compulsiveness, future pessimism, cognitive depression, and borderline personality characteristics showed that sexual compulsivity clearly discriminated between persons with 1 or no sex partners and persons with multiple partners in the past 3 months, for both men and women, suggesting evidence for criterion-related validity. Associations between sexual compulsivity scores and other markers of psychopathology showed different patterns for men and women; sexual compulsivity was associated with indexes of psychopathology in men but not in women. We conclude that the Sexual Compulsivity Scale is reliable and valid in assessing men and women infected with HIV, although sexual compulsivity may present differently between genders in relation to other forms of psychopathology.     

Psychometric analysis of the Revised Memory and Behavior Problems Checklist: factor structure of occurrence and reaction ratings

A modified version of the Revised Memory and Behavior Problems Checklist (RMBPC; L. Teri et al., 1992) was administered across 6 different sites to 1,229 family caregivers of community-dwelling adults with dementia. The total sample was divided randomly into 2 subsamples. Principal components analyses on occurrence responses and reaction ratings from the first subsample resulted in a 3-factor solution that closely resembled the originally proposed dimensions (memory-related problems, disruptive behaviors, and depression). Confirmatory factor analyses on data from the second subsample indicated adequate fit for the 3-factor model. Correlations with other caregiver and care-recipient measures supported the convergent and discriminant validity of the RMBPC measures. In addition, female caregivers and White caregivers reported more problems, on average, than male caregivers and African American caregivers, respectively.     

Convergent Validity of the Early Memory Index in Two Primary Care Samples

Karliner, Westrich, Shedler, and Mayman (1996) developed the Early Memory Index (EMI) to assess mental health, narrative coherence, and traumatic experiences in reports of early memories. We assessed the convergent validity of EMI scales with data from 103 women from an urban primary care clinic (Study 1) and data from 48 women and 24 men from a suburban primary care clinic (Study 2). Patients provided early memory narratives and completed self-report measures of psychopathology, trauma, and health care utilization. In both studies, lower scores on the Mental Health scale and higher scores on the Traumatic Experiences scale were related to higher scores on measures of psychopathology and childhood trauma. Less consistent associations were found between the Mental Health and Traumatic Experiences scores and measures of health care utilization. The Narrative Coherence scale showed inconsistent relationships across measures in both samples. In analyses assessing the overall fit between hypothesized and actual correlations between EMI scores and measures of psychopathology, severity of trauma symptoms, and health care utilization, the Mental Health scale of the EMI demonstrated stronger convergent validity than the EMI Traumatic Experiences scale. The results provide support for the convergent validity of the Mental Health scale of the EMI.     

Spanish Adaptation of the Working Alliance Inventory-Short (WAI-S)

The goal of our research was to adapt the short forms of the Working Alliance Inventory into the Spanish language for patients and therapists (WAI-S-P and WAI-S-T). The psychometric properties of scores from these measurement instruments were evaluated in Spanish outpatients with depressive disorders and their therapists. The scores of both measures exhibited excellent reliability in terms of internal consistency and excellent convergent validity. Their discriminant validity exhibited some limitations, particularly when the scores of both short measures correlated with those of two empathy measures. Regarding predictive validity, the scores of the overall WAI-S-P and WAI-S-T significantly correlated with residual gain scores of patients in the Beck Depression Inventory (BDI) after the tenth psychotherapy session. Additionally, the overall WAI-S-T scores explained a moderate percentage of the variance in patient BDI score changes. These results are satisfactory and similar to those found in the studies that have utilized the respective original versions of WAI-S in English.     

A Comparison of Single and Multi-Test Working Memory Assessments in Predicting Academic Achievement in Children

Children assessed as having low working memory capacity have also been shown to perform more poorly than their same-aged peers in measures of academic achievement. Early detection of working memory problems is, therefore, an important first step in reducing the impact of a working memory deficit on the development of academic skills. In this study, we compared a single-test assessment, the Working Memory Power Test for Children (WMPT) and a multi-test assessment, the Automated Working Memory Assessment (AWMA), in their ability to predict academic achievement in reading, numeracy, and spelling. A total of 132 Australian school children (mean age 9 years, 9 months) participated in the research. Strong positive correlations between the WMPT and AWMA total scores were found, indicating good convergent validity of the single and multi-test measures. WMPT scores correlated with each of the four AWMA subtests designed to assess verbal and visuospatial short-term and working memory. WMPT and AWMA scores separately predicted performance on Word Reading, Numerical Operations, and Spelling. Compared with either measure alone, the WMPT and the AWMA in combination predicted more of the variance in Word Reading and Numerical Operations, but not in Spelling. Theoretical and practical implications of these findings are discussed.