Comparisons of the Psychometric characteristics of the adaptive behavior inventory for children for different subgroups of children

Psychometric characteristics of the Adaptive Behavior Inventory for Children (ABIC) are analyzed through five statistical procedures (internal consistency, item difficulty, correlations of item-total correlations, concurrent validity, and construct validity) using data on 436 elementary age children from three racial-ethnic and two social class groups. Data from these five statistical procedures are reported for nine demographic characteristics: children's race, social class, sex, age, birth order, health, family size, family structure, and urban acculturation. Few systematic differences are apparent on internal consistency, correlation of item-total correlations, and construct validity. Some differences are apparent on item difficulty and concurrent validity. On item difficulty the ABIC scores are higher for middle-SES, older, first- or second-born children, and from families whose structures are more typical. Regarding concurrent validity, lower correlations are noted for Mexican American and Black, for more healthy, and for less acculturated children. ABIC-achievement correlations generally are too low to be of practical value. The results are interpreted in terms of possible test bias on the ABIC.     

More than g: Evidence for the Incremental Validity of Performance-Based Assessments for Predicting Training Performance

Past research has consistently shown that tests measuring specific cognitive abilities provide little if any incremental validity over tests of general mental ability when predicting performance on the job. In this study, we suggest that the seeming lack of incremental validity may have been due to the type of content that has traditionally been assessed. Therefore, we hypothesised that incremental validity can be obtained using specific cognitive abilities that are less highly correlated with g and are matched to the tasks performed on the job. To test this, we examined a recently developed performance-based measure that assesses a number of cognitive abilities related to training performance. In a sample of 310 US Navy student pilots, results indicated that performance-based scores added sizeable incremental validity to a measure of g. The significant increases in R² ranged from .08 to .10 across criteria. Similar results were obtained after correcting correlations for range restriction, though the magnitude of incremental validity was slightly smaller (ΔR² ranged from .05 to .07).     

The Situational Specificity of Validities: Correcting for Statistical Artifacts Does Not Always Reduce the Trans-Situational Variability of Correlation Coefficients

Validity generalization research suggests that much of the variability in validity coefficients is due to statistical artifacts, such as sampling error. Correcting for these artifacts usually reduces the trans-situational variability in validity coefficients, but the reverse can happen. Conditions under which corrections for statistical artifacts can increase the variability in validity coefficients are described, examples of meta-analyses reporting larger corrected than observed variance in validity are cited, and implications for the situational specificity of validity coefficients are discussed. In general, the true variability in validity coefficients based on large samples is often larger than the observed variability in test validities.     

Choosing the best method for local validity estimation: relative accuracy of meta-analysis versus a local study versus Bayes-analysis

This study assessed the relative accuracy of 3 techniques--local validity studies, meta-analysis, and Bayesian analysis--for estimating test validity, incremental validity, and adverse impact in the local selection context. Bayes-analysis involves combining a local study with nonlocal (meta-analytic) validity data. Using tests of cognitive ability and personality (conscientiousness) as predictors, an empirically driven selection scenario illustrates conditions in which each of the 3 estimation techniques performs best. General recommendations are offered for how to estimate local parameters, based on true population variability and the number of studies in the meta-analytic prior. Benefits of empirical Bayesian analysis for personnel selection are demonstrated, and equations are derived to help guide the choice of a local validity technique (i.e., meta-analysis vs. local study vs. Bayes-analysis).     

A depressive symptom scale for the California Psychological Inventory: construct validation of the CPI-D

To facilitate life span research on depressive symptomatology, a depressive symptom scale for the California Psychological Inventory (CPI) is needed. The authors constructed such a scale (the CPI-D) and compared its psychometric properties with 2 widely used self-report depression scales: the Beck Depression Inventory and the Center for Epidemiological Studies Depression Scale. Construct validity of the CPI-D was examined in 3 studies. Study 1 established content validity, classifying CPI-D items into Diagnostic and Statistical Manual of Mental Disorders-Fourth Edition depressive symptoms. Study 2 used 3 large samples to gather evidence for reliability and validity: correlational analyses demonstrated alpha reliability and convergent and discriminant validity; factor analysis provided evidence for discriminant validity with anxiety; and regression analyses demonstrated comparative validity with existing standard PI scales. Study 3 used clinician ratings of depression and anxiety as criteria for external validity.     

Initial examination of the validity and reliability of the female photographic figure rating scale for body image assessment

The present study reports on the reliability and validity of an improved body image assessment scale, namely the female Photographic Figure Rating Scale (PFRS). This scale consists of ten photographic images of real women varying in body mass index (BMI) from emaciated to obese. The PFRS was designed to overcome many of the limitations associated with line-drawn figures that are currently in use, including a lack of realism and poor ecological validity. Based on a sample of 208 adult women, the results of the present study showed that the PFRS had good validity in that all images were correctly rank-ordered by BMI. In addition, construct validity was supported by the finding that current self-ratings of body size based on the PFRS were significantly correlated with participants’ BMI and that body dissatisfaction was negatively correlated with positive body image. Finally, test–retest reliabilities showed that the PFRS remained stable after a three-week interval. The discussion focuses on the strengths and limitations of the PFRS in relation to existing scales used in body image assessment.     

Faithfulness for naive validity

Nontransitive responses to the validity Curry paradox face a dilemma that was recently formulated by Barrio, Rosenblatt and Tajer. It seems that, in the nontransitive logic ST enriched with a validity predicate, either you cannot prove that all derivable metarules preserve validity, or you can prove that instances of Cut that are not admissible in the logic preserve validity. I respond on behalf of the nontransitive approach. The paper argues, first, that we should reject the detachment principle for naive validity. Secondly, I show how to add a validity predicate to ST while avoiding the dilemma.

     

Comparison of Criterion-Related Validity Coefficients for the Mini-Markers and Goldberg's Markers of the Big Five Personality Factors

Saucier (1994) developed a shorter version of Goldberg's (1992) 100 Big Five markers, labeled the Mini-Markers. Although the Mini-Markers have been shown to have a fairly robust factor structure and acceptable internal consistency estimates, the criterion-related validity of the abbreviated inventory has not been demonstrated. In this study, we compared criterion-related validity estimates between the Mini-Markers and Goldberg's markers using several academic criteria. Results indicate that the criterion-related validity estimates were comparable. It is concluded that, in the context of this study, the Mini-Markers provide a viable and less time consuming alternative to Goldberg's full measure for researchers who are faced with time constraints or limited questionnaire space.     

Cross-modal validation of the Leipzig Affective Norms for German (LANG)

Affective stimuli are increasingly used in emotion research. Typically, stimuli are selected from databases providing affective norms. The validity of these norms is a critical factor with regard to the applicability of the stimuli for emotion research. We therefore probed the validity of the Leipzig Affective Norms for German (LANG) by correlating valence and arousal ratings across different sensory modalities. A sample of 120 words was selected from the LANG database, and auditory recordings of these words were obtained from two professional actors. The auditory stimuli were then rated again for valence and arousal. This cross-modal validation approach yielded very high correlations between auditory and visual ratings (>.95). These data confirm the strong validity of the Leipzig Affective Norms for German and encourage their use in emotion research.     

Ecological validity and cultural sensitivity for outcome research: Issues for the cultural adaptation and development of psychosocial treatments with Hispanics

This article has two objectives. The first is to provide a culturally sensitive perspective to treatment outcome research as a resource to augment the ecological validity of treatment research. The relationships between external validity, ecological validity, and culturally sensitive research are reviewed. The second objective is to present a preliminary framework for culturally sensitive interventions that strengthen ecological validity for treatment outcome research. The framework, consisting of eight dimensions of treatment interventions (language, persons, metaphors, content, concepts, goals, methods, and context) can serve as a guide for developing culturally sensitive treatments and adapting existing psychosocial treatments to specific ethnic minority groups. Examples of culturally sensitive elements for each dimension of the intervention are offered. Although the focus of the article is on Hispanic populations, the framework may be valuable to other ethnic and minority groups.     

Research Validity Scales for the NEO-PI-R: Additional Evidence for Reliability and Validity

We examined the reliability and validity of the research validity scales (Schinka, Kinder, & Kremer, 1997) for the NEO-Personality Inventory-Revised (NEO-PI-R) in a clinical sample. The Negative Presentation Management (NPM) and Positive Presentation Management (PPM) scales were found to have satisfactory internal consistency reliability. Support for the validity of these scales was provided by the pattern of convergent and discriminant correlations with respective Personality Assessment Inventory (PAI) validity scales. Finally, PAI profiles of individuals with invalid NPM scores were found to differ significantly from those with valid NPM scores. Comparisons of the invalid profiles with profiles from other clinical samples provided additional support for the use of the NPM scale as a measure of negative impression management.     

Longitudinal validity of the Miller Assessment for Preschoolers: study II

The classificational accuracy of the Miller Assessment for Preschoolers was examined in relation to intelligence and achievement measures assessed four years later. Specifically, the test's predictive validity was evaluated using the recommended 5% (Refer) and 25% cut-offs (Watch). The results' implications for decision strategies in research on validity for preschool screening instruments are discussed.     

Research Validity Scales for the NEO-PI-R: additional evidence for reliability and validity

We examined the reliability and validity of the research validity scales (Schinka, Kinder, & Kremer, 1997) for the NEO-Personality Inventory-Revised (NEO-PI-R) in a clinical sample. The Negative Presentation Management (NPM) and Positive Presentation Management (PPM) scales were found to have satisfactory internal consistency reliability. Support for the validity of these scales was provided by the pattern of convergent and discriminant correlations with respective Personality Assessment Inventory (PAI) validity scales. Finally, PAI profiles of individuals with invalid NPM scores were found to differ significantly from those with valid NPM scores. Comparisons of the invalid profiles with profiles from other clinical samples provided additional support for the use of the NPM scale as a measure of negative impression management.     

A new frame for frame-of-reference training: enhancing the construct validity of assessment centers

The authors undertook a comprehensive examination of the construct validity of an assessment center in this study by (a) gathering many different types of evidence to evaluate the strength of the inference between predictor measures and constructs (e.g., reliability, accuracy, convergent and discriminant relationships), (b) introducing a theoretically relevant intervention (frame-of-reference [FOR] training) aimed at improving construct validity, and (c) examining the effect of this intervention on criterion-related validity (something heretofore unexamined in the assessment center literature). Results from 58 assessees and 122 assessors suggested that FOR training was effective at improving the reliability, accuracy, convergent and discriminant validity, and criterion-related validity of assessment center ratings. Findings are discussed in terms of implications and future directions for both FOR training and assessment center practice.     

The validity of the five-factor model prototypes for personality disorders in two clinical samples

The authors examined the validity of D. R. Lynam and T. A. Widiger's (2001) prototypes for personality disorders (PDs) derived from the facets of the 5-factor model (FFM) of personality in 2 clinical samples. In the 1st sample (N = 94), there was good agreement between the prototypes generated by experts and the profiles reported by patients. These FFM PD similarity scores also demonstrated good convergent and discriminant validity with results from a semistructured interview and a self-report measure of Axis II pathology. In the 2nd sample (N = 132), the FFM PD similarity scores demonstrated excellent longitudinal stability and good predictive validity with regard to consensus ratings of PD features. The implications of these findings are discussed.     

Validation of the reasons for living inventory in general and delinquent adolescent samples

Two studies are reported that discuss the validation of an adult suicide prediction questionnaire for use with adolescents. The Reasons for Living Inventory (RFL; Linehan, Goodstein, Nielsen, & Chiles, 1983) was slightly modified and administered to two samples of adolescents: one from a general high school population and one from a population of juvenile delinquents receiving psychological treatment in a correctional facility. As with adults, adolescents who reported more reasons for staying alive were less apt to report past or recent suicidal thoughts or behaviors. Evidence of convergent validity emerged via correlations of RFL subscales with depression, hopelessness, and other suicide inventories. Evidence of discriminant validity emerged in that correlations with social desirability were not large. Evidence of construct validity emerged in that the RFL subscales related to suicidal thoughts and behaviors over and above depression and hopelessness. Differences between general and delinquent adolescents' reasons for living are discussed.Special gratitude is due to the Indiana Department of Corrections and the Penn-Harris-Madison Public School System for their cooperation and assistance in data collection for this project.     

大学生的恋爱宽恕:问卷编制与特点研究

为编制大学生恋爱宽恕问卷并对大学生恋爱宽恕的特点进行研究,采用自编初始问卷对上海某高校的213名在校大学生进行预测,利用完善后的正式问卷对上海和南京两地的556名在校大学生展开正式施测,通过项目分析、探索性因素分析、相关分析、信效度分析等方法对数据进行处理,并利用编制的问卷对大学生的恋爱宽恕特点进行研究。结果显示:(1)编制的《大学生恋爱宽恕问卷》包含报复、回避、宽恕和消极沉思四个维度,可以解释方差总变异的69.08%;(2)内部一致性系数、分半信度、重测信度、结构效度和外部效度均显示编制的问卷具有良好的信效度指标;(3)编制的问卷能够较好地契合宽恕的定义;(4)大学生恋爱宽恕存在性别差异,其中女大学生的宽恕倾向高于男生;(5)面对恋爱中的伤害,中国大学生更多地采用消极深思的应对方式,而较少采用报复的方式。可见,大学生恋爱宽恕问卷信效度均达到了测量学的要求,中国大学生的恋爱宽恕与西方有所不同。     

Detection of deception on the Schedule for Nonadaptive and Adaptive Personality: validation of the validity scales

This study used a simulation design to investigate the validity scales of the Schedule for Nonadaptive and Adaptive Personality (SNAP). Undergraduates (N=192) were randomly assigned to two positive distortion (PD) groups, two negative distortion (ND) groups, and a control group. Controls responded normally, whereas the deception groups responded according to assigned characters. Preliminary analyses indicated no significant differences within distortion valence; thus, the groups were collapsed into single PD (n=76), ND (n=79), and control groups (n=37). Mean-level analyses revealed that, consistent with previous studies, ND profiles are easier to detect than PD profiles. Cutoff scores were suggested, and the classification accuracy of these scores converged with the results of several discriminant function analyses to indicate that Rare Virtues and Deviance predict group membership at least as well as MMPI-2 validity scales. Structural analyses revealed that two moderately correlated factors-positive distortion and negative distortion-underlie scores on these validity scales.     

An extension of construct validity for personality scales using twin-based criteria

A twin-based analysis of personality inventory scales yields information relevant to construct validity. If scales validly measure dimensions influenced developmentally either by environmental factors common to cotwins or by genetic similarities, these influences should be apparent in patterns of intraclass correlations and within-pair variance ratios for monozygotic and dizygotic pairs. Criteria for construct validity derived from adolescent twin statistics are illustrated with Wiggins' MMPI Content Scales. A type of discriminant validity indicates that some scales are not distinct in terms of the influences of familial similarity. Sex differences are examined.