The Role of Range Restriction and Criterion Contamination in Assessing Differential Validity by Race/Ethnicity

Purpose

Berry et al.’s (J Appl Psychol 96:881–906, 2011) meta-analysis of cognitive ability test validity data across employment, college admissions, and military domains demonstrated that validity is lower for Black and Hispanic subgroups than for Asian and White subgroups. However, Berry et al. relied on observed test-criterion correlations and it is therefore not clear whether validity differences generalize beyond observed validities. The present study investigates the roles that range restriction and criterion contamination play in differential validity.

Design/Methodology/Approach

A large dataset (N > 140,000) containing SAT scores and college grades of Asian, Black, Hispanic, and White test takers was used. Within-race corrections for multivariate range restriction were applied. Differential validity analyses were carried out using freshman GPA versus individual course grades as criteria to control for the contaminating influence of individual differences between students in course choice.

Findings

Observed validities underestimated the magnitude of validity differences between subgroups relative to when range restriction and criterion contamination were controlled. Analyses also demonstrate that validity differences would translate to larger regression slope differences (i.e., differential prediction).

Implications

Subgroup differences in range restriction and/or individual differences in course choice cannot account for lower validity of the SAT for Black and Hispanic subgroups. Controlling for these factors increased subgroup validity differences. Future research must look to other explanations for subgroup validity differences.

Originality

The present study is the first differential validity study to simultaneously control for range restriction and individual differences in course choice, and answers a call to investigate potential causes of differential validity.     

Working with incest survivors

The purpose of this paper is to convey more widely the existence of this kind of specialist group in the NHS. We also wish to show some of the advantages and disadvantages in setting up such a group to other professionals who may be considering the possibility of starting an incest-survivors group. The paper describes the group which ran at the Psychiatric Day Hospital at the Whittington Hospital for forty weeks: how we adopted the group structure; some of the problems we faced; and some of the emotional issues generated in therapists and patients. Conclusions are drawn about the usefulness of such a group.     

Effects of active information processing on the understanding of risk information

Two experiments investigated effects of active processing of risk information on participants' understanding and judgments. It was hypothesized that more active processing would lead to better understanding and differences in affective judgments (e.g. increased satisfaction and reduced perceived risk to health). In both experiments participants were given a written scenario about their being prescribed a fictitious medication. This medication was said to cause side effects in 2% of people who took it. Before answering a series of written questions, participants in the active conditions of both experiments were asked to carry out a reflective task (portraying the size of risk on a bar chart in Experiment 1 and answering a reflective question in Experiment 2). The results showed that active participants rated the likelihood of experiencing possible side effects significantly lower than passive participants (Experiment 1), and that active participants were significantly more satisfied with the information and judged perceived risk to health from taking the medication significantly lower than passive participants (Experiment 2). In both experiments, active participants were significantly more correct in their probability and frequency estimates. The studies demonstrate that active processing of risk information leads to improved understanding of the information given. This has important implications for risk communication. In the context of health, better understanding should lead to improved decision‐making and health outcomes. Copyright © 2004 John Wiley & Sons, Ltd.     

Immigrant Youth: Acculturation, Identity, and Adaptation

Cet article présente plusieurs des principaux résultats d’une grande étude internationale sur l’acculturation et l’adaptation de jeunes immigrés (âgés de 13 à 18 ans) qui se sont implantés dans treize pays (N = 5,366); il y est adjoint un échantillon de jeunes nationaux (N = 2,631). La recherche s’appuyait sur trois questions centrales: comment les jeunes migrants gèrent‐ils le processus d’acculturation? Comment parviennent‐ils à s’adapter? Et y a‐t‐il un lien manifeste entre la forme d’acculturation et le succès de l’adaptation? L’analyse en clusters déboucha sur quatre profils d’acculturation: intégrateur, ethnique, national et diffus. L’analyse factorielle de cinq variables d’adaptation mit en évidence deux types d’adaptation: psychologique et socioculturel. Il existe une forte relation entre la façon dont les jeunes s’acculturent et leur adaptation: ceux qui présentent un profil intégrateur bénéficient des meilleurs indicateurs d’adaptations psychologique et socioculturelle alors que ceux souffrant d’un profil diffus ont les pires. Entre les deux, le profil ethnique présente une adaptation psychologique relativement bonne et une adaptation socioculturelle plutôt pauvre, tandis que le profil national a une adaptation psychologique relativement pauvre et une adaptation socioculturelle légèrement négative. Cette configuration de résultats fut en grande partie retrouvée à travers une modélisation en équation structurelle. Les conséquences pour l’implantation des jeunes immigrés sont claires: ils devraient être encouragés à préserver l’appartenance à leur culture d’origine tout en établissant des liens étroits avec la société d’accueil. This paper reports some of the main findings from a large international study of the acculturation and adaptation of immigrant youth (aged 13 to 18 years) who are settled in 13 societies (N= 5,366), as well as a sample of national youth (N= 2,631). The study was guided by three core questions: How do immigrant youth deal with the process of acculturation? How well do they adapt? Are there important relationships between how they acculturate and how well they adapt? Cluster analysis produced four distinct acculturation profiles: integration, ethnic, national, and diffuse. Factor analysis of five adaptation variables revealed two distinct forms of adaptation: psychological and sociocultural. There were substantial relationships between how youth acculturate and how well they adapt: those with an integration profile had the best psychological and sociocultural adaptation outcomes, while those with a diffuse profile had the worst; in between, those with an ethnic profile had moderately good psychological adaptation but poorer sociocultural adaptation, while those with a national profile had moderately poor psychological adaptation, and slightly negative sociocultural adaptation. This pattern of results was largely replicated using structural equation modeling. Implications for the settlement of immigrant youth are clear: youth should be encouraged to retain both a sense of their own heritage cultural identity, while establishing close ties with the larger national society.     

Implicit memory and consumer choice: the mediating role of brand familiarity

Two experiments investigated the influence of implicit memory on consumer choice for brands with varying levels of familiarity. Priming was measured using a consideration‐choice task, developed by Coates, Butler and Berry ( 2004 ). Experiment 1 employed a coupon‐rating task at encoding that required participants to meaningfully process individual brand names, to assess whether priming could affect participants' final (preferred) choices for familiar brands. Experiment 2 used this same method to assess the impact of implicit memory on consideration and choice for unknown and leader brands, presented in conjunction with familiar competitors. Significant priming was obtained in both experiments, and was shown to directly influence final choice in the case of familiar and highly familiar leader brands. Moreover, it was shown that a single prior exposure could lead participants to consider buying an unknown, and indeed fictitious, brand. Copyright © 2006 John Wiley & Sons, Ltd.     

Character mediation of story generation via protagonist insertion

The current study set out to examine how the presence or absence of depicted characters in visual narratives influences the degree of character-related content in improvised stories. The experiment consisted of trials of oral storytelling that were prompted by wordless comics. The degree of character content in the storylines was varied from being character-based—showing people engaging in social interactions—to being characterless, for example scenes depicting natural phenomena. An intermediate “character-implied” condition was also investigated, exemplified by the scene of a tornado passing through a town, where no people were depicted but in which their presence was strongly suggested. Linguistic content analysis of 472 stories demonstrated indistinguishable use of third-person pronouns (she/he) between character-implied and character-containing scenarios. An analysis of character presence demonstrated that storytellers inserted protagonists into the character-implied stories as vehicles for the actions taking place. This phenomenon reveals the character-driven nature of story creation.     

A single-system account of the relationship between priming, recognition, and fluency

A single-system computational model of priming and recognition was applied to studies that have looked at the relationship between priming, recognition, and fluency in continuous identification paradigms. The model was applied to 3 findings that have been interpreted as evidence for a multiple-systems account: (a) priming can occur for items not recognized; (b) the pattern of identification reaction times (RTs) to hits, misses, correct rejections, and false alarms can change as a function of recognition performance; and (c) fluency effects (shorter RTs to words judged old vs. judged new) and priming effects (shorter RTs to old vs. new words) can be observed in amnesic patients at levels comparable with healthy adults despite impaired or near-chance recognition. The authors' simulations suggest, contrary to previous interpretations, that these results are consistent with a single-system account.     

Psychometric properties of scores on three Black racial identity scales

In this study, we examined the internal consistency and the structural validity of scores on the African Self-Consciousness Scale (ASCS), the Multidimensional Inventory of Black Identity (MIBI), and the Cross Racial Identity Scale (CRIS). Participants consisted of 225 African American college students--75 attending predominantly White institutions (PWIs) and 150 attending historically Black colleges and universities (HBCUs). Internal consistency estimates were above .60 for scores on one ASCS subscale, six MIBI subscales, and six CRIS subscales. Exploratory factor analytic procedures supported a two-factor structure for ASCS scores, a five-factor structure for MIBI scores, and a six-factor structure for CRIS scores. Implications for Black racial identity and scale development are discussed.     

Implicit memory: a prime example for brand consideration and choice

Three experiments investigated the influence of implicit memory for familiar brand names on consumer choice. Priming was measured using modified preference judgment tasks that comprised both brand consideration and choice components. Experiment 1 used a ‘complex choice task’ where consideration and choice stages were characterized as acting in sequence. Experiment 2 explored a different formulation whereby consideration and choice were assumed to act in parallel. Both experiments demonstrated that priming had an influence on brand consideration but not on final or preferred choice. Finally, Experiment 3 replicated and extended these findings under more realistic conditions where participants actually received some of the products that they selected. Overall, the experiments suggested that for many decisions involving the consideration of familiar brands prior to choice, previous exposure to brand names can increase the likelihood that they will enter the consumers' consideration set. However, the advantage does not appear to extend to choice itself. Copyright © 2004 John Wiley & Sons, Ltd.