Cognitive Tests Used in Selection Can Have Content Validity as Well as Criterion Validity: A broader research review and implications for practice

Many industrial/organizational (I/O) psychologists, both academics and practitioners, believe that the content validity model is not appropriate for cognitive ability measures used in personnel selection. They believe that cognitive tests can have criterion validity and construct validity but not content validity. Based on a review of the broader differential psychology research literature on cognitive skills, aptitudes, and abilities, this article demonstrates that with the proper content validity procedures, cognitive ability measures, including, ultimately, some de facto measures of general cognitive ability, can have content validity in addition to criterion and construct validity. Finally, the article considers, critiques, and refutes the specific arguments contending that content validity is inappropriate for use with cognitive skills and abilities. These research facts have implications for I/O practice, professional standards, and legal defensibility of selection programs.     

Cognitive Abilities As Expressions Of Three "Ways Of Knowing"

Factor analytic studies suggest that there are six replicable second order cognitive factors. These six factors lend themselves to being interpreted as aspects of Royce's (1964) three "ways of knowing." This view provides a unified explanation of the second and third order factors. We hypothesize that each second order factor represents either the number of cognitive schemata of a particular type that a person possesses or the quality of these schemata, and the types of schemata are linked to "ways of knowing." The division of second order factors into qualitative and quantitative aspects, with the qualitative aspects being more subject to deterioration with age, and the quantitative aspects more trainable and subject to personality influence, provides an avenue for linking cognitive abilities to the other personality traits. The theory also resolves several theoretical problems concerning cognitive abilities, including distinguishing aptitudes from achievements, measuring creativity, and determining the relationship between rote memory and intelligence.     

The utility of visuospatial mnemonics is dependent on visuospatial aptitudes

Classic studies in cognition have demonstrated that the use of appropriate memory mnemonics can reliably increase recall performance. However, is the facilitative effect of mnemonics consistent across all individuals? As some mnemonics explicitly contain a large visuospatial component, does normal variance in visuospatial aptitudes predict the effectiveness of such strategy usage? To explore this question, participants who varied in visuospatial ability were asked to recall several lists of words, and either did or did not use a visuospatial mnemonic. Results indicated that effective mnemonic usage was directly dependent on participants' visuospatial ability, and those lower in visuospatial aptitudes actually produced lower recall performance when asked to use such a mnemonic. Similarly, those lower in visuospatial aptitude also reported that mnemonic usage made the task significantly more difficult. These findings suggest that individual differences in relevant cognitive abilities can influence the effectiveness of memory strategies commonly used to enhance recall.     

Cognitive Resources and Leadership Performance

Le rôle et la fonction des ressources cognitives que sont les aptitudes intellectuelles, l'expérience et les connaissances spécialisées ont longtemps été une énigme tacitement ignorée dans la théorie du leadership. En pratique, tout protocole de sélection ou de promotion d'un manager ou d'un leader évalue soigneusement les aptitudes intellectuelles du candidat, ses connaissances et son expérience professionnelle. Pourtant, rien de tout cela n'est en forte corrélation, voire tout simplement en corrélation, avec les performances de leader. Cet article, qui s'appuie sur la théorie des ressources cognitives (CRT), fait la synthèse aussi bien des recherches récentes que de nouveaux travaux qui éclairent le rôle des ressources cognitives dans le phénomène de leadership, et en tire des indications permettant d'améliorer les performances des leaders.
The role and function of such cognitive resources as intellectual abilities, experience, and expertise, have presented a long-standing but tacitly ignored enigma in leadership theory. Practically all managerial and leadership selection and promotion processes carefully weigh the leader's intellectual abilities, expertise, and job-related experience. However, none of these correlates highly, if at all, with leadership performance. This paper, based on Cognitive Resource Theory (CRT), summarises recent research, as well as new findings, that clarifies the role of cognitive resources in the leadership process, and spells out implications for more effective leadership performance.     

Cognitive ability influences on written expression: Evidence for developmental and sex-based differences in school-age children

Some studies have demonstrated that the Cattell-Horn-Carroll (CHC) cognitive abilities influence writing; however, little research has investigated whether CHC cognitive abilities influence writing the same way for males and females across grades. We used multiple group structural equation models to investigate whether CHC cognitive ability influences on written expression differed between grades or sex using the Kaufman Assessment Battery for Children, Second Edition and the Kaufman Tests of Educational Achievement, Second Edition co-normed standardization sample data (N = 2117). After testing for consistent measurement of cognitive abilities across grades and sex, we tested whether the cognitive ability influences on written expression were moderated by grade level or sex. An important developmental shift was observed equally across sex groups: Learning Efficiency (Gl) influences decreased whereas Crystallized Ability (Gc) influences increased after fourth grade. Further, Short-Term Memory (Gsm) and Retrieval Fluency (Gr) influences on written expression depended on sex at grades 1–4, with larger Gr influences for females and larger Gsm influences for males. We internally replicated our main findings using two different cognitive explanatory models, adding further support for the developmental and sex-based differential cognitive ability influences on writing. Explanatory cognitive models of writing need to incorporate development, and possibly, sex to provide an expanded understanding of writing development and guard against potential generalizability issues characteristic of special population (i.e., male-female) studies.     

Parent-infant resemblance for general and specific cognitive abilities in the Colorado adoption project

Previous publications emanating from the Colorado Adoption Project have reported significant relationships between parental general cognitive ability (g) and infant Bayley MDI scores. The present study compared infant Bayley factor scores representing separable dimensions of infant cognition with parental general and specific cognitive abilities for 182 adoptive families and 164 nonadoptive families. Parent/offspring correlations between 12-month Bayley factors and parental cognitive abilities suggest only minimal relationships for both parental g and specific abilities. At 24 months, more parent/offspring resemblance was present; moreover, Bayley factors that were related to parental cognition tended to be related to parental g, not to specific abilities. The finding of significant parent/offspring relationships at 24 months between biological parents and their adopted-away infants, as well as between nonadoptive parents and their infants, suggests some genetic continuity from infancy to adulthood.     

Cognitive ability,academic achievement and academic self‐concept: Extending the internal/external frame of reference model

Background. Marsh's internal/external (I/E) frame of reference model depicts the relationship between achievement and self‐concept in specific academic domains. Few efforts have been made to examine concurrent relationships among cognitive ability, achievement, and academic self‐concept (ASC) within an I/E model framework. Aim. To simultaneously examine the influences of domain‐specific cognitive ability and grades on domain self‐concept in an extended I/E model, including the indirect effect of domain‐specific cognitive ability on domain self‐concept via grades. Sample. Tenth grade respondents (628 male, 452 female) to a national adolescent survey conducted in Taiwan. Method. Respondents completed surveys designed to measure maths and verbal aptitudes. Data on Maths and Chinese class grades and self‐concepts were also collected. Results. Statistically significant and positive path coefficients were found between cognitive ability and self‐concept in the same domain (direct effect) and between these two constructs via grades (indirect effect). The cross‐domain effects of either ability or grades on ASC were negatively significant. Conclusions. Taiwanese 10th graders tend to evaluate their ASCs based on a mix of ability and achievement, with achievement as a mediator exceeding ability as a predictor. In addition, the cross‐domain effects suggest that Taiwanese students are likely to view Maths and verbal abilities and achievements as distinctly different.     

A preliminary investigation of sex differences in associations between emotion regulation difficulties and higher-order cognitive abilities

The present study sought to clarify the cognitive correlates of emotion regulation difficulties (ERD). Further, because prior evidence suggests sex differences in emotion regulation, sex was examined as a moderator of associations between cognitive abilities and ERD. Participants (N = 154) completed self-report measures of ERD, and were administered neuropsychological tests assessing crystallized and fluid intelligence, as well as various components of executive functioning. Bivariate correlations and results from regression analyses suggested sex-dependent associations among cognitive processes and ERD. For men, inhibition of dominant response tendencies was associated with lower ERD, whereas for women, a host of executive abilities (e.g., greater inhibition, cognitive flexibility, semantic processing, abstract reasoning) were associated with greater ERD. Implications for the neurocognitive conceptualization of emotion dysregulation will be discussed.     

The Effective Utilization of Intellectual Abilities and Job-relevant Knowledge in Group Performance: Cognitive Resource Theory and an Agenda for the Future

La théorie des ressources cognitives cherche à rendre compte du rôle que jouent les aptitudes intellectuelles, les connaissances techniques et l'expérience professionnelle dans le leadership et la performance de groupe. L'article résume les hypothèses de la théorie des ressources cognitives concernant l'exploitation efficace par le leader de son intelligence et de son expérience et propose de nouvelles perspectives pour des recherches à venir.
Cognitive resource theory seeks to explain the role which intellectual abilities, technical knowledge and job-relevant experience play in determining leadership and group performance. This paper summarises the hypotheses of cognitive resource theory as they relate to the effective utilisation of leader intelligence and experience, and proposes new directions for further research.     

Moderating effects of maternal emotional availability on language and cognitive development in toddlers of mothers exposed to a natural disaster in pregnancy: The QF2011 Queensland Flood Study

BackgroundPrenatal maternal stress exposure has been linked to sub-optimal developmental outcomes in toddlers, while maternal emotional availability is associated with better cognitive and language abilities. It is less clear whether early care-giving relationships can moderate the impact of prenatal stress on child development. The current study investigates the impact of stress during pregnancy resulting from the Queensland Floods in 2011 on toddlers’ cognitive and language development, and examines how maternal emotional availability is associated with these outcomes.MethodsData were available from 131 families. Measures of prenatal stress (objective hardship, cognitive appraisal, and three measures of maternal subjective stress) were collected within one year of the 2011 Queensland floods. Maternal emotional availability was rated from video-taped mother-child play sessions at 16 months: sensitivity (e.g., affective connection, responsiveness to signals) and structuring (e.g., scaffolding, guidance, limit-setting). The toddlers’ cognitive and language development was assessed at 30 months. Interactions were tested to determine whether maternal emotional availability moderated the relationship between prenatal maternal stress and toddler cognitive and language functioning.ResultsPrenatal stress was not correlated with toddlers’ cognitive and language development at 30 months. Overall, the higher the maternal structuring and sensitivity, the better the toddlers’ cognitive outcomes. However, significant interactions showed that the effects of maternal structuring on toddler language abilities depended on the degree of prenatal maternal subjective stress: when maternal subjective stress was above fairly low levels, the greater the maternal structuring, the higher the child vocabulary level.ConclusionThe current study highlights the importance of maternal emotional availability, especially structuring, for cognitive and language development in young children. Findings suggest that toddlers exposed to higher levels of prenatal maternal stress in utero may benefit from high maternal structuring for their language development.     

Out of sight,out of mind? Relations between visual acuity and cognition

Prior research has established significant relations between measures of sensory ability and cognitive function in adults of different ages, and several explanations for this relation have been proposed. One explanation is that sensory abilities restrict cognitive processing, a second is that cognitive abilities influence assessments of sensory ability, and a third is that both sensory function and cognition are affected by a common, potentially age-based, third factor. These explanations were investigated using mediation and moderation analyses, with near visual acuity as the sensory measure and scores on visual speed tests and auditory memory tests as the cognitive measures. Measures of visual acuity, speed, and memory were obtained from three moderately large samples, two cross-sectional (N?=?380, N?=?4,779) and one longitudinal (N?=?2,258), with participants ranging from 18 to 90 years of age. The visual acuity and cognitive measures had different age trajectories, and the visual acuity–cognition relations were similar in each 5-year age band. The results suggest that the age-related differences and changes in near visual acuity are unlikely to contribute to the age-related differences and changes in speed and memory measures.     

Scores composites CHC pour le WISC-IV : normes francophones

Although the WISC-IV references the Cattell–Horn–Carroll (CHC) theory in the manual, the composite scores of this battery (VCI, PRI, WMI, and PSI) were not defined according to this model. Nevertheless, we recommend examining the subtests scores of the WISC-IV in reference to the nomenclature of the cognitive abilities proposed in the CHC theory, so as to bring additional insight on the observed performance. The objective of the first part of this paper is to provide normative tables for five CHC cognitive abilities of the French WISC-IV: fluid reasoning (Gf), comprehension–knowledge (Gc), visual processing (Gv), short-term-memory (Gsm), and processing speed (Gs); these tables were created using a statistical approximation procedure. The objective of the second part is to test the validity of these tables with data obtained from 250 children. Correlation between the standard indices of the WISC-IV (VCI, PRI, WMI, and PSI) and the CHC composite scores were high, demonstrating the validity of these CHC scores. These tables, for the French version of the WISC-IV, allow using the CHC composite scores as complementary measures, in order to conduct normative and ipsative analyses.     

Personality change profiles and changes in cognition among middle-aged and older adults

Research on the relationship between personality traits and cognitive abilities has primarily used cross-sectional designs and considered personality traits individually in relation to cognitive dimensions. This study (N = 2652) examined the relationship between Big Five personality change profiles and change in cognitive factors, episodic memory and executive functioning. Latent profile analysis was used to capture patterns of change across the Big Five traits. Three profiles of personality change were defined: Decreasers, Maintainers, and Increasers. The Decreasers declined more in episodic memory compared to the Increasers and Maintainers. Also, the Decreasers declined more in executive functioning compared to the Increasers, but not the Maintainers. The findings advance our understanding of the links between patterns of personality change and cognitive aging.     

Sex differences in latent cognitive abilities ages 5 to 17: Evidence from the Differential Ability Scales—Second Edition

Sex differences in the latent general and broad cognitive abilities underlying the Differential Ability Scales, Second Edition were investigated for children and youth ages 5 through 17. Multi-group mean and covariance structural equation modeling was used to investigate sex differences in latent cognitive abilities as well as changes in these differences across age. Most broad abilities showed mean differences across the sexes, and all such differences varied across ages. Girls showed an advantage on the processing speed (Gs) first-order residual factor. Girls also showed advantages at some ages on free-recall memory, a narrow ability of long term retrieval (Glr). Boys showed a developmentally-related advantage on a visual-spatial ability (Gv) first-order residual factor, depending on age. Younger girls showed an advantage on short-term memory (Gsm). No statistically significant sex differences were shown on the latent comprehension-knowledge (Gc) factor, or on a second-order, latent g factor. Boys showed larger variances for several broad abilities, some substantial, but those differences were not statistically significant.     

Mental abilities and school achievement: A test of a mediation hypothesis

This study analyzes the interplay of four cognitive abilities - reasoning, divergent thinking, mental speed, and short-term memory - and their impact on academic achievement in school in a sample of adolescents in grades seven to 10 (N = 1135). Based on information processing approaches to intelligence, we tested a mediation hypothesis, which states that the complex cognitive abilities of reasoning and divergent thinking mediate the influence of the basic cognitive abilities of mental speed and short-term memory on achievement. We administered a comprehensive test battery and analyzed the data through structural equation modeling while controlling for the cluster structure of the data. Our findings support the notion that mental speed and short-term memory, as ability factors reflecting basic cognitive processes, exert an indirect influence on academic achievement by affecting reasoning and divergent thinking (total indirect effects: β = .22 and .24, respectively). Short-term memory also directly affects achievement (β = .22).     

Ecological rationality or nested sets? Individual differences in cognitive processing predict Bayesian reasoning

The presentation of a Bayesian inference problem in terms of natural frequencies rather than probabilities has been shown to enhance performance. The effect of individual differences in cognitive processing on Bayesian reasoning has rarely been studied, despite enabling us to test process-oriented variants of the two main accounts of the facilitative effect of natural frequencies: The ecological rationality account (ERA), which postulates an evolutionarily shaped ease of natural frequency automatic processing, and the nested sets account (NSA), which posits analytical processing of nested sets. In two experiments, we found that cognitive reflection abilities predicted normative performance equally well in tasks featuring whole and arbitrarily parsed objects (Experiment 1) and that cognitive abilities and thinking dispositions (analytical vs. intuitive) predicted performance with single-event probabilities, as well as natural frequencies (Experiment 2). Since these individual differences indicate that analytical processing improves Bayesian reasoning, our findings provide stronger support for the NSA than for the ERA.     

DNA markers associated with general and specific cognitive abilities

Multivariate quantitative genetic research suggests a hierarchical model of cognitive abilities where genetic effects are largely general, cutting across most cognitive abilities. Some genetic effects, however, are specific to certain cognitive abilities. These results lead to a hypothesis for molecular genetic research: Although most genes associated with one cognitive ability will be related to other cognitive abilities, some genes will be specific to a particular cognitive ability. The current research explored this hypothesis in an analysis of data in specific cognitive abilities from 86 children from 6 to 12 years of age from a larger allelic association study of general cognitive ability. Eight DNA markers were entered simultaneously in separate multiple regression analyses predicting each of four specific cognitive ability factors (Verbal, Spatial, Perceptual Speed, Memory), as well as WISC-R subtest scores. Four marjers (CTGB33, EST00083, HLA, and SOD2) showed similar effects across the cognitive ability scales, suggesting that they are related to general cognitive ability (g). These associations became negligible when the effects of ‘g’ (WISC-R IQ) were removed. Three markers (ADH5, DM, and NGFB) continued to be significantly associated with specific cognitive ability scales after the effects of ‘g’ were removed. Although preliminary, these molecular genetic results support the hierarchical model predicted by quantitative genetic research.     

An exploration of genetic g: Hierarchical factor analysis of cognitive data from the western reserve twin project

Hierarchical factor analyses involving Schmid-Leiman transformations (Schmid & Leiman, 1957) were conducted on specific cognitive abilities data collected in a sample of 148 identical (MZ) and 135 same-sex fraternal (DZ) twin pairs. Two main questions were addressed: First, are genetic influences on specific cognitive abilities simply a reflection of their g loading, or are different sets of genes affecting separate abilities? Second, to the extent that specific cognitive abilities are affected by common genetic variance, how similar is the common genetic factor to a phenotypic factor reflecting g? Model fitting results suggest that genetic influences on specific abilities are a reflection of both general intelligence and genetic influences specific to separate abilities and that loadings on the common genetic factor are more highly correlated with phenotypic g loadings than are common environmental factor loadings.     

Examining Preschool Cognitive Abilities Using a CHC Framework

Although there has been a substantial growth in the number of published studies examining tests of cognitive abilities and using contemporary theories of cognitive abilities, to date none have done so with preschool cognitive tests. In this study the relation between cognitive ability measures for young children and Cattell-Horn-Carroll (CHC) theory is examined. Tests and subtests from the Differential Ability Scales: Upper Preschool Level and the Woodcock-Johnson Tests of Cognitive Ability-Revised with a sample of 158 children between 4 and 5 years of age were used in a series of joint factor analyses. Although a series of models were explored, the model representative of the CHC theory of cognitive abilities was best supported by the data. This provides evidence for a greater differentiation of young children's cognitive abilities than are typically interpreted. Results are discussed with regard to understanding the link between contemporary theories of intelligence and young children's cognitive abilities, as well as implications for intellectual assessment practices with young children.     

The theory of multiple stupidities: education,technology and organisation in Arabia

Traditional perspectives have envisaged intelligence as one entity dominated by a single set of abilities (i.e. cognitive abilities), whereas modern perspectives have defined intelligence in various shapes (e.g. linguistic, musical and interpersonal intelligences). By the same token, traditional perspectives have examined stupidity as one set of inabilities (i.e. cognitive inabilities). However, it is not clear whether modern perspectives have discussed whether stupidity exists in various forms—in the same way as they have envisaged intelligence. To address this limitation, 257 university members were asked to share what they perceived as being stupid educational and technological practices in their institutions. Analysis of the data suggested three concepts were important to the members: moral, spatial and administrative stupidities. That is, stupidity is perceived to come in the form of failing to meet certain moral, spatial and administrative values. This implies that modern perspectives may conceptualise stupidity differently from traditional perspectives, seeing it as going beyond cognitive inabilities and viewing it as existing in various forms (e.g. moral, spatial and administrative stupidities). Thus, there are multiple stupidities as there are multiple forms of intelligence. A strength of this research is that it views stupidity through an organisational and qualitative lens, although some may traditionally expect such a topic to be examined quantitatively through psychometric and biological approaches.