Beyond IQ: a new perspective on the psychological assessment of intellectual abilities

The article presents a new approach to the psychological assessment of intellectual abilities, which is based on the new theory of human intelligence. The main shortcomings of conventional intelligence tests are briefly discussed. The nine methodological and procedural principles, which form this approach, are considered along with the examples of new intelligence tests. According to these principles, new intelligence tests should examine psychological mental context generated by an individual himself or herself. They should also have an “open character”, evaluate the basis of intelligence, and allow both retrospective and prospective assessment. New tests of intellectual abilities should not evaluate psychological functions (e.g., memory or attention) and mental speed, and they should not be very long and time-consuming. Cognitive styles and metacognitive abilities should also be assessed by new intelligence tests.     

A Neuropsychological Approach to Intelligence

This paper proposes that current psychometric intelligence tests are limited in evaluating cognitive activity. From a neuropsychological perspective, they fail to measure some fundamental cognitive abilities such as executive functions, memory, and visuospatial abilities. The analysis of the Wechsler Intelligence Scale presented shows that the original rationale for selecting the specific subtests included in the WAIS was unclear. The concept of a g factor in cognition is also analyzed, with the conclusion that the g factor continues to be controversial. The value of intelligence tests in predicting school performance is also criticized. It is proposed that the psychometric concept of general intelligence should be deleted from cognitive and neurological sciences. Finally, it is proposed that, in the future, neuropsychological instruments sensitive to more specific cognitive abilities replace current psychometric intelligence tests.     

Event-related-potential (ERP) correlates of cognitive styles,abilities and aptitudes

Fifty, right-handed males were given 11 psychometric tests of cognitive styles, abilities and aptitudes. Visual (VERP), auditory (AERP) and bimodal (BERP) brain event-related-potential (ERP) amplitudes were recorded from each of these Ss. Canonical and product-moment correlations were computed. These analyses established that VERPs and BERPs elicited in the frontal, temporal, parietal and occipital regions were related to abilities and aptitudes: general aptitude, reading and verbal comprehension and spatial ability; and a cognitive style: field dependence-independence. The results demonstrated the construct validity of ERPs as indicators of individual differences in cognitive characteristics, especially crystallized and fluid intelligence.     

Morningness–eveningness and intelligence: early to bed, early to rise will likely make you anything but wise!

Research examining various psychological correlates of circadian type (also known as diurnal preference) has been, over the years, quite expansive. A notable omission within this research program would appear a systematic exploration of the relation between intelligence and morningness-eveningness. The present study redressed this imbalance. 420 participants performed two self-report inventories assessing circadian type, as well as measures of intelligence from two psychometric batteries: CAM-IV and the ASVAB. The results indicate that, contrary to conventional folk wisdom, evening-types are more likely to have higher intelligence scores. This result is discussed in relation to current theories concerning the nature of human cognitive abilities.     

Introduction to the special section on cognitive abilities: 100 years after Spearman's (1904) "'General intelligence,' objectively determined and measured"

The study of individual differences in cognitive abilities is one of the few branches of psychological science to amass a coherent body of empirical knowledge withstanding the test of time. There is wide consensus that cognitive abilities are organized hierarchically, and C. Spearman's (1904) general intelligence occupies the vertex of this hierarchy. In addition, specific abilities beyond general intelligence refine longitudinal forecasts of important social phenomena and paint a rich portrait of this important domain of psychological diversity. This opening article identifies and then reviews 5 major areas concerning the personological significance of cognitive abilities and the methods used to study them. In models of human behavior and important life outcomes, cognitive abilities are critical in more ways than social scientists realize.     

Shavinina的智能测评观述评

近来Shavinina等人通过一系列研究,提出了一种新的智能结构观,认为智能主要包含两个部分：认知经验和智能表现。在此基础上,他们分析了未来智能测验应遵循的一系列原则,并进行了初步的测验编制尝试,提出了一些富有创意的测验方法,如“完美计算机”、“概念整合”以及“问题建构”等测验。Shavinina等人所提出的新智能观以及关于智能测验的新技术具有很强的启发性,代表了智能研究的又一新方向。     

The future of IQ testing in education

Will IQ tests as we currently know them be used in schools in the year 2000? Will they be used as they are now or will they serve different functions? What new kinds of tests of aptitude and intelligence are likely to be developed in the next twenty years? In this article, the author attempts to answer the first two questions by considering the functions that IQ and aptitude tests now serve in schools and the trends that may modify the present pattern of test use. To answer the third question, she examines current research on intelligence and aptitude and discusses the kind of intelligence tests that might prove more useful in instructional planning.     

Everyday cognition: age and intellectual ability correlates

The primary aim of this study was to examine the relationship between a new battery of everyday cognition measures, which assessed 4 cognitive abilities within 3 familiar real-world domains, and traditional psychometric tests of the same basic cognitive abilities. Several theoreticians have argued that everyday cognition measures are somewhat distinct from traditional cognitive assessment approaches, and the authors investigated this assertion correlationally in the present study. The sample consisted of 174 community-dwelling older adults from the Detroit metropolitan area, who had an average age of 73 years. Major results of the study showed that (a) each everyday cognitive test was strongly correlated with the basic cognitive abilities; (b) several basic abilities, as well as measures of domain-specific knowledge, predicted everyday cognitive performance; and (c) everyday and basic measures were similarly related to age. The results suggest that everyday cognition is not unrelated to traditional measures, nor is it less sensitive to age-related differences.     

Examination of personality-ability relationships in the elderly: The role of the contextual (interface) assessment mode

Personality-ability relationships in old age were examined in 71 elderly persons. Two modes of assessment were used. One consisted of measuring intellectual abilities (17 tests) and personality (6 dimensions) by means of established instruments. Intellectual abilities covered were drawn from Horn and Cattell's model of psychometric intelligence. Personality dimensions included three measures of locus of control and one measure each for achievement motivation, anxiety, and morale. The second mode of assessment was aimed directly at the interface between cognitive abilities and personality. Six such interface (context-specific) scales, involving self-assessment and attributions dealing with intellectual functioning in the context of aging, were developed using the six traditional (transcontextual) personality scales as conceptual criteria. These newly developed interface scales exhibit satisfactory convergent and discriminant validity with their transcontextual parent scales of personality. The six parent personality measures and the six personality-ability interface scales were correlated, separately, with performance scores of psychometric intelligence. Relationships between the two domains (personality, ability) were substantial and of greater magnitude when personality was assessed in the context of the personality-ability interface. Because of the conjoint anchoring of the interface scales to both personality and ability, the findings provide a basis for beginning to clarify the nature of personality-ability relationships in old age. In addition, the results support the continuation of a measurement approach to the study of interdomain relationships that includes the use of direct assessments of the domain interface, in addition to traditionally distinct measures of different domains.     

STRUCTURED INTERVIEWING: RAISING THE PSYCHOMETRIC PROPERTIES OF THE EMPLOYMENT INTERVIEW

A highly structured employment interviewing technique is proposed, which includes the following steps: (1) develop questions based on a job analysis, (2) ask the same questions of each candidate, (3) anchor the rating scales for scoring answers with examples and illustrations, (4) have an interview panel record and rate answers, (5) consistently administer the process to all candidates, and (6) give special attention to job relatedness, fairness, and documentation in accordance with testing guidelines. Examination of psychometric properties for hiring entry-level production employees ( n = 149) reveals high interrater reliability ( r = .88) and predictive validity (uncorrected r = .34, corrected r = .56), as well as evidence for test fairness and utility. The levels of these properties are comparable to those of a comparison battery of typical employment tests, and correlations with the tests suggest that the interview has a strong cognitive aptitude component. Potential explanations for the effectiveness of this structured interviewing technique are discussed.     

Genetic and Environmental Influences on Two Measures of Speed of Information Processing and their Relation to Psychometric Intelligence: Evidence from the German Observational Study of Adult Twins

Speed of information processing, as measured by reaction times (RTs) in elementary cognitive tasks (ECTs), has been found to be an important correlate of human psychometric intelligence. While the heritability of psychometric intelligence is well understood, we know only a little about genetic and environmental influences on ECT performance, particularly about genetic and environmental contributions to ECT–intelligence relation. These questions were studied by employing two widely used ECTs (Sternberg's memory scanning and Posner's letter-matching task) as well as two psychometric intelligence tests (Advanced Progressive Matrices and Leistungs–Prüf System) in a large sample of 169 monozygotic (MZ) and 131 dizygotic (DZ) twin pairs. As expected, RTs correlated negatively with psychometric intelligence. Moreover, heritability estimates were substantial for both psychometric intelligence and RTs in ECTs. Finally, multivariate genetic analyses suggested that most of the phenotypic correlation between mental speed and intelligence is due to genetic factors.     

Individual and group differences in intelligence and speed of information processing

A battery of eight different reaction time (RT) tests, measuring the speed with which individuals perform various elementary cognitive processes, and a group test of scholastic aptitude (the Armed Services Vocational Aptitude Battery, ASVAB) were given to 50 black and 56 white male vocational college students. The regression of the general factor scores of the ASVAB on the RT measures yielded a shrunken multiple correlation of 0.465. Although discriminant analyses, when applied separately to the ASVAB subtests and to the RT variables, showed highly comparable overall discrimination (over 70% correct classification) between the black and white groups, factor scores derived from the general factor (labeled ‘speed of information processing’) of the RT battery show only about one-third as large a mean black-white difference as the mean group difference on the general factor scores derived from the ASVAB. Comparisons were also made between the 106 vocational college students and 100 university students of higher average academic aptitude who had previously been tested on the same RT battery (Vernon, 1983a). These groups showed marked differences on the RT variables, the largest differences occuring on the tests that required more complex cognitive processing. The more complex RT tests also correlate most highly with the psychometric measures of ability within each group. The results are consistent with the hypothesis that individual differences and the mean differences between groups in psychometric abilities and scholastic achievement are related to differences in the speed of information processing as measured in elementary cognitive tasks.     

Testing specific cognitive abilities by telephone and mail

The two goals of this research were to develop a brief battery of tests of specific cognitive abilities that can be administered via telephone to adolescents and to assess the psychometric properties of the battery. In a sample of 212 adolescents from 10 to 15 years of age, factor analyses supported the hypothesized structure of verbal, spatial, perceptual speed, and memory abilities, with three tests intended to mark each factor. For a subsample of 62 subjects, retest correlations were .81, .73, .82, and .57, respectively, for the four specific cognitive abilities; scores from telephone testing and face-to-face testing correlated near the reliabilities of the telephone tests. Recommendations are made for shortening the 60-min battery to 35 min by using only two tests to mark each factor.     

Relations between the motor and cognitive dimensions of preschool girls and boys

The aim of this study was to compare relations between latent motor dimensions and cognitive abilities of preschool boys and girls (N=665, age: 5 to 6 years). The psychological part of the testing was implemented with the Test Razkol. For the assessment of motor abilities 28 tests were given. The associations of motor and cognitive variables were estimated by multiple regression analysis, which showed positive and significant associations between the latent motor variables and the cognitive variable for both boys and girls. On both sexes, the motor dimensions with the strongest associations with the cognitive abilities are those of coordination and the speed of movement. Despite some differences between boys and girls, they still have a lot in common since the most important latent motor dimensions prevailing in the connection between motor and cognitive dimensions are similar.     

Examining Preschool Cognitive Abilities Using a CHC Framework

Although there has been a substantial growth in the number of published studies examining tests of cognitive abilities and using contemporary theories of cognitive abilities, to date none have done so with preschool cognitive tests. In this study the relation between cognitive ability measures for young children and Cattell-Horn-Carroll (CHC) theory is examined. Tests and subtests from the Differential Ability Scales: Upper Preschool Level and the Woodcock-Johnson Tests of Cognitive Ability-Revised with a sample of 158 children between 4 and 5 years of age were used in a series of joint factor analyses. Although a series of models were explored, the model representative of the CHC theory of cognitive abilities was best supported by the data. This provides evidence for a greater differentiation of young children's cognitive abilities than are typically interpreted. Results are discussed with regard to understanding the link between contemporary theories of intelligence and young children's cognitive abilities, as well as implications for intellectual assessment practices with young children.     

L’examen psychologique dans le handicap visuel : intérêts et limites méthodologiques

The psychological assessment of visually impaired people (blind or partially sighted) confronts the psychologist with methodological constraints regarding the choice of assessment tools. Both critical judgement and an extensive psychometric knowledge are necessary. The objective of this article is to present the results of a study in which the existing tools in this field are identified. The results of this study bring to light the shortage of tools and methods of investigation specifically designed to assess the different psychological facets (affective, cognitive or conative) of visual impairment. We will then examine the methodological and psychometric issues specifically related to assessment in the field of visual impairment. Although some tools have psychometric qualities for the assessment of blind and visually impaired people (Miller & Skillman, 2003; Reid, 1997), we note that the limits of some tests are often overlooked or ignored (Reid, 1997; Tobin, 1994; Tobin & Hill, 2011). Questions relating to the use, adaptation and translation of foreign language tools are examined. In order to illustrate these points, we present some practices used by psychologists which highlight the limits of currently existing tools for the assessment of the psychological, in particular, the cognitive facet, and in addition provide some recommendations for assessment.     

Can fast and slow intelligence be differentiated?

Responses to items from an intelligence test may be fast or slow. The research issue dealt with in this paper is whether the intelligence involved in fast correct responses differs in nature from the intelligence involved in slow correct responses. There are two questions related to this issue: 1. Are the processes involved different? 2. Are the abilities involved different? An answer to these questions is provided making use of data from a Raven-like matrices test and a verbal analogies test, and the use of a psychometric branching model. The branching model is based on three latent traits: speed, fast accuracy and slow accuracy, and item parameters corresponding to each of these. The pattern of item difficulties is used to draw conclusions on the cognitive processes involved. The results are as follows: 1. The processes involved in fast and slow responses can be differentiated, as can be derived from qualitative differences in the patterns of item difficulty, and fast responses lead to a larger differentiation between items than slow responses do. 2. The abilities underlying fast and slow responses can also be differentiated, and fast responses allow for a better differentiation between the respondents.     

The Relationship between Reaction Time and Psychometric Intelligence in a Rural Guatemalan Adolescent Population

In industrialized countries reaction time has been found to be related to measures of intelligence and cognitive abilities. Little, however, is known about the validity of using such tasks in nonindustrialized countries. The present research investigated the association between reaction time and psychometric intelligence in a rural Guatemalan adolescent population. Results indicated that speed and consistency of processing on reaction time tasks were related to psychometric intelligence. However, the magnitude of these relationships were considerably smaller than those reported in industrialized populations. Reaction time task performance accounted for less than 5% of the variance in psychometric intelligence. Findings suggest that although reaction time tasks are associated with intelligence, the predictive validity of such measures needs to be established before use in nontraditional populations.     

INTELLIGENCE TESTING,COGNITION, AND INSTRUCTION*

This paper examines the implications of recent theory and research in cognitive psychology for the understanding and assessment of intelligence. Three major themes are developed. The first has to do with how changes in the social and educational climate for testing can influence the conception of intellectual competence and the technology of testing. The second theme concerns the ways that cognitive psychology, with its emphases on memory, problem-solving, and knowledge acquisition, has begun to provide a new framework for viewing differences in intellectual functioning. Finally, it is argued that study of the kinds of performances required for success in school suggests ways in which intelligence testing can be made more responsive to current social and educational needs.     

The relationship between speed of information processing and cognitive ability

Speed of information processing as measured by various reaction time and inspection tasks has been shown to correlate with psychometric intelligence, and it has been suggested that general intelligence (g) is determined to some degree by the speed that information is processed. If this is so, then various measures of speed of information processing should correlate substantially with each other, and each should also correlate with a wide range of psychometric tests that load on g. Alternatively, intelligence may be considered to be a multi-faceted complex of partially related abilities with specific abilities being dependent upon specific cognitive processes. If this is the case, it should be possible to discover independent cognitive processes, some of which correlate with one facet or broad ability and some with another. This paper presents three experiments in which the relationship between intellectual ability and four speed of information processing measures was examined. These were rate of memory scanning, rate of retrieval of information from long term memory, speed of stimulus-response mapping and inspection time (IT). Results showed that correlations between IT and most reaction time measures of speed of information processing were low, and that correlations between different versions of IT were negligible. In addition, some cognitive tasks with verbal material (memory scanning rate for digits and Posner letter matching IT) correlated most substantially with Verbal Reasoning whereas non-verbal (two-line) IT consistently correlated with tests loading on g. It was thus suggested that while non-verbal IT may be a measure of a perceptual speed attribute that contributes to mental functioning, other “speed of information processing” parameters may be more specific to a subset of abilities.