Intelligence Measurement by Computerized Information Processing using Inspection Time

A computer program was used to investigate the correlation of IQ with inspection time (IT). The program was written as a space game and was presented to 122 fourth-, fifth-, and sixth-grade children. The results were then compared to known Otis-Lennon IQ scores. The correlation was moderately high (.79), most subjects scoring within one stanine of the Otis IQ. Not included in the correlation sample were 23 children of the same grade and age level who were classified by school officials as having reading and language difficulties. All of these children scored significantly higher in IT and teacher evaluation than they did on the SAT vocabulary test and the Otis IQ. IT is a useful alternative to the more traditional measures of IQ. In addition, the computerized approach used in this study overcame many of its criticisms.     

Not so F.A.S.T., Dr. Vickers!

Vickers and his co-workers have recently reported studies with a “frequency accrual speed test” (FAST) that was devised to assess individuals' speed or efficiency of sampling of sensory input. According to Vickers, the FAST overcomes some of the limitations of the inspection time (IT) task, a psychophysical measure that has moderate correlations with IQ scores. After several experiments, Vickers concluded that speed of sensory processing is unimportant in FAST (and IT) differences. After a critical review of the FAST's theoretical basis and empirical results, we argue that the FAST is not appropriately described as an equivalent or alternative to IT, and that results from FAST studies are not generalizable to IT. The FAST involves a substantial memory load. Moreover, no studies to date have used appropriate stimulus parameters to allow Vickers' claim that speed of processing is unimportant in FAST (and IT) variance. The FAST, we suggest, has moderate correlations with IQ-type test because it is a complex, high-level task that is poorly parameterized. Specific hypotheses are formulated based on our understanding of the nature of the FAST. For those who wish to understand the information processing bases of higher order abilities the IT task (also devised by Vickers) continues to afford a better focus of study.     

IQ and the wealth of nations: How much reverse causality?

This paper uses data from 130 IQ test administrations worldwide and employs regression analysis to try to quantify the impact of living conditions on average IQ scores in nationally-representative samples. The study emphasizes the possible role of conditions at or near the test-takers' time of birth. The paper finds that the impact of living conditions is of much smaller magnitude than is suggested by just looking at correlations between average IQ scores and socioeconomic indicators. After controlling for test-takers' region of ancestry, the impact of parasitic diseases on average IQ is found to be statistically insignificant when test results from the Caribbean are included in the analysis. As far as IQ and the wealth of nations are concerned, causality thus appears to run mostly from the former to the latter. The test-takers' region of ancestry dominates the regression results. While differences in average scores worldwide can thus be plausibly viewed as being influenced by genetic differences across world regions, it is also possible that score differences are influenced by regional differences in culture that are independent of genetic factors. Differences in average IQ across world regions may change in the years ahead insofar as the strength of Flynn effects may not be uniform, but some regional differences in average g levels seem likely to continue indefinitely.     

Is the Flynn effect on g?: A meta-analysis

Black/White differences in mean IQ have been clearly shown to strongly correlate with g loadings, so large group differences on subtests of high cognitive complexity and small group differences on subtests of low cognitive complexity. IQ scores have been increasing over the last half century, a phenomenon known as the Flynn effect. Flynn effect gains are predominantly driven by environmental factors. Might these factors also be responsible for group differences in intelligence? The empirical studies on whether the pattern of Flynn effect gains is the same as the pattern of group differences yield conflicting findings. A psychometric meta-analysis on all studies with seven or more subtests reporting correlations between g loadings and standardized score gains was carried out, based on 5 papers, yielding 11 data points (total N = 16,663). It yielded a true correlation of − .38, and none of the variance between the studies could be attributed to moderators. It appears that the Flynn effect and group differences have different causes. Suggestions for future research are discussed.     

A longitudinal study of bilingual and cognitive development(1)

This paper presents the findings of a longitudinal study of IQ data collected over a 5-year period (Grades K-4) on pupils enrolled in a French immersion program (anglophone pupils receiving all instruction in French except English language arts) and pupils in the regular English program. Although year-by-year results may fail to show IQ differences between the two groups, repeated measures analysis indicates that the immersion group has a higher IQ measure over the 5-year period. However, considering Grades 1–3 only, which involved the administration of the same test, the two groups do not score differentially with respect to either overall IQ measure or specific subtest scores (classification/categorization, analogies, following of verbal directions) when scores are adjusted for initial IQ (and age) differences, thus failing initially to support studies which show positive relationships between bilingualism and cognitive functioning. However, supportive of those studies is a further analysis on the data of immersion pupils classified as “high” French achievers vs. “low” French achievers. The high French achievers obtain significantly higher IQ measures and subtest scores (analogies and following of verbal directions) than the low French achievers, even when scores are adjusted for initial IQ and age differences. These findings are interpreted in the context of Cummins' (1976) “threshold” hypothesis relating to level of competence in the second language.     

Visual information processing and intelligence

Measures of inspection time (IT) have robust, moderately-sized correlations with IQ-type test scores. However, the reason for the IT-IQ correlation is not understood. Although the original theory asserted that IT performance was based on a single parameter—essentially speed of visual processing—peculiarities of the task have afforded other interpretations of IT differences and the IT-IQ association. In the present report two new visual processing tasks, visual change detection (VCD) and visual movement detection (VMD) are found to be correlated at or above .4 with IT and with non-verbal scores from the Alice Heim 4 test of general intelligence. VCD and VMD, in common with IT, assess the stimulus duration that is required by subjects in order to make an accurate discrimination. VCD and VMD, however, require a broader attentional focus than IT and do not involve backward masking. Measures of contrast sensitivity, a difficult discrimination task in which stimuli are not time-limited, had near-to-zero correlations with other visual processing tasks and with IQ-type test scores. We tested the hypothesis that only the latent trait derived from the speeded visual processing tasks (rather than task-specific features) would correlate with cognitive ability, and this was supported. The present study adds weight to the view that it is the ability to make accurate discriminations in the face of limited stimulus time that causes IT to correlate with psychometric intelligence. The psychological correlates of VCD, in terms of neural circuits that detect “difference” suggest a new line of investigation into the psychobiological bases of human intelligence.     

A simple syllogism-solving test: Empirical findings and implications for g research

It has been reported that the ability to solve syllogisms is highly g-loaded. In the present study, using a self-administered shortened version of a syllogism-solving test, the BAROCO Short, we examined whether robust findings generated by previous research regarding IQ scores were also applicable to BAROCO Short scores. Five syllogism-solving problems were included in a questionnaire as part of a postal survey conducted by the Keio Twin Research Center. Data were collected from 487 pairs of twins (1021 individuals) who were Japanese junior high or high school students (ages 13–18) and from 536 mothers and 431 fathers. Four findings related to IQ were replicated: 1) The mean level increased gradually during adolescence, stayed unchanged from the 30s to the early 50s, and subsequently declined after the late 50s. 2) The scores for both children and parents were predicted by the socioeconomic status of the family. 3) The genetic effect increased, although the shared environmental effect decreased during progression from adolescence to adulthood. 4) Children's scores were genetically correlated with school achievement. These findings further substantiate the close association between syllogistic reasoning ability and g.     

On the heritability of inspection time and its covariance with IQ: a twin study

Using the classical twin design, this study investigates the influence of genetic factors on the large phenotypic variance in inspection time (IT), and whether the well established IT–IQ association can be explained by a common genetic factor. Three hundred ninety pairs of twins (184 monozygotic, MZ; 206 dizygotic, DZ) with a mean age of 16 years participated, and 49 pairs returned approximately 3 months later for retesting. As in many IT studies, the pi figure stimulus was used and IT was estimated from the cumulative normal ogive. IT ranged from 39.4 to 774.1 ms (159±110.1 ms) with faster ITs (by an average of 26.9 ms) found in the retest session from which a reliability of .69 was estimated. Full-scale IQ (FIQ) was assessed by the Multidimensional Aptitude Battery (MAB) and ranged from 79 to 145 (111±13). The phenotypic association between IT and FIQ was confirmed (−.35) and bivariate results showed that a common genetic factor accounted for 36% of the variance in IT and 32% of the variance in FIQ. The maximum likelihood estimate of the genetic correlation was −.63. When performance and verbal IQ (PIQ & VIQ) were analysed with IT, a stronger phenotypic and genetic relationship was found between PIQ and IT than with VIQ. A large part of the IT variance (64%) was accounted for by a unique environmental factor. Further genetic factors were needed to explain the remaining variance in IQ with a small component of unique environmental variance present. The separability of a shared genetic factor influencing IT and IQ from the total genetic variance in IQ suggests that IT affects a specific subcomponent of intelligence rather than a generalised efficiency.     

Comparability of IQ scores over time

This study investigates the comparability of IQ scores. Three cohorts (1933/36, 1997/98, 2006) of Estonian students (N = 2173) are compared using the Estonian National Intelligence Test. After 72 years the secular rise of the IQ test scores is.79 SD. The mean .16 SD increase in the last 8 years suggests a rapid increase of the Flynn Effect (FE) in Estonia. The measurement is not strictly invariant, which means that the IQ scores of different cohorts are not directly comparable. Less than perfect comparability of test scores is caused by at least two factors: time between measurements and societal/educational changes between cohorts. As was to be expected, the meaning of subtests and the meaning of the g score have changed over time.     

Reversing the speed–IQ correlation: Intra-individual variability and attentional control in the inspection time paradigm

Elementary cognitive tasks (ECTs) are simple tasks involving basic cognitive processes for which speed of performance typically correlates with IQ. Inspection time (IT) has the strongest IQ correlations and is considered critical evidence for neural speed underlying individual differences in intelligence. However, results from Bors et al. [Bors, D.A., Stokes, T.L., Forrin, B. & Hodder, S.L., (1999). Inspection Time and Intelligence: Practice, strategies, and attention. Intelligence, 27, 111–129.] suggest task consistency may underlie this shared variance. One possibility is that performance consistency reflects attentional mechanisms, as previous research has shown relationships between attentional control and cognitive performance. In study 1, participants were administered the Raven's Advanced Progressive Matrices and performed an alternative version of the IT task to measure individual trial-by-trial consistency expressed as the standard deviation of IT (ITSD). The alternative procedure yielded IT–IQ correlations similar to those obtained in previous studies and ITSD accounted for the IT–IQ variance. A second experiment tested whether ITSD measures attentional control, as participants simultaneously performed the IT task and an attention-demanding verbalization task. Under these conditions, high IQ participants performed worse on IT. These results suggest IT performance may reflect individual differences in attentional control and that this variable may account for the variance shared between IT and IQ.     

The comparability of intelligence test results: Group- and individual-level comparisons of seven intelligence tests

A significant body of research has demonstrated that IQs obtained from different intelligence tests substantially correlate at the group level. Yet, there is minimal research investigating whether different intelligence tests yield comparable results for individuals. Examining this issue is paramount given that high-stakes decisions are based on individual test results. Consequently, we investigated whether seven current and widely used intelligence tests yielded comparable results for individuals between the ages of 4–20 years. Results mostly indicated substantial correlations between tests, although several significant mean differences at the group level were identified. Results associated with individual-level comparability indicated that the interpretation of exact IQ scores cannot be empirically supported, as the 95% confidence intervals could not be reliably replicated with different intelligence tests. Similar patterns also appeared for the individual-level comparability of nonverbal and verbal intelligence factor scores. Furthermore, the nominal level of intelligence systematically predicted IQ differences between tests, with above- and below-average IQ scores associated with larger differences as compared to average IQ scores. Analyses based on continuous data confirmed that differences appeared to increase toward the above-average IQ score range. These findings are critical as these are the ranges in which diagnostic questions most often arise in practice. Implications for test interpretation and test construction are discussed.     

Race, social class and ability patterns on the WISC-R

The national standardization sample of whites and blacks on the Wechsler Intelligence Scale for Children—Revised (WISC-R) was the basis for a detailed analysis of the psychometric nature of racial and social class differences on the original 13 subscales of the WISC-R. The profiles of subtest scores of whites and blacks were compared directly and also after the racial groups were statistically equated on Full Scale IQ (FSIQ). Under the latter condition, the races differ only very slightly, although significantly, on some of the subtests, in ways generally contrary to popular expectations. The profile of white-black differences on the WISC-R subtests is markedly different, and negatively correlated with, the profiles of social class differences within each racial group, indicating that the pattern of racial differences is not explainable in terms of the difference in the average socio-economic status (SES) of blacks and whites. A Schmid-Leiman orthogonalized hierarchical factor analysis yields virtually identical factor structures and highly congruent factor loadings on the subtests for whites and blacks. Analysis of factor scores shows that by far the largest proportion of the variance between races is attributable to the general factor (g) common to all the subtests, whereas the group factors (verbal, performance and memory) contribute only minutely to the interracial variance. Hence the white-black differences on the diverse subtests of the WISC-R, and in the Full Scale IQ, are interpreted primarily as a difference in Spearman's g, rather than as differences in the more specific factors peculiar to particular content, knowledge, acquired skills or type of test. However, some slight but significant differences in patterns of ability also occur that are independent of g.     

Black–White differences on IQ and grades: The mediating role of elementary cognitive tasks

The relationship between IQ scores and elementary cognitive task (ECT) performance is well established, with variance on each largely reflecting the general factor of intelligence, or g. Also ubiquitous are Black–White mean differences on IQ and measures of academic success, like grade point average (GPA). Given C. Spearman's (Spearman, C. (1927). The Abilities of Man. New York: Macmillan) hypothesis that group differences vary directly with a test's g loading, we explored whether ECT performance could mediate Black–White IQ and GPA differences. Undergraduates (139 White and 40 Black) completed the Wonderlic Personnel Test, followed by inspection time and choice reaction time ECTs. Despite restriction of range, ECT performance completely mediated Black–White differences on IQ (d = .45). Group differences on GPA (d = .73), however, were larger and ECT performance did not mediate them. We discuss findings in light of Spearman's hypothesis.     

IQ change and occupational level: A longitudinal study with Third Harvard Growth Study participants

Eighty subjects from a larger number of participants in a longitudinal study were selected according to their 1916 Stanford-Binet Intelligence Test scores, administered in the 1930s, and their 1977 occupations. They were then individually administered the Wechsler Adult Intelligence Scale. The research questions asked were: Did subjects shift their positions relative to age peers with regard to measured intelligence from Time 1 (1930s) testing to Time 2 (1977) testing? And, if they did, were these shifts related to their occupational levels? A secondary question asked whether subjects as a group showed mean T score increments between test times. A Pearson correlation coefficient (r = .62) showed that subjects had significantly maintained their positions relative to peers with regard to measured intelligence over approximately one-half of a century. The hypothesis that persons in higher level occupations should show greater gains in measured intelligence over time was not supported. Using multiple regression procedures, no significant difference was found from analysis of effects of occupational level on D (D = T₂ ? T₁) scores. An 80-subject mean T score increase (M = +8.13) was found. This represented an average increase of four-fifths of a standard deviation in T score units. These data suggest that, on average, persons increase in mental abilities over time while maintaining IQ positions relative to peers and that those changes in IQ which do occur are not related to occupational level experience.     

The secular rise in IQs in the Netherlands: Is the Flynn effect on g?

IQ scores have been increasing over the last half century, a phenomenon known as the Flynn effect. In this study, we focused on the question to what extent these secular gains are on the g factor. Two IQ batteries: the Interest-School achievement-Intelligence Test (ISI) and the Groningen Final Examination Primary Education (GALO) yielded small and modest negative correlations between standardized gains and g loadings. As these studies employ large samples this suggests that the combined literature now shows a modest negative relationship between d (the secular change in test score) and g.     

The relationship between WAIS-R abilities and speed of processing in a word identification task

Matched to the proportions found in the U.K. census data for a range of demographic variables (age, sex, and socioeconomic status) 123 participants were tested on the Wechsler Adult Intelligence Scale-Revised (WAIS-R) and a test of the minimum presentation time required to identify tachistoscopically presented words. The correlations between the sum of the scaled scores for Full, Verbal, and Performance subtests and the log of the identification measures were -0.40, -0.22, and -0.51, respectively. These results are in line with those observed between the WAIS-R measures and standard visual inspection time (IT). Confirmatory factor analysis indicated that a three-factor model of intelligence with Verbal, Performance, and Attention/Concentration factors, and with the identification threshold loaded on the Performance factor alone, represented a better fit to the data than either a single general factor model or a two-factor model with Verbal and Performance factors. These results are in line with findings in the IT literature (Deary, 1993) that speed of information processing is significantly related to performance IQ but not to verbal IQ.     

Inspection time and intelligence in 7-yr-old children: A follow-up

Remeasures of inspection time (IT) were obtained from 30 of the 47 children reported in Nettelbeck and Young (Personality and Individual Differences, 10, 605–614, 1989). Ages ranged from 7 yr–0 months to 7–11 and Full Scale IQ (WISC-R) ranged from 93 to 142 (mean = 116.5 SD = 12.2). Correlations between IT and the WISC-R subtests, scales and factors used in the earlier study were generally statistically significant: and similar to those found earlier. The correlation between IT and Full Scale IQ was — 0.49, with those children whose IQs were below the median score of 116 again contributing more to this outcome. Similarly, the IT-IQ correlation was higher among children showing less well-directed attention in the IT task. Once again IT correlated better with Verbal IQ, supporting the hypothesis that IT is better associated with more general intellectual functioning than with specific cognitive abilities. Cross-lagged panel correlations between IT and IQ were —0.40, whether predicting IQ from IT or the reverse. Thus, there was no evidence for a causal relationship between these variables, although both may reflect a common cognitive ability factor.     

Are Shunt Revisions Associated with IQ in Congenital Hydrocephalus? A Meta -Analysis

Although it is generally acknowledged that shunt revisions are associated with reductions in cognitive functions in individuals with congenital hydrocephalus, the literature yields mixed results and is inconclusive. The current study used meta-analytic methods to empirically synthesize studies addressing the association of shunt revisions and IQ in individuals with congenital hydrocephalus. Six studies and three in-house datasets yielded 11 independent samples for meta-analysis. Groups representing lower and higher numbers of shunt revisions were coded to generate effect sizes for differences in IQ scores. Mean effect size across studies was statistically significant, but small (Hedges’ g = 0.25, p < 0.001, 95 % CI [0.08, 0.43]) with more shunt revisions associated with lower IQ scores. Results show an association of lower IQ and more shunt revisions of about 3 IQ points, a small effect, but within the error of measurement associated with IQ tests. Although clinical significance of this effect is not clear, results suggest that repeated shunt revisions because of shunt failure is associated with a reduction in cognitive functions.     

Graduate student WAIS-III scoring accuracy is a function of full scale IQ and complexity of examiner tasks

Research on the Wechsler Adult Intelligence Scale-Revised and Wechsler Adult Intelligence Scale-Third Edition (WAIS-III) suggests that practicing clinical psychologists and graduate students make item-level scoring errors that affect IQ, index, and subtest scores. Studies have been limited in that Full-Scale IQ (FSIQ) and examiner administration, recording, and scoring tasks have not been systematically varied. In this study, graduate student participants score a high (FSIQ = 112) and low (FSIQ = 85) IQ record form in one of two stimulus conditions: digitized film clips (N = 13) or partially completed record forms (N = 11). Results demonstrate that examiners are less accurate in the high IQ condition, and that recording examinee responses from scoring video clips results in more scoring errors. Obtained FSIQs are significantly higher than criterion IQ scores in the high IQ condition (8.46 for video condition, 2.55 for record form condition). Self-reported proficiency in WAIS-III administration and scoring is positively related to number of scoring errors.     

Were the Victorians cleverer than us? The decline in general intelligence estimated from a meta-analysis of the slowing of simple reaction time

The Victorian era was marked by an explosion of innovation and genius, per capita rates of which appear to have declined subsequently. The presence of dysgenic fertility for IQ amongst Western nations, starting in the 19th century, suggests that these trends might be related to declining IQ. This is because high-IQ people are more productive and more creative. We tested the hypothesis that the Victorians were cleverer than modern populations, using high-quality instruments, namely measures of simple visual reaction time in a meta-analytic study. Simple reaction time measures correlate substantially with measures of general intelligence (g) and are considered elementary measures of cognition. In this study we used the data on the secular slowing of simple reaction time described in a meta-analysis of 14 age-matched studies from Western countries conducted between 1889 and 2004 to estimate the decline in g that may have resulted from the presence of dysgenic fertility. Using psychometric meta-analysis we computed the true correlation between simple reaction time and g, yielding a decline of − 1.16 IQ points per decade or − 13.35 IQ points since Victorian times. These findings strongly indicate that with respect to g the Victorians were substantially cleverer than modern Western populations.