A factor analysis of verbal ability

The Psychological Record -     

A factor analysis of intra-task performance on two psychomotor tests

There are indications that even during the short time of administration of a single psychomotor test, the ability or abilities sampled may shift materially in importance. It then becomes important to know the stages in which these fluctuations occur, the stage at which the test is most complex, and the stage at which the test most nearly measures one ability at a time. This paper describes an application of factorial methods to this problem. Factor analysis of inter-trial correlations on two models of the Rudder Control Test revealed three factors, Steadiness-Control, Precision of Movement, and Strength. The same factor pattern was confirmed in a separate factor analysis on another sample in which the order of administration of the tests was reversed. Implications are pointed out for future psychomotor test development.Perceptual and Motor Skills Research Laboratory, Lackland Air Force Base, San Antonio, Texas. The opinions or conclusions contained in this report are those of the author. They are not to be construed as reflecting the views or indorsement of the Department of the Air Force.     

The predictive validity of cognitive ability tests: A UK meta‐analysis

A meta‐analysis on the validity of tests of general mental ability (GMA) and specific cognitive abilities for predicting job performance and training success in the UK was conducted. An extensive literature search resulted in a database of 283 independent samples with job performance as the criterion (N=13,262), and 223 with training success as the criterion (N=75,311). Primary studies were also coded by occupational group, resulting in seven main groups (clerical, engineer, professional, driver, operator, manager, and sales), and by type of specific ability test (verbal, numerical, perceptual, and spatial). Results indicate that GMA and specific ability tests are valid predictors of both job performance and training success, with operational validities in the magnitude of .5–.6. Minor differences between these UK findings and previous US meta‐analyses are reported. As expected, operational validities were moderated by occupational group, with occupational families possessing greater job complexity demonstrating higher operational validities between cognitive tests and job performance and training success. Implications for the practical use of tests of GMA and specific cognitive abilities in the context of UK selection practices are discussed in conclusion.     

Estimation and tests of significance in factor analysis

A distinction is drawn between the method of principal components developed by Hotelling and the common factor analysis discussed in psychological literature both from the point of view of stochastic models involved and problems of statistical inference. The appropriate statistical techniques are briefly reviewed in the first case and detailed in the second. A new method of analysis called the canonical factor analysis, explaining the correlations between rather than the variances of the measurements, is developed. This analysis furnishes one out of a number of possible solutions to the maximum likelihood equations of Lawley. It admits an iterative procedure for estimating the factor loadings and also for constructing the likelihood criterion useful in testing a specified hypothesis on the number of factors and in determining a lower confidence limit to the number of factors.     

Multicomponent latent trait models for ability tests

A major research direction for ability measurement has been to identify the information-processes that are involved in solving test items through mathematical modeling of item difficulty. However, this research has had limited impact on ability measurement, since person parameters are not included in the process models. The current paper presents some multicomponent latent trait models for reproducing test performance from both item and person parameters on processing components. Components are identified from item subtasks, in which performance is a logistic function (i.e., Rasch model) of person and item parameters, and then are combined according to a mathematical model of processing on the composite item.The author would like to thank David Thissen for his invaluable insights concerning this model and an anonymous reviewer for his suggestion about the sample space for the model.This research was partially supported by National Institute of Education grant number NIE-6-7-0156 to Susan E. Whitely, principal investigator. However the opinions expressed herein do not necessarily reflect the position or policy of the National Institute of Education, and no official endorsement by the National Institute of Education should be referred. Part of this paper was presented at the annual meeting of thePsychometric Society, Monterey, California: June, 1979.     

Age comparative factor analysis of ability variables in adulthood and old age

The generality of ability factor structure in adulthood and old age was investigated using simultaneous maximum likelihood procedures. Data were analyzed for 198 young individuals (age range of 15–32 years), 156 younger old individuals (age range of 53–68 years), and 156 older old individuals (69–91 years). Variables were nine tests marking three ability factors: Verbal Comprehension, Sensitivity to Problems and Semantic Redefinition. Results indicated no changes in the number of factors and no psychologically important shifts in salient factor loadings. Increasingly larger factor covariances, however, were obtained in the two older groups. The results supported the generalizability of ability structures to late life at the level of factor loadings. The implications of these results for the dedifferentiation hypothesis were not clear cut. The consistency of the number of factors across age groups precluded strong support for this hypothesis, The increased factor covariances could be construed as modest support for this hypothesis, but other interpretations were possible.     

The MacQuarrie test for mechanical ability

Data originally analyzed by Charles H. Goodman on the MacQuarrie Test for Mechanical Ability are subjected to the principal axes factoring method. The maximum variance was extracted with three factors. Rotation to an oblique simple structure yielded a factor pattern which satisfies the simple structure concept more adequately than the orthogonal factor matrix, thus leading to greater clarity of interpretation of the factors.     

Psychometric costs of retaking driving-related cognitive ability tests

The present study tested predictions deduced from competing models advanced in the literature to explain practice effects in driving-related cognitive ability tests due to retesting. The models differ in terms of the processes assumed to be responsible for practice effects and make competing predictions with regard to the level measurement invariance across test administration sessions. A total of N = 239 test-takers solved four driving-related cognitive ability tests at three time-points of measurement. Item response theory analyses indicated that practice effects can be explained in terms of an increase in test-specific abilities. The size of the practice effect varied across driving-related cognitive ability tests and across test-takers’ level of general mental ability. Latent mean and covariance structure analyses indicated that the observed improvements in test performance are purely test-specific and do not generalize to broad cognitive speededness.     

Test anxiety and the validity of cognitive tests: A confirmatory factor analysis perspective and some empirical findings

The validity of cognitive ability tests is often interpreted solely as a function of the cognitive abilities that these tests are supposed to measure, but other factors may be at play. The effects of test anxiety on the criterion related validity (CRV) of tests was the topic of a recent study by Reeve, Heggestad, and Lievens (2009) (Reeve, C. L., Heggestad, E. D., & Lievens, F. (2009). Modeling the impact of test anxiety and test familiarity on the criterion-related validity of cognitive ability tests. Intelligence, 37, 34?41.). They proposed a model on the basis of classical test theory, and concluded on the basis of data simulations that test anxiety typically decreases the CRV. In this paper, we view the effects of test anxiety on cognitive ability test scores and its implications for validity coefficients from the perspective of confirmatory factor analysis. We argue that CRV will be increased above the effect of targeted constructs if test anxiety affects both predictor and criterion performance. This prediction is tested empirically by considering convergent validity of subtests in five experimental studies of the effect of stereotype threat on test performance. Results show that the effects of test anxiety on cognitive test performance may actually enhance the validity of tests.     

Adapting chronometric tests for field studies of cognitive ability

This study was designed to examine the relationship of hand preference to performance on a thumb-positioning task. Two hypotheses were proposed on the basis of hemispheric lateralization. The first stated that all subjects would perform the task more accurately using the left thumb, regardless of hand preference. The second hypothesis tested was that left-handed subjects would perform more accurately than right-handed subjects. Each of 20 neurologically intact adults grouped by hand preference reproduced a criterion thumb position with both thumbs simultaneously. Absolute error, recorded for each movement and analyzed by mixed analysis of variance, did support the first hypothesis. However, the left-handed group did not perform statistically differently from right-handed subjects. Factors influencing the data are discussed and recommendations for further studies are made.     

Comparison of the WISC-R and Woodcock-Johnson tests of cognitive ability

The relationship between the Woodcock-Johnson Tests of Cognitive Ability (WJTCA) and Wechsler Intelligence Scale For Children-Revised (WISC-R) was investigated in a referral sample of 52 elementary aged students. The WJTCA and WISC-R provided comparable ability estimates as reflected by a .74 correlation between the respective Full Scale scores and no significant (.05 level) mean difference (WJTCA Broad Cognitive Ability mean = 97.1, WISC-R Full Scale mean = 96.8). The comparability of the WJTCA/WISC-R global ability estimates is contrary to lower WJTCA scores found in recent studies with learning disabled students, with the current findings supporting the criticism of those studies as advanced by the author of the WJTCA.     

A simple method of factor analysis

A simple method for extracting correlated factors simultaneously is described. The method is based on the idea that the centroid pattern coefficients for the sections of unit rank of the complete matrix may be interpreted as structure values for the entire matrix. Only the routine centroid average process is required.