The selective efficiency of a test battery

In industrial acceptance sampling one frequently makes use of operating characteristic curves to describe the discriminating power of a particular sampling plan. Similarly, it is possible to demonstrate the selective efficiency of a test battery in terms of (a) the Applicant's Operating Characteristic (A.O.C.); (b) the Selector's Operating Characteristic (S.O.C.). The A.O.C. determines the chance of selection by means of a test for any given level of true ability. The S.O.C. connects functionally probability of success on the criterion with the predictor scores of a battery. For the case of a normal bivariate distribution the exact mathematical expressions of the OC curves are derived in terms of the correlation coefficient, the cut-off points and, and the predictor and criterion scoresX andY (in standard measures). The Efficiency IndexH is defined as the percentage of successful subjects gained by the use of a test battery, taking chance selection as a yardstick for comparison. Its optimum, for fixed and , is derived. The distribution law of the criterion scores of selectees is deduced and its first four moments are shown to depart little from normality for cases usually encountered in practice. A Quality-Gain diagram graphically illustrates the improvements secured. Another simple device, the Cost-Utility diagram, explains to management the full implications of selecting personnel by means of a test battery. Neither of the diagrams requires an understanding of the correlation coefficient. The confidence belt of the OC curves, the standard error of the mean criterion score of selectees and the standard error of the predicted number of successful applicants are determined. Finally, the full theory is applied in detail to a real test battery.This paper is the result of an investigation undertaken by the South African National Institute for Personnel Research, Johannesburg, and was completed at the Educational Testing Service, Princeton. The author wishes to thank these organizations for permission to publish this paper.     

Optimal test length for maximum battery validity

Having given a fixed amount of total testing time it is important to know how long each test in the battery should be so that the correlation of the battery with the criterion will be a maximum. The precise solution for the test lengths will depend on a particular set of conditions which may be specified. The writer has previously presented solutions for two sets of conditions. This article presents the solution for a third set of conditions. These are: (1) The total number of items or testing time is fixed. (2) The score is the total number of items correctly answered. (3) The test lengths are determined in such a way that the correlation of total score with the criterion is a maximum. The solutions for the two previous sets of conditions, together with the current set, are summarized. A set of experimental data is submitted to each solution and the three sets of results are compared.     

Genetic differences in the mouse defense test battery

The mouse defense test battery (MDTB) has been designed to examine anxiogenic- or anxiolytic-like properties of psychoactive drugs through effects on specific defensive behaviors. In the present study, the MDTB was used to evaluate the potential contribution of genetic factors to these behaviors. The data revealed pronounced differences in several defense reactions among four inbred strains (BALB/c, C57BL/6, CBA, DBA/2) and one outbred (Swiss) mouse line. Thus, when subjects were introduced into the apparatus, Swiss and C57BL/6 displayed the highest levels of horizontal and vertical activities, while BALB/c and DBA/2 mice showed intermediate and CBA low activity rates. When subjects were chased by the rat, C57BL/6 mice used flight as the dominant defense strategy, while the defensive responses of BALB/c, C57BL/6, and DBA/2 mice consisted of flight reactions and risk assessment activities. However, when flight or escape was not possible, risk assessment became the predominant feature of the defense repertoire in the C57BL/6 mice. When defensive threat/attack behaviors were required, Swiss, BALB/c, DBA/2, and C57BL/6 mice showed very similar reactions in terms of the magnitude of the responses observed. CBA mice were poorly defensive in all these test situations. Finally, after the rat was removed from the test apparatus, Swiss, DBA/2, and C57BL/6 mice displayed more vertical activities than BALB/c mice. These latter, however, showed an increased level of ambulation compared to the activity recorded before the rat exposure. Together, these findings indicate that genetic factors contribute to defensive behaviors in this animal model of anxiety. The different behavioral profiles displayed by the strains used here may provide the means to obtain a better insight into the neurobehavioral mechanisms involved in anxiety-related disorders. Aggr. Behav. 23:19–31, 1997. © 1997 Wiley-Liss, Inc.     

Validation of a test battery for manufacturing machine operators

The present study determined if it was possible to develop a selection procedure which would effectively select machine operator applicants. A concurrent validity study was conducted on 140 employees with a job simulation as the criterion. The results indicated a correlation with the criterion of .71, and the Lawshe (1983) test of fairness revealed no significant bias for minority or female applicants. The utility analysis indicated a 16% increase in output would occur with the use of the validated selection system.     

The organization of attention in typical development: A new preschool attention test battery

This article introduces a new battery of attention tests for typically developing and atypically developing children with a mental age of 3–6 years. In the light of adult and child studies supporting a model of distinct networks for specific attentional operations, tests in the current battery were selected with the aim of measuring functions of selective attention, sustained attention and attentional control (executive function). Normative data were collected from 154 typically developing children aged 3–6 years and examined using exploratory factor analysis to determine latent constructs underlying test performance. This analysis suggested increasing differentiation of attention functions over the age range, with support for the hypothesized three‐factor model only after 4½ years of age. Additional analyses supported the validity of the new attention battery with respect to (1) parent/teacher report measures of everyday attention behaviour and (2) later performance on the Test of Everyday Attention for Children (TEA‐Ch), a battery designed for children aged 6–16 years. The results show the developing differentiation of attention functions and support the ecological and predictive validity of the battery as providing early performance‐based measures of attention and an attention ‘profile’ for each individual child, which may aid characterization and remediation of neurodevelopmental disorders.     

The relationship between the validity of a single test and its contribution to the predictive efficiency of a test battery

Typical selection or classification testing programs should provide for improvement of the predictive efficiency of the test battery. Such provision calls for the administration of experimental tests along with the operational battery administration and follow-up analysis to determine the value of the experimental material. It is possible to determine without waiting for criterion data what the validity of the experimental test must be in order to improve the battery validity. The method together with the proof is presented.     

The relationship between intelligence,working memory,academic self-esteem,and academic achievement

Academic achievement is crucial for life and long-term outcomes. The aim of the present study is to examine the joint role of cognitive (intelligence and working memory) and non-cognitive (academic self-esteem) factors in predicting academic achievement (mathematics and reading literacy) in a sample of Italian sixth and eighth graders. The results showed that within the cognitive factors considered, intelligence was the best predictor of achievement. As regards to non-cognitive factors, academic self-esteem was effective at predicting achievement after controlling for cognitive measures. Academic self-esteem was also found to have an indirect effect, mediated by intelligence, on academic achievement. Both theoretical and practical implications of the present results are discussed.     

A test battery to assess intrasensory and intersensory development of young children.

The purpose of the study was to develop a battery of tests for use in evaluation of intra- and intersensory development of young children. A battery of 15 tests (4 visual, 4 auditory, 4 tactile-kinesthetic, and 3 intersensory) was administered to 109 normally developing 6- and 8-year-old and 32 slowly developing or learning disabled children. Interdependence of test items within each intrasensory and the intersensory category was determined; intercorrelations ranged from .00 to .78. Reliability estimates were also determined. Face validity was claimed for each item. The effects of age or developmental level on test performance were established. Based upon the interdependence of the tests, reliability estimates, and the capacity of the tests to discriminate among groups classified according to age or developmental level, a battery of 10 intra- and intersensory tests was proposed. The battery has 3 tests of visual perception-visual memory, dynamic depth perception, and size discrimination; 3 tests of auditory perception-auditory discrimination, auditory memory of related syllables, and auditory sequential memory of numbers; 2 tests of tactile-kinesthetic perception-tactile integration and movement awareness; and 2 tests of intersensory integration-auditory-tactile intergration and auditory-visual integration.     

Toward a comprehensive test battery for face cognition: Assessment of the tasks

Despite the importance of face recognition in everyday life and frequent complaints about its failure, there is no comprehensive test battery for this ability. As a first step in constructing such a battery, we present 18 tasks aimed at measuring face perception, face learning, face recognition, and the recognition of facially expressed emotions. A sample of 153 healthy young adults completed all tasks. In general, reaction time measures showed high estimates of internal consistency; tasks focused on performance accuracy yielded reliabilities that were somewhat lower, yet high enough to support their use in a battery of face cognition measures. Some of the tasks allowed computation of established experimental effects in a within-subjects design, such as the part-whole effect. Most of these experimental effects were confirmed in our large sample, and valuable effect size estimates were obtained. However, in many cases these difference measures showed poor estimates of internal consistency.     

Maximizing test battery prediction when the weights are required to be non-negative

A procedure is developed for computing optimum regression weights under the restriction that they be non-negative. The weights maximize, subject to the restrictions, the multiple correlation between several predictors and a criterion. A numerical example is provided.     

The stability of validity coefficients over time: Ackerman's (1988) model and the general aptitude test battery

This study examined P. L. Ackerman's (1988) model of skill acquisition within an applied setting. Differences were examined between jobs on the basis of task consistency: changes in performance variability across experience, learning curves, and stability of ability-performance correlations across experience. Results showed the degree of task consistency influenced the shape of learning curves, with jobs composed of primarily consistent tasks improving more rapidly and reaching asymptote sooner. In addition, trends in ability-performance correlations were moderated by the degree of task consistency within ajob. Specifically, forjobs with primarily consistent tasks, general cognitive ability best predicted early performance whereas psychomotor ability best predicted later performance. In contrast, general cognitive ability was the strongest predictor across experience for jobs with primarily inconsistent tasks.     

A computer-based test battery for the assessment of static and dynamic spatial reasoning abilities

A battery of 10 computerized tests of spatial ability is described. It includes 5 tests that require reasoning about static spatial displays and 5 tests that require reasoning about dynamically displayed spatial information. An integrated software package for task presentation and data analysis is described, along with a summary of results from a validation study comparing performance on the computer-based tests with performance on standardized paper-and-pencil tests of spatial abilities. Finally, research applications of the current battery are discussed.     

A revised orthogonal rotational solution for Thurstone's original primary mental abilities test battery

By extension of the rotational process, meaningful orthogonally related positions were found for all of the thirteen centroid factors which Thurstone extracted from his original PMA intercorrelations. Most of the original primary ability factors were more sharply delineated and corresponded more closely to the Army Air Force factors that bear similar names (demonstrating greater invariance from analysis to analysis). While such different results obtained by two investigators applying the same methods on the same data may initiate some concern, the results strengthen rather than weaken the idea that more psychological meaningfulness and greater invariance will result if centroid axes are rotated, using the concepts of a simple structure and positive manifold.Thurstone considered loadings between ±.20 as negligible and considered only loadings of at least .40 in naming factors.     

Gender,g, Gender Identity Concepts,and Self-Constructs as Predictors of the Self-Estimated IQ

In all 102 participants completed 2 intelligence tests, a self-estimated domain-masculine (DMIQ) intelligence rating (which is a composite of self-rated mathematical–logical and spatial intelligence), a measure of self-esteem, and of self-control. The aim was to confirm and extend previous findings about the role of general intelligence and gender identity in self-assessed intelligence. It aimed to examine further correlates of the Hubris-Humility Effect that shows men believe they are more intelligent than women. The DMIQ scores were correlated significantly with gender, psychometrically assessed IQ, and masculinity but not self-esteem or self-control. Stepwise regressions indicated that gender and gender role were the strongest predictors of DMIQ accounting for a third of the variance.