Validities of Unit-Weighted Composites of the ASVAB and the ECAT Battery

Currently, assignment to training in each entry-level enlisted job in the U.S. military is influenced by examinees’ scores on the classification composite for that job from the Armed Services Vocational Aptitude Battery (ASVAB). For a cross-service sample of the 18 occupations in the Enhanced Computer-Administered Test (ECAT) project, enhancements of their respective operational ASVAB composites (9 unique ones) are evaluated here. Analyses are reported on the gains in validity from adding 1 test with unit weight to each composite, the addition coming either from the other ASVAB tests or from the 9 tests of the ECAT battery. In more than half the schools, the best ASVAB additions were Coding Speed or Mechanical Comprehension. In the ECAT battery, 1 test of psychomotor ability (Two-Hand Tracking) and 2 tests of working memory (Mental Counters and Sequential Memory) were the most promising additions. The utility of the new composites for person–job matching is discussed.     

An Example of Assessment's Role in Career Exploration

A new ASVAB (Armed Services Vocational Aptitude Battery) 18/19 Career Exploration Program was made available to United States secondary and postsecondary schools in July 1992. The program allows individual students to use their aptitude test results, an inventory of their interests, and personal preferences to identify occupations with characteristics that seem to be consistent with their own. This capability of matching student characteristics to occupations is derived from extensive analyses based on work performed by the U.S. Departments of Labor and Defense.     

Development of a Cyber/Information Technology Knowledge Test for Military Enlisted Technical Training Qualification

An Armed Services Vocational Aptitude Battery (ASVAB) Review Panel, with expertise in personnel selection, job classification, psychometrics, and cognitive psychology developed recommendations for changes to the military enlistment test battery. One recommendation was to develop and evaluate a test of cyber/information and communications technology literacy to supplement current ASVAB content. This article summarizes a multiphased Cyber Test development process: (a) a review of information/computer technology literacy definitions and measures, (b) development and pilot testing of a cyber knowledge measure, (c) validation of test scores against final school grades (FSGs) for selected technical training courses, (d) development of an operational reporting metric and subgroup norms, and (e) examination of construct validity. Results indicate the Cyber Test has predictive validity versus technical training school grades and incremental validity comparable to the ASVAB technical knowledge tests when used with the ASVAB Armed Forces Qualification Test (AFQT) verbal/math composite as a baseline.     

Stepwise Selection of ECATs for Maximum Mean Validity

The problem addressed in this article is how to select a common battery of predictor tests for all armed services schools. A technique was developed for selecting a subset of tests from a larger test pool in order to maximize the mean corrected validity across occupational samples. The method involved adding or deleting tests stepwise to build a battery having a specified number of tests. The method was applied to the combined battery consisting of the Armed Services Vocational Aptitude Battery (ASVAB) and the Enhanced Computer-Administered Test (ECAT) battery. The analyses showed that, if all ASVAB tests were forced in first, validity tended to level off after 3 ECAT tests were added, each test representing a different ECAT factor. The first 3 ECAT tests selected by the procedure were Two-Hand Tracking, Mental Counters, and Assembling Objects. These 3 ECAT tests produced 76% of the validity gain from the full 9-test ECAT battery for preferred (i.e., hands-on performance oriented) school criteria. Also, a combination of 3 ECAT battery tests and 5 ASVAB tests had greater mean validity than did the full ASVAB of 10 tests. A variety of alternative combinations of 3 ECAT tests had nearly the same validity as did the optimal tests, as long as the tests measured the 3 basic ECAT battery factors of Psychomotor Ability, Working Memory, and Spatial Ability.     

Alternative Techniques for Predicting Success in Air Controller School

The Armed Services Vocational Aptitude Battery (ASVAB) is the principal cognitive test battery used for military classification-that is, for assignment of individuals to specific job categories. Successful entrance into a specific job category requires satisfactory completion of relevant training. Therefore, it is necessary that the ASVAB accurately predict the likelihood that individuals will complete training. Presently, the U.S. Navy classifies enlisted personnel based on a unit-weighted linear combination of scores derived from a subset of tests currently composing the ASVAB test battery. This research explored the development of new classification models estimated by using linear regression, logistic regression, discriminant analysis, and artificial neural networks, and it compared their classification accuracy with models developed using unit- weighted regression. Models were estimated and cross-validated using data from individuals admitted into the Navy's Air Controlman training during fiscal years 1988 and 1989. Accuracy was measured by the proportion of individuals correctly classified as graduates or as academic failures and by the ability to rank students-that is, to predict the highest scores for graduates and the lowest scores for attrites.     

The extension of Holland's Occupational Classification to all occupations in the Dictionary of Occupational Titles

Two methods are presented for extending Holland's occupational classification to include all occupations in the Dictionary of Occupational Titles (DOT).     

Perceived causality for success in occupations

A representative group of occupations was examined within an attributional framework, utilizing the concept of perceived causality for success. Specifically, it was hypothesized that (1) success in different types of occupations would be attributed to different causes, (2) the causal attributions of incumbents would differ from those of nonincumbents, (3) standard occupational categories could be derived on the basis of perceived causality for success, and (4) perceived causality for success could be used as a basis for generating a circular ordering of occupations.Holland's (1973) occupational classification was used as a basis for categorization. College students, as well as six types of occupational incumbents, were administered a questionnaire in which they attributed causality for success in 35 occupations. The results supported the first three hypotheses and also revealed some systematic relationships between causes and between perceived causality for success and occupational prestige.     

An Examination of Five Indexes of Test Battery Performance: Analysis of the ECAT Battery

This investigation evaluated potential revisions to the Armed Services Vocational Aptitude Battery (ASVAB). The data analyzed were collected from trainees in 17 U.S. Air Force, Army, and Navy jobs as part of the Joint-Services Enhanced Computer-Administered Test (ECAT) battery validation study. Predictors included the trainees’ preenlistment scores for the 10 tests in the current ASVAB, plus the 9 experimental ECAT battery tests. The criteria were measures of training performance. All possible combinations of tests that (a) included the Word Knowledge and Arithmetic Reasoning tests of the ASVAB and (b) could be administered in a 134- to 164-min interval were evaluated with respect to 5 indexes of test battery performance: criterion-related validity, classification efficiency, and 3 types of subgroup differences (White vs. Black, White vs. Hispanic, and male vs. female). The 5 indexes were calculated for each of the 16,437 possible combinations of tests. The standard deviations of the indexes across the combinations of tests showed that (a) values on the validity index varied little, (b) values on the classification efficiency and White versus Black and White versus Hispanic subgroup differences indexes varied moderately, and (c) values on the male versus female difference index varied substantially. The validity index of the combinations showed a moderate correlation with the classification efficiency index and a nearly zero correlation with subgroup differences. However, the classification efficiency index showed a small-to-moderate positive correlation with the subgroup difference indexes. The subgroup difference indexes showed moderate-to-high positive correlations with one another. Examinations of the top 20 combinations of tests identified by each index demonstrated that tests that optimize one type of index usually do not optimize each of the other indexes. In particular, trade-offs were observed between (a) the maximization of validity (and classification efficiency) versus the minimization of all 3 types of subgroup differences and (b) the minimization of differences between Whites and Blacks (or between Whites and Hispanics) versus the minimization of differences between men and women. These results suggest that no combination of the tests considered in this investigation simultaneously optimizes all 5 test battery performance indexes.     

An occupational taxonomy by professional characteristics: Implications for research

Theorists concerned with the nature of professionalism and researchers investigating professionals in the work environment often assume that professional occupations are a unique occupational type. To test this assumption, an occupational taxonomy based on nine dimensions of professionalism was derived empirically. The taxonomy represented expectations only to a moderate degree. Several implications were noted for the use of occupational taxonomies in the generalization of research findings on one occupational group to other occupational groups in the same classification.     

A multivariate investigation of the reinforcer structure of occupations

Earlier research based on 81 Occupational Reinforcer Patterns (ORPs) suggested a nine-category classification of occupations. The present research, based on 148 ORPs, investigated the ability of that classificatory system to assimilate new information. Cluster analysis of the 148 ORPs yielded an eight-category classification of occupations in which five of the original occupational clusters appeared virtually unchanged; the other four original clusters were combined into two occupational clusters. One new cluster was identified. Principal factors analysis was employed to study the factor structure of the occupational reinforcers and to highlight the essential nature of the classificatory system. Five reinforcer factors were identified.     

Individual and group differences in intelligence and speed of information processing

A battery of eight different reaction time (RT) tests, measuring the speed with which individuals perform various elementary cognitive processes, and a group test of scholastic aptitude (the Armed Services Vocational Aptitude Battery, ASVAB) were given to 50 black and 56 white male vocational college students. The regression of the general factor scores of the ASVAB on the RT measures yielded a shrunken multiple correlation of 0.465. Although discriminant analyses, when applied separately to the ASVAB subtests and to the RT variables, showed highly comparable overall discrimination (over 70% correct classification) between the black and white groups, factor scores derived from the general factor (labeled ‘speed of information processing’) of the RT battery show only about one-third as large a mean black-white difference as the mean group difference on the general factor scores derived from the ASVAB. Comparisons were also made between the 106 vocational college students and 100 university students of higher average academic aptitude who had previously been tested on the same RT battery (Vernon, 1983a). These groups showed marked differences on the RT variables, the largest differences occuring on the tests that required more complex cognitive processing. The more complex RT tests also correlate most highly with the psychometric measures of ability within each group. The results are consistent with the hypothesis that individual differences and the mean differences between groups in psychometric abilities and scholastic achievement are related to differences in the speed of information processing as measured in elementary cognitive tasks.     

The common space of personality traits and vocational interests

Investigated relationships between personality traits and vocational interests. Cattell's (Research and Consultations Center of Educational Personnel, 1976) CAQ Part I and the Ramak interest inventory (Meir, 1975) based upon Roe's (1956) occupational classification system were administered to a sample of 397 university applicants. Canonical Correlation Analysis and Smallest Space Analysis were used to test two hypotheses (a) relationships exist between personality traits and vocational interests; and (b) personality traits which characterize occupational profiles are arranged in circular order corresponding to the configuration Of the vocational fields which represent those occupations. Both hypotheses were supported by the data.     

Correcting Differences in Answer Sheets for the 1980 Armed Services Vocational Aptitude Battery Reference Population

In the late 1970s, the Department of Defense (DoD) requested that the reference population for the Armed Services Vocational Aptitude Battery (ASVAB), at that time based on a 1944 sample, be changed and updated to reflect the current youth population. In 1980, the data for the new reference group were collected. Data analyses indicate that the new sample's speeded test scores are atypically low; therefore, the sample might be inappropriate as a reference. The problem was traced to the format of an answer sheet used in the 1980 youth population data collection. In our study, we tested the differences between performance on the 1980 youth study answer sheet and that used operationally for the ASVAB. An adjustment was developed to resolve those differences. Data for this study were scores on two ASVAB speeded tests of about 9,500 service applicants at Military Entrance Processing Stations (MEPS). Half of these applicants were tested on the operational ASVAB answer sheet; half were tested with the answer sheet used in the 1980 youth study. The speeded test scores derived from the 1980 youth study answer sheets were then equated to those derived from the operational ASVAB answer sheets. Adjustments based on these equatings resolved the speeded test anomalies observed in the 1980 youth study.     

The fit of Holland’s RIASEC model to US occupations

Holland’s [Holland, J. L. (1959). A theory of occupational choice. Journal of Counseling Psychology, 6, 35-45; Holland, J. L. (1997). Making vocational choices: A theory of vocational personalities and work environments (3rd ed.). Odessa, FL: Psychological Assessment Resources, Inc.] RIASEC types were initially developed using a restricted range of occupational titles. Holland’s type classification system has been extended to encompass the full range of occupations in the US, using both statistical and expert rating methods. However, the extent that Holland’s classification model is sufficient to represent the full range of occupational interests has not been examined. Multidimensional scaling (MDS) was used to analyze college students’ (266 men, 572 women) interests in occupations representing approximately 85% of the US labor market. A two-dimensional MDS solution of the full set of occupations did not fit Holland’s model, but limiting the analysis to occupations used in Holland-based measures produced the expected RIASEC structure. In comparison, a three-dimensional solution included Prediger’s [Prediger, D. J. (1982). Dimensions underlying Holland’s hexagon: Missing link between interests and occupations? Journal of Vocational Behavior, 21, 259-287] dimensions (Things/People and Data/Ideas) consistent with Holland’s model, but also included prestige and sex-type dimensions that were not orthogonal to Prediger’s dimensions. These results demonstrate that the RIASEC types are not sufficient to represent the full range of occupational interests and are confounded with prestige and sex-type.     

Homemaking as an occupational plan: Evidence from a national longitudinal study

While several guidelines for avoiding sexist language in career materials have been published, little empirical evidence exists to support the assumption that sexist language in career information has deleterious effects on clients. The purpose of this study was to explore the effects of sex-biased language in occupational information on subject interest and attitudes regarding gender appropriateness of occupations. Eighth-grade students read occupational briefs on two occupations presented in either neutral, female-biased, or male-biased language. Results showed a nonsignificant language effect and a significant sex difference in interest in the occupations. A significant three-way interaction (language by subject sex by occupation) was found for gender-appropriateness ratings. The findings, together with previous research, suggest that language may have little impact on specific occupational interests, but may affect other career attitudes related to interests.     

Relationship with people as the underlying dimension for Roe's classification of occupations

One hundred eleven subjects were asked to indicate how much relationship with people is involved in 48 occupational titles. The results support Roe's (1956) classification of occupations: differences within occupational fields were found to be smaller than differences between occupational fields (F = 8.53, P < .01). The homogeneity of Arts and Entertainment is discussed.     

Inventories based on Roe and Holland yield similar results

Holland (1973) classified all occupations into six occupational fields: Realistic, Investigative, Artistic, Social, Enterprising and Conventional. Roe (1956) classified occupations into Service, Business, Organization, Technology, Outdoor, Science, General Cultural, and Arts and Entertainment fields. Two hundred seventeen Israeli ninth-grade students answered two interest inventories, one based on Holland's classification and one on Roe's classification. By means of a Smallest Space Analysis (SSA-I), a two-dimensional configuration was found. In this configuration the hypothesized parallel fields appear adjacent to one another and the general shape resembles the structure found earlier for each classification system separately. The findings indicate the possibility of incorporating results based on either classification. Some practical applications of the findings are discussed.     

Implicit and Explicit Occupational Gender Stereotypes

This study was designed to compare implicit and explicit occupational gender stereotypes for three occupations (engineer, accountant, and elementary school teacher). These occupations represented the end points and middle of a masculine–feminine continuum of explicit occupational gender stereotypes. Implicit stereotypes were assessed using the Implicit Association Test (IAT), which is believed to minimize self-presentational biases common with explicit measures of occupational gender stereotypes. IAT results for the most gender stereotyped occupations, engineer (masculine) and elementary school teacher (feminine), were comparable to explicit ratings. There was less agreement with less stereotyped comparisons. Results indicated that accounting was implicitly perceived as more masculine than explicit measures indicate, which calls into question reports of diminishing gender stereotyping for such occupations.     

Ranking and Factorial Structure of Occupational Stereotypes Among Jewish Pupils in South Africa

This study investigated the hierarchical order of occupations by means of 10 evaluative criteria, and established the factorial structure of occupational stereotypes in a group of 82 Jewish pupils in South Africa, who rated 20 occupations on the Semantic Differential. Conclusions are: (a) the rank orders of occupations are highly similar irrespective of ranking criterion; (b) on the whole, professions tended to be ranked most favorably, and manual and unskilled jobs least favorably; and (c) occupational stereotypes were found to fall into four different categories, labeled (1) practical occupations with relatively high status; (2) unattractive occupations (semiskilled); (3) female occupations; and (4) occupations possessing power and influence.