Analysis of the piat with Anglo and Mexican-American children

This study analyzed the utility of the PIAT when administered to separate samples of Anglo and Mexican-American children using the WRAT and WISC-R as comparative measures. Thirty-one Mexican-American and 31 Anglo-American children were matched on the basis of sex, age, SES, educational placement, and reason referred for psychological assessment. All children were administered the PIAT, WRAT, and WISC-R. Partial intercorrelations (CA held constant) among the PIAT subtest raw scores and subtests of the WRAT purporting to measure the same construct were performed. Adequate concurrent validity was found for the PIAT Mathematics, Spelling, and Reading Recognition subtests for both Anglo and Mexican-American children. Analysis of subtest means and concurrent validity between ethnic groups showed general equivalence with the exception of WISC-R Verbal IQ means, which was significantly lower for the Mexican-American group. Implications for assessing Mexican-American children are discussed.     

EDITOR'S NOTE

In the framework of a linear logistic testing model, Mislevy, Sheehan, and Wingersky (1993) showed how to incorporate collateral information in estimating item parameters required for test equating. The purpose of the study was to explore the feasibility of applying this method to equate tests constructed for college entrance examination by comparing its results with those of the item response theory (IRT) true-score equating. Overall, the equating results based on collateral information are relatively comparable with those of IRT equating. In terms of R2's, the prediction equations for item characteristics are good to excellent. The significant levels of correlation coefficients between IRT calibrated b (difficulty level) and predicted b parameters range from around .01 to .05. The goodness of fit of true-score test characteristic curves (TCCs) based on collateral information to IRT true-score TCCs are excellent. Results of the study are discussed in light of factors that may affect the validity of using collateral information in test equating.     

A Japanese short form of the Swanson Cognitive Processing Test to measure working memory: reliability, validity, and differences in scores between primary school children of the United States and Japan

The purpose of this study was to examine the reliability and validity of a Japanese short form of the Swanson Cognitive Processing Test, which assesses capacity of working memory. Test-retest reliability was acceptable (r = .76). Concurrent validity was suggested through comparison of scores on the Reading Span Task (r = .55). Means on the Japanese short form were comparable with means for the 3 subtests for the older group and 2 subtests for the younger group. With the exception of the Auditory Digit Sequence, results suggested that both the Japanese short form and the initial Swanson Cognitive Processing Test measured comparably the working memory in the two samples of children.     

The relation between the difficulty and the differential validity of a test

Using scores of 1200 students on a long test as a criterion, each of five subtests of different difficulty has maximum correlation with the criterion when the criterion is dichotomized at a value appropriate to the difficulty of the subtest. A 50-item test element is scored on an all-or-none basis with different standards for passing, and the percentage of passes for successive points on the criterion variable is computed. The Constant Method is applied to this relationship. The limen thus computed is a measure of difficulty, the dispersion is a measure of average (or total) validity, and the slope of the curve is a measure of differential validity. The difficulty of a test element is thus directly related to the maximum differential validity.     

Validity and reliability of the Test of Early Reading Ability-Second Edition with preschool age children

Criterion validity and test-retest reliability across the two forms of the Test of Early Reading Ability-Second Edition were examined. 18 preschool age children, 4 boys and 14 girls, between the ages of 37 and 59 mo. (M = 48.5, SD = 7.6) were randomly administered Forms A and B as well as the sound-blending, letter-word identification, spelling, and sound-awareness reading subtests from the 2001 Woodcock Johnson-III. Correlations were moderate between the children's performance on the Test of Early Reading Ability-2 Forms A and B and their reading subtest scores from the Woodcock Johnson-III and also between Forms A and B of the Test of Early Reading Ability-2. However, Forms A and B of the Test of Early Reading Ability-2 were not clinically equivalent.     

Exploring the Reliability and Validity of the DAT-K in Grade 11 Learners in a Historically Disadvantaged School in Johannesburg,South Africa

This study explored the reliability and validity of the Differential Aptitude Test—Form K (DAT-K) in a sample of 75 learners (mean age = 17.1 years, SD = 1.13) from a previously disadvantaged school in Johannesburg. Adequate reliability coefficients were obtained but coefficients were higher for nonverbal than verbal subtests. Face validity was judged to be adequate but construct validity was questionable. All subtests correlated within cluster (verbal, non-verbal) but all the subtests with the exception of the Comparison subtest loaded highly on a single factor. Examination of the influence of language as a variable suggested that learners whose home language was an African language did significantly poorer on all the DAT-K subtests except for the Comparison subtest. These findings lend support to the arguments that psychological testing in South Africa is problematic particularly in individuals who do not speak English as their first language.     

Gender and Mathematical Problem Solving

The relationship between gender and mathematical problem-solving among high ability students depends on the attributes of the problem solving questions. This was evident in the present study of 12-year-olds. The children were from predominately White families. Eighty-three males and 76 females were tested in both the fall and the spring on the Fennema-Sherman Mathematics Attitudes Scales and on the Canadian Test of Basic Skills (CTBS). In the Spring, students were also tested on the GAUSS. Both the CTBS and the GAUSS measure mathematical problem solving. Among high ability students, there were gender differences on the problem-solving scale of the CTBS but not on the GAUSS, even though the GAUSS was independently rated as the more abstract and difficult of the two tests. The present study describes the implications of this for the question of the origin of gender differences in mathematics, and also looked at the relationship between attitudes toward mathematics and mathematical problem-solving performance.     

Sex Differences in Mathematics Components of the Iowa Tests of Basic Skills

The Mathematics Problem Solving (MRS) and Mathematics Concepts (MC) subtests of the Iowa Tests of Basic Skills were investigated for content and psychometric item bias at grades 3, 6, and 8. A small proportion of items were identified in each subtest which significantly favored either males or females. No skill classification, item content or location trends could be found for the mathematics subtests at each grade level. Across the grade levels, items in the MC subtest favored males for grades 3 and 6, but females were favored at grade 8. The procedure used in the study is generalizable to other groups (minority or grade levels). Test consumers have the right to know whether the test they use is fair for selected groups of students. Results from empirical investigations should appear in the Test Manual that accompanies the test battery.     

Cognitive Tests Used in Selection Can Have Content Validity as Well as Criterion Validity: A broader research review and implications for practice

Many industrial/organizational (I/O) psychologists, both academics and practitioners, believe that the content validity model is not appropriate for cognitive ability measures used in personnel selection. They believe that cognitive tests can have criterion validity and construct validity but not content validity. Based on a review of the broader differential psychology research literature on cognitive skills, aptitudes, and abilities, this article demonstrates that with the proper content validity procedures, cognitive ability measures, including, ultimately, some de facto measures of general cognitive ability, can have content validity in addition to criterion and construct validity. Finally, the article considers, critiques, and refutes the specific arguments contending that content validity is inappropriate for use with cognitive skills and abilities. These research facts have implications for I/O practice, professional standards, and legal defensibility of selection programs.     

Incremental validity of the MMPI-A content scales in the prediction of self-reported symptoms

The incremental contribution of the MMPI-A (Butcher et al., 1992) content scales to the prediction of scores on self-report measures of psychopathology was examined in a sample of 62 adolescents in inpatient treatment and 59 adolescents from the community. All participants completed the MMPI-A and a battery of criterion measures. A series of hierarchical regression analyses was conducted in which the MMPI-A clinical and content scales served as the independent variables and the criterion measures as the dependent variables. The content scales were found to have incremental validity beyond the clinical scales in predicting variance in the criterion measures. Similarly, the clinical scales also demonstrated incremental validity over the content scales in making these predictions. Both sets of scales made independent contributions to the prediction of sample membership (clinical vs. nonclinical). Findings suggest that both the clinical and content scales of the MMPI-A make significant contributions to the assessment of adolescents' psychological functioning.     

Assessing reading comprehension with narrative and expository texts: Dimensionality and relationship with fluency,vocabulary and memory

Reading comprehension assessment should rely on valid instruments that enable adequate conclusions to be taken regarding students' reading comprehension performance. In this article, two studies were conducted to collect validity evidence for the vertically scaled forms of two Tests of Reading Comprehension for Portuguese elementary school students in the second to fourth grades, one with narrative texts (TRC‐n) and another with expository ones (TRC‐e). Two samples of 950 and 990 students participated in Study 1, the study of the dimensionality of the TRC‐n and TRC‐e forms, respectively. Confirmatory factor analyses provided evidence of an acceptable fit for the one‐factor solution for all test forms. Study 2 included 218 students to collect criterion‐related validity. The scores obtained in each of the test forms were significantly correlated with the ones obtained in other reading comprehension measures and with the results obtained in oral reading fluency, vocabulary and working memory tests. Evidence suggests that the test forms are valid measures of reading comprehension.     

Spearman’s Law of Diminishing Returns and national ability

This research examined Spearman’s Law of Diminishing Returns (SLODR) using national ability as the unit of analysis. National ability was estimated using international standardized tests such as the Programme for International Student Assessment (PISA), Trends in International Mathematics and Science Study (TIMSS), and Progress in International Reading Literacy Study (PIRLS). Factor analysis estimated the national G loadings of tests for high and low ability nations. Consistent with SLODR, the G loadings of tests were lower for higher ability nations. The pattern was confirmed after correcting for school attendance and age biases. Because a test’s g loading is directly related to its predictive validity (correlation with outcomes), our results imply that the predictive validity of tests may be lower for higher ability nations.     

Measuring Latent Quantities

A distinction is proposed between measures and predictors of latent variables. The discussion addresses the consequences of the distinction for the true-score model, the linear factor model, Structural Equation Models, longitudinal and multilevel models, and item-response models. A distribution-free treatment of calibration and error-of-measurement is given, and the contrasting properties of measures and predictors are examined.     

Conceptual tempo as a moderator variable in predicting first grade achievement test scores

This study examined the utility of a set of tests for predicting the academic achievement of separate samples of impulsive and reflective first graders. The predictor tests were the Peabody Picture Vocabulary Test, the Columbia Mental Maturity Scale, Wepman's Auditory Discrimination Test, the ITPA Sound Blending Subtest, the WISC Digit Span Subtest, and Kaufman's WISC-R Verbal Comprehension Factor (Comprehension, Information, Similarities, and Vocabulary). The criterion measures were drawn from the Stanford Achievement Test and included scores for Total Auditory, Total Mathematics, Total Reading, Vocabulary and Listening Comprehension. Multiple regression analyses revealed that (a) for three of the five criterion variables, the optimal equations for predicting the achievement test scores differed for impulsives and reflectives, and (b) given the same predictor scores, the predicted achievement of impulsive and reflective children different considerably. It was concluded that conceptual tempo is an important moderator variable in predicting academic performance.     

The construct validity of the stanford-binet 5 measures of working memory

This study examines the validity of the measures of verbal and nonverbal working memory on the Stanford-Binet Fifth Edition (SB5). The validity evidence included Rasch-based, criterion-referenced item mapping, correlations with other clinical measures of memory, and prediction of reading and mathematics scores. The item mapping clearly demonstrates a parallel between increasing item difficulty and a progression of item characteristics that placed increasing demands on verbal and nonverbal working memory. The higher correlations of the SB5 verbal and nonverbal working memory subtests with other measures of verbal and nonverbal memory, respectively, and lower correlations with nonverbal and verbal memory measures, respectively, clearly show convergent and divergent validity. The higher correlations between SB5 verbal working memory and reading skills and between SB5 nonverbal memory and mathematics skills are consistent with past research.     

Relationship between the Kaufman Test of Educational Achievement--Brief Form and the Wide Range Achievement Test--Revised Level 2 with incarcerated juvenile delinquents

The Kaufman Test of Educational Achievement--Brief Form and the Wide Range Achievement Test--Revised Level 2 were administered in counterbalanced order to 50 male incarcerated juvenile delinquents. The analyses showed the similar subtests on the two tests, i.e., Kaufman Reading test and WRAT-R Reading, were highly correlated. The mean standard scores of th e similar subtests were not significantly different from each other. These results contrast with the significantly lower WRAT-R scores found when scores on the WRAT-R Level 1 are compared with those on the Kaufman test.     

Relationship of the Wechsler pre-school and primary scale of intelligence and the Stanford-Binet (L-M) in lower class children

Using 72 lower class children, concurrent validity of the WPPSI was studied employing Form L-M of the Stanford-Binet as the criterion. Correlations between SB and WPPSI were moderately high (.86 for FS, .81 for VS, .73 for PS), but the WPPSI appeared a somewhat more difficult test for the sample employed. Mean SB IQ (94.61) was higher than the mean FS (90.71), VS (89.38) and PS (93.68) IQs; it exceeded WPPSI IQ in 72% of all cases. On the WPPSI, PS IQ was significantly greater than either VS or FS IQs. Amont the WPPSI subtests, Vocabulary was significantly lower than all other subtests and Comprehension lower than Picture Completion, Mazes, and Block Design. The only significant sexual difference favored females on Similarities. For subjects whose FS IQ was below the group median IQ, relationships among each of the WPPSI scales and subtests were lower than for those subjects who scored above the median. This was particularly true for the Vocabulary, Animal House, and Picture Completion subtests.     

The Effect of Size of Pupil on the Form and Color Fields

The construct validity of the Wallach-Kogan (W-K) creativity test was investigated through an hierarchical factor analysis of intercorrelations among intelligence, creativity, control, and criterion variables for 73 Ss enrolled in grades 3 and 4 of an inner-city parochial school. The results provided considerable support for W-K's theoretical formulations. Creativity and intelligence assessors defined separate domains and remained totally resilient to merger into a superordinate factor. The creativity domain, which was defined by W-K subtests and criterion ratings, included the following factors: general, visual, and verbal creativity plus a weak methods factor for crayon drawings. The intelligence domain, which was defined by WISC subtests, included a relatively strong g factor and the following four primary factors: verbal precision, freedom from distractibility, perceptual organization, and quasi-specific.     

Parent-report and performance-based measures of executive function assess different constructs

A total of 405 children of 5–18 years of age were administered performance-based and parent-report measures of executive function (EF), and measures of motor, attention, reading, and mathematics performance. Attention, reading, and mathematics abilities were associated with a parent-report measure of EF. Reading and mathematics abilities were also associated with performance-based measures of EF, including the Animal Sorting, Inhibition, and Response Set subtests of the Developmental NEuroPSYchological Assessment-II. In contrast, motor functioning was only associated with performance-based measures of EF. Findings suggest that different constructs of EF are measured by parent-report versus performance-based measures, and that these different constructs of EF are associated with different neurodevelopmental processes.     

Assessing the validity of the achievement motive in the presence of random measurement error

The presence of random measurement error in indicators of theoretical constructs biases observed estimates of relations among those constructs. Correcting for this bias is particularly important when random measurement error is substantial, or is substantially different for indicators of distinct constructs included in a theoretical model. Validity assessment in the case of thematic apperceptive measures of the achievement motive (TAT n Achievement) has been vulnerable to interpretive errors because these indicators of the achievement motive are typically much less reliable than indicators of other constructs to which the motive may be related, and no correction has been made for the bias introduced by such differential measurement error. Here we illustrate a causal modeling approach to validity assessment for TAT n Achievement that incorporates explicit true-score measurement models of theoretical constructs. We confirm the hypothesis that the achievement motive construct is positively related to work satisfaction in a representative sample of adult males in the United States, taken in 1976 (N = 413). Evidence for the discriminant validity of story content versus story length, an issue raised in the literature on the TAT, is also presented in this nomological network.