Some supplementary methods for the analysis of WAIS-IV index scores in neuropsychological assessment

Objectives. To develop supplementary methods for the analysis of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) in neuropsychological assessment. Design and Methods. Psychometric. Results. The following methods are made available: (a) provision of traditional confidence intervals (CIs) on index scores, (b) expression of the endpoints of CIs as percentile ranks; (c) quantification of the number of abnormally low index scores exhibited by a case and accompanying estimate of the percentage of the normative population expected to exhibit at least this number of low scores; (d) quantification of the reliability and abnormality of index score deviations from an individual's index score mean (thereby offering an alternative to the pairwise approach to index score comparisons available in the WAIS-IV manual); (e) provision of CIs on an individual's deviation scores or pairwise difference scores, (f) estimation of the percentage of the normative population expected to exhibit at least as many abnormal deviations or abnormal pairwise differences as a case; and (g) calculation of a case's Mahalanobis distance index (MDI), thereby providing a multivariate estimate of the overall abnormality of an index score profile. With the exception of the MDI, all the methods can be applied using tables provided in this paper. However, for ease and speed of application, and to reduce the possibility of clerical error, all the methods have also been implemented in a computer program. Conclusions. The methods are useful for neuropsychological interpretation of the WAIS-IV.     

Some supplementary methods for the analysis of the Delis-Kaplan Executive Function System

Supplementary methods for the analysis of the Delis-Kaplan Executive Function System (Delis, Kaplan, & Kramer, 2001) are made available, including (a) quantifying the number of abnormally low achievement scores exhibited by an individual and accompanying this with an estimate of the percentage of the normative population expected to exhibit at least this number of low scores; (b) estimating the overall abnormality of an individual's achievement score profile with the Mahalanobis distance index; (c) calculating a composite executive function index score for an individual and providing accompanying confidence limits; and (d) providing the percentile ranks for an individual's achievement scores and executive index score (in the latter case, confidence limits on scores are also expressed as percentile ranks). With the exception of the Mahalanobis distance index, all the methods can be obtained with the equations and tables provided in this article. However, for the convenience of clinicians and to reduce the possibility of clerical error, the methods have also been implemented in a computer program. More important, the program allows the methods to be applied when only a subset of scores is available. The program can be downloaded (as a zip file) from this article's supplemental materials or from www.abdn.ac.uk/~psy086/dept/DKEFS_Supplementary_Analysis.htm.     

Developmental outcome of drug-exposed children through 30 months: a comparison of Bayley and Bayley-II

This study examined the effects of the Bayley Scales of Infant Development (BSID) version on developmental outcomes among drug-exposed children, some of whom received an intervention. Developmental outcome was evaluated with the BSID at 12 and 18 months and with the BSID-II at 24 and 30 months. In the repeated measures analyses, children scored higher on the BSID Mental Developmental Index (MDI; p < .01) and Psychomotor Developmental Index (PDI; p < .01) than on the BSID-II MDI and PDI. Version x Time (p < .01) and Version x Group (p < .01) interactions were also found for the MDI but not the PDI. PDI scores decreased on both the BSID and the BSID-II (p < .01). Over the first 2 years postpartum, mean MDI and PDI scores decreased among these high-risk, drug-exposed children.     

The use of the mental development index of the Bayley scale to diagnose language delay in 2-year-old high-risk infants

To determine if a detailed analysis of the language items of the Bayley Scales of Infant Development (BSID) would be useful in detecting language delay, the Bayley Mental Development Index (MDI) and Reynell Developmental Language Scales (RDLS-R) were administered to 137 low-birthweight infants at 2 years of age. In spite of scores in the normal range on the BSID, many of these children had significantly delayed language. However, the children with delayed language could be detected on the basis of detailed analysis of certain language items of the MDI, indicating that these items are more useful than the total MDI score.     

The relationship between depression and smoking in adolescents

The literature suggests that smokers are more likely to be depressed, while people who are depressed are more likely to smoke. The purpose of the present study was to determine the strength of the relationship between smoking, depression, intention to smoke, and several psychosocial and environmental factors. The participants (98 high school and college students aged 16 to 19 years) completed a paper-and-pencil questionnaire consisting of the Multiscore Depression Inventory (MDI) and items regarding smoking behavior as well as psychosocial and environmental factors. Correlation, stepwise regression, and discriminant analyses were then conducted. It was found that participants were more likely to smoke if their parents smoked, if their scores on the MDI indicated instrumental helplessness and social isolation/withdrawal, or if they were older. Participants were more likely to state intention to smoke in the future if they had MDI scores indicating instrumental helplessness, if they were older, if their parents smoked, if their MDI scores indicated social intro-version, or if they resided with a guardian. Participants were also more likely to have smoked for more years if their parents smoked or if their scores on the MDI indicated instrumental helplessness. Further, participants were more likely to have scores on the MDI indicative of higher depression levels if they had low grades or if their parents smoked.     

The WISC-V in children and adolescents with epilepsy

Despite its popularity in the neuropsychological evaluation of children, the utility of the Wechsler Intelligence Scale for Children – Fifth Edition (WISC-V) has not yet been investigated in children with epilepsy. Eighty clinically referred children and adolescents with epilepsy were administered the WISC-V as part of a comprehensive assessment and scores were compared to matched controls from the WISC-V standardization sample. T tests compared WISC-V indices and subtests between patients and controls and Chi-square analyses compared the rates of low scores. Correlational analyses assessed the relationships between epilepsy severity variables (e.g., age of onset, duration of epilepsy, number of antiepileptic drugs, seizure frequency). All WISC-V composites and subtests were significantly lower in patients versus controls and the rate of low scores was higher in patients than controls for all composites and subtests with the exception of Figure Weights. The Working Memory Index and Processing Speed Index were most sensitive to impairment, while the Verbal Comprehension Index and Fluid Reasoning Index were least sensitive. Of the epilepsy severity variables, age of seizure onset and number of antiepileptic drugs were strong predictors of deficits, whereas seizure frequency was the weakest predictor. Importantly, no significant differences were seen in children with right hemisphere epilepsy versus left on the five WISC-V composites, though a trend was seen towards a lower Visual-Spatial Index in those with right-sided focal seizures.     

A longitudinal study of bilingual and cognitive development(1)

This paper presents the findings of a longitudinal study of IQ data collected over a 5-year period (Grades K-4) on pupils enrolled in a French immersion program (anglophone pupils receiving all instruction in French except English language arts) and pupils in the regular English program. Although year-by-year results may fail to show IQ differences between the two groups, repeated measures analysis indicates that the immersion group has a higher IQ measure over the 5-year period. However, considering Grades 1–3 only, which involved the administration of the same test, the two groups do not score differentially with respect to either overall IQ measure or specific subtest scores (classification/categorization, analogies, following of verbal directions) when scores are adjusted for initial IQ (and age) differences, thus failing initially to support studies which show positive relationships between bilingualism and cognitive functioning. However, supportive of those studies is a further analysis on the data of immersion pupils classified as “high” French achievers vs. “low” French achievers. The high French achievers obtain significantly higher IQ measures and subtest scores (analogies and following of verbal directions) than the low French achievers, even when scores are adjusted for initial IQ and age differences. These findings are interpreted in the context of Cummins' (1976) “threshold” hypothesis relating to level of competence in the second language.     

A Study of low scores in Canadian children and adolescents on the Wechsler Intelligence Scale for Children,Fourth Edition (WISC-IV)

Knowing the prevalence of low neurocognitive scores for the WISC-IV Canadian normative sample (WISC-IV^CDN) is an important supplement for clinical interpretation of test performance. On the WISC-IV^CDN, it is uncommon for children and adolescents to have 4 or more subtest scores or 2 or more Index scores ≤ 9th percentile when all scores on the battery are considered simultaneously. As the level of the child's intelligence increases or the number of years of parental education increases, the prevalence of low scores decreases. These results are consistent with existing studies of the base rates of low scores in children and adolescents on pediatric cognitive batteries, including the WISC-IV American normative sample. Tables provided are ready for clinical use.     

GGUMLINK: A computer program to link parameter estimates of the generalized graded unfolding model from item response theory

The generalized graded unfolding model (GGUM) is an item response theory (IRT) model that implements symmetric, nonmonotonic, single-peaked item characteristic curves. The GGUM is appropriate for measuring individual differences for a variety of psychological constructs, especially attitudes. Like other IRT models, the location and scale (i.e., the metric) of parameter estimates from the GGUM are data dependent. Therefore, parameter estimates from alternative calibrations will generally not be comparable, even when responses to the same items are analyzed. GGUMLINK is a computer program developed to reexpress parameter estimates from two separate GGUM calibrations in a common metric. In this way, the results from separate calibrations of model parameters can be compared. GGUMLINK can secure a common metric by using one of five methods that have recently been generalized to the GGUM. The GGUMLINK executable program is available free and may be downloaded from http://www.education.umd.edu/EDMS/tutorials/index.html.     

Computer assisted versus traditional vocational counseling with high and low readiness clients

This study tested Hershenson's hypothesis that different vocational counseling methods would be differentially effective for clients at different levels of readiness. The top 54 and bottom 54 high school sophomores from a class of 853 were selected on the basis of their Educational Development Series test scores. Half of each group (highs and lows) received individual counseling; the other half interacted with a computerized vocational information program (CVIS). It was predicted that high readiness subjects would change more with CVIS and lows would change more with counseling. Only the latter prediction was confirmed. The groups did not differ in satisfaction with their posttreatment vocational choices. Findings suggest that individual counseling be emphasized with low readiness clients when both options are available.     

Fractional designs: A simulation study of usefulness in the social sciences

Fractional designs can be extremely useful in social science research, especially when a large number of factors is involved. Reluctance for the use of fractional designs seems to be warranted for two reasons: (1) In the social sciences, the amount of measurement error is often large, which may decrease the power, and (2) higher order interactions are assumed to be nonsignificant, which is difficult to guarantee without sufficient research. This simulation study shows the effects of measurement error and assumption violations under various conditions. It is concluded that fractional designs handle measurement error gracefully and that they are as powerful as a full design when equal degrees of freedom are available. Significant interaction effects can cause serious problems, especially in situations with low or intermediate measurement error, and can lead to erroneous conclusions. Only when estimated confounded effects are clearly not significant, the chance of a wrong decision is reasonably small. Therefore, fractional designs are especially warranted for the exclusion of irrelevant factors. However, we note pitfalls in the use of Version 1.0 of the program Trail Run from SPSS, Inc., to implement the procedures.     

THE EFFECTS OF REHEARSAL GROUP SIZE AND VIDEO FEEDBACK IN BEHAVIOR MODELING TRAINING

This study was done to assess the effects of the number of observers present during behavioral rehearsal (one or ten) and the presence or absence of videotaped replays of each rehearsal attempt on accurate reproduction of a model's performance. The study was done as part of a behavior modeling training program designed to teach college students eight key behaviors for doing on-the-job training. Thirty-six students were drawn from two evening business school courses and randomly assigned to three experimental conditions (i.e., one observer/videotaped feedback, large group observing/videotaped feedback, and large group observing/no videotaped feedback) during the behavioral rehearsal portion of the program. This investigation revealed that the presence of one observer and videotaped feedback enhanced reproduction scores. Reproduction was measured by three different methods. Possible theoretical explanations for these results are discussed. Implications for the practice of behavior modeling are suggested.     

Maternal risk factors as predictors of developmental outcome in early childhood

This paper describes the rationale, procedures, and initial validation of an instrument which assesses distal environmental factors thought to negatively influence maternal caregiving ability. A sample of 36 lower class, single, black mothers (ranging in age from 14 to 19 years) of first born, full-term infants were included in an educational intervention program carried out during infants' first 12 months of life. The development of the maternal risk score (MRS) instrument was centered around four areas: maturity of mother, degree of planning of the mother, family support system and level of poverty. Initial, Year 1, Year 2, and Year 3 MRS scores were compared with infant development at one and two years as measured by the Bayley Scales, and at three years with the McCarthy Scales, using Pearson product-moment correlations. The initial MRS correlated negatively with the Bayley Mental Development Index (MDI) at Year 1 and also at Year 2 (N=−.38 and −.40 respectively, both significant at p<.05). The MRS for Year 1 showed significant negative correlations with the two Bayley MDIs: two and three year MRS scores were significantly related to three year McCarthy test scores. This screening instrument, which assesses qualitative aspects of the caretaking environment, appears to be a promising approach for identifying lower class mothers of infants who might be at risk for developmental disabilities.     

The Utility of the MAPI in the Assessment of Depression

The relationships between the Millon Adolescent Personality inventory (MAPI; Millon, Green, & Meagher, 1982) and depression, as assessed by the Multiscore Depression Inventory (MDI; Berndt, 1968) were examined. Elevations on the MDI subscales were positively related to elevations on MAPI personality style Scale 2 (Inhibited) and Scale 8 (Sensitive) and on six of the eight MAPI expressed concerns scales. MAPI personality style Scale 4 (Sociable) and Scale 5 (Confident) were negatively correlated with the MDI. MAPI code types containing either Scale 2 or 8 were associated with a high MDI full-scale score. The subjects who received a MAPI computer-generated diagnosis of borderline personality disorder also had elevated MDI full-scale scores. The findings of this study appear consistent with the existing body of MAPI research, and the data suggest that the MAPI personality style scales may have both state and trait qualities.     

The utility of the MAPI in the assessment of depression

The relationships between the Millon Adolescent Personality Inventory (MAPI; Millon, Green, & Meagher, 1982) and depression, as assessed by the Multiscore Depression Inventory (MDI; Berndt, 1968) were examined. Elevations on the MDI subscales were positively related to elevations on MAPI personality style Scale 2 (Inhibited) and Scale 8 (Sensitive) and on six of the eight MAPI expressed concerns scales. MAPI personality style Scale 4 (Sociable) and Scale 5 (Confident) were negatively correlated with the MDI. MAPI code types containing either Scale 2 or 8 were associated with a high MDI full-scale score. The subjects who received a MAPI computer-generated diagnosis of borderline personality disorder also had elevated MDI full-scale scores. The findings of this study appear consistent with the existing body of MAPI research, and the data suggest that the MAPI personality style scales may have both state and trait qualities.     

Values for comparison of WAIS-III index scores with overall means

The Wechsler Adult Intelligence Scale--Third Edition (WAIS-III; Wechsler, 1997b) provides factor-based index scores but allows only for pairwise comparison of these scores, producing inflated Type I error rates and reducing profile interpretability. This article provides tables for simultaneous comparison to the overall mean index score, thus reducing error rates and aiding interpretation. The Working Memory Index or Processing Speed Index can also be specifically compared when an individual is believed to have a condition, such as a learning disability or traumatic brain injury, associated with the selective depression of these indexes. Tables for the infrequency of specific differences are also provided, allowing the practitioner to note how unusual an obtained difference is in the general population.     

Effects of Organizationally Endorsed Coaching on Performance and Validity of Situational Judgment Tests

There is growing interest in organizationally provided or organizationally endorsed coaching. However, little is known about the effects of such coaching on test scores in operational settings. This study reports on an examination of such a program in the context of the use of a situational judgment test (SJT) for medical school admissions. We examine the effects of multiple types of coaching methods on SJT scores and on their construct‐related and predictive validities. Results suggest that (1) commercial coaching techniques may not be as effective as previously thought, whereas organizationally provided methods may be more effective, and that (2) the criterion‐related validity of the SJT scores is not degraded by the availability of coaching. Generally, this study illustrates that concerns about potential unfairness of coaching can be countered by making effective coaching available to all examinees, in the form of organizationally endorsed coaching.     

A DEVELOPMENTAL-GENETIC ANALYSIS OF CONTINUITY AND CHANGE IN THE BAYLEY MENTAL DEVELOPMENT INDEX FROM 14 TO 24 MONTHS:

Abstract— A developmental-genetic model was fitted to Bayley Mental Development Index (MDI) data to address questions concerning the origins of individual differences in MDI performance and the origins of change and continuity during infancy More than 350 pairs of identical and same-sex fraternal twins were studied longitudinally at 14, 20, and 24 months of age There was substantial genetic continuity of general cognitive ability from 14 to 24 months but significant new genetic variation also appeared at 24 months Shared family environmental influences were global across all three ages and not time-specific Finally, nonshared environmental influences did not contribute to the observed continuity of general cognitive ability, only to change.     

Examination of the structural, convergent, and incremental validity of the Reynolds Intellectual Assessment Scales (RIAS) with a clinical sample

Empirical examination of the Reynolds Intellectual Assessment Scales (RIAS; C. R. Reynolds & R. W. Kamphaus, 2003a) has produced mixed results regarding its internal structure and convergent validity. Various aspects of validity of RIAS scores with a sample (N = 521) of adolescents and adults seeking psychological evaluations at a university-based clinic were examined. Results from exploratory factor analysis indicated only 1 factor, and confirmatory factor analysis (CFA) indicated that the 1-factor model was a good fit and a better fit than the 2-factor model. Hierarchical factor analysis indicated the higher order, general intelligence factor accounted for the largest amount of variance. Correlations with other measures of verbal/crystallized and nonverbal/fluid intelligence were supportive of the convergent validity of the Verbal Intelligence Index but not the Nonverbal Intelligence Index. Joint CFA with these additional measures resulted in a superior fit of the 2-factor model compared with the 1-factor model, although the Odd-Item-Out subtest was found to be a poor measure of nonverbal/fluid intelligence. Incremental validity analyses indicated that the Composite Intelligence Index explained a medium to large portion of academic achievement variance; the NIX and VIX explained a small amount of remaining variance. Implications regarding interpretation of the RIAS when assessing similar individuals are discussed.     

Correlates of the Egocentricity Index in child and adolescent outpatients

This study examined the Rorschach and MMPI covariates of Exner's Egocentricity Index, 3r + (2): R, in a sample of child and adolescent outpatients (n = 46). Consistent with previous findings on adult psychiatric inpatients (Barley, Dorr, & Reid, 1985), significant positive correlations were obtained between the Index and M, FM, X + %, and D when controlled for the number of protocol responses. The Egocentricity Index was negatively associated with lambda and, in a subsample of adolescents (n = 19), depression scores. The index bore no significant relationship to either Minnesota Multiphasic Personality Inventory (MMPI) validity or clinical scales, also congruent with earlier investigations. Implications for the interpretation of childrens' Egocentricity Indices are discussed.