Cultural Values Underlying Psychometric Cognitive Testing

It is proposed that culture (values, beliefs, styles of behavior) can affect neuropsychological testing.Cognitive testing represents a social situation that-as any social situation, it is one governed by implicit cultural rules. At least eight different culture-dependent values underlie cognitive testing: (1)One-to-one relationship, (2) Background authority, (3) Best performance, (4)Isolated environment (5) Special type of communication, (6) Speed, (7) Internal or subjective issues, and (8) The use of specific testing elements and strategies. In addition, it is proposed that“the distance” (e.g., gender, age, ethnicity) between the examiner and the examinee may potentiallyimpact the testing situation. A special analysis regarding the function of instruction in cognitive tests is also presented emphasizing that test instruction interpretation is also culture-dependent. Some potential avenues of research are finally proposed.     

Objective personality assessment of people in diverse cultures: European adaptations of the MMPI-2

This article examines the cross-national application of psychological tests and examines the generalizability of objective psychological assessment instruments. The most widely used and internationally adapted personality instrument, the Minnesota Multiphasic Personality Inventory (MMPI-2), is highlighted to illustrate the adaptation of psychological tests across the barriers of language and culture. The problems and limitations of using questionnaire methods were noted and effective strategies for translating, adapting, and standardizing questionnaires in languages and cultures different from their country of origin are reviewed. The history of several European adaptations of the original MMPI and MMPI-2 is surveyed to illustrate the extensive research base for the test in Europe. Applications of the MMPI-2 in clinical and non-clinical (e.g. industrial) settings were noted. Current research is described and recommendations for future research are provided.     

An Evaluation of the Validity and Fairness of the Graduate Management Admissions Test (GMAT) Used for MBA Selection in a UK Business School

The Graduate Management Admission Test (GMAT) has been shown to be a valid predictor of Masters of Business Administration (MBA) performance in the USA, but no UK validity studies have been published. This study uses a large sample of UK MBA students to examine the validity and fairness of GMAT. It is found that GMAT-Verbal is a good predictor of MBA examination performance but GMAT-Quantitative is not. It is also found that both components are unfair to native English speakers. The reasons for these findings are to be found in the nature of the criterion employed. Some observations are made regarding the consequences for best practice of the competitive and political context of MBA selection.     

A Patient's Perspective on Genetic Counseling and Predictive Testing for Alzheimer's Disease

The availability of genetic testing for Alzheimer's disease is anticipated to be widespread in the future. As an individual at risk with a family history of Alzheimer's disease, I discuss why I sought predictive tests and how I would use the information from such tests. I relay what I learned in my genetic counseling session, my response to the counseling process, and steps I have since taken. I discuss life planning, psychological and fear of discrimination issues from a patient's perspective.     

Optimal sequential designs for on-line item estimation

Replenishing item pools for on-line ability testing requires innovative and efficient data collection designs. By generating localD-optimal designs for selecting individual examinees, and consistently estimating item parameters in the presence of error in the design points, sequential procedures are efficient for on-line item calibration. The estimating error in the on-line ability values is accounted for with an item parameter estimate studied by Stefanski and Carroll. LocallyD-optimaln-point designs are derived using the branch-and-bound algorithm of Welch. In simulations, the overall sequential designs appear to be considerably more efficient than random seeding of items.This report was prepared under the Navy Manpower, Personnel, and Training R&D Program of the Office of the Chief of Naval Research under Contract N00014-87-0696. The authors wish to acknowledge the valuable advice and consultation given by Ronald Armstrong, Charles Davis, Bradford Sympson, Zhaobo Wang, Ing-Long Wu and three anonymous reviewers.     

Test theory without true scores?

This paper traces the course of the consequences of viewing test responses as simply providing dichotomous data concerning ordinal relations. It begins by proposing that the score matrix is best considered to be items-plus-persons by items-plus-persons, and recording the wrongs as well as the rights. This shows how an underlying order is defined, and was used to provide the basis for a tailored testing procedure. It also was used to define a number of measures of test consistency. Test items provide person dominance relations, and the relations provided by one item can be in one of three relations with a second one: redundant, contradictory, or unique. Summary statistics concerning the number of relations of each kind are easy to get and provide useful information about the test, information which is related to but different from the usual statistics. These concepts can be extended to form the basis of a test theory which is based on ordinal statistics and frequency counts and which invokes the concept of true scores only in a limited sense.1979 Psychometric Society presidential address.I want to recognize the contributions which others have made to whatever I have accomplished. First to mention here are my teachers: principally Harold Gulliksen, Ledyard Tucker, and the late Edith Jay. Second, I would like to recognize the importance of my graduate students. Tom Reynolds has been especially important in developing the ideas that I will talk about here today, but at various times, the others have made major contributions in this and other topics. I would like to express also a debt to my family, primarily my wife, Rosemary, who herself has a longterm interest in the psychometric area. Finally, I must acknowledge the financial support of the NIMH some time ago, the Office of Naval Research, until about a year ago, and of the James McKeen Cattell Fund this past year.     

Maximum likelihood estimation in multidimensional scaling

A variety of distributional assumptions for dissimilarity judgments are considered, with the lognormal distribution being favored for most situations. An implicit equation is discussed for the maximum likelihood estimation of the configuration with or without individual weighting of dimensions. A technique for solving this equation is described and a number of examples offered to indicate its performance in practice. The estimation of a power transformation of dissimilarity is also considered. A number of likelihood ratio hypothesis tests are discussed and a small Monte Carlo experiment described to illustrate the behavior of the test of dimensionality in small samples.The research reported here was supported by grant number APA 320 to the author by the National Research Council of Canada.     

Context specificity of operant discriminative performance in pigeons: II. Necessary and sufficient conditions

Six experiments were performed to explore the necessary and sufficient conditions for producing context specificity of discriminative operant performance in pigeons. In Experiment 1, pigeons learned a successive discrimination (red S+/blue S−) in two chambers that had a particular odor present and between which they were frequently switched. The birds subsequently learned the reversal (blue S+/ red S−) in one of these chambers with a different odor present. When switched to the alternative chamber, although the odor and the reinforcement contingency were still appropriate to the reversal, performance appropriate to the original discrimination recurred in subjects for which the houselights were on during training and testing but not for those for which the houselights were off. This indicated the importance of visual contextual cues in producing context specificity. Experiment 2 showed that the frequent switching between boxes in initial training was of no consequence, presumably because the apparatus cues were highly salient to the subjects. Experiment 3 showed significantly less context specificity when odor cues were omitted. Experiment 4 showed that simply using a different reinforced stimulus in each phase of training was ineffective in producing context specificity. Experiment 5 showed that the generalization test procedure used in Experiment 4 was sensitive to context specificity when discrimination-reversal training was used with different odors in the two training phases. Experiment 6 replicated the results of Experiment 4, but then showed that when different odors accompanied the two training phases, context specificity was obtained with the single-stimulus paradigm. Thus in both single-stimulus and discrimination-reversal paradigms, redundant odor cues potentiated learning about apparatus cues.     

To Use or Not to Use: The Prenatal Genetic Technology/Worry Conundrum

We conducted an exploratory, qualitative study investigating the factors influencing the use of genetic counseling and prenatal genetic testing for two groups: pregnant women 35 years of age and over (AMA) at the time of delivery and pregnant women with an abnormal maternal serum triple screen (MSAFP3). The convenience sample consisted of 25 semistructured interviews of women/couples and 50 observations of genetic counseling sessions. Worry turned out to be the most important variable influencing decision making about prenatal genetic testing and was greater in the MSAFP3 group than in the AMA group. The women in the AMA group appeared to assign the risk of having a child with Down syndrome to their age category rather than to themselves individually, whereas, the risk perception for women with an abnormal MSAFP3 appeared to have shifted from a general population risk for pregnant women to an individual, personal risk. There was a general lack of understanding and also more misinformation about the MSAFP3 screen compared to amniocentesis. Women in both groups were torn between fear of an invasive test and worry about the health of their fetus for the rest of their pregnancy if they did not undergo amniocentesis.     

Utilizing response times in cognitive diagnostic computerized adaptive testing under the higher-order deterministic input,noisy ‘and’ gate model

Methods of cognitive diagnostic computerized adaptive testing (CD-CAT) under higher-order cognitive diagnosis models have been developed to simultaneously provide estimates of the attribute mastery statuses of examinees for formative assessment and estimates of a latent continuous trait for overall summative evaluation. In a typical CD-CAT environment, examinees are often subject to a time limit, and the examinees’ response times (RTs) for specific test items can be routinely recorded by custom-made programs. Because examinees are individually administered tailored sets of test items from the item pool, they may experience different levels of speededness during testing and different levels of risk of running out of time. In this study, RTs were considered during the item-selection procedure to control the test speededness and the RTs were treated as useful information for improving latent trait estimation in CD-CAT under the higher-order deterministic input, noisy ‘and’ gate (DINA) model. A modified posterior-weighted Kullback–Leibler (PWKL) method that maximizes the item information per time unit and a shadow-test method that assembles a provisional test subject to a specified time constraint were developed. Two simulation studies were conducted to assess the effects of the proposed methods on the quality of CD-CAT for fixed- and variable-length exams. The results show that, compared with the traditional PWKL method, the proposed methods preserve a lower risk of running out of time while ensuring satisfactory attribute estimation and providing more accurate estimates of the latent trait and speed parameters. Finally, several suggestions for future research are proposed.