Evaluation of an MMPI--a short form: implications for adaptive testing

Efforts to develop a viable short form of the MMPI (Hathaway & McKinley, 1943) span more than 50 years, with more recent attempts to significantly shorten the item pool focused on the use of adaptive computerized test administration. In this article, we report some psychometric properties of an MMPI-Adolescent version (MMPI-A; Butcher et al., 1992) short form based on administration of the first 150 items of this test instrument. We report results for both the MMPI-A normative sample of 1,620 adolescents and a clinical sample of 565 adolescents in a variety of treatment settings. We summarize results for the MMPI-A basic scales in terms of Pearson product-moment correlations generated between full administration and short-form administration formats and mean Tscore elevations for the basic scales generated by each approach. In this investigation, we also examined single-scale and 2-point congruences found for the MMPI-A basic clinical scales as derived from standard and short-form administrations. We present the relative strengths and weaknesses of the MMPI-A short form and discuss the findings in terms of implications for attempts to shorten the item pool through the use of computerized adaptive assessment approaches.     

A comparison of two college classroom testing procedures: required remediation versus no remediation

Forty one subjects from a 10-week introductory course in Educational Psychology were randomly divided into two experimental groups. All students took weekly quizzes over content material. Members of one group received little or no academic credit if they performed at less than 90% on a weekly quiz, but could earn additional credit by taking a weekly remedial quiz. Members of the second group also took the initial weekly quizzes, but retained their raw scores and were not permitted to take the weekly remedial quizzes. Performance on a 100-item multiple-choice comprehensive final revealed a statistically significant and educationally important difference between the two groups, the required-remediation group scoring an average of one-half letter grade higher.     

The intelligence of the Mongoloids: A psychometric, evolutionary and neurological theory

This paper presents a theory of the intelligence of the Mongoloids consisting of three linked sub-theories. The first concerns the psychometric features of Mongoloid intelligence and proposes that Mongoloids are characterised by high general intelligence (Spearman's g), high visuospatial abilities and low verbal abilities. Mongoloid abilities also display slow maturation in infancy and early childhood. It is proposed that this pattern of abilities cannot be explained in environmental terms and should be regarded as substantially genetically programmed. The second sub-theory presents an evolutionary explanation for this pattern of abilities in Mongoloids, whereby it is proposed that the extreme cold of the ice ages acted as a selection pressure for increases in Spearman's g and the visuospatial abilities. The low verbal abilities and slow maturation rates are interpreted as by-products of these adaptations. The third sub-theory presents a neurological model for the Mongoloid brain in which it is proposed that cortex devoted to the visuospatial abilities was expanded at the expense of the cortex devoted to the verbal abilities. The implication that there exists a negative correlation between the visuospatial abilities and the verbal abilities is considered in the concluding part of the paper and shown to be correct.     

Comparison of contrast sensitivity functions across three orientations: implications for theory and testing.

The contrast sensitivity functions of a large group of observers (N = 71) were determined for three orientations of test gratings: vertical, oblique, and horizontal. Comparison of group means indicated that, consistent with previous findings for the 'oblique effect', sensitivity was poorer for the oblique orientation-but only for the mid-high spatial frequencies. Correlation analyses indicated that contrast sensitivity for a particular spatial frequency at a given orientation was highly correlated with contrast sensitivity for that same frequency at the other two orientations. Factor analysis of the intercorrelations revealed two strong factors, a low frequency factor, and a mid-high frequency factor. Results are discussed in terms of: (a) the implications for contrast-sensitivity testing across orientations, (b) the basis for the oblique effect, and (c) a different type of evidence for a dichotomy among spatial-frequency channels that may reflect the distinction between X cells and Y cells or between the parvocellular and magnocellular systems.     

A job-seeking self-efficacy scale for people with physical disabilities: preliminary development and psychometric testing

People with disabilities are at an increased risk of unemployment. The role of interventions aiming to enhance the employment prospects of people with disabilities is receiving increased attention. However, evaluation is hampered by the paucity of measures specific to the needs of the target population. The purpose of the present study was to develop and conduct preliminary testing of the psychometric properties of a job-seeking self-efficacy (JSS) scale that reflected the experiences of people with physical disabilities. Job-seeking self-efficacy was defined as perceived ability to perform the skills involved in seeking employment that are salient to people with disabilities. Scale development and testing involved four studies and resulted in the 12-item JSS scale and six-item managing disability at interview (MDI) component, both of which were unidimensional and had high internal consistency. In addition, there was evidence of construct and concurrent validity. Greater jobseeking self-efficacy and perceived ability to manage disability at interview were associated with more positive psychological well-being. Only the MDI component was associated with physical functioning: lower perceived ability to manage disability at interview was associated with greater impairment of physical functioning. The pattern of associations supported the rationale for a separate component reflecting the need to resolve practical issues linked to access and availability of facilities before participation in the interview procedure per se .     

A comparison of two‐stage procedures for testing least‐squares coefficients under heteroscedasticity

This study explores the performance of several two‐stage procedures for testing ordinary least‐squares (OLS) coefficients under heteroscedasticity. A test of the usual homoscedasticity assumption is carried out in the first stage of the procedure. Subsequently, a test of the regression coefficients is chosen and performed in the second stage. Three recently developed methods for detecting heteroscedasticity are examined. In addition, three heteroscedastic robust tests of OLS coefficients are considered. A major finding is that performing a test of heteroscedasticity prior to applying a heteroscedastic robust test can lead to poor control over Type I errors.     

A review of exact hypothesis testing procedures (and selection techniques) that control power regardless of the variances

When testing hypotheses, two important problems that applied statisticians must consider are whether a large enough sample was used, and what to do when the frequently adopted homogeneity of variance assumption is violated. The first goal in this paper is to briefly review exact solutions to these problems. In the one-way ANOVA, for example, these procedures tell an experimenter whether enough observations were sampled so that the power will be at least as large as some pre-specified level. If too few observations were sampled, the procedure indicates how many more observations are required. The solution is exact, which is in contrast to another well-known procedure described in the paper. Also, the variances are allowed to be unequal. The second goal is to review how the techniques used to test hypotheses have also been used to solve problems in selection.     

A psychometric comparison of the Beck Depression Inventory-II in English and Spanish

The Beck Depression Inventory-II (BDI-II; A. T. Beck, R. A. Steer, & G. K. Brown, 1996) is a widely used measure of depressive symptomatology originally authored in English and then translated to Spanish. However, there are very limited data available on the Spanish translation. This study compared the psychometric characteristics of the BDI-II in Spanish and English in a sample of 895 college students. The instrument was administered twice with a 1-week interval, either in the same language on both occasions or in a different language on each occasion. Results show strong internal consistency and good test-retest reliability in both languages. Confirmatory factor analysis demonstrated that the published English-language factor structure showed good fit with data from the Spanish instrument. Among bilingual participants who took the BDI-II in both languages, there was no significant language effect. These data provide initial evidence of comparable reliability and validity between the English and Spanish BDI-II in a nonclinical sample.     

eCAT-Listening: design and psychometric properties of a computerized adaptive test on English Listening

In this study, eCAT-Listening, a new computerized adaptive test for the evaluation of English Listening, is described. Item bank development, anchor design for data collection, and the study of the psychometric properties of the item bank and the adaptive test are described. The calibration sample comprised 1.576 participants. Good psychometric guarantees: the bank is unidimensional, the items are satisfactorily fitted to the 3-parameter logistic model, and an accurate estimation of the trait level is obtained. As validity evidence, a high correlation was obtained between the estimated trait level and a latent factor made up of the diverse criteria selected. The analysis of the trait level estimation by means of a simulation led us to fix the test length at 20 items, with a maximum exposure rate of .40.     

A reappraisal of classical archetype theory and its implications for theory and practice

Abstract: This paper begins with an overview of contemporary approaches to archetype theory and notes the radical nature of certain deductions. Some argue that there is no ‘archetype‐as‐such’ as a pre‐existing entity at the core of a complex driving its formation whilst the findings of current neuroscience are calling into question one very thing on which the classical theory is built – innatism. Knox's argument for image schemas raises the question as to the extent to which archetypes can be conceived in any preformationist sense. The question is then posed – to what extent can Jung's classical theory of archetypes be read in light of these current models? The case examples Jung uses to evidence the existence of archetypes, his explications of synchronicity and his own Philemon experience are then reappraised. The conclusion is drawn that it is difficult to evidence the existence of autonomous archetypes unrelated to personal affective experience. Not only would this be expected by emergent/developmental models of archetype but it can explain many of Jung's disjunctive statements about archetype constellation; the difficulties in separating personal and collective psychic content and Jung's apparent Lamarckianism. The implications of these models for theory, clinical practice and analyst training are then offered for discussion.     

A comparison of ranking and rating procedures for value system measurement

Compared the validity and reliability of 2 value measurement techniques. 296 Ss (161 females and 135 males) in introductory psychology filled out the 2 measurement techniques and an attitude survey. The Rokeach Value Survey instructed Ss to separately rank 2 sets of 18 values in order of importance. A rating version of the Value Survey instructed Ss to rate the same 36 values from 1 to 99. 236 Sreturned 6 weeks later and again filled out both measurement techniques. Results of the multimethod factor analysis indicate very good convergent validity among the 4 measures of a given value (2 techniques × 2 sessions) and very good discriminant validity between measures of different values. Probably due to the ipsative nature of the ranking procedure, the test-retest reliabilities were higher for the ranked measurements than for the rated measurements. The construct validity of both measurement techniques, as determined by multiple regression and analysis of variance, were similar. Despite criticisms of ranking procedures, both the ranked and the rated versions were of equal reliability and validity.     

A comparison of administration procedures for the Rey-Osterrieth Complex Figure: flowcharts versus pen switching

The Rey-Osterrieth Complex Figure (ROCF) is commonly used to assess visuospatial skills, visuoconstruction, visual memory, and executive functioning. Two different methods are traditionally used to record the order in which the figure is drawn: the flowchart method and the pen-switching method. Although it has been suggested that pen switching may interfere with performance, to date no research has been conducted to assess whether ROCF performance significantly differs due to administration method. As part of routine neuropsychological evaluation, 100 inpatients and outpatients were randomly assigned to either method. Using the Boston Qualitative Scoring System and the traditional 36-point scoring method, the authors unexpectedly found that the pen-switching group generally performed better than the flowchart group, and productions drawn with pen switching were also significantly faster to score.     

Healing by the laying on of hands: Review of experiments and implications

Pastoral Psychology -     

Decreasing junk food consumption: A comparison of self-perception theory and reinforcement theory

A behavior reduction procedure based on self-perception theory was developed, and its efficacy was compared to that of a common behavior modification intervention based on traditional reinforcement theory. Following a baseline phase, university students were monetarily reinforced for increasing (in the self-perception condition) or decreasing (in the behavior modification condition) their consumption of junk food. Subsequently, the magnitude of reinforcement was reduced and, finally, the reinforcement contingency was withdrawn. The intervention based on reinforcement theory produced the predicted decrease in junk food consumption while the intervention was in effect, and the postreinforcement intake of subjects in that condition remained below baseline. However, despite an increase in junk food consumption during the intervention phase in the self-perception condition, the hypothesized overjustification effect was not produced. While the results did not support self-perception theory, the data were consistent with an alternative account of the overjustification effect proposed by Williams (1980).This research was partially supported by National Science Foundation Grant SPI8026324 to John F. Kremer and Robert G. Bringle.     

Choice for aperiodic versus periodic ratio schedules: A comparison of concurrent and concurrent-chain procedures

Choice between mixed-ratio schedules, consisting of equiprobable ratios of 1 and 99 responses per reinforcement, and fixed-ratio schedules of food reinforcement was assessed by two commonly used procedures: concurrent schedules and concurrent-chains schedules. Rats were trained under concurrent fixed-ratio mixed-ratio schedules, in which both ratio schedules were simultaneously available, and under a concurrent-chains schedule, in which access to one of the mutually exclusive ratio schedules comprising the terminal links was contingent on a single “choice” response. The distribution of responses between the two ratio schedules was taken as the choice proportion under the concurrent procedure, and the distribution of “choice” responses was taken as the choice proportion under the concurrent-chains procedure. Seven of eight rats displayed systematic choice; of those, each displayed nearly exclusive choice for fixed-ratio 35 to the mixed-ratio schedule under the concurrent procedure, but each displayed nearly exclusive choice for the mixed-ratio schedule to fixed-ratio 35 under the concurrent-chains procedure. Thus, preference for a fixed or a mixed schedule of reinforcement depended on the procedure used to assess preference.     

A comparison of the psychometric properties of the psychopathic personality inventory full-length and short-form versions

The Psychopathic Personality Inventory (PPI) has shown promising construct validity as a measure of psychopathy. Because of its relative efficiency, a short-form version of the PPI (PPI-SF) was developed and has proven useful in many psychopathy studies. The validity of the PPI-SF, however, has not been thoroughly examined, and no studies have directly compared the validity of the short form with that of the full-length version. The current study was designed to compare the psychometric properties of both PPI versions, with an emphasis on convergent and discriminant validity in predicting external criteria conceptually relevant to psychopathy. We used both prison (n = 558) and college samples (n = 322) for this investigation. PPI scale scores were more reliable and more strongly correlated with the conceptually relevant criterion measures compared with the PPI-SF, particularly in the prison sample. There were no differences in relative discriminant validity. Thus, overall, the PPI full-length version showed more evidence of construct validity than did the short form, and the consequences of this psychometric difference should be considered when evaluating the clinical utility of each measure.     

Development of a portable psychometric testing device for use in the field: an alcohol investigation

Cognitive and psychomotor performance have traditionally been assessed in the laboratory. There is a need for an objective portable assessment tool to assess cognitive and psychomotor performance. This study investigated the viability of a portable psychometric test battery, in a controlled laboratory environment, possibly leading to use in the field. A randomised, double-blind placebo controlled, three-way crossover design was employed. 16 subjects received 50 mg/100 ml and 80 mg/100 ml of alcohol and alcohol placebo. Performance was assessed with a tracking task, and an attention task presented on a small ruggedised handheld computer. The attention task showed no significant training effects; however, an element of the tracking task did. Statistical significance, effect size, and test-retest reliability analyses are presented indicating sensitivity of the portable psychometric test battery to the impairing effects of two separate doses of alcohol. Ability to undertake wide-scale impairment testing in the field with meaningful results in the absence of baseline data collection may have wide reaching implications, particularly in relation to the assessment of drivers impaired by drug use.     

Human perception of verticality: Psychophysical experiments on the centrifuge and their neuronal implications

The role of the otoliths in the perception of verticality is analyzed in two different gravitational environments, 1 g and 1.5 g , and in different roll body positions between upright and upside down. The subjective visual vertical (SVV) is determined when a subject judges the orientation of an indicator as apparently vertical. An increase of g level hardly affects the SVV in the subject's frontal plane (y-z plane). However, for the first time, a three-dimensionally adjustable indicator was used for the SVV and this revealed a new phenomenon: An increase of g level induces a backward slant of the SVV into subject's median plane (x-z plane). The data are discussed with regard to Mittelstaedt's SVV theory; particular emphasis is given to the otolith-head coordinate transformation and the normalization of afferent otolith components. The results of this study provide evidence that the former is implemented at an earlier level and thus precedes the latter.     

A comparison of forward and backward procedures for the acquisition of response chains in humans

Ten university students each learned four separate six-link response chains, two forward and two backward. All 10 subjects made fewer errors in the forward procedure. It was concluded that the forward procedure is superior because each link of the response chain is acquired by direct reinforcement.