The Utility of the Michigan Alcoholism Screening Test in the detection of Alcoholics and Problem Drinkers

This study examined the vulnerability of the Michigan Alcoholism Screening Test (MAST), a widely used, direct alcohol inventory, to positive dissimulation. An earlier study by developers of the MAST suggested that most alcoholics were unable to alter their scores and thereby avoid detection by the instrument. But closer examination indicated that a standard scoring procedure was not employed. This study examined the ability of alcoholics to avoid detection by the MAST when using a standard scoring procedure. As predicted, alcoholics readily manipulated their MAST scores and avoided detection when so motivated. These results are discussed, indications and contraindications for use are included, and recommendations regarding future research are made.     

Toward an objective evaluation procedure of the Kinetic Family Drawings (KFD).

The feasibility of employing a quantitative scoring procedure for evaluating the Kinetic Family Drawings (KFD) was examined. A quantitative scoring procedure was developed from the clinical hypotheses Burns and Kaufman (1970, 1972) to score 21 measurable KFD styles, actions, and characteristics. The scoring procedure was employed to evaluate 116 KFDs obtained from four groups of boys to determine the effectiveness of the procedure to differentiate among two levels of emotional adjustment and the two levels of age. The results indicated that four of seven sets of extracted component scores significantly differed between the emotionally well-adjusted and the emotionally disturbed groups. One set of component scores significantly differed between the younger and the older groups, while two sets of component scores did not differ among any of the four groups. The KFD total score was found to differ significantly only between the young emotionally disturbed and the young emotionally well-adjusted groups. It was concluded that a quantitative scoring procedure for the KFD is feasible.     

Motivation needs of sampled Fortune-500 CEOs: relations to organization outcomes.

Motive scores (needs for Achievement, Affiliation, and Power) of the chief executive officers of the nation's 50 largest industrial firms were determined using content analysis of letters to stockholders contained in the firms' annual reports. The scoring method was a modification of the standard TAT scoring procedure. Results showed that chief executive officers' high need Achievement was correlated with relative growth in sales, while high need Power was correlated with relative growth in profits. Effects of need Achievement and need Power also were examined for return on equity and return on sales. Implications are discussed.     

A Proposed Number Correct Scoring Procedure Based on Classical True-Score Theory and Multidimensional Item Response Theory

A hybrid procedure for number correct scoring is proposed. The proposed scoring procedure is based on both classical true-score theory (CTT) and multidimensional item response theory (MIRT). Specifically, the hybrid scoring procedure uses test item weights based on MIRT and the total test scores are computed based on CTT. Thus, what makes the hybrid scoring method attractive is that this method accounts for the dimensionality of the test items while test scores remain easy to compute. Further, the hybrid scoring does not require large sample sizes once the item parameters are known. Monte Carlo techniques were used to compare and contrast the proposed hybrid scoring method with three other scoring procedures. Results indicated that all scoring methods in this study generated estimated and true scores that were highly correlated. However, the hybrid scoring procedure had significantly smaller error variances between the estimated and true scores relative to the other procedures.     

Alcoholism and the Rorschach

This study attempts to cross validate 20 hypotheses reported over the past three decades professing to differentiate alcoholics from non-alcoholics using the Rorschach. Comparison groups (N = 25 each) were matched for age, sex, race, income and education, and diagnosis. Each S received the Rorschach and a test to rule out “organicity”. Rorschach scoring was consensually validated and Chi squares were performed for all twenty hypotheses. Through the careful selection and matching of control and experimental groups, only two significant differences were found, both in the direction opposite to that predicted. Non-alcoholics gave 4 or more water responses significantly more often than alcoholics (p < .05) and significantly more “high CF with C” scores (p < .05).     

Estimating the validity of the guilty knowledge test from simulated experiments: the external validity of mock crime studies

This experiment was designed to examine the external validity of the standard mock-crime procedure used extensively to evaluate the validity of polygraph tests. The authors manipulated the type of mock-crime procedure (standard vs. a more realistic version) and the time of test (immediate vs. delayed) and examined their effects on the validity of the Guilty Knowledge Test (GKT) and the recall rate of the relevant items. The results indicated that only the type of mock-crime affected the 2 outcome variables. The realistic procedure was associated with a lower recall rate and weaker detection efficiency than the standard procedure. However, these effects were mediated by the type of GKT questions used. Practical implications of these results are discussed.     

Appropriateness of the Multi-Attitude Suicide Tendency Scale for non-White individuals

Analyses of data collected from 480 university students (approximately 56% White and 44% Black) challenge the utility of the Multi-Attitude Suicide Tendency Scale (MAST) for use with individuals of diverse cultural backgrounds. This size sample allowed for an examination of the psychometric properties and cultural relevance of the MAST for non-Whites. Correlations between scores on the MAST, suicide, and depression measures were in the expected directions for Whites but not for Blacks or Latinos. The White sample data fit the four-factor model of the MAST, but the model required several modifications to fit the data from the Black sample. Verification of the cultural relevance of the MAST and a revision of the scale are recommended to improve its usefulness.     

Shyness and informal help-seeking behavior

The present study examined whether shy individuals are more reluctant to seek help than less shy individuals. A sample of 48 undergraduates (46% men, Mage=20.6 yr.) were selected from a pool of 72 students based on their relatively high or low scores on the Social Interaction Anxiety Scale. They were then exposed to a situation involving an impossible task, on which they had the option of seeking assistance. Analysis indicated that participants scoring high on Shyness took significantly more time to seek help than participants scoring low. This result suggests that even when help is readily available, shy individuals may refrain from seeking it. Presumably, shy people may be reluctant to seek help because that often requires them to initiate a social interaction.     

Comparison of the concurrent validity of Holland's theory for men and women in an enterprising occupation

This study examined the concurrent validity of Holland's theory for men and women employed in an enterprising occupation. Using Holland-theme scores obtained from both the Self-Directed Search (SDS) and the Strong-Campbell Interest Inventory (SCII), the degree of personality-environment correspondence and the relationships of personality type to job satisfaction were examined in a sample of 45 male and 43 female sales managers. In general, the findings suggested that, at least within an employed sample, Holland's theory is valid for women as well as for men. Using both the SDS and the SCII, women and men obtained their highest scores on the enterprising theme, and the mean E-theme scores of women were at least as high as were those of men. Significant sex differences on the Realistic, Artistic, and Social scales, found using SDS scores and SCII standard scores, were in the direction of generally-found sex differences. Both men and women were highly satisfied with their jobs, and moderate relationships between job satisfaction and enterprising and social scores were also found. While the results of this study suggest optimism regarding the theoretical and practical utility of Holland's theory for women as well as for men, differences in results as a function of different instruments and scoring methods suggest the need for further studies of this kind.     

Characteristics of the relapse situation of alcoholics treated with aversion conditioning

Recently, there has been considerable interest in applying the principles of learning theory and operant conditioning to the problems of alcoholism. One principle which may be of value is stimulus control. The principle of stimulus control would suggest that there should be some degree of similarity between the environmental circumstances in which alcoholics do their drinking and the situation where they take their first, post-treatment, drink. The principle of stimulus control also suggests that alcoholics treated with aversion therapy would tend to relapse under environmental conditions that were in some way different from their usual drinking environments.Whether we are able to observe a difference in drinking environments before and after treatment depends on whether we have selected the appropriate stimulus dimensions. The present author is in agreement with Lunde and Vogler (1970) who suggest that; types of liquor consumed; drinking associates; whether at home alone, with others or at a bar; are some of the important characteristics of an alcoholic's learning history. These stimulus conditions could be further simplified to location, type of beverage and social or non-social drinking.Since it is physically impossible to turn time backwards or to have observers follow patients everywhere they go, we must rely on self-reports of alcoholics about their drinking history. Although many clinicians have reservations about the veracity of alcoholics. Guze et al. (1963) report that 97 per cent of alcoholics in a prison population could be correctly diagnosed from their own self-report. Thus, it appears that at least when interviewed in the context of a research study where no contingencies are placed on their behavior, verbal or otherwise, self-report by alcoholics can indeed be reliable. The present study examined the relapse situation of alcoholics in terms of the location of the first drink episode, the social environment, and type of beverage consumed and compared this situation to the usual (most frequent) drinking situation prior to treatment.     

Developing Clear and Useful Scoring Procedures for Goal Attainment Scaling in Longitudinal Case Studies

This article examines scoring procedures for Goal Attainment Scaling (GAS) and suggests a new scoring procedure to communicate GAS outcomes in longitudinal studies. Analysis is based on longitudinal case studies that evaluate transitioning from psychiatric institutions to independent living. Five scoring methods are identified: raw scores; sum of score differences; mean scores; T-scores; and graphing raw scores. Graphing raw scores is presented as an alternative method of expressing GAS scores for studies with few participants and multiple time points. This enables easy interpretation of goal attainment, and allows for fluctuation in performance as is typical in clinical practice.     

Improvements in the community-reinforcement approach to alcoholism

This study evaluated a modified Community-Reinforcement program for treating alcoholics. The previously tested Community-Reinforcement program included special job. family, social and recreational procedures and was shown to reduce alcoholism. To increase the effectiveness of the program further, the present study incorporated a Buddy system, a daily report procedure, group counseling, and a special social motivation program to ensure the self-administration of Disulfiram (Antabuse). The alcoholics who received the improved Community-Reinforcement program drank less. worked more, spent more time at home and less time institutionalized than did their matched controls who received the standard hospital treatment including Antabuse in the usual manner. These results were stable over a 2-year period. The program appeared even more effective and less time-consuming than the previous program. The present results replicate the effectiveness of the Community-Reinforcement program for reducing alcoholism and indicate the usefulness of the additions to the program.     

Stability of biodata keys and dimensions across English-speaking countries: A test of the cross-situational hypothesis

Questions have been raised about the generalizability of biodata instruments across situations. In the present study, the stability of a biodata scoring key and factor structure was examined across two situations—the insurance industry in the United States and the United Kingdom/Republic of Ireland. Results indicated that the validity of a biodata scoring key could be successfully transported. Confirmatory factor analysis, using a maximum likelihood estimation procedure (LISREL), also indicated that the biodata factor structure was stable across the countries and cultures. The reliability and validity of the dimension scores also were successfully transported. The results provide new support for the contention that biodata keys, as well as underlying dimensional structures, can generalize across situations, specifically English-speaking countries and cultures.This research was conducted while the first two authors were at LIMRA, International.     

The Depressive Experiences Questionnaire: on using a student-based scoring program for a clinical sample

In both clinical and nonclinical samples, the Depressive Experiences Questionnaire is scored with a program that computes factor scores by using means, standard deviations, and item-loadings of a student sample. The underlying assumption of the use of this program in clinical samples is that factor scores computed on the basis of the student factor solution are similar to factor scores computed on the basis of a clinical factor solution. Consequently, both series of scores should lead up to the same conclusions when studying associations with theoretically related variables. This assumption has not been tested although the questionnaire has been used in research for almost 30 years. In the present paper an alternative scoring program was constructed, based on the factor solution of a clinical sample (N = 400) to assess whether scores of this clinical scoring program are associated in the same way with different types of depressive symptoms and interpersonal problems as the scores of the original (student-based) program. Analysis gave results inconsistent with the assumption and did not support the use of the student-based scoring program in the clinical sample. Further, results suggest that standards for assessing factorial similarity used in confirmatory factor analysis might be too lenient.     

The thematic apperception test: toward a standard measure of the big three motives

The application of the Thematic Apperception Test to the assessment of motives has been heralded as an important milestone in personality psychology. However, although this approach is well established, there is at present no standard battery of cues for measuring the Big Three motives (achievement, affiliation, power). Furthermore, the extent to which scoring subcategories contribute to overall motive scores has been neglected. Our research with students and managers examined the effectiveness of picture cues in eliciting motive imagery and the prevalence of scoring subcategories within each motive scoring system. Results from 2 data sets comprising 547 men and women suggested that there were 3 cues that should be retained for future research and that motive scoring systems could be refined through removal of redundant subcategories. Further research is needed to systematically investigate the effectiveness of a standard battery of cues and the validity of revised motive scoring systems.     

Expert and Target Scoring: Their relation,corresponding test instructions,and their effects on the construct validity of the video‐based social understanding test (VSU)

This study investigated the relation between expert and target scoring of a video‐based social understanding test (VSU) under two different types of instructions (internal and observer). The effects of the scoring methods and instructions on the VSU's construct validity were also examined. A total of 529 pilot applicants completed the VSU (some with internal and some with observer instructions), cognitive ability and knowledge tests, and a personality questionnaire. A subsample (n = 132) completed the VSU again with the other instructions and participated in an assessment center (AC). The two scores were moderately correlated; correlations decreased when the instructions were considered. Neither expert nor target scores showed convergent validity with AC variables; none of the scoring‐instruction combinations showed significant associations with the remaining measures.     

Threats to the Operational Use of Situational Judgment Tests in the College Admission Process

This study examined the coachability of two situational judgment tests, the College Student Questionnaire (CSQ) and the Situational Judgment Inventory (SJI), developed for consideration as selection instruments in the college admission process. Strategies for raising scores on each test were generated, and undergraduates were trained in the use of the strategies using a video‐based training program. Results indicated that the CSQ was susceptible to coaching. In addition, the scoring format of the CSQ was found to be easily exploited, such that trainees could increase their scores by greater than 1 SD simply by avoiding extreme responses on that test. The results as a whole sounded a note of caution for the potential use of the CSQ in the college admission process.     

AN EVALUATION OF ALTERNATE SCORING METHODS FOR THE MIXED STANDARD SCALE

This study investigated the psychometric properties of three methods of scoring a Mixed Standard Scale (MSS) performance evaluation: the patterned procedure as corrected by Saal (1979); a simple nonpatterned scoring procedure suggested by Prien, Jones, and Miller (1977), which gives equal weights to the performance statements; and a procedure that assigned differential weights to each statement on the basis of scale values provided by a panel of subject matter experts. Interrater reliabilities, scale variances for averaged ratings, and a convergent/discriminant validity analysis, which included an alternate method of job skill ratings, indicated no difference in the score distribution variance, interrater reliability, or validity of different method scores.     

Accounting for age differences on the Wisconsin Card Sorting Test: decreased working memory, not inflexibility

Two experiments examined the role of cognitive inflexibility and reduced working memory in age-related declines on the Wisconsin Card Sorting Test. Both standard scoring procedures and newly developed scores were used to measure each construct, and modifications of the test further evaluated the role of working memory. Results indicated that age differences are not due to cognitive inflexibility but that for a subset of older adults errors are associated with a reduction in the amount of information that can be stored or processed in working memory. These age differences disappear, however, when visual cues provide information about the immediately preceding sort. The authors conclude by proposing a decline in updating working memory as the explanation that can best account for the entire pattern of age differences on this test.