Reliability and validity of the kiddie mach scale in Chinese children

The present study examined the psychometric properties of a translated Chinese version of the Kiddie Mach Scale in a sample of Chinese students (N=787) ages 9 to 13 years (416 boys, 371 girls; M age= 11.3 yr., SD = 1.3). Results of confirmatory factor analysis showed a three-factor structure to be the most adequate model: Distrust, Lack of faith in human nature, and Dishonesty. These results are similar to the English version, but not the Greek version. The Chinese version exhibited weak internal consistency, but acceptable 4-week test-retest reliability. The Chinese version of the Kiddie Mach Scale was significantly associated with the Basic Empathy Scale. There was a sex effect on Kiddie Mach Scale scores with boys scoring higher on the Total scale and the Distrust subscale. Some items did not seem to function well in Chinese culture. More research will be needed to find items that represent, especially, distrust in Chinese settings.     

Measurement of Preoperative Anxiety in Young Children: Self-report Versus Observer-rated

The utility of the self-report Children’s Anxiety and Pain Scale Anxiety subscale (CAPS-A) in comparison to the widely used, observer-rated Modified Yale Preoperative Anxiety Scale (mYPAS) in assessing anxiety in children undergoing day surgery procedures was examined. The CAPS-A test-retest reliability, concurrent validity with the Modified Yale Preoperative Anxiety Scale (mYPAS), and sensitivity to expected increases in anxiety at stressful times during the preoperative period were examined. Levels of observer-rated (mYPAS) and self-reported anxiety (CAPS-A) were obtained from 61 children (3 to 6 years) undergoing day surgery procedures. The CAPS-A demonstrated adequate test-retest reliability. Concurrent validity between the CAPS-A and mYPAS scores was poor. The CAPS-A failed to show sensitivity to the expected increases in anxiety at stressful time-points. Thus, an alternative scoring strategy for the CAPS-A was proposed (i.e., child’s refusal to point was scored as high anxiety). Post-hoc analyses demonstrated good concurrent and adequate convergent validity with the alternative scoring strategy.     

The development and evaluation of a computer-administered measure of cognitive complexity

The present study presents and evaluates the Computer-Administered Rep Test (CART). The CART is a micro computer program that automates both the administration and scoring of a repertory grid based measure of cognitive complexity. Preliminary evaluation of the CART indicates that it provides a useful alternative to traditional paper-and-pencil administered repertory grid measures of cognitive complexity. We also examine the effect of an alternative scoring approach on the reliability of scores derived from role repertory grid measures of cognitive complexity. Results indicate that this scoring approach substantially enhances the reliability of cognitive complexity scores derived from both the paper-and-pencil and computer-administered measures.     

Psychopathology scale of the Hutt adaptation of the Bender-Gestalt Test: reliability.

The test-retest reliability of the Hutt Adaptation of the Bender-Gestalt test was explored with a population of 40 process schizophrenics over a two-week interval. The total Psychopathology Scale Score was found to have high retest reliability for both male and female patients (rho = .87 for males and .83 for females). Moreover the three major components for the Scale were found to have high reliability, and fairly high reliabilities were obtained for patients scoring high as well as low on the Scale. Interjudge reliability was also found to be very high (rho = .895), confirming previous studies in this respect. On these grounds, the Scale offers promise both for clinical and research purposes.     

Predictive Validity of the MMPI–2 Restructured Clinical (RC) Scales in a Batterers' Intervention Program

Summary: The test-retest reliability of the Hutt Adaptation of the Bender-Gestalt Test was explored with a population of 40 process schizophrenics over a two-week interval. The total Psychopathology Scale Score was found to have high retest reliability for both male and female patients (rho = .87 for males and .83 for females). Moreover the three major components of the Scale were found to have high reliability, and fairly high reliabilities were obtained for patients scoring high as well as low on the Scale. Interjudge reliability was also found to be very high (rho = .895), confirming previous studies in this respect. On these grounds, the Scale offers promise both for clinical and research purposes.     

Comment on 'Measuring Machiavellianism with Mach V: a psychometric investigation'

A recent article (Shea & Beatty, 1983) attacks the reliability, triadic-choice format, and validity of the Mach V. The issues of meaningful versus statistical criteria, differing perspectives of bias, and reliability-validity independence are raised in challenge. Although the Mach V may have some construct validity problems, Shea and Beatty's call for a new measure of Machiavellionism is not supported by their article.     

Percent of agreement among raters and rater reliability of the copying subtest of the Stanford-Binet Intelligence Scale: Fourth Edition.

The purpose of this study was to investigate the interrater reliability of the visual-motor portion of the Copying subtest of the Stanford-Binet Intelligence Scale: Fourth Edition. Eight raters independently scored 11 protocols completed by children aged 5 through 10 years, using the scoring criteria and guidelines in the manual. The raters marked each of 10 items pass or fail and computed a total raw score for each protocol. Interrater reliability coefficients were obtained for each child's protocol, and the Kappa coefficient was computed for each item. Significant raters' reliability coefficients ranged from .82 to .91, which were low in comparison to test-retest reliability and Kuder-Richardson-20 coefficients for this and other subtests of the Stanford-Binet in the technical manual. Percent agreement among 8 raters also indicated weak reliability. Although the obtained results suggested some interrater reliability coefficients within acceptable levels, questions were raised about the scoring criteria for individual items. Caution is warranted in the use of cognitive measures which include subjective judgement of the examiner in applying scoring criteria.     

Computer scoring of the Levels of Emotional Awareness Scale

The Levels of Emotional Awareness Scale (LEAS; Lane, Quinlan, Schwartz, Walker, & Zeitlan, 1990) is the most commonly used measure of differentiation and complexity in the use of emotion words and is associated with important clinical outcomes. Hand scoring the LEAS is time consuming. Existing programs for scoring open-ended responses cannot mimic LEAS hand scoring. Therefore, Leaf and Barchard (2006) developed the Program for Open-Ended Scoring (POES) to score the LEAS. In this article, we report a study in which the reliability and validity of POES scoring were examined. In the study, we used three participant types (adult community members, university students, children), three LEAS versions (paper based, computer based, and the LEAS for children), and a diverse set of criterion variables. Across this variety of conditions, the four POES scoring methods had internal consistencies and validities that were comparable to hand scoring, indicating that POES scoring can be used in clinical practice and other applied settings in which hand scoring is impractical.     

Children's original thinking: an empirical examination of alternative measures derived from divergent thinking tasks

Children's creative potential is often assessed using cognitive tests that require divergent thinking, such as the Torrance Tests of Creative Thinking (TTCT; E. P. Torrance, 1974, 1976, 1990). In this study the authors investigated the effect of various scoring systems on the originality index, evaluating the high intercorrelation of fluency and originality measures found in the TTCT scoring system and the applicability of TTCT scoring norms over time and across age groups. In 3 studies, the originality of elementary school children was measured using TTCT norms and various sample-specific scoring methods with the TTCT Unusual Uses of a Box test as well as social-problem-solving tasks. Results revealed an effect of scoring technique on creativity indices as well as on the reliability of originality scores and the relationship between originality and other ability measures. The usefulness of the various measures for understanding children's original thinking are discussed.     

艾森克人格问卷简式量表中国版(EPQ-RSC)的修订

该文引进艾森克人格问卷简式量表（EPQ-RShortScale,EPQ-RS）,首次在国内加以修订。根据来自30个省市56个地区的8637人（含汉族7725人）的样本数据,修订形成了艾森克人格问卷简式量表中国版（EPQ-RSC）,共包括4个分量表,各12个项目,这一形式和EPQ-RS相同。作者并基于本研究的样本提供了EPQ-RSC的中国常模。研究表明该问卷的E、N和L三个分量表具有令人满意的信度和效度,P量表的信度和效度基本达到有关的心理测量学标准。作者最后对此问卷的信效度结果以及问卷结果反映的当代中国人人格特点进行了讨论。     

Children's Original Thinking: An Empirical Examination of Alternative Measures Derived From Divergent Thinking Tasks

Children's creative potential is often assessed using cognitive tests that require divergent thinking, such as the Torrance Tests of Creative Thinking (TTCT; E. P. Torrance, 1974, 1976, 1990). In this study the authors investigated the effect of various scoring systems on the originality index, evaluating the high intercorrelation of fluency and originality measures found in the TTCT scoring system and the applicability of TTCT scoring norms over time and across age groups. In 3 studies, the originality of elementary school children was measured using TTCT norms and various sample-specific scoring methods with the TTCT Unusual Uses of a Box test as well as social-problem-solving tasks. Results revealed an effect of scoring technique on creativity indices as well as on the reliability of originality scores and the relationship between originality and other ability measures. The usefulness of the various measures for understanding children's original thinking are discussed.     

Conners' Teacher Rating Scale for use in drug studies with children — An empirical study

Their classroom teachers rated 291 schoolchildren, grades kindergarten through 6, on Conners' Teacher Rating Scale, developed for and used widely in drug studies in children. Scores were found to be significantly lower than those reported for a similar group of 92 New York children and considerably less than those of a group of 64 children receiving medication for deviant behavior. Boys generally had higher scores for acting-out-type behavior while girls scored higher on neuroticism. The factor structure in this sample showed some differences from that in Conners' original analysis but they are insufficient for any change in the widely accepted scoring system, except perhaps to add a fifth factor of sociability.     

Confirmatory factor analysis of the Machiavellian Personality Scale

According to Christie and Geis (1970), Machiavellianism predisposes one to self-interested behavior, manipulation, and deceit often at the expense of others. The measurement of Machiavellianism began with the Mach IV (Christie & Geis, 1970), which has long suffered from an indeterminant factor structure and poor reliability. Dahling, Whitaker, and Levy (2009) developed the Machiavellian Personality Scale (MPS) to address these shortcomings. In the current examination of the MPS, a four-factor structure is supported with confirmatory factor analysis, but the relationships in a full structural equation model between the four subscales and the criterion of empathy is problematic in that some MPS subscales are negative, some positive, and some unrelated to empathy. Additionally, reliability issues arose with the MPS as have historically occurred with the Mach IV. The four subscales of the MPS appear to act as suppressors of each other, further complicating the predictive relationship between Machiavellianism and other variables.     

Relation of transliminality and sensation seeking

The Revised Transliminality Scale and Zuckerman's Sensation Seeking Scale (Form V) were administered to 83 psychology undergraduates. Weak positive correlations suggested that participants scoring high on the Transliminality Scale tended to be more experience seeking and, overall, more inclined to score sensation seeking.     

Measuring client-centred attitudes

The development of a Counsellor Attitude Scale is reported. Other attempts to measure client-centred attitudes are reviewed, with particular attention to reliability and validity. In the past much of the research on counsellor attitudes has been based on Porter's Test of Counsellor Attitudes. The Counsellor Attitude Scale provides another instrument for measuring client-centredness. The final version is a modification by the authors of a scale developed by Stewart in the late 1950s. With its ease of administration and scoring, the new scale may prove valuable in counsellor selection and counselling research. Since its items are based on theoretical and practical issues in client-centred counselling, the scale is also useful for counsellor training. Data on reliability and validity are reviewed, and sample items from the Counsellor Attitude Scale are provided.     

Scoring accuracy using the comprehensive system for the Rorschach.

The Comprehensive System (CS; Exner, 1974, 1978) for scoring Rorschach responses is the most widely taught and most widely accepted system in use today. The complexity and labor- intensive nature of the CS makes the issue of scoring accuracy a central concern. Twenty-one graduate psychology students and 12 professionals scored 20 Rorschach responses drawn from normal and clinical protocols. In general. accuracy scores for both students and professionals were below acceptable levels. Accuracy scores were clearly better for the code categories of Location, DQ, Pairs, Popular, and Z than for Determinants, FQ, Content, and Special Scores. Responses from clinical protocols were subject to more error. The results suggest that high levels of scoring errors may exist in the field use of the CS. Training standards may need to be devised to insure scoring competence.     

An examination of the effectiveness of multiple summary scoring procedures of the BNBAS in detecting group differences

The Brazelton Neonatal Behavioral Assessment Scale is the most widely used and accepted tool in the study of the behavior of the human newborn; yet there remains some controversy over the most appropriate way to score the results. The present research compares three a priori methods of scoring. The sample consisted of 43 infants: (a) 11 preterms, (b) 10 fullterms in intensive care, (c) 7 fullterms with sick mothers, and (d) 15 healthy fullterms. BNBAS exams administered to these four groups of infants were scored using the Als (1978), Lester, Als, and Brazelton (1982), and Jacobsen, Fein, Jacobsen, and Schwartz (1984) clusters. The data from these three methods were analyzed by means of one-way ANOVAs for group differences. In addition, a factor analysis on the BNBAS scores was also completed. These three approaches all detected differences between medically at-risk and healthy infants on those items assessing motor maturity and orientation. These results suggest that at this time no one scoring system can capture the richness of behavior of the newborn and address the question by researchers, clinicians, and parents.     

Assessment of Score Dependability of the Wisconsin Schizotypy Scales Using Generalizability Analysis

To investigate the reliability of the Wisconsin Schizotypy Scales, this study applied generalizability analysis with two college student samples who completed the scales at two time points. The results indicated that the Revised Social Anhedonia Scale had acceptable levels of score dependability, but that the score dependability for the other scales (the Physical Anhedonia Scale, the Perceptual Aberration Scale, and the Magical Ideation Scale) was below an acceptable level of .80. The patterns of variance components suggested that the scales’ items need improvement. Researchers can use the included tables to choose the number of items and occasions needed to get dependable score interpretations.     

A Latent-Variable Modeling Approach to Assessing Reliability and Validity of a Creativity Instrument

ABSTRACT: A multiple-choice paper-and-pencil test was developed based on the constructs from the Torrance Test of Creative Thinking (TTCT). The rationale of this new instrument was to shorten the amount of time required for the administration and scoring of creativity tests. This instrument was translated into Spanish and administered along with the TTCT and the Villa and Auzmendi Creativity Test (VAT) to 2,270 students in Spain. Teachers' ratings of student creativity were also obtained. Using a traditional concurrent validation approach from an earlier study, we found low but significant correlations between the scores of the four subscales of the new test and the same subscales of the VAT and TTCT, as well as the students' academic achievement measures. In terms of reliability, mostly moderate (internal consistency) reliability coefficients were found for the new test. As an alternative to the traditional approach, this study employed structural equation modeling (SEM) with multiple indicators to examine the validity and reliability of the new creativity test. The results indicated that substantial improvements in the validity and reliability estimation over the traditional approaches can be made by using SEM with multiple indicators.