Context and test-retest reliability of Kolb's Learning Style Inventory

Two groups of students enrolled in a university physical activity course volunteered to complete Kolb's Learning Style Inventory at the beginning of and the end of a semester to estimate test-retest reliability. A control group (n = 129) completed the inventory in its original form while the experimental group (n = 124) completed the same test but with modified instructions providing a more specific focus. Test-retest reliability, assessed using a Pearson product-moment correlation, improved for the group given instructions which specified a contextual focus.     

Semantic response consistency and protocol validity in structured personality assessment: the case of the NEO-PI-R

In this study we tested the hypothesis that groups of NEO Personality Inventory-Revised (NEO-PI-R; Costa & McCrae, 1992a) protocols identified as potentially invalid by an inconsistency scale (INC; Schinka, Kinder, & Kremer, 1997) would show reduced reliability and validity according to a series of psychometric tests. Data were obtained from 2 undergraduate student samples, a self-report group (n = 132) who provided NEO-PI-R self-ratings on 2 occasions separated by a 7- to 14-day interval and an informant group (n = 109) who provided ratings of well-known friends or relatives on 2 occasions separated by a 6 month interval. INC scores from the Time 1 protocols were used to divide these samples into low, moderate, and elevated inconsistency groups. In both samples, these 3 groups showed equivalent levels of reliability and validity as measured by: contingency coefficients for the 20 INC item responses across occasions; test-retest intraclass correlations of NEO-PI-R domain scores; convergent correlations with Goldberg's (1992) Bipolar Adjective Scale scores; and discriminant correlations between the 5 NEO-PI-R domain scores. The similarity of results across self-report and informant assessment contexts provides additional evidence that semantic consistency approaches to assessing protocol validity may overestimate the prevalence of random or careless response behavior in standard administration conditions. Several theories are discussed that accommodate the existence of valid inconsistency in structured personality assessment.     

消费者独特性需求量表的研究

本研究目的是修订消费者独特性需求量表（CNFU）的中文版。研究对两个样本共计918名被试进行了问卷测量。项目分析显示,31个题目均符合心理测量学要求。验证性因素分析表明,26个题目的中文版量表符合原量表的三因素（即标新立异、非大众化和避免雷同）模型。量表的重测信度、内部一致性和分半信度均在0．85以上。量表具有较好的汇聚和区分效度,非学生样本得分显著高于学生样本。本文对量表今后的研究和应用进行了探讨。     

Assessment of adolescents' learned helplessness in achievement situations

Three studies are reported that describe the development, reliability, and initial validation of the Mastery Orientation Inventory (MOI; Reynolds & Miller, in press) as a measure of generalized learned helplessness in adolescents. In Study 1, an initial version of 50 items was administered to a sample of 112 adolescents. A revised 40-item scale with an internal consistency reliability of .94 was then constructed, which correlated significantly with measures of locus of control and depression. Study 2 involved the administration of the 40-item MOI to 645 adolescents. In this study, the reliability of the MOI was .92, and MOI scores were significantly correlated with subjects' depression scores and with self-reported grade point average. Factor analysis of the MOI items produced a strong first factor with high loadings for every item. In Study 3, the 112 subjects who participated in Study 1 were, 3 months later, readministered the MOI, locus of control, and depression measures. As an external criterion variable, 13 teachers provided global ratings of learned helpless/mastery-oriented behaviors for 99 of these subjects. The MOI demonstrated high internal consistency (r alpha = .95) and adequate test-retest (rtt = .77) reliability. Validity was supported by significant correlations between the MOI and the three criterion variables (/rs/ = .49-.58). The results of these investigations provide initial support for the reliability and validity of the MOI as a measure of learned helplessness.     

The reliability and validity of the Swedish version of the Body Shape Questionnaire

Psychometric properties of the Swedish version of the Body Shape Questionnaire (BSQ) were examined using data from three samples: (1) a sample from the general population (n= 1157), (2) a student sample (n= 124) and (3) a clinical sample (n= 90). Analyses showed that a single factor solution might be a reasonable solution as 32 of the 34 items loaded heavily on the first factor. The derived short 14-item version of the BSQ also showed a coherent structure with all the items loading on one single factor. The BSQ showed high test-retest reliability, very high internal consistency, ranging from 0.94 to 0.97, and high split-half reliability (above 0.93). Furthermore, it showed high validity by correlating highly with the body dissatisfaction subscale of the Eating Disorders Inventory (r= 0.72 and higher), and high discriminant validity. Thus, the Swedish version of the BSQ showed good concurrent and discriminant validity as well as high reliability.     

Reliability and validity of scores on the Slosson Visual Perceptual Skill Screener

Psychometric characteristics of the Slosson Visual Perceptual Skill Screener were studied using three independent samples of 595 boys and 578 girls ages 5 to 10 years. Adequate characteristics for item selection were indicated by item difficulty (Mdn=.49) and item discrimination (Mdn=.59). Interitem consistency of .93 (n1 = 1,045) was recorded for the total scale, while 30-day test-retest reliability was .80 (n2=55). Convergent validity was estimated using the Bender Visual-Motor Gestalt test (Koppitz developmental scoring system; r = .43, n3=47), the Developmental Test of Visuo-motor Integration, Visual Perception subtest (r =.62, n3 =73), and the Test of Visual Perceptual Skills-Revised-Nonmotor Total Score (r = .63, n2 =59).     

Psychometric analysis of the Psychopathic Personality Inventory (PPI) with female inmates

This study evaluated the reliability, internal structure, and validity of the Psychopathic Personality Inventory (PPI; Lilienfeld & Andrews, 1996) among female inmates (n = 153) housed at a multilevel prison facility. Findings from this research suggested both strengths and weaknesses associated with PPI psychopathy assessment. Reliability of the PPI was supported by internal consistency analyses of scale and subscale item sets, and test-retest reliability was supported by findings obtained with a subsample (n = 36) retested an average of 49 days after initial test administration. Validity of the PPI total score was also supported by moderate to very high correlations with other self-report measures of psychopathy. Relative weaknesses of the PPI were evident by the low or negative associations among many of the PPI subscales, moderate associations that PPI total scores demonstrated with response set indexes, and the similarity of PPI total scores among female inmates and undergraduates. Findings from this research are considered in relation to possible sex differences in the expression of psychopathy and challenges associated with the assessment of the psychopathy construct with self-report methods.     

小学一年级数感不良儿童的筛查与动态干预

首先编制测查小学一年级儿童数感发展水平的测验, 以筛查出数感发展不良儿童并进行数量转换和数量估计的动态干预。将数感不良儿童分为干预组(29人)和控制组(27人), 并以数感正常儿童作为对照组(40人), 以比较干预训练对儿童数感水平和与之密切相关的计算流畅性的促进作用。同时进一步考查数感和计算流畅性的作用方向。结果发现：(1)所编制的儿童数感发展测验信效度良好, 能有效评估一年级儿童的数感水平; (2)数感不良儿童经干预后, 其数感水平较控制组有了明显改善, 计算流畅性水平也显著提高, 甚至达到正常组儿童的水平; (3)数感对计算流畅性有明显的预测作用, 是计算流畅性的基础。     

Reliability of heterosocial skills measurement with sex offenders

The heterosocial skills of 79 sex offenders were assessed using two self-report inventories, the Social Anxiety and Distress Scale (SAD) and the S-R Inventory of Anxiousness (SRI). In addition, staff members rated the offenders on modified versions of the SAD and the Heterosocial Skills Behavior Checklist for Males (HSB). Twenty-one offenders were also videotaped during a brief interaction with a female confederate. The tapes were rated using the HSB. All ratings and videotapings were conducted twice within a two-week period. The two self-report scales showed good test-retest reliability (r=.88) and correlatedr=.63 with each other. However, the SAD correlated significantly with the Crowne-Marlowe Social Desirability Scale and showed significant change from first to second administrations. The SRI showed less reactivity to social desirability and changed less over time. The staff ratings showed higher test-retest (r=.72–.76) than interrater (r=.36–.43) reliability. They correlatedr=–.56 with each other and did not show a significant relationship to the Crowne-Marlowe. However, both staff-ratings changed significantly from test to retest. Inspection of correlations between staff and self-report measures indicated that these instruments may be strongly affected by rater variance. Different measures completed by the same person correlated higher than the same measure completed by different persons. The HSB showed high levels of interrater agreement (90–100%) and split-half reliability (r=.95–.97). However, test-retest reliability was poor for the overall score and for the category measuring form of conversation. Categories measuring voice and affect were moderately reliable over time (r=.53–.74). However, the voice category scores changed substantially from first to second videotaping. On almost all measures used in this study, the sex offenders' scores were similar to those derived from normal populations. Only the category measuring affect on the HSB seemed to differentiate this group from normals.     

An exploratory study of the draw-a-person as a measure of racial identity.

The race of the figure drawn on the Draw-A-Person Test is proposed as a measure of acceptance of racial identity. Reliability and validity of this measure were explored in a two-part study. Part 1 confirmed the hypothesis that the race of the figure drawn is related to the race of the child producing the drawing. Comparison of the figures drawn by black (n = 157) and white (n = 167) children confirmed three other hypotheses based on the voluminous literature suggesting that black children are less accepting of their racial group membership than whites. These hypotheses were: (a) whites should be more likely to draw figures that are clearly white than blacks are to draw figures that are clearly black, (b) whites should be less likely to draw blacks than blacks are to draw whites, and (c) blacks should be more likely to avoid giving clear indication of the race of the figures they draw than are whites. Inter-rater reliability for the race of the figure drawn was .79. Five weeks after the initial drawing, a subsample of 28 black children drew a second figure and performed a picture choice task designed to assess acceptance of racial identity. The race of the figure drawn showed a test-retest reliability of .53 and correlated significantly with the other measure of racial identity (r27 = .39).     

Increasing positive self-referent statements to improve self-esteem in low-income elementary school children

The purpose of this study was to increase verbalization of positive self-referent statements in an effort to increase corresponding self-esteem scores. A total of 30 children from 10 elementary school classes were divided into an experimental group, a control group, and an inventory group. All children received pre- and post-experiment administration of the Coopersmith Self-Esteem Inventory. The experimental group received teacher praise contingent upon verbalizing positive self-referent statements. Control group students from these same classes received no praise for their statements. Inventory group students were from different classrooms and only took the Coopersmith Inventory. Results showed that experimental group students made significantly more positive self-referent statements than control students. Self-esteem scores for experimental group students were significantly higher than scores for control and inventory students.     

Psychometric evaluation of trauma and posttraumatic stress disorder assessments in persons with severe mental illness

Interrater reliability, internal consistency, test-retest reliability, and convergent validity were examined for the Trauma History Questionnaire (THQ), the Clinician-Administered Posttraumatic Stress Disorder (PTSD) Scale (CAPS), and the PTSD Checklist (PCL) in 30 clients with severe mental illnesses. Interrater reliability for the THQ and CAPS was high, as was internal consistency of CAPS and PCL subscales. The test-retest reliability of the THQ was moderate to high for different traumas. PTSD diagnoses on the CAPS and PCL showed moderate test-retest reliability. Lower levels of test-retest reliability for PTSD diagnoses were related to psychosis diagnoses and symptoms. However, when more stringent criteria for PTSD were used on the CAPS, it had excellent test-retest reliability across all clients. CAPS and PCL diagnoses of PTSD showed moderate convergent validity. The results support the reliability of trauma and PTSD assessments in clients with severe mental illness.     

English validation of the short form of the Physical Self-Inventory (PSI-S)

The study examined the psychometric properties of scores on the English version of the short Physical Self-Inventory (PSI-S) among 1368 English-Speaking and 224 French-Speaking adolescents. Participants completed the original PSI-S and a revised version including positively-worded reformulations of the original negatively-worded items. The results supported the a priori factor structure, composite reliability, and test-retest reliability (7–8 months) of scores on the revised PSI-S, and its equivalence with the French version. Compared to confirmatory factor analyses, exploratory structural equation modeling resulted in a superior solution, and more cleanly differentiated factors. PSI-S responses were longitudinally invariant across 7–8 months, and presented no evidence of differential item functioning as a function of age, gender, body mass index (BMI) and physical activity. The results showed latent mean differences as a function of gender, BMI (linear and curvilinear effects), and physical activity, supporting the criterion-related validity of the PSI-S factors.     

Reliability of a sentence completion measure of ego development.

Studied the reliability of the Washington University Sentence Completion Test by giving 51 9th graders and 26 college students the test twice, a week apart. For 9th graders the design included a test-retest group and two groups given half of the test at each session. Although test-retest correlations were high for the 9th graders, retest scores dropped significantly. With college students (a) test-retest correlations through positive and significant were lower, (b) retest scores did not change systematically, and (c) percentage agreement between test and retest scores was high. Discrepant results were related to motivational set and variance in test scores. Split-half correlations and internal consistency coefficients were high. Likelihood of lower retest scores makes problematic the use of this test for short term pretest-posttest studies seeking to stimulate ego development.     

中文版婴儿态度量表在已婚育龄女性中的信效度检验

目的 将婴儿态度量表(Attitude Toward Babies Scale,ABS)进行汉化,并检验在中国已婚育龄女性中的信效度。方法 采用方便取样的方法,选取贵州、山西、湖北等地的700名育龄女性进行施测,通过项目分析、内容效度分析、探索性因素分析、验证性因素分析、效标关联效度、Cronbach α系数、分半信度、重测信度评价其信效度。结果 项目分析表明,婴儿态度量表各条目与量表各维度总分显著相关,具有良好的区分度; 内容效度分析表明专家间一致性水平(IR)为1,I-CVI在0.83～1之间,S-CVI/UA为0.82,S-CVI/Ave为0.97; 探索性因素分析得出5个特征值>1的因子,累计方差贡献率为54.399%; 验证性因素分析表明五因素模型拟合度较好(χ2/df=2.500,CFI=0.922,TLI=0.914,RMSEA=0.048,SRMR=0.050); 各效标与该量表显著相关; 总量表Cronbach α系数为0.748,量表的分半信度为0.661,重测信度为0.639。结论 修订后的ABS具有良好的信效度,可以作为已婚育龄女性生育动机的有效测量工具。     

Psychometric properties of the Spanish version of the self-perception profile for children

Harter's Self-perception Profile for Children was designed to assess children's domain-specific judgments of their competence (scholastic, social, athletic, physical, and behavioral), as well as global self-worth. The psychometric properties and exploratory factor analysis of the profile for two Spanish samples of children (49% boys and 51% girls; M age=11.1 yr., SD=9.7), were examined (n=23 from an after-school social care center in an economically deprived neighborhood and n=120 from a private school mainly enrolling families of medium socioeconomic status). All attending children between 9 and 12 yr. old were included. Analysis showed sex differences, with girls scoring lower than boys on Athletic Competence and higher on Behavioral Conduct. Children from the economically deprived group had higher scores on Social Acceptance and lower scores on Physical Appearance. The cross-cultural analysis showed that the Spanish control group scored significantly higher than the original American control group on Global Self-worth. A Spanish validation with 9- to 12-yr.-olds clearly replicated the five-factor structure reported by Harter in 1985 and also replicated the results obtained in other European samples, showing reliable and valid psychometric properties.     

Short-interval test-retest interrater reliability of the Dutch version of the Structured Clinical Interview for DSM-IV personality disorders (SCID-II)

This study examined the short-interval test-retest reliability of the Structured Clinical Interview (SCID-II: First, Spitzer, Gibbon, & Williams, 1995) for DSM-IV personality disorders (PDs). The SCID-II was administered to 69 in- and outpatients on two occasions separated by 1 to 6 weeks. The interviews were conducted at three sites by ten raters. Each rater acted as first and as second rater and equal number of times. The test-retest interrater reliability for the presence or absence of any PD was fair to good (kappa = .63) and was higher than values found in previous short-interval test-retest studies with the SCID-II for DSM-III-R. Test-retest reliability coefficients for trait and sumscores were sufficient, except for dependent PD. Values for single criteria were variable, ranging from poor to good agreement. Further large-scale test-retest research is needed to test the interrater reliability of more categorical diagnoses and single traits.     

The two-week and five-week dependability and stability of the depressive personality disorder inventory and its association with current depressive symptoms

Within the psychometric framework of assessing a measure's dependability (Watson, 2004), this study considered the 2-week and 5-week test-retest correlations of the Depressive Personality Disorder Inventory (DPDI; Huprich, Margrett, Barthelemy, & Fine, 1996). DPDI scores were compared with the test-retest reliability (i.e., dependability) of the Beck Depression Inventory-II (BDI-II; Beck, Steer, & Brown, 1996). Three-hundred sixty-three undergraduates completed the DPDI and BDI-II and were reevaluated at either a 2- or 5-week interval. Two- and 5-week test-retest correlations for the DPDI were .89 and .82, respectively, and test-retest correlations for the BDI-II were .88 and .75. The effect sizes of the mean scores' changes in the measures across time were larger for the DPDI (ds = .48, .23) than the BDI-II (ds = .28, -.21), with mean BDI-II scores not significantly differing at the 5-week assessment from the baseline mean. Although the 5-week retest correlation for the BDI-II trended toward decreasing reliability from baseline, it did not significantly differ from the DPDI 5-week retest correlation. It is concluded that both measures are dependable and assess latent propensities toward depressive thoughts and feelings, along with the current influence of depressive states.     

Death anxiety in Egyptian samples

The present research was an attempt to determine the Egyptian death anxiety level and correlates, and to compare such data with those of Americans. The sample consisted of 673 Egyptian males and 770 females in 13 subgroups. The Arabic version of the Templer's Death Anxiety Scale (DAS) was administered. Testing bilingual Ss, test-retest reliability and factorial validity of the DAS in Egyptian Ss has been adequately demonstrated. However, split-half reliability was not high. The mean DAS scores for Egyptians were a little higher than those of Americans. Egyptian females had higher DAS scores than males. The DAS correlates significantly with the Manifest Anxiety Scale and State-Trait Anxiety Inventory. However, DAS correlates with Trait Anxiety more than with State Anxiety. There is a significant correlation between the DAS and the Neuroticism subscale of the Eysenck Personality Questionnaire. Death anxiety and general anxiety constitute two distinct factors.     

Two forms of minority-group test bias as psychometric artifacts with an animal model (Rattus norvegicus)

Controversy abounds over attributing group differences on tests to nature, nurture, or test bias. Limitations of correlational sampling from natural populations necessitate experimental methods to resolve underlying issues. In classical psychometrics test items are selected from a larger item pool through analysis of item responses in a sample of subjects. Rats of six inbred strains (n = 366) were tested in multiple mazes to provide a large item pool. Six populations were created, each with differing proportions of each strain. Items selected through independent item analyses within each population yielded six tests. An independent cross-validation sample (n = 146) provided scores on all six tests. This sample was also tested in another set of maze problems defined as the criterion to be predicted. Strain means and intrastrain predictive validities for the six tests varied with strain representation in the population used for item selection (p less than .001). Conventional item-selection procedures clearly produced two forms of minority test bias.