The First Twenty Years of the Will and the Ways: An Examination of Score Reliability Distribution on Snyder’s Dispositional Hope Scale

C. R. Snyder has established hope theory as an important contributor to positive psychology. As the empirical evidence continues to grow, hope researchers need to have confidence that their measures will produce reliable scores. This study presents a reliability generalization on both the internal consistency and test–retest reliability estimates from Snyder’s dispositional hope scale. While over 300 published works were found to have cited the target article 74 present internal consistency scores and 17 reported scores for test–retest reliability. The results of the reliability generalization suggest support for the score reliabilities produced by the dispositional hope scale. However, internal consistency was higher for studies using the eight-item response format (α = 0.82) compared to those using the four-item response format (α = 0.77). Additionally, the test–retest score reliability was high 0.80 with no statistically significant differences by response format. Findings also demonstrated that score reliability estimates were not significantly influenced by the coded sample characteristics.     

Some cautionary notes regarding the use of aggregated scores as a measure of behavioral stability

The utility of the method of aggregation as a measure of behavioral consistency was examined in 26 studies involving computer-generated, repeated-measurement data. The first series of studies involved rectangular distributions in which score constant. A second series of studies used normally distributed z scores, and score consistency was manipulated by inducing a desired correlation between the scores in adjacent trials. In both sets of studies, the aggregate stability coefficient was a strictly increasing function of the number of aggregated trials, and even trivial amounts of score stability resulted in large stability coefficients. In a third series of studies, high stability coefficients occurred when computed on combined unstable subsamples which differed from each other only in central tendency. Terminal aggregate coefficients were compared with Spearman-Brown prophecy and Cronbach's alpha reliability coefficients computed on the experimental data. It was concluded that the method of aggregation produces spuriously high estimates of behavioral consistency. It was further shown that the Spearman-Brown prophecy formula and coefficient alpha accurately predict the results of the aggregation method, suggesting that aggregation is an internal consistency reliability procedure. The equating of stability with traditional notions of reliability was questioned.     

Psychometric Properties of the WHOQOL-BREF Questionnaire among Disabled Students in Malaysian Higher Learning Institutions

This study aims to evaluate reliability, internal consistency and dimensional structure of the World Health Organization Quality of Life (WHOQOL-BREF) among disabled students. The study covers 127 disabled students studying in public universities, 26 in private universities, 109 in polytechnic and 19 studying in community colleges. The World Health Organization Quality of Life Abbreviation (WHOQOL-BREF) has been used to assess QOL. The reliability and validity of the questionnaire were evaluated by Cronbach’s alpha (α) and Pearson’s correlation coefficients. Alpha scores greater than or equal to 0.6 are considered to denote acceptable and adequate internal consistency. Correlation matrix also showed satisfactory results in all domains. Factor analysis was carried out using the principal components method with varimax rotation to examine the dimensional structure of the questionnaire. This study has provided some preliminary evidence of the reliability and validity of the WHOQOL-BREF to be used for evaluating quality of life among disabled students.     

The reliability of romantic love: A reliability generalization meta‐analysis

The present study is a reliability‐generalization meta‐analysis of 5 commonly used measures of romantic love: Rubin’s Loving and Liking scales, the Love Attitudes Scale, the Love Attitudes Scale–Short Form, the Passionate Love Scale, and the Triangular Love Scale. Data from 127 studies representing 38,132 participants provided internal consistency reliability estimates. The studies provide information on the average score reliability across studies and the effect of sample characteristics on score reliability across measures. The reliability of scores from several measures proved to be susceptible to the influence of sample characteristics, most notably, the ethnicity of the sample. The discussion provides recommendations to researchers and focuses on the ramifications of score reliability on love research.     

Score reliability for tests constructed for African-American populations

Test score reliabilities and sample sizes (N) used to establish the reliabilities are described for a variety of tests constructed for African-American populations. The sample size was 341. The average internal consistency reliability was .74 (SD = .16) with a median value of .77. The median N was 131. The mean internal consistency reliability and median N for tests intended for assessment of individuals were only .72 and 96, respectively.     

Das-Naglieri认知评估系统（中文版）在学前儿童样本中的结构验证

本研究以246名5-6岁幼儿园儿童（男101名,女145名）为研究对象,考察基于智力PASS理论开发的Das-Naglieri 认知评估系统（5-7岁版）在中国学前儿童中的适用性,对评估系统中的12个任务进行了内在一致性信度评估,以幼儿早期数学能力测试作为参考评估其校标效度,并采用验证性因素分析对评估系统的结构效度进行评估。结果发现,该版本评估系统具有较好的信度和校标效度,并且很好地拟合了PASS模型。     

Psychometric analysis of the Visual Form Discrimination Test

The Visual Form Discrimination Test is a matching-to-sample test involving visual discrimination. Although normative information has been presented, limited psychometric data have been available. The current study estimated the internal consistency and additional psychometric properties of the test in a sample of 66 persons with acute traumatic brain injury. Internal consistency as measured by alpha was .66. A homogeneous sample and a restricted range of scores likely attenuated this estimate. Using the standard cutoff score, only 32% of the sample showed impaired performance. Visual form discrimination as measured by this test may be affected less by traumatic brain injury than other cognitive processes such as attention and memory.     

Severe intimate partner violence risk prediction scale-revised

The aim of this study was to describe the psychometric properties of the Severe Intimate Partner Violence Risk Prediction Scale and to revise it in order to ponderate the 20 items according to their discriminant capacity and to solve the missing item problem. The sample for this study consisted of 450 male batterers who were reported to the police station. The victims were classified as high-risk (18.2%), moderate-risk (45.8%) and low-risk (36%), depending on the cutoff scores in the original scale. Internal consistency (Cronbach's alpha=.72) and interrater reliability (r=.73) were acceptable. The point biserial correlation coefficient between each item and the corrected total score of the 20-item scale was calculated to determine the most discriminative items, which were associated with the context of intimate partner violence in the last month, with the male batterer's profile and with the victim's vulnerability. A revised scale (EPV-R) with new cutoff scores and indications on how to deal with the missing items were proposed in accordance with these results. This easy-to-use tool appears to be suitable to the requirements of criminal justice professionals and is intended for use in safety planning. Implications of these results for further research are discussed.     

A Reliability Generalization Meta-Analysis of Self-Report Measures of Adult Attachment

This study is a reliability generalization meta-analysis that reviews 5 of the most frequently used continuous measures of adult attachment security: the Adult Attachment Scale, Revised Adult Attachment Scale, Adult Attachment Questionnaire, Experiences in Close Relationships, and Experiences in Close Relationships–Revised. A total of 313,462 individuals from 564 studies provided 1,629 internal consistency reliability estimates for this meta-analysis. We present the average internal consistency reliability of scores for each measure and test the consistency of score reliabilities across a wide variety of sample characteristics. In light of this, we highlight several issues in the measurement of adult attachment security and make concrete recommendations for researchers seeking to measure adult attachment.     

心理测验中的趋中回归与超常分数重现概率

研究了心理测验中的趋中回归及其性质,超常分数重现概率与真分数的分布、测验信度、超常分数界值的关系。结果表明,信度越低,趋中回归越大;超常分数界值越高,趋中回归越大。在正态分布下,超常分数重现概率与信度是指数关系;超常分数重现概率与界值是直线关系。初步讨论了如何在心理学研究中避免和减少趋中回归的误导。     

测验信度估计：从α系数到内部一致性信度

沿用经典的测验信度定义, 简介了信度与a 系数的关系以及a系数的局限。为了推荐替代a系数的信度估计方法, 深入讨论了与a 系数关系密切的同质性信度和内部一致性信度。在很一般的条件下, 证明了a 系数和同质性信度都不超过内部一致性信度, 后者不超过测验信度, 说明内部一致性信度比较接近测验信度。总结出一个测验信度分析流程, 说明什么情况下a 系数还有参考价值; 什么情况下a 系数不再适用, 应当使用内部一致性信度(文献上也常称为合成信度)。提供了计算同质性信度和内部一致性信度的计算程序, 一般的应用工作者可以直接套用。     

Structural validity and reliability of the Spanish version of the White Bear Suppression Inventory (WBSI) in a sample of the general Spanish population

This paper introduces the validation of the Spanish adaptation of the White Bear Suppression Inventory (WBSI) by Wegner and Zanakos (1994). A sample of 833 people from the general population completed the WBSI along with other questionnaires. The exploratory factor analysis and the confirmatory factor analysis supported a two-factor solution accounting for 51.8% of the cumulative variance. This structure is comprised of the two following factors: unwanted intrusive thoughts (alpha = .87, r = .70) and actions of distraction and suppression of thoughts (alpha = .80, r = .60). Both internal consistency reliability (alpha = .89) and test-retest reliability (r = .71) showed adequate homogeneity, sound consistency, and stability over time. The results are discussed bearing in mind both isolated factors and the possible relationships of the suppression factor with automatic negative thoughts and insomnia.     

Measuring decision‐making competence in Chinese adults

In this study, we translated and localized the Adult Decision‐making Competence scale (A‐DMC) and tested its reliability and validity with large samples. Results show the Chinese A‐DMC has relatively good reliability (Cronbach's alpha above 0.6 and test–retest reliability coefficients ranging from 0.44 to 0.78 on all subscales), comparable with the original version. Regarding validity, results of exploratory factor analysis and confirmatory factor analysis support the one‐factor model, indicating the A‐DMC has good internal consistency and construct validity. A‐DMC scores correlated positively with cognitive ability, constructive decision‐making styles, and good decision outcomes. Additionally, individuals with higher A‐DMC scores were found to perform better on the Cambridge gambling task and Iowa gambling task. These results confirm the validity of the Chinese version of the A‐DMC, which is suitable for measuring decision‐making competence in Chinese adults.     

Statistical significance and reliability of single-subtest and cluster deviation scores

Suppose one has a battery of K subtests and a composite for the battery is defined as the mean of the K standardized subtest scores. An individual's single-subtest deviation score is the difference between the individual's score on any single subtest and his composite score. A cluster deviation score is the difference between an examinee's average for a small set (cluster) of subtests and his composite. Formulas are given for the test of statistical significance of the individual's subtest or cluster deviation score and the internal consistency reliability of such deviation scores.     

Assessing PTSD in the military: Validation of a scale distributed to Danish soldiers after deployment since 1998

Since 1998, soldiers deployed to war zones with the Danish Defense (≈31,000) have been invited to fill out a questionnaire on post‐mission reactions. This provides a unique data source for studying the psychological toll of war. Here, we validate a measure of PTSD‐symptoms from the questionnaire. Soldiers from two cohorts deployed to Afghanistan with the International Security Assistance Force (ISAF) in 2009 (ISAF7, N = 334) and 2013 (ISAF15, N = 278) filled out a standard questionnaire (Psychological Reactions following International Missions, PRIM) concerning a range of post‐deployment reactions including symptoms of PTSD (PRIM‐PTSD). They also filled out a validated measure of PTSD‐symptoms in DSM‐IV, the PTSD‐checklist (PCL). We tested reliability of PRIM‐PTSD by estimating Cronbach's alpha, and tested validity by correlating items, clusters, and overall scale with corresponding items in the PCL. Furthermore, we conducted two confirmatory factor analytic models to test the factor structure of PRIM‐PTSD, and tested measurement invariance of the selected model. Finally, we established a screening and a clinical cutoff score by application of ROC analysis. We found high internal consistency of the PRIM‐PTSD (Cronbach's alpha = 0.88; both cohorts), strong item‐item (0.48–0.83), item‐cluster (0.43–0.72), cluster‐cluster (0.71–0.82) and full‐scale (0.86–0.88) correlations between PRIM‐PTSD and PCL. The factor analyses showed adequate fit of a one‐factor model, which was also found to display strong measurement invariance across cohorts. ROC curve analysis established cutoff scores for screening (sensitivity = 1, specificity = 0.93) and clinical use (sensitivity = 0.71, specificity = 0.98). In conclusion, we find that PRIM‐PTSD is a valid measure for assessing PTSD‐symptoms in Danish soldiers following deployment.     

《适应分量表》在蒙古族青少年群体中使用的信、效度检验

采用《青少年心理健康素质调查表·适应分量表》对内蒙古自治区10所蒙古族中小学的1768名蒙古族中小学生进行了调查,对其结果分析表明,量表中的22个项目均符合测量学要求,高低分组被试在所有因子上的得分差异都达到显著性水平;量表的内部一致性信度α系数为0.803;探索性因素分析均揭示了量表结构效度较好;验证性因素分析表明,本量表数据与6因子模型的拟合程度很好,达到可接受的各项标准指数。该量表具有较好的信度和效度,适合蒙古族青少年群体使用。     

The Assessment of Marital Adjustment with Chinese Populations: A Study of the Psychometric Properties of the Dyadic Adjustment Scale

This article presents findings from a study of the psychometric properties of the Dyadic Adjustment Scale (DAS) with 63 Chinese-Americans. The analysis revealed high internal consistency for DAS scores. Coefficient alpha for the total DAS score was r = .93. Convergent validity was established with the Locke-Wallis Marital Adjustment Scale (LWMAT) (r = .87) and divergent validity by evidence of an inverse relationship with the Marital Disaffection Scale (MDS) (r = –.79). Correlations with each measure were found to be (p = 0.01). The result of factor analysis fail to support the presence of four separate subscales. Results show that the global DAS score is of potential utility with Asian samples.     

Development and validation of the Body,Eating, and Exercise Comparison Orientation Measure (BEECOM) among college women

We constructed and validated a measure of comparison dimensions associated with eating pathology, namely, the Body, Eating, and Exercise Comparison Orientation Measure (BEECOM). Participants were 441 undergraduate women. In Study 1, items were generated and refined via exploratory factor analysis, yielding three interpretable factors (i.e., Body, Eating, and Exercise Comparison Orientation). Confirmatory factor analysis was then used to confirm the three-factor structure of the BEECOM and to investigate the potential presence of a higher-order factor. Given that the lower-order factors loaded strongly onto a higher-order factor, it is appropriate to use a total BEECOM score, in addition to subscale scores. Further, the BEECOM's scores yielded evidence of internal consistency and construct validity in this sample. Study 2 demonstrated two-week test–retest reliability of the BEECOM among college women. Overall, the BEECOM demonstrated good psychometric properties and may be useful for more comprehensively assessing eating disorder-related social comparison behavior.     

The Japanese version of the overall assessment of the speaker’s experience of stuttering for adults (OASES-A-J): Translation and psychometric evaluation

PurposeThis study evaluates the psychometric performance of the Japanese version of the Overall Assessment of the Speaker’s Experience of Stuttering for Adults (OASES-A), a comprehensive assessment tool of individuals who stutter.MethodsThe OASES-A-J was administered to 200 adults who stutter in Japan. All respondents also evaluated their own speech (SA scale), satisfaction of their own speech (SS scale) and the Japanese translation version of the Modified Erickson Communication Attitude scale (S-24). The test-retest reliability and internal consistency of the OASES-A-J were assessed. To examine the concurrent validity of the questionnaire, Pearson correlation was conducted between the OASES-A-J Impact score and the S-24 scale, SA scale and SS scale. In addition, Pearson correlation among the impact scores of each section and total were calculated to examine the construct validity.ResultsThe OASES-A-J showed a good test-retest reliability (r = 0.81–0.95) and high internal consistency (α > 0.80). Concurrent validity was moderate to high (0.55–0.75). Construct validity was confirmed by the relation between internal consistency in each section and correlation among sections’ impact scores. Japanese adults showed higher negative impact for ‘General Information’, ‘Reactions to Stuttering’ and ‘Quality of Life’ sections.ConclusionThese results suggest that the OASES-A-J is a reliable and valid instrument to measure the impact of stuttering on Japanese adults who stutter. The OASES-A-J could be used as a clinical tool in Japanese stuttering field.