Rorschach interrater agreement estimates: An empirical evaluation

A standardized estimation of Rorschach interrater agreement is needed. Percentage agreement, although widely used, is found to be unsuitable. Forty-one protocols from adults in both a normal and a psychiatric sample were scored by two or three scorers, making 85 scoring pairs. Percentage agreement, correlations (phi and Pearson's r ), and kappa were computed on single response, total score, and category level. Percentage agreement shows minimal variation. Even when exceeding 0.80, it can obscure major disagreements. Kappa and correlations both vary in a similar way with level of disagreement. Total score level does not give additional information compared to single score and category levels. Kappa proved to be conservative and reliable and is therefore suggested as a standard estimate.     

Reliability and expected loss: A unifying principle

We provide a unified, theoretical basis on which measures of data reliability may be derived or evaluated, for both quantitative and qualitative data. This approach evaluates reliability as the proportional reduction in loss (PRL) that is attained in a sample by an optimal estimator. The resulting measure is between 0 and 1, linearly related to expected loss, and provides a direct way of contrasting the measured reliability in the sample with the least reliable and most reliable data-generating cases. The PRL measure is a generalization of many of the commonly-used reliability measures.We show how the quantitative measures from generalizability theory can be derived as PRL measures (including Cronbach's alpha and measures proposed by Winer). For categorical data, we develop a new measure for the general case in which each of N judges assigns a subject to one of K categories and show that it is equivalent to a measure proposed by Perreault and Leigh for the case where N is 2.Bruce Cooil is an Associate Professor of Statistics, and Roland T. Rust is a Professor and area head for Marketing. The authors thank three anonymous reviewers and an Associate Editor for their helpful comments and suggestions. This work was supported in part by the Dean's Fund for Faculty Research of the Owen Graduate School of Management, Vanderbilt University.     

Graphic comparisons of interobserver agreement indices

How changes in the interobserver agreement and disagreement cells in the reliability matrix are reflected differently in eight commonly used reliability indices is shown graphically. Indices which take into account expected chance difference are compared to those indices which do not. Differences between indices which do and do not treat the agreement and the disagreement cells equally are also illustrated.     

Comparison of Mothers', Fathers', and Teachers' Reports on Problem Behavior in 5- to 6-Year-Old Children

Evidence exists that there is low agreement between multiple informants reporting on children's and adolescents' behavior problems. Few studies, however, focus on agreement between informants in specific age groups. This study examined correspondence and disagreement between mother, father, and teacher reports of problem behavior by analyzing CBCL and TRF data of 2 nonclinical samples of 5- to 6-year-old preschool children (N = 424). Findings indicated that interrater agreement was low to moderate. This was shown by the intercorrelations, the explained variance in regression analyses and the little overlap in the number of children rated as behaviorally disturbed by all 3 informants. Agreement between mother and father reports was highest, whereas agreement between mother and teacher reports was lowest. Disagreement between informants was highest for internalizing problems. Potential explanations for the lack of agreement are discussed. Guidelines are formulated to refine assessment and optimize clinical decision-making processes.     

对流行病学本科教材中病因推断的部分方法的质疑

全国高等医药院校教材第五版<流行病学>,在讲述病因研究的推理方法时,介绍了求因果联系的5种方法.但其中的求异法和同异并用法及其举例是错误的.     

手术同意书的相关法律问题

医患双方都非常重视手术同意书,从法理角度分析,手术同意书是患者知情同意权利和医方告知义务的体现;符合民事法律要件的合法有效的手术同意书,证明了医患之间告知与知情同意权的实现.对手术同意书的法律性质及法律效力进行探究,有助于维护医患双方的合法权利.     

Climate justice after Paris: a normative framework

This paper puts forward a normative framework to differentiate between the climate-related responsibilities of different countries in the aftermath of the Paris Agreement. It offers reasons for applying the chief moral principles of ‘historical responsibility’ and ‘capacity’ to climate finance instead of climate change mitigation targets. This will (i) provide a normative basis to realize the goal of climate change mitigation while allowing for developing and newly industrialized countries to develop economically and (ii) offer an account of the distributive principles that can regulate climate finance. This is a real-world interpretation of the 1992 UNFCCC principle of ‘common but differentiated responsibilities’ that takes into account the progress accomplished at the COP21 in Paris and offers a solution to the still unsolved problem of differentiated responsibilities. This paper offers an application of this proposal to the Green Climate Fund.     

How gender-expectancy affects the processing of “them”

How sensitive is pronoun processing to expectancies based on real-world knowledge and language usage? The current study links research on the integration of gender stereotypes and number-mismatch to explore this question. It focuses on the use of them to refer to antecedents of different levels of gender-expectancy (low–cyclist, high–mechanic, known–spokeswoman). In a rating task, them is considered increasingly unnatural with greater gender-expectancy. However, participants might not be able to differentiate high-expectancy and gender-known antecedents online because they initially search for plural antecedents (e.g., Sanford & Filik), and they make all-or-nothing gender inferences. An eye-tracking study reveals early differences in the processing of them with antecedents of high gender-expectancy compared with gender-known antecedents. This suggests that participants have rapid access to the expected gender of the antecedent and the level of that expectancy.