Hubert's multi-rater kappa revisited

There is a frequent need to measure the degree of agreement among R observers who independently classify n subjects within K nominal or ordinal categories. The most popular methods are usually kappa-type measurements. When R = 2, Cohen's kappa coefficient (weighted or not) is well known. When defined in the ordinal case while assuming quadratic weights, Cohen's kappa has the advantage of coinciding with the intraclass and concordance correlation coefficients. When R > 2, there are more discrepancies because the definition of the kappa coefficient depends on how the phrase ‘an agreement has occurred’ is interpreted. In this paper, Hubert's interpretation, that ‘an agreement occurs if and only if all raters agree on the categorization of an object’, is used, which leads to Hubert's (nominal) and Schuster and Smith's (ordinal) kappa coefficients. Formulae for the large-sample variances for the estimators of all these coefficients are given, allowing the latter to illustrate the different ways of carrying out inference and, with the use of simulation, to select the optimal procedure. In addition, it is shown that Schuster and Smith's kappa coefficient coincides with the intraclass and concordance correlation coefficients if the first coefficient is also defined assuming quadratic weights.     

Sympathy as knowledge of the other in need: An investigation into the roles of need for closure and the moral foundations on sympathy toward immigrants

Although sympathy is a powerful other-focused motivation, not all individuals will experience sympathy when it is appropriate. Immigrants, as a disadvantaged out-group, are especially in need of sympathy and, given the tensions of the immigration debate, are at-risk for low sympathy. Indeed, past research has found that sympathy is less likely to be experienced toward disliked out-groups. In the current research, we investigated the role of need for closure (NFC), or the general desire for epistemic certainty, on the experience of sympathy toward immigrants in Italy, a nation where the immigration debate is becoming increasingly fractious. Consistent with past research on the roles of NFC and the binding moral foundations (i.e., a concern for the well-being of groups) on prejudice toward out-groups, we propose that individuals with a high NFC, and who endorsed the binding moral foundations (i.e., a concern for the well-being of groups), would be particularly likely to have decreased sympathy toward immigrants in Italy. In line with past research and our hypotheses, in three studies we found that the binding foundations mediated the NFC effect on decreased sympathy toward immigrants in Italy. Conceptually, these individuals can strongly adopt traditional cultural norms as a way to acquire stable knowledge; this can make sympathy toward immigrants less likely, as they both stand outside “traditional” morality, as well can threaten the stability of natives’ knowledge.     

Effect of autonomy support and dialogic learning on school children’s physical activity and sport

This study applies an intervention based on autonomy support through dialogic learning to examine effects on motivation and the promotion of physical activity and sport involvement during schoolchildren’s leisure time. One hundred and two primary school students, aged 11–13 years, participated (M = 10.93, SD = 0.75). The sample was divided into two groups: an experimental group (49 students) and a control group (53 students). A quasi-experimental study was conducted in physical education classes over the course of 9 months. Assessments of autonomy support from teachers, family, and peers; basic psychological needs; self-determined motivation in physical education and during leisure time; planned behavior variables; physical activity intention; and estimated and actual physical exercise behavior time were included in the model. Following the intervention, the results revealed that greater autonomy support by the teacher, the family and peers, satisfaction of the basic psychological needs, self-determined motivation during physical education class and during free time, greater perceived control, favorable attitude and intention to engage in physical activity contributed to the explanation of student physical activity involvement. These results suggest that when students receive extensive social support from diverse social agents that essential precursors to physical activity are strengthened and contribute to increased motivation and actual physical activity involvement. Efforts to promote effective communications with students and other pedagogical efforts, such as providing dialogic learning opportunities, should be considered in order to strengthen physical activity motivation and involvement in students.     

Peculiar aspects of reading and writing performances in patients with olivopontocerebellar atrophy

Olivopontocerebellar atrophy (OPCA) is a still debated condition, of which motor disruption is the most common feature. A high incidence of associated mood disorders may exist, but there are few studies on concomitant cognitive impairment. Our aim was to assess whether there is reading and writing disruption in olivopontocerebellar atrophy (OPCA). 6 patients were administered different reading and writing tasks. Scores were then compared to those obtained by healthy volunteers. There was an evident impairment in reading and writing execution in our patients compared to those of the control group. On the contrary, no difference could be found in abstraction, problem-solving, and memory tasks. We discuss the results, debating the role of the cerebellum in the conscious process of cognition or in ocular movement control (necessary for reading and writing fluidity and effective execution) and in the dynamic activation of all the cerebral cortex mediated by the diffuse projection to the reticular system.     

Construing action abstractly and blurring social distinctions: implications for perceiving homogeneity among,but also empathizing with and helping,others

Most people's actions serve goals that, defined abstractly enough, are quite similar to one another. The authors thus proposed, and found, that construing action in abstract (vs. concrete) terms relates to perceiving greater similarity among persons both within and across different social groups (Studies 1-3). By fostering perspective taking, viewing action abstractly also related to empathizing with and expressing willingness to help nonstigmatized and stigmatized others (e.g., AIDS patients; Studies 3-5) and to donating money to help those in need (Study 6). These findings held when controlling for ideological, motivational, and broad personality variables. Abstract action construals, then, appear to blur social distinctions, fostering perspective taking and empathy on the one hand but also perceptions of group homogeneity on the other.     

Confirmatory factor analysis of parents' and teachers' ratings of DSM-IV symptoms of attention deficit hyperactivity disorder in a Spanish sample

Confirmatory factor analysis examined the factor structure of DSM IV Attention Deficit Hyperactivity Disorder symptoms and analyzed the differences in informants' ratings of ADHD symptoms by children's age and sex. A sample of 1,018 Spanish school children, 574 girls and 444 boys, ages 4 to 12 years, was rated by teachers and parents. Confirmatory factor analysis showed a similar fit for the three-factor model of Inattention, Hyperactivity, and Impulsivity (teachers: CFI = .976, RMR = .041, % of total variance = 83.2; parents: CFI = .969, RMR = .037, % of total variance = 82.7) and for the two-factor model of Inattention and Hyperactivity Impulsivity (teachers: CFI = .958, RMR = .044, % of total variance = 79.3; parents: CFI = .961, RMR = .038, % of total variance, 79.9). The two-factor model was selected as a parsi monious representation of the teachers' and parents' ratings of ADHD symptoms. Analyses of variance indicated significant differences in teachers' and parents' mean ratings across sex and school grades of children.     

Likelihood inference on the underlying structure of IRT models

The assumptions underlying item response theory (IRT) models may be expressed as a set of equality and inequality constraints on the parameters of a latent class model. It is well known that the same assumptions imply that the parameters of the manifest distribution have to satisfy a more complicated set of inequality constraints which, however, are necessary but not sufficient. In this paper, we describe how the theory for likelihood-based inference under equality and inequality constraints may be used to test the underlying assumptions of IRT models. It turns out that the analysis based directly on the latent structure is simpler and more flexible. In particular, we indicate how several interesting extensions of the Rasch model may be obtained by partial relaxation of the basic constraints. An application to a data set provided by Educational Testing Service is used to illustrate the approach.We thank Dr. Gorman and Dr. Rogers of the Educational Testing Service for providing the data analyzed in Section 4. We also thank three reviewers for comments and suggestions.This revised article was published online in August 2005 with the PDF paginated correctly.     

Metarepresentative functions in borderline personality disorder

Many authors consider that patients suffering from Borderline Personality Disorder (BPD) are hampered in their ability to metarepresent, which is the correct ascribing of states of mind to oneself and to others and the reflecting thereon. Although the ability to mentalize is generally described as being uniform, various authors pinpoint problems which appear to be of a diverse psychological nature. Some describe difficulties in identifying emotions or a shortfall in their regulation, others identify a lack of integration between representations of self and those of others, and yet others focus on the failure to distinguish between fantasy and reality. In the present research all sessions during the first year of therapy of four patients suffering from BPD were tape-recorded and transcribed, and then analyzed using the Metacognition Assessment Scale (MAS), which is designed for the evaluation of the ability to metarepresent in clinical reports. The results support the hypothesis that there is a metarepresentation impairment in BPD but that it is more selective than was thought until now. In particular, such patients maintain their ability to identify internal states, whereas they are impaired in the integration of representations of self and others and in the differentiation between fantasy and reality.     

Fitting Rasch model using appropriateness measure statistics

In this paper, the distributional properties and power rates of the Lz, Eci2z, and Eci4z statistics when they are used as item fit statistics were explored. The results were compared to t-transformation of Outfit and Infit mean square. Four sample sizes were selected: 100, 250, 500, and 1000 examinees. The abilities were uniform and normal with mean 0 and standard deviation 1, and uniform and normal with mean -1 and standard deviation 1. The pseudo-guessing parameter was fixed at .25. Two ranges of difficulty parameters were selected: +/- 1 logits and +/- 2 logits. Two test lengths were selected: 15 and 30 items. The results showed important differences between the T-infit, T-outfit, Lz, Eci2z, and Eci4z statistics. The T-oufit, T-infit, and Lz statistics showed poor standardization with estimated parameters because their distributional properties were not close to the expected values. However, the Eci2z and Eci4z statistics showed satisfactory standardization on all conditions. Further, the power rates of Eci2z and Eci4z were 5% to 10% higher than the power rates of Lz, T-outfit, and T-infit to detect items that do not fit Rasch model.