Considerations in the choice of interobserver reliability estimates

Two types of interobserver reliability values may be needed in treatment studies in which observers constitute the primary data-acquisition system: trial reliability and the reliability of the composite unit or score which is subsequently analyzed, e.g., daily or weekly session totals. Two approaches to determining interobserver reliability are described: percentage agreement and "correlational" measures of reliability. The interpretation of these estimates, factors affecting their magnitude, and the advantages and limitations of each approach are presented.     

Two simple classes of mastery scores based on the beta-binomial model

Two simple classes of mastery scores which are suitable for hand calculations are presented for beta-binomial test score distributions combined with linear and cubic referral success. The models provide a simple way to explore the consequences of selecting an arbitrary mastery score. Such assessment would be useful whenever the test user is not willing to posta priori a loss ratio, but wishes to look at the various consequences before aiming at a particular score.     

Fitting and testing carroll's weighted unfolding model for preferences

A quadratic programming algorithm is presented for fitting Carroll's weighted unfolding model for preferences to known multidimensional scale values. The algorithm can be applied directly to pairwise preferences; it permits nonnegativity constraints on subject weights; and it provides a means of testing various preference model hypotheses. While basically metric, it can be combined with Kruskal's monotone regression to fit ordinal data. Monte Carlo results show that (a) adequacy of true preference recovery depends on the number of data points and the amount of error, and (b) the proportion of data variance accounted for by the model sometimes only approximately reflects true recovery.This study is based on a doctoral dissertation submitted to the University of Illinois at Urbana-Champaign. The author wishes to thank the members of his dissertation committee—Lawrence E. Jones, Chairman, Charles Lewis, Stephen Golding, Ledyard Tucker, and Nancy Wiggins—for their helpful comments.     

A note on computing Louis’ observed information matrix identity for IRT and cognitive diagnostic models

Using Louis’ formula, it is possible to obtain the observed information matrix and the corresponding large-sample standard error estimates after the expectation–maximization (EM) algorithm has converged. However, Louis’ formula is commonly de-emphasized due to its relatively complex integration representation, particularly when studying latent variable models. This paper provides a holistic overview that demonstrates how Louis’ formula can be applied efficiently to item response theory (IRT) models and other popular latent variable models, such as cognitive diagnostic models (CDMs). After presenting the algebraic components required for Louis’ formula, two real data analyses, with accompanying numerical illustrations, are presented. Next, a Monte Carlo simulation is presented to compare the computational efficiency of Louis’ formula with previously existing methods. Results from these presentations suggest that Louis’ formula should be adopted as a standard method when computing the observed information matrix for IRT models and CDMs fitted with the EM algorithm due to its computational efficiency and flexibility.     

I can see myself helping: The effect of self-awareness on prosocial behaviour

Many studies indicate that increasing self-awareness leads to individuals reflecting on their values and ideals (Silvia & Duval, 2001). This self-reflection appears to increase prosocial behaviour (Berkowitz, 1987). However, previously studies typically manipulated self-awareness in situations in which the individual may have felt pressure from the researcher to help. Thus, experimenter pressure to behave prosocially confounds the self-awareness explanation provided in past research. We used a novel experimental paradigm to manipulate self-awareness and remove the researcher's presence to decrease the likelihood that the participant would conform to experimenter demand. Participants were 36 college students (M_age = 19.52; 25 women). The results indicated a strong probability that the experimental condition participants were more prosocial than control condition participants. These findings provide additional support for the hypothesis that self-reflection increases prosocial behaviour, even without experimenter demands. These findings and the importance of studying objective self-awareness in light of the coronavirus are discussed.     

From Implicit Theories to Creative Achievements: The Mediating Role of Creativity Motivation in the Relationship between Stereotypes,Growth Mindset,and Creative Achievement

Research has demonstrated that implicit theories of creativity are crucial in shaping an individual’s behavior and real‐life decisions toward being creative. The present study proposed and examined the underlying mechanisms of how two kinds of implicit theories—the growth mindset of the creative self and the stereotype of creative others—are associated with creative achievements through the mediating role of creativity motivation. Participants were 606 undergraduate students who were enrolled in an education major in two universities in China. Overall, the study found that Chinese students held a positive image toward a creative student, regarding him or her as highly competent, warm, and popular. Student perceptions of a creative other were positively related to their growth mindset of creativity. Moreover, results verified both the mediating role of creativity motivation on growth mindset, as well as the effect of positive stereotyping of the creative other on students’ creative achievement. These findings point to promising creativity motivation strategies including the cultivation of a malleable view of creativity and of creative role models, that may, in turn, promote creative achievement by encouraging students to do, learn, and accomplish new things.     

Modeling Asymmetry in the Time–Distance Relation of Ordinal Personality Items

In analyzing responses and response times to personality questionnaire items, models have been proposed which include the so-called “inverted-U effect.” These models predict that response times to personality test items decrease as the latent trait value of a given person gets closer to the attractiveness of an item. Initial studies into these models have focused on dichotomous personality items, and more recently, models for Likert-type scale items have been proposed. In all these models, it is assumed that the inverted-U effect is symmetrical around 0, while, as will be explained in this article, there are substantive and statistical reasons to study this assumption. Therefore, in this article, a general inverted-U model is proposed which accommodates two sources of asymmetry between the response times and the attractiveness of the items. The viability of this model is demonstrated in a simulation study, and the model is applied to the responses and response times of the Temperament and Character Inventory–Revised, covering a broad range of personality dimensions.     

Personal Contact with Refugees is Key to Welcoming Them: An Analysis of Politicians' and Citizens' Attitudes Towards Refugee Integration

Politicians are influential both in directing policies about refugees and in framing public discourse about them. However, unlike other host country residents, politicians' attitudes towards refugees and integration are remarkably understudied. We therefore examine similarities and differences between politicians' attitudes towards refugee integration and those held by citizens. Based on the stereotype content model, we expect that political ideology informs stereotypes about refugees, which subsequently shape attitudes towards refugee integration. Based on the Contact Hypothesis, we further argue that personal contact with refugees reduces negative stereotypes about them—in particular for those endorsing a right-wing ideology. We draw on data collected via two surveys with 905 politicians and 8013 citizens in the Netherlands to show that (1) unlike those with a left-wing orientation, residents (i.e., both politicians and citizens) with a right-wing orientation hold more negative stereotypes about refugees, which in turn relate to more negative attitudes towards refugee integration; (2) personal contact with refugees is associated with less negative stereotypes among residents; and (3) politicians, compared to citizens, report less negative stereotypes and more positive attitudes towards refugee integration. The practical implication of fostering residents' contact with refugees as well as the implications for future research are discussed.