Considerations in the choice of interobserver reliability estimates

Two types of interobserver reliability values may be needed in treatment studies in which observers constitute the primary data-acquisition system: trial reliability and the reliability of the composite unit or score which is subsequently analyzed, e.g., daily or weekly session totals. Two approaches to determining interobserver reliability are described: percentage agreement and "correlational" measures of reliability. The interpretation of these estimates, factors affecting their magnitude, and the advantages and limitations of each approach are presented.     

Two simple classes of mastery scores based on the beta-binomial model

Two simple classes of mastery scores which are suitable for hand calculations are presented for beta-binomial test score distributions combined with linear and cubic referral success. The models provide a simple way to explore the consequences of selecting an arbitrary mastery score. Such assessment would be useful whenever the test user is not willing to posta priori a loss ratio, but wishes to look at the various consequences before aiming at a particular score.     

Fitting cross-classification table data to models when observations are subject to classification error

Individuals are classified in a cross-classification table where two behavioral observations on each individual determine the classification. The problem is to test certain structural models assumed to underlie the cross-classified observations. A minimum chi-square test procedure is proposed.     

Fitting and testing carroll's weighted unfolding model for preferences

A quadratic programming algorithm is presented for fitting Carroll's weighted unfolding model for preferences to known multidimensional scale values. The algorithm can be applied directly to pairwise preferences; it permits nonnegativity constraints on subject weights; and it provides a means of testing various preference model hypotheses. While basically metric, it can be combined with Kruskal's monotone regression to fit ordinal data. Monte Carlo results show that (a) adequacy of true preference recovery depends on the number of data points and the amount of error, and (b) the proportion of data variance accounted for by the model sometimes only approximately reflects true recovery.This study is based on a doctoral dissertation submitted to the University of Illinois at Urbana-Champaign. The author wishes to thank the members of his dissertation committee—Lawrence E. Jones, Chairman, Charles Lewis, Stephen Golding, Ledyard Tucker, and Nancy Wiggins—for their helpful comments.     

How a high working memory capacity can increase proactive interference

Previous findings suggested that a high working memory capacity (WMC) is potentially associated with a higher susceptibility to proactive interference (PI) if the latter is measured under high cognitive load. To explain such a finding, we propose to consider susceptibility to PI as a net effect of individual executive processes and the intrinsic potential for PI. With the latter, we refer to the amount of information that is activated at a given time and that has the potential to exert PI subsequently. In two studies deploying generalized linear mixed models, susceptibility to PI was modeled as the decline of performance over trials of a complex span task. The results revealed that a higher WMC was associated with a higher susceptibility to PI. Moreover, the number of stimuli recalled in one trial as a proxy variable for the intrinsic potential for PI negatively affected memory performance in the subsequent trial.     

Childhood Maltreatment,Emotional Response Inhibition,and Suicide in Psychiatric Inpatients

Childhood abuse and/or neglect adversely influences development of neurocognitive systems that regulate affect and behavior. Poor inhibitory control over emotional reactions is thus one potential pathway from maltreatment to suicide. Adult psychiatric inpatients completed the Childhood Trauma Questionnaire and an emotional stop-signal task indexing negative emotional action termination (NEAT): the ability to inhibit ongoing motor reactions to aversive stimuli triggered by negative affect. Clinical interviews assessed suicidal thoughts and behaviors during hospitalization (n = 131) and at follow-up assessments 6 months later (n = 87). Our primary aim was to examine whether maltreatment history and NEAT explain overlapping variance in suicidal behaviors (1) retrospectively and (2) 6 months following hospital discharge. Contrary to prediction, childhood maltreatment was unrelated to history of suicidal behaviors. However, NEAT was consistently associated with prior suicidal acts, even controlling for suicidal ideation and demographic covariates. NEAT similarly contributed to the prediction of post-discharge suicidal behaviors, whereas we found no effect of maltreatment history. The present study suggests that NEAT captures suicide risk independently of childhood maltreatment. Results implicated NEAT impairment specifically, rather than broader response inhibition deficits (e.g., to positive stimuli), in past and future suicidal behaviors. These findings provide preliminary support for NEAT as a behavioral vulnerability marker for suicide, with implications for understanding links between maltreatment history and suicidal acts.     

A note on computing Louis’ observed information matrix identity for IRT and cognitive diagnostic models

Using Louis’ formula, it is possible to obtain the observed information matrix and the corresponding large-sample standard error estimates after the expectation–maximization (EM) algorithm has converged. However, Louis’ formula is commonly de-emphasized due to its relatively complex integration representation, particularly when studying latent variable models. This paper provides a holistic overview that demonstrates how Louis’ formula can be applied efficiently to item response theory (IRT) models and other popular latent variable models, such as cognitive diagnostic models (CDMs). After presenting the algebraic components required for Louis’ formula, two real data analyses, with accompanying numerical illustrations, are presented. Next, a Monte Carlo simulation is presented to compare the computational efficiency of Louis’ formula with previously existing methods. Results from these presentations suggest that Louis’ formula should be adopted as a standard method when computing the observed information matrix for IRT models and CDMs fitted with the EM algorithm due to its computational efficiency and flexibility.     

I can see myself helping: The effect of self-awareness on prosocial behaviour

Many studies indicate that increasing self-awareness leads to individuals reflecting on their values and ideals (Silvia & Duval, 2001). This self-reflection appears to increase prosocial behaviour (Berkowitz, 1987). However, previously studies typically manipulated self-awareness in situations in which the individual may have felt pressure from the researcher to help. Thus, experimenter pressure to behave prosocially confounds the self-awareness explanation provided in past research. We used a novel experimental paradigm to manipulate self-awareness and remove the researcher's presence to decrease the likelihood that the participant would conform to experimenter demand. Participants were 36 college students (M_age = 19.52; 25 women). The results indicated a strong probability that the experimental condition participants were more prosocial than control condition participants. These findings provide additional support for the hypothesis that self-reflection increases prosocial behaviour, even without experimenter demands. These findings and the importance of studying objective self-awareness in light of the coronavirus are discussed.     

Using a Fork as a Hairbrush: Investigating Dual Routes to Release from Functional Fixedness

Functional fixedness involves difficulty with conceptualizing creative object uses. When it obstructs problem‐solving, individuals must reframe their approach. We examined how different training techniques—chunk decomposition (i.e., considering an object’s basic parts and physical properties) and constraint relaxation (i.e., considering an object’s different functions)—might rely upon different routes to creative reframing. Additionally, we investigated how different forms of cognitive load interact with these dual routes. Participants learned one of three techniques. Chunk decomposition participants created object breakdown diagrams; constraint relaxation participants created object functions lists; and free association (control) participants wrote a word that they associated with each of several concrete nouns. After training, participants attempted to solve five functional fixedness problems. E1 investigated how increasing germane cognitive load via either direct or indirect prompting affected training transfer. Experiment 2 investigated how reducing extraneous cognitive load by providing no transfer instructions and using an eye‐closure strategy. Across both experiments, results supported differences in accuracy and response latency by training. However, chunk decomposition and constraint relaxation did not follow the same pattern, suggesting different mechanisms of the effect. We discuss possible applications to increase innovation in real‐world domains such as education, business, and engineering.     

The role of empathy and social anxiety in Latinx adolescents' indirect peer aggression during the transition to high school

The primary purpose of this study was to evaluate the relationship between decreased empathy (i.e., cognitive and affective) and indirect and cyber peer aggression among Latinx adolescents during their transition to high school. Further, we examined the degree to which social anxiety moderated this relationship. Participants were 469 Latinx ninth graders, ages 13–17 years (M = 14.52, SD = 0.58; 58% girls). Adolescents completed the Revised Peer Experiences Questionnaire, Cyber Peer Experiences Questionnaire, Basic Empathy Scale, and Social Anxiety Scale for Adolescents at two different time points, 3 months apart. Hierarchical linear regression analyses revealed concurrent and prospective relationships between lower cognitive empathy and the perpetration of both indirect and cyber aggression. In addition, social anxiety moderated the concurrent associations between both types of empathy and both types of aggression perpetration. Results suggest that interventions that facilitate cognitive empathy and decrease social anxiety may help to reduce adolescents' indirect and cyber aggression toward peers throughout the high school transition.