Multilevel Reliability Measures of Latent Scores Within an Item Response Theory Framework

Abstract

This paper evaluated multilevel reliability measures in two-level nested designs (e.g., students nested within teachers) within an item response theory framework. A simulation study was implemented to investigate the behavior of the multilevel reliability measures and the uncertainty associated with the measures in various multilevel designs regarding the number of clusters, cluster sizes, and intraclass correlations (ICCs), and in different test lengths, for two parameterizations of multilevel item response models with separate item discriminations or the same item discrimination over levels. Marginal maximum likelihood estimation (MMLE)-multiple imputation and Bayesian analysis were employed to evaluate the accuracy of the multilevel reliability measures and the empirical coverage rates of Monte Carlo (MC) confidence or credible intervals. Considering the accuracy of the multilevel reliability measures and the empirical coverage rate of the intervals, the results lead us to generally recommend MMLE-multiple imputation. In the model with separate item discriminations over levels, marginally acceptable accuracy of the multilevel reliability measures and empirical coverage rate of the MC confidence intervals were found in a limited condition, 200 clusters, 30 cluster size, .2 ICC, and 40 items, in MMLE-multiple imputation. In the model with the same item discrimination over levels, the accuracy of the multilevel reliability measures and the empirical coverage rate of the MC confidence intervals were acceptable in all multilevel designs we considered with 40 items under MMLE-multiple imputation. We discuss these findings and provide guidelines for reporting multilevel reliability measures.     

Facilitating and inhibiting effects of priming and selection criteria in a sequence of dichotic listening trials

Competing models of attention make different predictions of how priming from recent stimulus processing could interact with intended selection. The present experiment examined the interaction between exogenous attention and endogenous priming across trial sequences. A sound cue directed attention to left, right or both sides before a dichotic syllable pair was presented. Participants were asked to report one syllable from each trial. Results showed that responses were slower on trials where one of the presented syllables had also been presented on the previous trial. Within these trials, the repeated syllable was selected less frequently, and the responses doing so were slower. Examined according to response choice on the preceding trial, syllables that had been ignored on the preceding trial tended to be ignored on the current trial (negative priming), while syllables that had been selected on the preceding trial tended to be selected on the current trial (positive priming). Responses that followed these selection biases were faster than responses that did not. Response selection was also influenced by the attention direction cue for the current trial, but not by the cue presented on the preceding trial. The results support an attentional model where traces from the preceding processing are retained, and current selection is biased to minimize cognitive conflict between recent and current processing. Negative priming appears to be due to after-effects of preceding processing, independently of the intentions behind that processing. The study accounts for positive and negative priming of dichotic listening sequences within an established, computationally viable biased competition framework.     

Personality trait inferences of Turkish immigrant and neutral targets: An experimental study

Sandal, G. M. Bye, H. H. & Pallesen, S. (2012). Personality trait inferences of Turkish immigrant and neutral targets: An experimental study. Scandinavian Journal of Psychology 53, 528–533. The study investigated whether personality traits attributed to immigrant targets differ from personality inferences made for a neutral target, and whether trait attributions differ for assimilated and integrated immigrant targets. Participants (n = 340) were randomized to one of three conditions in which they read the same story about a person, but where the person was described as either: (a) an assimilated Turkish immigrant; (b) an integrated Turkish immigrant; or (c) neutral (no nationality or religious practice indicated). Subsequently, they rated the personality of the described person on the NEO‐Five Factor Inventory (observer rating version) and completed the Balanced Inventory of Desirable Responding (Impression Management scale) with reference to themselves. Both immigrant targets were rated as significantly higher on extraversion and lower on neuroticism than the neutral target. The integrated target was rated as more open than the neutral target, and as higher than the assimilated target on neuroticism when controlling for impression management.     

A Different View of Anger: The Cognitive‐Neoassociation Conception of the Relation of Anger to Aggression

The common, everyday understanding of anger is problematic in a number of respects—in its inattention to the prototypic nature of this emotional state; in its failure to recognize the important role often played by the critical event's aversiveness; and in its neglect of the frequently close connection between anger arousal and aggression‐related motor impulses. This article discusses all of these matters from the point of view of my cognitive‐neoassociation perspective [Berkowitz, 1990, 1993, 2010; Berkowitz and Harmon‐Jones, 2004]. The role of automatic, nonconscious reactions is considered, and it is also emphasized that angry feelings are linked to approach motivation—movement toward the perceived source of the anger. The article also briefly summarizes relevant research dealing with the self‐regulation of anger reactions. This broad review hopefully will prompt further inquiries into the arousal, nature, and operation of anger. Aggr. Behav. 38:322‐333, 2012. © 2012 Wiley Periodicals, Inc.     

The cortical organization of lexical knowledge: a dual lexicon model of spoken language processing

Current accounts of spoken language assume the existence of a lexicon where wordforms are stored and interact during spoken language perception, understanding and production. Despite the theoretical importance of the wordform lexicon, the exact localization and function of the lexicon in the broader context of language use is not well understood. This review draws on evidence from aphasia, functional imaging, neuroanatomy, laboratory phonology and behavioral results to argue for the existence of parallel lexica that facilitate different processes in the dorsal and ventral speech pathways. The dorsal lexicon, localized in the inferior parietal region including the supramarginal gyrus, serves as an interface between phonetic and articulatory representations. The ventral lexicon, localized in the posterior superior temporal sulcus and middle temporal gyrus, serves as an interface between phonetic and semantic representations. In addition to their interface roles, the two lexica contribute to the robustness of speech processing.     

Feeling and Thinking of Others: Affective and Cognitive Empathy and Emotion Comprehension in Prosocial/Hostile Preschoolers

This study aims at investigating the affective and cognitive components of empathy in relation to both emotion comprehension and prosocial/hostile behaviors in preschoolers. A total of 219 children (54% boys; aged between 3 and 6: mean age 4.10) and 20 teachers (two for each class: group A and group B) took part in this research. Pupils’ empathy and hostile/prosocial roles were assessed by teacher reports [Belacchi and Farina, 2010] and children's emotion comprehension by a nonverbal test [Test of Emotion Comprehension: Pons and Harris, 2000; adapted by Albanese and Molina; 2008]. As expected, the results showed a significant influence of gender, with girls being more empathic than boys, according to all of the teachers’ perception. Contrary to our expectations, no systematic age influence emerged. Regarding the relations of children's emotion comprehension with both empathy measures and their prosocial/hostile attitudes, we have found: (1) a low significant relation with the total empathy measure, according to all the teachers, but with the cognitive empathy only according to teachers B; (2) a robust negative relationship of both affective and cognitive empathy with Hostile roles and with Outsider role, contrary to a positive correlation of only affective empathy with Prosocial roles. No relationships emerged between empathy measures and Victim role.     

Mood-congruent thoughts and personality disorder pathology

The primary aim of this research was to investigate associations that depression severity and trait anxiety have with reactions to specific, identifiable thoughts experienced by persons with varying levels of personality disorder (PD) pathology as they went about their day-to-day lives. Ninety-eight psychotropic medication-free persons participated in an experience sampling assessment procedure over four consecutive days, during which participants recorded specific thoughts experienced moments before a page signal was received and corresponding ratings of thought discomfort. Thought discomfort, regarded as an emotional reaction to thoughts or their evaluation, was moderately associated with several forms of PD pathology, particularly Cluster C pathology. Once depression severity and trait anxiety were controlled, however, associations between PD pathology and thought discomfort were eliminated. Findings from this research generally support the mood-congruence of negatively valenced thoughts in relation to PD pathology.     

Evaluation of a Combined Cognitive Behavioural Therapy and Interpersonal Process Group in the Psychotherapy Training of Clinical Psychologists

It is now widely acknowledged that both content and process elements of psychotherapy play a part in client treatment outcomes. Despite this, there are pressures on Australian clinical psychology training programs to teach evidence‐based approaches in a relatively short time frame. Producing clinical psychology graduates who have an adequate level of competence in evidence‐based practice and meeting the demands of professional accreditation requirements can mean that less time is available to teach the process elements of psychotherapy. The aim of this study was to conduct a preliminary evaluation of a clinical psychology psychotherapy training program that combines an interpersonal process group with a cognitive behavioural therapy training model that incorporates self‐reflection and self‐practice. Eleven participants who participated in the training in 2008 completed the Counseling Self‐Estimate Inventory at pre‐ and post‐training. Significant improvements on the majority of the subscales of this inventory were found. A separate sample of nine trainees and clinical psychology registrars who also previously completed the program attended individual interviews in 2010 aimed at gaining their perspective regarding various aspects of the program. Self‐practice of cognitive behavioural therapy techniques was found to be important in the identification and management of trainees’ own core beliefs, and to their appreciation of how challenging this process may be for clients. The interpersonal process group was described by participants as enhancing their competency as psychotherapists. Common themes included the experience of anxiety and a high level of emotion, and understanding how this experience might be similar for clients; increased self‐awareness; and increased competence in process issues. Many participants believed the process and content components of training were equally important to their development as psychotherapists.     

Cognitive Processing Therapy Versus Supportive Counseling for Acute Stress Disorder Following Assault: A Randomized Pilot Trial

The study tested the efficacy and tolerability of cognitive processing therapy (CPT) for survivors of assault with acute stress disorder. Participants (N = 30) were randomly allocated to CPT or supportive counseling. Therapy comprised six individual weekly sessions of 90-min duration. Independent diagnostic assessment for PTSD was conducted at posttreatment. Participants completed self-report measures of posttraumatic stress, depression, and negative trauma-related beliefs at pre-, posttreatment, and 6-month follow-up. Results indicated that both interventions were successful in reducing symptoms at posttreatment with no statistical difference between the two; within and between-group effect sizes and the proportion of participants not meeting PTSD criteria was greater in CPT. Treatment gains were maintained for both groups at 6-month follow-up.