Multilevel Reliability Measures of Latent Scores Within an Item Response Theory Framework

Abstract

This paper evaluated multilevel reliability measures in two-level nested designs (e.g., students nested within teachers) within an item response theory framework. A simulation study was implemented to investigate the behavior of the multilevel reliability measures and the uncertainty associated with the measures in various multilevel designs regarding the number of clusters, cluster sizes, and intraclass correlations (ICCs), and in different test lengths, for two parameterizations of multilevel item response models with separate item discriminations or the same item discrimination over levels. Marginal maximum likelihood estimation (MMLE)-multiple imputation and Bayesian analysis were employed to evaluate the accuracy of the multilevel reliability measures and the empirical coverage rates of Monte Carlo (MC) confidence or credible intervals. Considering the accuracy of the multilevel reliability measures and the empirical coverage rate of the intervals, the results lead us to generally recommend MMLE-multiple imputation. In the model with separate item discriminations over levels, marginally acceptable accuracy of the multilevel reliability measures and empirical coverage rate of the MC confidence intervals were found in a limited condition, 200 clusters, 30 cluster size, .2 ICC, and 40 items, in MMLE-multiple imputation. In the model with the same item discrimination over levels, the accuracy of the multilevel reliability measures and the empirical coverage rate of the MC confidence intervals were acceptable in all multilevel designs we considered with 40 items under MMLE-multiple imputation. We discuss these findings and provide guidelines for reporting multilevel reliability measures.     

Development and Psychometric Evaluation of the Social Justice Scale (SJS)

The study describes the development of the Social Justice Scale (SJS). Practitioners, educators, students, and other members of the community differ on their attitudes and values regarding social justice. It is important to assess, not only individuals' attitudes and values around social values, but also other constructs that might be related to social justice behaviors. The implication of Ajzen in Organizational Behavior and Human Decision Processes 50:179-211, (1991) theory of planned behavior suggests that attitudes, perceived behavioral control, and social norms predict intentions, which then lead to behaviors. A scale was designed to measure social justice-related values, attitudes, perceived behavioral control, subjective norms, and intentions based on a four-factor conception of Ajzen's theory. Confirmatory factor analysis and analyses for reliability and validity were used to test the properties of the scale.     

Perceived Neighborhood Social Resources as Determinants of Prosocial Behavior in Early Adolescence

The present study aims to develop an integrative model that links neighborhood behavioral opportunities and social resources (neighborhood cohesion, neighborhood friendship and neighborhood attachment) to prosocial (sharing, helping, empathic) behavior in early adolescence, taking into account the potential mediating role of perceived support of friends. Path analysis was used to test the proposed theoretical model in a sample of 1,145 Italian early adolescents (6th through 8th graders). More perceived opportunities and social resources in the neighborhood are related to higher levels of adolescent prosocial behavior, and this relationship is partially mediated by perceived social support from friends. The results offer promising implications for future research and intervention programs that aim to modify social systems to improve child and adolescent social competencies.     

The multi-factor structure of the Brief Self-Control Scale: Discriminant validity of restraint and impulsivity

The Brief Self-Control Scale (BSCS; Tangney, Baumeister, & Boone, 2004) was developed to assess dispositional self-control as it is conceptualized by contemporary theoretical perspectives; however, concerns regarding its unidimensionality and validity remain. This article addresses these concerns using three samples to define, confirm and test a multi-factor version of the BSCS. Results of Study 1 (n = 909) identified two factors of the BSCS: restraint and impulsivity. Results of Study 2 (n = 364) confirmed that the 2-factor structure fit the data well and performed better than 1-factor structures. Finally, results from Study 3 (n = 175) demonstrated the utility of the multi-factor BSCS in predicting self-reported affective and behavioral outcomes. Implications for research and theoretical development are discussed.     

What Is and Is Not Ethnocentrism? A Conceptual Analysis and Political Implications

Conceptual analysis has not been systematically implemented in psychology, and many concepts have often been defined in different and contradictory ways. This article focuses on a conceptual clarification of ethnocentrism. It points out the conceptual confusion surrounding the term, reviews numerous definitions and operationalizations, and attempts to clarify it. Ethnocentrism is reconceptualized as a strong sense of ethnic group self‐centeredness, which involves intergroup expressions of ethnic group preference, superiority, purity, and exploitativeness, and intragroup expressions of ethnic group cohesion and devotion. It is conceptually and empirically distinguished from other concepts, such as outgroup negativity and mere ingroup positivity. The article presents a theoretical framework and related empirical analyses supporting the usefulness of reconceptualized ethnocentrism. It also details important and unique implications of reconceptualized ethnocentrism for political phenomena. It is expected that reliance on the clarified reconceptualization should enable researchers to systematically study ethnocentrism, its origins, and consequences.     

Neural activation underlying cognitive control in the context of neutral and affectively charged pictures in children

The neural correlates of cognitive control for typically developing 9-year-old children were examined using dense-array ERPs and estimates of cortical activation (LORETA) during a go/no-go task with two conditions: a neutral picture condition and an affectively charged picture condition. Activation was estimated for the entire cortex after which data were exported for four regions of interests (ROIs): ventrolateral prefrontal cortex (VLPFC), dorsal anterior cingulate cortex (dACC), dorsolateral prefrontal cortex (DLPFC), and orbitofrontal/ventromedial prefrontal cortex (OFC/VMPFC). Results revealed faster reaction times, greater N2 activation, and greater prefrontal activation for the affectively charged picture condition than the neutral picture condition. The findings are discussed in reference to the impact of affective stimuli on recruitment of specific brain regions involved in cognitive control.     

The challenge of prejudice: counsellors’ talk about challenging clients’ prejudices

This paper considers the implications for training and practice of counsellors’ responses to the notion of challenging clients’ prejudices. It explores tensions in counselling discourse between social responsibility, responsibility to the client and responsibility for one's self as counsellor. Three focus groups of counsellors were asked whether a counsellor should challenge clients’ prejudices. Responses were categorised as challenge, not-challenge or exit responses. Discursive themes identified in the responses are: managing congruence and being non-judgemental; self-care and self-respect; and social responsibility. Strategies for managing the discursive conflicts identified in responding to counsellor-identified client prejudices are summarised.     

Reducing the barriers to accessing psychological therapies for Bengali,Urdu, Tamil and Somali communities in the UK: some implications for training,policy and practice

The aim of this research was to investigate the feasibility of achieving Improving Access to Psychological Therapies (IAPT) for people from Black, Asian and Minority Ethnic (BAME) communities living in the UK, with specific reference to Bengali, Urdu, Tamil and Somali speaking communities. Focus groups were carried out with each of the communities to investigate how they conceptualise and experience ‘mental health issues’ and what they do when faced with what they regard as these issues. A thematic analysis of the data suggested that participants did not fully understand common conceptualisations about mental health issues, nor did they know how to seek mental health support. Implications of cultural barriers and recommendations for IAPT outcomes for the four communities are discussed.     

A rational analysis of the acquisition of multisensory representations

How do people learn multisensory, or amodal, representations, and what consequences do these representations have for perceptual performance? We address this question by performing a rational analysis of the problem of learning multisensory representations. This analysis makes use of a Bayesian nonparametric model that acquires latent multisensory features that optimally explain the unisensory features arising in individual sensory modalities. The model qualitatively accounts for several important aspects of multisensory perception: (a) it integrates information from multiple sensory sources in such a way that it leads to superior performances in, for example, categorization tasks; (b) its performances suggest that multisensory training leads to better learning than unisensory training, even when testing is conducted in unisensory conditions; (c) its multisensory representations are modality invariant; and (d) it predicts ‘‘missing” sensory representations in modalities when the input to those modalities is absent. Our rational analysis indicates that all of these aspects emerge as part of the optimal solution to the problem of learning to represent complex multisensory environments.