Multilevel Reliability Measures of Latent Scores Within an Item Response Theory Framework

Abstract

This paper evaluated multilevel reliability measures in two-level nested designs (e.g., students nested within teachers) within an item response theory framework. A simulation study was implemented to investigate the behavior of the multilevel reliability measures and the uncertainty associated with the measures in various multilevel designs regarding the number of clusters, cluster sizes, and intraclass correlations (ICCs), and in different test lengths, for two parameterizations of multilevel item response models with separate item discriminations or the same item discrimination over levels. Marginal maximum likelihood estimation (MMLE)-multiple imputation and Bayesian analysis were employed to evaluate the accuracy of the multilevel reliability measures and the empirical coverage rates of Monte Carlo (MC) confidence or credible intervals. Considering the accuracy of the multilevel reliability measures and the empirical coverage rate of the intervals, the results lead us to generally recommend MMLE-multiple imputation. In the model with separate item discriminations over levels, marginally acceptable accuracy of the multilevel reliability measures and empirical coverage rate of the MC confidence intervals were found in a limited condition, 200 clusters, 30 cluster size, .2 ICC, and 40 items, in MMLE-multiple imputation. In the model with the same item discrimination over levels, the accuracy of the multilevel reliability measures and the empirical coverage rate of the MC confidence intervals were acceptable in all multilevel designs we considered with 40 items under MMLE-multiple imputation. We discuss these findings and provide guidelines for reporting multilevel reliability measures.     

Child-oriented family therapy in China: A cross-cultural application of integrative family therapy targeting children aged 4–10

This article describes child-oriented family therapy (COF), a family therapy approach to early psychological and behavioral problems that is widely applied in northern Europe and has been adopted by countries with different cultures, such as Germany and China. This article explains the theoretical background, setting, characteristics, development and effective factors of this method and explores relevant research. In addition, the application of this method in China and reflections on its applicability to families in different cultures are presented. A clinical case is provided to illustrate the core therapeutic principles of COF. Since the application of COF interventions to families with children in Asian cultures remains understudied, the widespread availability of COF and adaptation to local conditions could facilitate training and research achievements in this field.     

Editorial: Harmful or helpful to learning? The impact of seductive details on learning and instruction

Most previous research found negative effects on learning outcomes when interesting but irrelevant information (i.e., seductive details) is added to an instruction. To what degree such effects are bound to specific conditions is in the focus of this special issue. Specifically, 11 empirical studies are reported within this special issue. They all address the topic of seductive details in learning and instruction by focusing either on cognitive moderators (e.g., working memory capacity and current beliefs) or on noncognitive moderators (e.g., arousal and affect) of the seductive details effect. Taken together, results from the empirical studies hint towards new moderators and suggest that the negative effects of seductive details on learning outcomes may be smaller than expected based on previous research.