Developing new online calibration methods for multidimensional computerized adaptive testing

Multidimensional computerized adaptive testing (MCAT) has received increasing attention over the past few years in educational measurement. Like all other formats of CAT, item replenishment is an essential part of MCAT for its item bank maintenance and management, which governs retiring overexposed or obsolete items over time and replacing them with new ones. Moreover, calibration precision of the new items will directly affect the estimation accuracy of examinees’ ability vectors. In unidimensional CAT (UCAT) and cognitive diagnostic CAT, online calibration techniques have been developed to effectively calibrate new items. However, there has been very little discussion of online calibration in MCAT in the literature. Thus, this paper proposes new online calibration methods for MCAT based upon some popular methods used in UCAT. Three representative methods, Method A, the ‘one EM cycle’ method and the ‘multiple EM cycles’ method, are generalized to MCAT. Three simulation studies were conducted to compare the three new methods by manipulating three factors (test length, item bank design, and level of correlation between coordinate dimensions). The results showed that all the new methods were able to recover the item parameters accurately, and the adaptive online calibration designs showed some improvements compared to the random design under most conditions.     

Analysis of categorical moderators in mixed‐effects meta‐analysis: Consequences of using pooled versus separate estimates of the residual between‐studies variances

Subgroup analyses allow us to examine the influence of a categorical moderator on the effect size in meta‐analysis. We conducted a simulation study using a dichotomous moderator, and compared the impact of pooled versus separate estimates of the residual between‐studies variance on the statistical performance of the Q _{B (P)} and Q _{B (S)} tests for subgroup analyses assuming a mixed‐effects model. Our results suggested that similar performance can be expected as long as there are at least 20 studies and these are approximately balanced across categories. Conversely, when subgroups were unbalanced, the practical consequences of having heterogeneous residual between‐studies variances were more evident, with both tests leading to the wrong statistical conclusion more often than in the conditions with balanced subgroups. A pooled estimate should be preferred for most scenarios, unless the residual between‐studies variances are clearly different and there are enough studies in each category to obtain precise separate estimates.     

Non‐ignorable missingness item response theory models for choice effects in examinee‐selected items

Examinee‐selected item (ESI) design, in which examinees are required to respond to a fixed number of items in a given set, always yields incomplete data (i.e., when only the selected items are answered, data are missing for the others) that are likely non‐ignorable in likelihood inference. Standard item response theory (IRT) models become infeasible when ESI data are missing not at random (MNAR). To solve this problem, the authors propose a two‐dimensional IRT model that posits one unidimensional IRT model for observed data and another for nominal selection patterns. The two latent variables are assumed to follow a bivariate normal distribution. In this study, the mirt freeware package was adopted to estimate parameters. The authors conduct an experiment to demonstrate that ESI data are often non‐ignorable and to determine how to apply the new model to the data collected. Two follow‐up simulation studies are conducted to assess the parameter recovery of the new model and the consequences for parameter estimation of ignoring MNAR data. The results of the two simulation studies indicate good parameter recovery of the new model and poor parameter recovery when non‐ignorable missing data were mistakenly treated as ignorable.     

Ritual and Recovery: Traditions in Disaster Ritualizing

The aim of this article is partly to analyze and discuss the ritual traditions in the Norwegian context, called disaster services, which consists in ritualizing as a response to accidents and disasters. Furthermore, we find it relevant to understand these traditions in relation to two aspects of recovery: personal and social recovery. From a practical theological perspective, the new traditions are interesting for the understanding of how the churches work in situations where people have stressful experiences, and for developing an understanding of contemporary religion.     

Reformation Unfinished: Economy,Inclusivity, Authority

In 2017, churches around the world are organizing different activities to commemorate the 500th anniversary of Martin Luther's 95 Theses. The Reformation was a momentous event in the church and the history of Europe. This article examines three important legacies of the Reformation to look ahead to the future: the church and economic life; the priesthood of all believers; and the authority of the Bible. In many ways, the issues that Luther has raised – such as authority, church structure, priesthood and ministry, biblical interpretation, and the church's relation to economics and social issues – remain to this day and demand the church's critical attention.     

The Historic Peace Churches and the Reformations

This contribution considers the broad historical and theological category of Reformation and Reformations in relation to the Historic Peace Churches before turning to a more detailed consideration of recent and contemporary meaning of Reformation(s) in selected settings and needs: Mennonites in Taiwan; Friends in East Africa, especially Tanzania; and the Church of the Brethren in Nigeria. Reformation insights of the 16th, 17th, and early 18th centuries continue to inform, inspire, and sustain Mennonite, Quaker, and Brethren communities in contexts quite different from those in which our communities arose and from one another.     

Paternal Caregivers’ Parenting Practices and Psychological Functioning among African American Youth Living in Urban Public Housing

Structural factors associated with public housing contribute to living environments that expose families to adverse life events that may in turn directly impact parenting and youth outcomes. However, despite the growth in research on fathers, research on families in public housing has practically excluded fathers and the role fathers play in the well‐being of their adolescents. Using a sample of 660 African American adolescents recruited from public housing, we examined the relationship between paternal caregivers’ (i.e., fathers’ and father figures’) parenting practices and adolescents’ depressive symptoms, attitudes toward deviance, and self‐efficacy. Using a latent profile analysis (LPA), we confirmed a four‐class model of paternal parenting practices ranging from high to low levels of monitoring and encouragement. Results from a one‐way ANOVA indicated that paternal caregivers with high (compared to moderate) levels of encouragement and monitoring were associated with youth who reported less depressive symptoms, higher levels of self‐efficacy, and less favorable attitudes toward deviance. Discriminant analysis results indicated that approximately half of the sample were correctly classified into two paternal caregiver classes. The findings provide evidence that some of these caregivers engage in parenting practices that support youths’ psychological functioning. More research is needed to determine what accounts for the variability in levels of paternal encouragement and supervision, including environmental influences, particularly for paternal caregivers exhibiting moderate‐to‐low levels of paternal encouragement and monitoring.     

Child Characteristics,Parent Education and Depressive Symptoms,and Marital Conflict Predicting Trajectories of Parenting Behavior from Childhood Through Early Adolescence in Taiwan

The study examined how child and parent characteristics, and contextual sources of stress, such as marital conflict predict initial status and trajectories of parent involvement, support, and harsh control, over a 4‐year period in families in Taiwan (n = 4,754). Based on Belsky's (1984) ecological model of parenting, three domains predicting parenting were tested, child characteristics (age cohort and gender), father and mother characteristics (education and depressive symptoms), and contextual sources of stress (marital conflict). The study followed two cohorts of children; the younger cohort was followed from first to fourth grade and the older cohort from fourth to seventh grade. Initially, fourth graders reported more parental involvement, support, and harsh control than first graders. However, involvement, support, and harsh control decreased across the 4 years for the older cohort as they transitioned to early adolescence. In the first year, girls reported more parental involvement and support and less harsh control than boys. Across the 4 years, involvement and support increased, and harsh control decreased for boys; whereas involvement stayed the same, support slightly decreased, and harsh control slightly increased for girls. Children whose parents were more educated reported more parent involvement, support, and harsh control in the first year. Children whose fathers were chronically depressed and whose parents were experiencing marital conflict reported decreasing parent involvement and support over the years.     

Adapting the Unique Minds Program: Exploring the Feasibility of a Multiple Family Intervention for Children with Learning Disabilities in the Context of Spain

The Unique Minds Program (Stern, Unique Minds Program, 1999) addresses the socio‐emotional needs of children with learning disabilities (LD) and their families. Children and their parents work together in a multiple family group to learn more about LD and themselves as people with the capacity to solve problems in a collaborative way, including problems in family school relationships. This article reports the cultural adaptation of the program for use in Spain and findings from a feasibility study involving three multiple family groups and a total of 15 children and 15 mothers, using a pre‐post design. This Spanish adaptation of the program is called “Mentes Únicas”. Standardized outcome measures indicated an overall statistically significant decrease in children's self‐rated maladjustment and relationship difficulties by the end of the program. Improvements were endorsed by most mothers, although they were not always recognized by the children's teachers. The program had a high level of acceptability: Mothers and children felt safe, understood, and helped throughout the sessions. The efficacy of the adapted intervention for the context of Spain remains to be tested in a more rigorous study.