General mixture item response models with different item response structures: Exposition with an application to Likert scales

This article proposes a general mixture item response theory (IRT) framework that allows for classes of persons to differ with respect to the type of processes underlying the item responses. Through the use of mixture models, nonnested IRT models with different structures can be estimated for different classes, and class membership can be estimated for each person in the sample. If researchers are able to provide competing measurement models, this mixture IRT framework may help them deal with some violations of measurement invariance. To illustrate this approach, we consider a two-class mixture model, where a person’s responses to Likert-scale items containing a neutral middle category are either modeled using a generalized partial credit model, or through an IRTree model. In the first model, the middle category (“neither agree nor disagree”) is taken to be qualitatively similar to the other categories, and is taken to provide information about the person’s endorsement. In the second model, the middle category is taken to be qualitatively different and to reflect a nonresponse choice, which is modeled using an additional latent variable that captures a person’s willingness to respond. The mixture model is studied using simulation studies and is applied to an empirical example.     

Children's Attitudes towards Peers with Disabilities: Associations with Personal and Parental Factors

The purpose of this study was to investigate the following: (i) associations among children's prior contact with people with disabilities and the three dimensions of children's attitudes towards people with disabilities: children's understanding of and their feelings about people with disabilities and their behavioural intentions to make inclusion decisions; (ii) the relation between children's behavioural intentions to make inclusion decisions and the demands of activity contexts and the types of disabilities; and (iii) the association between parents' attitudes and children's attitudes. Participants included 94 typically developing four‐ and five‐year‐old preschoolers. Children's understanding of disabilities and their prior contact with people with disabilities were found to be positively related to their feelings about people with disabilities; children's understanding of disabilities was a significant moderator of the relation between their behavioural intentions and activity contexts or types of disabilities. The hypothesized association between parents' attitudes and children's attitudes was not significant. Preschoolers may benefit from having more regular contact with people with disabilities to develop positive feelings towards their peers with disabilities, which is also related to their understanding of disabilities. Children's behavioural intentions to make inclusion decisions need to be understood in relation to their understanding of disabilities, the demand of activity contexts, and types of disabilities. Copyright © 2013 John Wiley & Sons, Ltd.     

A Cross-Classified CFA-MTMM Model for Structurally Different and Nonindependent Interchangeable Methods

Multirater (multimethod, multisource) studies are increasingly applied in psychology. Eid and colleagues (2008) proposed a multilevel confirmatory factor model for multitrait-multimethod (MTMM) data combining structurally different and multiple independent interchangeable methods (raters). In many studies, however, different interchangeable raters (e.g., peers, subordinates) are asked to rate different targets (students, supervisors), leading to violations of the independence assumption and to cross-classified data structures. In the present work, we extend the ML-CFA-MTMM model by Eid and colleagues (2008) to cross-classified multirater designs. The new C4 model (Cross-Classified CTC[M-1] Combination of Methods) accounts for nonindependent interchangeable raters and enables researchers to explicitly model the interaction between targets and raters as a latent variable. Using a real data application, it is shown how credibility intervals of model parameters and different variance components can be obtained using Bayesian estimation techniques.     

Applying Evidence-Centered Design for the Development of Game-Based Assessments in Physics Playground

Game-based assessment (GBA) is a specific use of educational games that employs game activities to elicit evidence for educationally valuable skills and knowledge. While this approach can provide individualized and diagnostic information about students, the design and development of assessment mechanics for a GBA is a nontrivial task. In this article, we describe the 10-step procedure that the design team of Physics Playground (formerly known as Newton's Playground) has established by adapting evidence-centered design to address unique challenges of GBA. The scaling method used for Physics Playground was Bayesian networks; thus this article describes specific actions taken for the iterative process of constructing and revising Bayesian networks in the context of the game Physics Playground.     

A generalized item response tree model for psychological assessments

A new item response theory (IRT) model with a tree structure has been introduced for modeling item response processes with a tree structure. In this paper, we present a generalized item response tree model with a flexible parametric form, dimensionality, and choice of covariates. The utilities of the model are demonstrated with two applications in psychological assessments for investigating Likert scale item responses and for modeling omitted item responses. The proposed model is estimated with the freely available R package flirt (Jeon et al., 2014b).     

Mothers' and Fathers' Parenting Quality and Toddlers' Interactive Behaviours in Dyadic and Triadic Family Contexts

Based on a family systems perspective, this research examined the role of parental gender and family play context in parent–toddler interactions and how behaviours of family members influence each other. Sixty‐seven mostly White, middle‐class families consisting of a mother, father and toddler were videotaped in three separate sessions: mother–child, father–child and both parents–child at a university laboratory setting. The results indicated that there were significant main effects of both parent gender (mother versus father) and context (dyadic versus triadic) on parents' positive and negative parenting and children's engagement and negativity toward parents. Higher levels of mutual engagement between mothers and toddlers were associated with lower levels of fathers' positive parenting and children's engagement with fathers, when moving from the dyadic to the triadic play context. However, fathers' mutual engagement with toddlers was not associated with mothers' parenting quality and child interactive behaviours with mothers. There were also interaction effects of parent gender and context on parents' negative parenting and children's engagement and negativity toward parents. This study adds unique insights to the differences and similarities of parent–child dyadic and triadic interactions during toddlerhood. Copyright © 2012 John Wiley & Sons, Ltd.     

Evaluation on types of invariance in studying extreme response bias with an IRTree approach

In recent years, item response tree (IRTree) approaches have received increasing attention in the response style literature for their ability to partial out response style latent variables as well as associated item parameters. When an IRTree approach is adopted to measure extreme response styles, directional and content invariance could be assumed at the latent variable and item parameter levels. In this study, we propose to evaluate the empirical validity of these invariance assumptions by employing a general IRTree model with relaxed invariance assumptions. This would allow us to examine extreme response biases, beyond extreme response styles. With three empirical applications of the proposed evaluation, we find that relaxing some of the invariance assumptions improves the model fit, which suggests that not all assumed invariances are empirically supported. Specifically, at the latent variable level, we find reasonable evidence for directional invariance but mixed evidence for content invariance, although we also find that estimated correlations between content-specific extreme response latent variables are high, hinting at the potential presence of a general extreme response tendency. At the item parameter level, we find no directional or content invariance for thresholds and no content invariance for slopes. We discuss how the variant item parameter estimates obtained from a general IRTree model can offer useful insight to help us understand response bias related to extreme responding measured within the IRTree framework.     

Developmental changes during childhood in single-letter acuity and its crowding by surrounding contours

Crowding refers to impaired target recognition caused by surrounding contours. We investigated the development of crowding in central vision by comparing single-letter and crowding thresholds in groups of 5-year-olds, 8-year-olds, 11-year-olds, and adults. The task was to discriminate the orientation of a Sloan letter E. Single-letter thresholds, defined as the stroke width forming the smallest discriminable E, were worse than those of adults (0.83 arcmin) at 5 years of age (1.05 arcmin) but not at older ages (8-year-olds: 0.81 arcmin; 11-year-olds: 0.78 arcmin). The maximum distances over which crowding occurred, as measured in multiples of threshold stroke width, were smaller in adults (2.83) than in the three groups of children, who did not differ from each other (5-year-olds: 7.03; 8-year-olds: 7.84; 11-year-olds: 7.13). Thus, even 11-year-olds are more affected than adults by surrounding contours despite having single-letter acuity that has been mature for several years. The stronger influence of crowding in children may be caused by immaturities in the brain areas beyond the primary visual cortex (V1) where early visual inputs are combined and may contribute to their slower reading speed.     

Modeling Within-Item Dependencies in Parallel Data on Test Responses and Brain Activation

Psychometrika - In this paper, we propose a joint modeling approach to analyze dependency in parallel response data. We define two types of dependency: higher-level dependency and within-item...