Limited‐information goodness‐of‐fit testing of diagnostic classification item response models

Despite the growing popularity of diagnostic classification models (e.g., Rupp et al., 2010, Diagnostic measurement: theory, methods, and applications, Guilford Press, New York, NY) in educational and psychological measurement, methods for testing their absolute goodness of fit to real data remain relatively underdeveloped. For tests of reasonable length and for realistic sample size, full‐information test statistics such as Pearson's X² and the likelihood ratio statistic G² suffer from sparseness in the underlying contingency table from which they are computed. Recently, limited‐information fit statistics such as Maydeu‐Olivares and Joe's (2006, Psychometrika, 71, 713) M₂ have been found to be quite useful in testing the overall goodness of fit of item response theory models. In this study, we applied Maydeu‐Olivares and Joe's (2006, Psychometrika, 71, 713) M₂ statistic to diagnostic classification models. Through a series of simulation studies, we found that M₂ is well calibrated across a wide range of diagnostic model structures and was sensitive to certain misspecifications of the item model (e.g., fitting disjunctive models to data generated according to a conjunctive model), errors in the Q‐matrix (adding or omitting paths, omitting a latent variable), and violations of local item independence due to unmodelled testlet effects. On the other hand, M₂ was largely insensitive to misspecifications in the distribution of higher‐order latent dimensions and to the specification of an extraneous attribute. To complement the analyses of the overall model goodness of fit using M₂, we investigated the utility of the Chen and Thissen (1997, J. Educ. Behav. Stat., 22, 265) local dependence statistic $X_{\mathrm{LD}}^2$ for characterizing sources of misfit, an important aspect of model appraisal often overlooked in favour of overall statements. The $X_{\mathrm{LD}}^2$ statistic was found to be slightly conservative (with Type I error rates consistently below the nominal level) but still useful in pinpointing the sources of misfit. Patterns of local dependence arising due to specific model misspecifications are illustrated. Finally, we used the M₂ and $X_{\mathrm{LD}}^2$ statistics to evaluate a diagnostic model fit to data from the Trends in Mathematics and Science Study, drawing upon analyses previously conducted by Lee et al., (2011, IJT, 11, 144).     

The role of locomotor posture and experience on handedness and footedness in infancy

This research examined the development of handedness and footedness in infancy. We measured footedness by documenting the limb infants used to "lead-out" as they crawled or walked down a path several times. We measured handedness by documenting the hand infants used to reach for a goal at the end of each trial. Study 1 showed that locomotor skill affects limb lateralization preferences and that most 13-month-old infants demonstrated a side preference for reaching and leading out "in the moment." Study 2 longitudinally examined the developmental trajectories of handedness and footedness as they related to locomotor posture and experience. The findings suggest high variability in the developmental trajectory of footedness, with frequent fluctuation between side preferences. The developmental trajectory of handedness was more stable over the transition between locomotor milestones. The transition between crawling and walking decreased the proportion of infants demonstrating side preferences for leading out and the onset of walking decreased the proportion of infants demonstrating side preferences for reaching. These findings demonstrate the importance of making behavioral observations at multiple time scales to understand underlying developmental trajectories, specifically the stability or instability of the motor system associated with the acquisition of new motor abilities.     

Children's memory for the times of events from the past years

This study tested 8–12‐year‐olds' ability to localize in time parent‐reported events from four time intervals ranging from 6 months to 4 years ago. Memory for content was very accurate, and children's time estimates showed substantial agreement with the times provided by their parents. Accuracy of year judgments declined with retention interval, with the greatest change occurring between the 1–2‐year and 2–3‐year intervals. Season, month and time of day accuracy were much more stable over time. There were significant improvements with age in performance on measures of conventional time knowledge, and this performance was correlated with the accuracy of time estimates on the long time scales, controlling for age and general cognitive ability. Copyright © 2010 John Wiley & Sons, Ltd.     

View combination: a generalization mechanism for visual recognition

We examined whether view combination mechanisms shown to underlie object and scene recognition can integrate visual information across views that have little or no three-dimensional information at either the object or scene level. In three experiments, people learned four “views” of a two dimensional visual array derived from a three-dimensional scene. In Experiments 1 and 2, the stimuli were arrays of colored rectangles that preserved the relative sizes, distances, and angles among objects in the original scene, as well as the original occlusion relations. Participants recognized a novel central view more efficiently than any of the Trained views, which in turn were recognized more efficiently than equidistant novel views. Experiment 2 eliminated presentation frequency as an explanation for this effect. Experiment 3 used colored dots that preserved only identity and relative location information, which resulted in a weaker effect, though still one that was inconsistent with both part-based and normalization accounts of recognition. We argue that, for recognition processes to function so effectively with such minimalist stimuli, view combination must be a very general and fundamental mechanism, potentially enabling both visual recognition and categorization.     

Are we aware of our ability to forget? Metacognitive predictions of directed forgetting

It is often important to accurately predict not only what information we will later remember, but also what information we are likely to forget. The present research examined these abilities in the context of item-method directed forgetting, to determine whether people are aware of their strategic control of remembering and forgetting, as well as what cues are used when making metacognitive judgments. Participants studied words, each of which was followed by a cue to remember (R) or forget (F) the word for an upcoming test, and also made predictions of how likely they would be to later recall each word. When asked to recall all of the words, regardless of cue, both recall and predicted recall were fairly sensitive to the R or F instructions, despite some overconfidence. A similar and stronger pattern was found when words were assigned positive or negative point values as cues to remember or forget. These findings suggest that item-based cues to remember or forget information can be successfully utilized when making metacognitive judgments, and that people are fairly aware of the control they have over both remembering and forgetting information.     

Acquiring ownership and the attribution of responsibility

How is ownership established over non-owned things? We suggest that people may view ownership as a kind of credit given to agents responsible for making possession of a non-owned object possible. On this view, judgments about the establishment of ownership depend on attributions of responsibility. We report three experiments showing that people’s judgments about the establishment of ownership are influenced by an agent’s intent and control in bringing about an outcome, factors that also affect attributions of responsibility. These findings demonstrate that people do not just consider who was first to possess an object in judging who owns it, and are broadly consistent with the view that ownership is acquired through labor. The findings also suggest that rather than exclusively being the product of social conventions, judgments about the establishment of ownership over non-owned things also depend on the psychological processes underlying the attribution of responsibility.     

Varieties of Resilience in MIDUS

Population‐based studies of health typically focus on psychosocial contributors to illness and disease. We examine findings from a national longitudinal study of American adults, known as MIDUS (Midlife in the U.S.) to examine the role of psychosocial factors in promoting resilience, defined as the maintenance, recovery, or improvement in health following challenge. Classic studies of resilience are briefly noted, followed by a look at three categories of resilience in MIDUS. The first pertains to having good health and well‐being in the face of low socioeconomic standing. The second pertains to maintaining good health and well‐being despite the challenges that accompany aging. The third pertains to resilience in the face of targeted life challenges such as abuse in childhood, loss of spouse in adulthood, or having cancer. Across each area, we summarize evidence of positive health, and where possible, highlight protective influences that account for such salubrious outcomes. We conclude with opportunities for future research in MIDUS such as examining cultural and genetic influences on resilience as well as utilizing laboratory challenge data to illuminate underlying mechanisms.     

Culture and accountability in negotiation: Recognizing the importance of in-group relations

We extend Gelfand and Realo’s (1999) argument that accountability motivates negotiators from relationally-focused cultures to use a more pro-relationship approach during negotiations. Our research shows that the effect they predict is found only when the other negotiating partner is an in-group member. Specifically, in two studies involving participants from China (a relationally-focused culture) and the US (a less relationally-focused culture), we found that only when negotiating with an in-group member are Chinese participants under high accountability more likely to use a pro-relationship approach than those under low accountability. Consequently, the differences between Chinese and American participants in the use of a pro-relationship approach occur only when they negotiate with an in-group member under high accountability. The strong attention to relationships, however, results in higher fixed-pie perceptions and lower joint gains. The implications of our findings for theory and practice are discussed.     

Different standards are not double standards: all elective surgical patients are not alike

Testa and colleagues argue that evaluation for suitability for living donor surgery is rooted in paternalism in contrast with the evaluation for most operative interventions, which is rooted in the autonomy of patients. We examine two key ethical concepts that Testa and colleagues use: paternalism and autonomy, and two related ethical concepts: moral agency and shared decision making. We show that by moving the conversation from paternalism, negative autonomy, and informed consent to moral agency, relational autonomy, and shared decision making, one better understands why the arguments given by Testa and colleagues fail. We argue (1) why the hurdles that one must overcome to become a living donor are appropriate; and (2) that the similarities between living donor transplant surgery and cosmetic plastic surgery that the authors describe are inaccurate. Finally, we consider the recommendation to treat plastic surgery patients and living donors more similarly. We argue that any change should not be in the direction of becoming less protective of living donors, but more protective of cosmetic plastic surgery candidates.