A person-fit index for polytomous rasch models,latent class models,and their mixture generalizations

A normally distributed person-fit index is proposed for detecting aberrant response patterns in latent class models and mixture distribution IRT models for dichotomous and polytomous data.This article extends previous work on the null distribution of person-fit indices for the dichotomous Rasch model to a number of models for categorical data. A comparison of two different approaches to handle the skewness of the person-fit index distribution is included.Major parts of this paper were written while the first author worked at the Institute for Science Education, Kiel, Germany. Any opinions expressed in this paper are those of the authors and not necessarily of Educational Testing Service. The results presented in this paper were improved by valuable comments from J. Rost, K. Yamamoto, N.D. Verhelst, E. Bedrick and two anonymous reviewers.     

Getting the big picture: Development of spatial scaling abilities

Spatial scaling is an integral aspect of many spatial tasks that involve symbol-to-referent correspondences (e.g., map reading, drawing). In this study, we asked 3–6-year-olds and adults to locate objects in a two-dimensional spatial layout using information from a second spatial representation (map). We examined how scaling factor and reference features, such as the shape of the layout or the presence of landmarks, affect performance. Results showed that spatial scaling on this simple task undergoes considerable development, especially between 3 and 5 years of age. Furthermore, the youngest children showed large individual variability and profited from landmark information. Accuracy differed between scaled and un-scaled items, but not between items using different scaling factors (1:2 vs. 1:4), suggesting that participants encoded relative rather than absolute distances.     

Validating the coping scale for Chinese athletes using multidimensional Rasch analysis

Objective

The Coping Scale for Chinese Athletes (CSCA) was developed and validated using classic testing theory in 2004 (Chung, Si, Lee, & Liu, 2004). This study aimed to validate CSCA using multidimensional Rasch analysis with the ConQuest software programme.

Method

The sample in this study comprised 367 athletes from mainland China. A Multidimensional Rating Scale model was applied to investigate the validity of the four-dimension scale. Standard fit statistics (Infit and Outfit MNSQ) and Differential item functioning (DIF) were computed to examine the model-data fit. Test reliability and category functioning were also checked.

Results

The item difficulty and the athletes’ trait level of coping were calibrated along the same latent trait scale. Three items were removed from the scale due to misfit with the Rasch model. No DIF across gender was found for the remaining 21 items. Test reliabilities for the four subscales ranged from 0.66 to 0.76. The results also indicated that the original 5-category rating scale structure did not function well.

Conclusion

The multidimensional Rasch analysis supported that the 21-item CSCA measures four latent traits of coping of Chinese athletes as expected. The results also demonstrated advantages of multidimensional Rasch analysis over unidimensional Rasch analysis as well as traditional approach in examining the quality of multidimensional scale in sport settings.     

Modeling the effect of reward amount on probability discounting

The present study with college students examined the effect of amount on the discounting of probabilistic monetary rewards. A hyperboloid function accurately described the discounting of hypothetical rewards ranging in amount from $20 to $10,000,000. The degree of discounting increased continuously with amount of probabilistic reward. This effect of amount was not due to changes in the rate parameter of the discounting function, but rather was due to increases in the exponent. These results stand in contrast to those observed with the discounting of delayed monetary rewards, in which the degree of discounting decreases with reward amount due to amount-dependent decreases in the rate parameter. Taken together, this pattern of results suggests that delay and probability discounting reflect different underlying mechanisms. That is, the fact that the exponent in the delay discounting function is independent of amount is consistent with a psychophysical scaling interpretation, whereas the finding that the exponent of the probability-discounting function is amount-dependent is inconsistent with such an interpretation. Instead, the present results are consistent with the idea that the probability-discounting function is itself the product of a value function and a weighting function. This idea was first suggested by Kahneman and Tversky (1979), although their prospect theory does not predict amount effects like those observed. The effect of amount on probability discounting was parsimoniously incorporated into our hyperboloid discounting function by assuming that the exponent was proportional to the amount raised to a power. The amount-dependent exponent of the probability-discounting function may be viewed as reflecting the effect of amount on the weighting of the probability with which the reward will be received.     

研究生入学考试写作评分的概化理论研究与多面Rasch分析

为了评价和改进硕士研究生入学考试一般能力测试的写作评分,研究者采用概化理论和多面Rasch分析对113位考生的写作样本的评分误差来源、评分信度等进行了探讨.概化理论研究显示,评分者和题目对评分准确性影响不大,以两道写作题的考试设计而言,评分者为2人即可保证评分信度在0.75以上.多面Rasch分析显示,评分者宽严度的估计值及其误差均在可接受的范围内,评分者之间在宽严度上不存在显著差异,且评分者自身在评分时总体上比较稳定.但个别评分者在特定考生特定题目上表现出特殊偏向.概化理论和多面Rasch分析丰富了写作评分研究的量化指标,证实了硕士研究生入学考试一般能力测试的写作评分具有较高的信度.     

Exploring Differential Subgroup Functioning on SAT Writing Items: What Happens When English Is Not a Test Taker's Best Language?

The purpose of this study is to explore patterns in model-data fit related to subgroups of test takers from a large-scale writing assessment. Using data from the SAT, a calibration group was randomly selected to represent test takers who reported that English was their best language from the total population of test takers (N = 322,011). A reference scale for the items was constructed based on EBL responses. Response behaviors of test takers who reported that English was not their best language (ENBL) were examined in relationship to this reference scale. This study illustrates the use of differential subgroup analyses to identify patterns related to person misfit within subgroups, as well as subsets of items, that may affect the validity of writing scores for ENBL test takers. The methodology described here offers an approach that can be used to explore, understand, and improve the validity of scores obtained from ENBL test takers in large-scale writing assessments.     

Profile Analysis of Psychological Symptoms Associated With Misophonia: A Community Sample

Misophonia is characterized by extreme aversive reactions to certain classes of sounds. It has recently been recognized as a condition associated with significant disability. Research has begun to evaluate psychopathological correlates of misophonia. This study sought to identify profiles of psychopathology that characterize misophonia in a large community sample. A total of N = 628 adult participants completed a battery of measures assessing anxiety and anxiety sensitivity, depression, stress responses, anger, dissociative experiences, obsessive-compulsive symptoms and beliefs, distress tolerance, bodily perceptions, as well as misophonia severity. Profile Analysis via Multidimensional Scaling (PAMS) was employed to evaluate profiles associated with elevated misophonia and those without symptoms. Three profiles were extracted. The first two accounted for 70% total variance and did not show distinctions between groups. The third profile accounted for 11% total variance, and showed that misophonia is associated with lower obsessive-compulsive symptoms for neutralizing, obsessions generally, and washing compared to those not endorsing misophonia, and higher levels of obsessive-compulsive symptoms associated with ordering and harm avoidance. This third profile extracted also showed significant differences between those with and without misophonia on the scale assessing physical concerns (that is, sensitivity to interoceptive sensations) as assessed with the ASI-3. Further research is called for involving diagnostic interviewing and experimental methods to clarify these putative mechanisms associated with misophonia.     

The effects of goal setting on rugby performance

Goal-setting effects on selected performance behaviors of 5 collegiate rugby players were assessed over an entire competitive season using self-generated targets and goal-attainment scaling. Results suggest that goal setting was effective for enhancing task-specific on-field behavior in rugby union.     

Adaptation in Visuomanual Tracking Depends on Intact Proprioception

The role of arm proprioception in motor learning was investigated in experiments in which, by moving the arm, subjects followed the motion of a target displayed on a monitor screen. Adaptive capabilities were tested in visuomanual tracking tasks following alterations in the relationship between the observer's actual arm movement and visual feedback of the arm movement given by a cursor motion on the screen. Tracking performance and adaptive changes, measured in terms of spatiotemporal error, tracking trajectory curvature, and spatial gain, were compared in 7 control subjects (CSs) and in 1 deafferented subject (DS). CSs adapted appropriately to altered visuomanual relationships; those changes were present in trials immediately after restoration of normal scaling. In contrast, although the DS modified his tracking strategy from trial to trial according to the altered conditions, he did not show plastic changes in internal visuomanual scaling. Like the results of prismatic adaptation experiments, the present results suggest that arm proprioception contributes to the plastic changes that follow alterations in the scaling of visuomanual gain.     

Seeing through the eyes of anxious individuals: An investigation of anxiety-related interpretations of emotional expressions

The interpretation of emotional states is necessary for successful social communication. Often individuals interpret emotional expressions intuitively and without full cognitive awareness. The aim of the present study was to test whether anxiety would influence affect interpretation in the manner suggested by interpretation bias—the tendency to interpret ambiguous cues in a threatening way. Interpretation of social cues was assessed with the similarity rating task (simtask) in two studies (n₁ = 116, n₂ = 76). The similarity ratings were analysed with a multidimensional scaling (MDS) approach, and the effects of anxiety on the interpretation of emotional expressions were analysed with multilevel modelling. The results of both studies showed evidence for an anxiety-related interpretation bias. High-anxious individuals tended to interpret milder threats as more negative than low-anxious individuals did. The consequences for anxiety research are discussed.