Reliability of test scores in nonparametric item response theory

Three methods for estimating reliability are studied within the context of nonparametric item response theory. Two were proposed originally by Mokken (1971) and a third is developed in this paper. Using a Monte Carlo strategy, these three estimation methods are compared with four classical lower bounds to reliability. Finally, recommendations are given concerning the use of these estimation methods.The authors are grateful for constructive comments from the reviewers and from Charles Lewis.     

A family of chance-corrected association coefficients for metric scales

A chance-corrected version of the family of association coefficients for metric scales proposed by Zegers and ten Berge is presented. It is shown that a matrix with chance-corrected coefficients between a number of variables is Gramian. The members of the chance-corrected family are shown to be partially ordered. The author is obliged to Jos ten Berge for helpful comments.     

Création de l’Échelle de Distorsions Cognitives pour adultes (EDC-A) : étude des propriétés psychométriques en population générale et association avec l’anxiété et la dépression

IntroductionCognitive distortions contribute to the maintenance of inappropriate cognitive schemas and play a role in the emergence of pathologies such as anxiety and depression. We developed the Cognitive Distortion Scale for Adults in order to identify distortions in individuals’ reasoning. The main objectives of this study were: (1) to study the psychometric properties of the Cognitive Distortion Scale for Adults, (2) to identify cognitive distortions associated with anxiety and depression in the general population.MethodThe study involved 916 participants (151 men and 765 women) aged 18 to 85-years. The participants completed the Cognitive Distortion Scale for Adults. The tool presents 42 mini scenarios with a daily life situation and a proposition concerning a cognitive distortion. Participants must give their degree of agreement (0 to 10) with this one. Seven cognitive distortions are operationalized (dichotomous reasoning, disqualification of one of the poles, arbitrary focusing, omission of the neutral, requalification in the other pole, maximization and minimization). They also completed the Hospital Anxiety and Depression Scale. Both scales were available online on the Internet. The total duration of the test was approximately 10 minutes. A group of 35 participants completed the two scale 15 days apart.ResultsThe sub-dimensions of EDC-A obtain Cronbach alphas higher than .65 and EDC-A has a coherent factor structure. The scale has good temporal stability. Anxiety is predicted by dichotomous reasoning, disqualification of one of the poles, arbitrary focusing and maximization. Depression is predicted by dichotomous reasoning, arbitrary focusing, omission of the neutral and requalification in the other pole. Anxiety and depression are associated with negative cognitive distortions in reasoning. However, depression is also associated with positive cognitive distortions. Subjects with depression produce more varied cognitive distortions than subjects with anxiety.DiscussionThe Cognitive Distortion Scale for Adults shows promising psychometric properties. Further studies will need to be conducted to confirm these results. Anxiety would be related to biased information treatment of negative information, whereas depression would be related to more comprehensive biased information treatment, both negative and positive information. Anxiety would be related to suboptimal functioning of reasoning abilities; depression would be more characterized by a structural deficit of reasoning abilities.     

The effect of the two-chair dialogue intervention on self-compassion - adding an emotional evocative component to a basic Rogerian condition

Objective

How people relate to themselves when facing distress or failure influences general psychological well-being and vulnerability to psychological disorders. The aim of the present study was to explore the effect of an emotionally evocative intervention on self-compassion.

Methods

The data were retrieved from a larger study of Emotion-Focused Therapy (EFT) utilising a multiple baseline design comparing two treatment phases. The baseline phase consisted of 5, 7 or 9 therapy sessions where the therapist solely adhered to Rogerian relational conditions, as prescribed in EFT. A two-chair dialogue intervention was then added for five sessions. The sample consisted of 18 self-critical clients with clinically significant symptoms of depression and/or anxiety. The “Self-Compassion Scale” (SCS) was administered pre, mid and post therapy.

Results

The baseline phase did not lead to significant changes in self-compassion. However, the addition of the two-chair dialogue was associated with a significant increase in self-compassion. This increase was due to reductions in the negative subscales, especially the isolation subscale.

Conclusion

The emotionally evocative two-chair dialogue was associated with a significant change in self-to-self relating, compared to relational conditions alone. The two-chair dialogue, thus, seems to be a promising intervention for promoting healthier self-to-self relating.     

Penalized optimal scaling for ordinal variables with an application to international classification of functioning core sets

Ordinal data occur frequently in the social sciences. When applying principal component analysis (PCA), however, those data are often treated as numeric, implying linear relationships between the variables at hand; alternatively, non-linear PCA is applied where the obtained quantifications are sometimes hard to interpret. Non-linear PCA for categorical data, also called optimal scoring/scaling, constructs new variables by assigning numerical values to categories such that the proportion of variance in those new variables that is explained by a predefined number of principal components (PCs) is maximized. We propose a penalized version of non-linear PCA for ordinal variables that is a smoothed intermediate between standard PCA on category labels and non-linear PCA as used so far. The new approach is by no means limited to monotonic effects and offers both better interpretability of the non-linear transformation of the category labels and better performance on validation data than unpenalized non-linear PCA and/or standard linear PCA. In particular, an application of penalized optimal scaling to ordinal data as given with the International Classification of Functioning, Disability and Health (ICF) is provided.     

初中生学业成就动机量表的编制

本研究根据我国初中生的实际编制了一套测量初中生学业成就动机的自陈式量表。该量表由外部行为表现和内部心理因素两个分量表构成。行为表现分置表包括主动性、行为策略和坚持性三个子量表,心理因素分量表包括能力、兴趣、目的、知识价值观四个子量表。测题分析和测验分析的结果表明此量表具有较高的信度和效度,能用于鉴别初中生学业成就动机的水平。     

A generalized family of coefficients of relational agreement for numerical scales

A family of coefficients of relational agreement for numerical scales is proposed. The theory is a generalization to multiple judges of the Zegers and ten Berge theory of association coefficients for two variables and is based on the premise that the choice of a coefficient depends on the scale type of the variables, defined by the class of admissible transformations. Coefficients of relational agreement that denote agreement with respect to empirically meaningful relationships are derived for absolute, ratio, interval, and additive scales. The proposed theory is compared to intraclass correlation, and it is shown that the coefficient of additivity is identical to one measure of intraclass correlation.The author thanks the Editor and anonymous reviewers for helpful suggestions.     

Some properties of estimated scale invariant covariance structures

Scale invariance is a property shared by many covariance structure models employed in practice. An example is provided by the well-known LISREL model subject only to classical normalizations and zero constraints on the parameters. It is shown that scale invariance implies that the estimated covariannce matrix must satisfy certain equations, and the nature of these equations depends on the fitting function used. In this context, the paper considers two classes of fitting functions: weighted least squares and the class of functions proposed by Swain.Constructive comments by the referees are greatly appreciated. The author gratefully acknowledges Michael Browne's interest in his work.     

中国和澳大利亚父母报告的儿童社会性发展

采用作者编制的《３－９岁儿童社会性发展量表》的英译本,在２８４名澳大利亚儿童中进行测试。结果表明,对于社会文化背景差异巨大的中国和澳大利亚,本量表具有较好的稳定性和跨文化适用性。儿童社会性发展的各个方面,在中澳父母心目中占有不同地位：中国父母重视自我意识、社会技能、意志品质,而澳大利亚父母更重视社会技能和社会情绪的发展。在中澳两个样本中,女孩的社会性发展量表得分均高于男孩。     

Separability of item and person parameters in response time models

This paper discusses two forms of separability of item and person parameters in the context of response time (RT) models. The first is separate sufficiency: the existence of sufficient statistics for the item (person) parameters that do not depend on the person (item) parameters. The second is ranking independence: the likelihood of the item (person) ranking with respect to RTs does not depend on the person (item) parameters. For each form a theorem stating sufficient conditions, is proved. The two forms of separability are shown to include several (special cases of) models from psychometric and biometric literature. Ranking independence imposes no restrictions on the general distribution form, but on its parametrization. An estimation procedure based upon ranks and pseudolikelihood theory is discussed, as well as the relation of ranking independence to the concept of double monotonicity.I am indebted to Wim van der Linden for bringing Thissen's (1983) paper to my notice, and to Martijn Berger, Frans Tan, and the anonymous reviewers for their constructive comments on earlier drafts of this paper.