Reliability of the Child and Adolescent Needs and Strengths-Mental Health (CANS-MH) Scale

We examined the interrater reliability of the Child and Adolescent Needs and Strengths-Mental Health (CANS-MH) scale among researchers and between researchers and clinicians. All children presenting to a treatment facility for either protective or mental health needs were eligible to be included in the study. As part of standard assessment procedure, all children entering the facility were described by caseworkers using the CANS-MH. A random sample of 60 cases was selected and researchers made retrospective assessments using the CANS-MH based on chart review. Results of the interrater reliability support previous findings that the CANS-MH is a reliable measure of clinical and psychosocial needs and strengths. Results also suggest that ratings on the CANS-MH based on medical record abstraction by researchers relate to ratings performed by clinical staff, demonstrating the clinical and research utility of the CANS-MH. The CANS-MH can be used reliably to assess the type and severity of problem presentation, risk behaviors, functioning, care intensity and organization, caregiver capacity and strengths among children with protective and mental health needs. In addition, items of the CANS-MH appear to be reliable supporting the use of these items individually. Findings are relevant to the ongoing delivery of clinical services, monitoring of quality assurance, and outcomes.     

智慧测量三十年:两种测量范式及新发展

准确且高效地测量智慧是智慧研究的基石。自柏林智慧模式于1990年首创智慧测量法后,围绕如何测量智慧形成两种测量范式:最佳行为测量取向和典型行为测量取向。文中综述了两种测量范式的新发展、优势和不足。未来宜重点测量“德才一体”的综合心理素质和借助这一素质创造出的产品; 兼顾自我报告、行为观察和认知神经科学的方法测量智慧。     

解释性项目反应理论模型：理论与应用

解释性项目反应理论模型(Explanatory Item Response Theory Models, EIRTM)是指基于广义线性混合模型和非线性混合模型构建的项目反应理论(Item Response Theory, IRT)模型。EIRTM能在IRT模型的基础上直接加入预测变量, 从而解决各类测量问题。首先介绍EIRTM的相关概念和参数估计方法, 然后展示如何使用EIRTM处理题目位置效应、测验模式效应、题目功能差异、局部被试依赖和局部题目依赖, 接着提供实例对EIRTM的使用进行说明, 最后对EIRTM的不足之处和应用前景进行讨论。     

Perceived collective efficacy to stop aggression at school: A validation of an Italian and a Swedish version of a scale for adolescents

Collective efficacy to stop peer aggression in the school context refers to adolescents’ beliefs about the capability of students and teachers in their school to work together to counteract aggressive behaviours among peers. This study presents the Italian and Swedish versions of a recently developed scale to measure the construct. Factorial structure and measurement invariance of the scale were assessed in two samples of adolescents aged 10–15 years. The findings support both a two-dimensional and a three-dimensional scale across gender and countries, demonstrating the importance of making distinctions between different forms of aggression when measuring collective efficacy to stop aggression. A one-dimensional scale was only supported in the Swedish sample. The results support the use of the Collective Efficacy to Stop Aggression scale with both Italian and Swedish adolescents.     

An empirical Q-matrix validation method for the sequential generalized DINA model

As a core component of most cognitive diagnosis models, the Q-matrix, or item and attribute association matrix, is typically developed by domain experts, and tends to be subjective. It is critical to validate the Q-matrix empirically because a misspecified Q-matrix could result in erroneous attribute estimation. Most existing Q-matrix validation procedures are developed for dichotomous responses. However, in this paper, we propose a method to empirically detect and correct the misspecifications in the Q-matrix for graded response data based on the sequential generalized deterministic inputs, noisy ‘and’ gate (G-DINA) model. The proposed Q-matrix validation procedure is implemented in a stepwise manner based on the Wald test and an effect size measure. The feasibility of the proposed method is examined using simulation studies. Also, a set of data from the Trends in International Mathematics and Science Study (TIMSS) 2011 mathematics assessment is analysed for illustration.     

Development of the Inventory of College Students' Resilience and evaluating the measurement invariance

In order to help students adapt well to stressful situations or adversity, many researchers have explored the issue of students' resilience. The main purpose of this study was to develop the Inventory of College Students' Resilience (ICSR), for assessing resilience of college students. The present study recruited 993 participants to conduct item analysis, exploratory factor analysis and reliability analysis. We then administered the questionnaire to another 1490 participants in order to conduct confirmatory factor analysis and assess criterion-related validity. The results showed the proposed model fit the data well and the ICSR had both internal consistency and criterion-related validity. The ICSR was also found to have measurement invariance across gender. We conclude that the ICSR can help students to identify strengths and weaknesses in order to reinforce their resilience and improve their response to life stress and trauma.     

Consequences of Ignoring Guessing Effects on Measurement Invariance Analysis

Pseudo-guessing parameters are present in item response theory applications for many educational assessments. When sample size is not sufficiently large, the guessing parameters may be ignored from the analysis. This study examines the impact of ignoring pseudo-guessing parameters on measurement invariance analysis, specifically, on item difficulty, item discrimination, and mean and variance of ability distribution. Results show that when non-zero guessing parameters are ignored from the measurement invariance analysis, item discrimination estimates tend to decrease particularly for more difficult items, and item difficulty estimates decrease unless the items are highly discriminating and difficult. As the guessing parameter increases, the size of the decrease in item discrimination and difficulty tends to increase, and the estimated mean and variance of ability distribution tend to be inaccurate. When two groups have heterogeneous ability distributions, ignoring the guessing parameter affects the reference group and the focal group differently. Implications of result findings are discussed.     

True or False? Keying Direction and Acquiescence Influence the Validity of Socio-Emotional Skills Items in Predicting High School Achievement

What type of items, keyed positively or negatively, makes social-emotional skill or personality scales more valid? The present study examines the different criterion validities of true- and false-keyed items, before and after correction for acquiescence. The sample included 12,987 children and adolescents from 425 schools of the State of São Paulo Brazil (ages 11–18 attending grades 6–12). They answered a computerized 162-item questionnaire measuring 18 facets grouped into five broad domains of social-emotional skills, i.e.: Open-mindedness (O), Conscientious Self-Management (C), Engaging with others (E), Amity (A), and Negative-Emotion Regulation (N). All facet scales were fully balanced (3 true-keyed and 3 false-keyed items per facet). Criterion validity coefficients of scales composed of only true-keyed items versus only false-keyed items were compared. The criterion measure was a standardized achievement test of language and math ability. We found that coefficients were almost as twice as big for false-keyed items’ scales than for true-keyed items’ scales. After correcting for acquiescence coefficients became more similar. Acquiescence suppresses the criterion validity of unbalanced scales composed of true-keyed items. We conclude that balanced scales with pairs of true and false keyed items make a better scale in terms of internal structural and predictive validity.     

What do we measure and how do we elicit it? The case for the use of repertory grid technique in multi-party psychological contract research

ABSTRACT

The psychological contract is a multi-faceted construct and, with the rise of gig work, increasingly the contract extends beyond the conventional employer-employee relationship to encompass multi-party exchanges. Against this backdrop, the question of what should be measured when assessing the contract and how it should be elicited remains a significant issue for scholars. We argue that the potential of psychological contract theory as an explanatory lens in understanding contemporary multi-party working relationships is constrained by two key limitations inherent in conventional measurement approaches. Firstly, such approaches have favoured singular rather than multiparty perspectives, and secondly, they have broadly accorded equal weight and significance to the content dimensions unearthed, despite the fact that they may differ markedly in how they are understood by each party to the employment relationship. In order to remedy these shortcomings, we make the case for adopting repertory grid technique as a methodological framework to address measurement limitations and to more rigorously assess the content of the complex multi-party psychological contract.     

Equal prioritisation does not yield lower levels of participation in physical activities than higher prioritisation

ObjectivesThis study examined whether individuals who assigned equal priority to physical activity and an alternative activity exhibited lower levels of participation in physical activities than individuals who assigned higher priority to physical activity than an alternative activity. In addition, we examined whether a measure of prioritisation derived from an algebraic difference index provided a rigorous test of prioritisation effects.DesignWe employed a two-wave prospective design that aimed to predict physical activity participation.MethodPrioritisation, intentions and perceptions of control were measured at the first wave of data collection. After five weeks, we administered follow-up measures of behavioural conflict and physical activity participation.ResultsA hierarchical regression analysis showed that although the algebraic difference index was positively associated with measures of physical activity participation, equal prioritisation did not yield lower levels of physical activity participation than high prioritisation.ConclusionsFindings suggest that equal prioritisation is not a less optimal self-regulatory strategy than high prioritisation in the domain of physical activity. Regression coefficients associated with algebraic difference indexes should be interpreted with caution and consider analyses that examine effects of component measures of prioritisation on physical activity participation.