Empirical Guidance for Time-Window Sequential Analysis of Single Cases

Time-window sequential analyses test whether a target behavior occurs within a temporal window (e.g., within 2 seconds) after an antecedent behavior more than is expected by chance. This type of question is common when we need to know how one person or event may immediately affect another event or person in the natural environment. Theoretically, the significance of sequential associations from time-window analysis can be tested on the single subject level (Bakeman & Quera, 1995). The present Monte Carlo study was conducted to test the Type I error rates and the difference in sequential associations derived from four methods of time-window sequential analysis. The four methods vary according to whether they analyze the duration of antecedent and target behaviors. The results indicate that time-window sequential analysis method is generally valid. The results were most accurate when antecedent duration and target onset was analyzed. Although analyzing duration of the antecedent did affect the results, the effect size for the difference in results due to presence or absence of measuring duration of the antecedent was extremely small. Time-window analysis results appear unaffected by the decision to analyze the duration of the target event.     

Reliability of the Child and Adolescent Needs and Strengths-Mental Health (CANS-MH) Scale

We examined the interrater reliability of the Child and Adolescent Needs and Strengths-Mental Health (CANS-MH) scale among researchers and between researchers and clinicians. All children presenting to a treatment facility for either protective or mental health needs were eligible to be included in the study. As part of standard assessment procedure, all children entering the facility were described by caseworkers using the CANS-MH. A random sample of 60 cases was selected and researchers made retrospective assessments using the CANS-MH based on chart review. Results of the interrater reliability support previous findings that the CANS-MH is a reliable measure of clinical and psychosocial needs and strengths. Results also suggest that ratings on the CANS-MH based on medical record abstraction by researchers relate to ratings performed by clinical staff, demonstrating the clinical and research utility of the CANS-MH. The CANS-MH can be used reliably to assess the type and severity of problem presentation, risk behaviors, functioning, care intensity and organization, caregiver capacity and strengths among children with protective and mental health needs. In addition, items of the CANS-MH appear to be reliable supporting the use of these items individually. Findings are relevant to the ongoing delivery of clinical services, monitoring of quality assurance, and outcomes.     

Teens on the Internet—commercial application of a deconstructive analysis of ‘teen zine’ features

This paper presents the authors' approach to understanding drivers of interest for teen e‐zines (Internet magazines). The paper shows how a deconstruction of the current set of e‐zines provides the raw material for a conjoint measurement study, whereby the elements are mixed and matched in order to create new test concepts. From reactions to those test concepts one can identify four newly emerging segments: the ‘indifferents’, the ‘adults in training’, the ‘media and me’ and the ‘talk and celebrate being a teen’. Deconstruction applied to the competitive frame provides both a deeper understanding of the e‐zine landscape and input for newer and better e‐zines that are targeted to specific mindsets. Copyright © 2003 Henry Stewart Publications.     

智慧测量三十年:两种测量范式及新发展

准确且高效地测量智慧是智慧研究的基石。自柏林智慧模式于1990年首创智慧测量法后,围绕如何测量智慧形成两种测量范式:最佳行为测量取向和典型行为测量取向。文中综述了两种测量范式的新发展、优势和不足。未来宜重点测量“德才一体”的综合心理素质和借助这一素质创造出的产品; 兼顾自我报告、行为观察和认知神经科学的方法测量智慧。     

解释性项目反应理论模型：理论与应用

解释性项目反应理论模型(Explanatory Item Response Theory Models, EIRTM)是指基于广义线性混合模型和非线性混合模型构建的项目反应理论(Item Response Theory, IRT)模型。EIRTM能在IRT模型的基础上直接加入预测变量, 从而解决各类测量问题。首先介绍EIRTM的相关概念和参数估计方法, 然后展示如何使用EIRTM处理题目位置效应、测验模式效应、题目功能差异、局部被试依赖和局部题目依赖, 接着提供实例对EIRTM的使用进行说明, 最后对EIRTM的不足之处和应用前景进行讨论。     

Perceived collective efficacy to stop aggression at school: A validation of an Italian and a Swedish version of a scale for adolescents

Collective efficacy to stop peer aggression in the school context refers to adolescents’ beliefs about the capability of students and teachers in their school to work together to counteract aggressive behaviours among peers. This study presents the Italian and Swedish versions of a recently developed scale to measure the construct. Factorial structure and measurement invariance of the scale were assessed in two samples of adolescents aged 10–15 years. The findings support both a two-dimensional and a three-dimensional scale across gender and countries, demonstrating the importance of making distinctions between different forms of aggression when measuring collective efficacy to stop aggression. A one-dimensional scale was only supported in the Swedish sample. The results support the use of the Collective Efficacy to Stop Aggression scale with both Italian and Swedish adolescents.     

Development of the Inventory of College Students' Resilience and evaluating the measurement invariance

In order to help students adapt well to stressful situations or adversity, many researchers have explored the issue of students' resilience. The main purpose of this study was to develop the Inventory of College Students' Resilience (ICSR), for assessing resilience of college students. The present study recruited 993 participants to conduct item analysis, exploratory factor analysis and reliability analysis. We then administered the questionnaire to another 1490 participants in order to conduct confirmatory factor analysis and assess criterion-related validity. The results showed the proposed model fit the data well and the ICSR had both internal consistency and criterion-related validity. The ICSR was also found to have measurement invariance across gender. We conclude that the ICSR can help students to identify strengths and weaknesses in order to reinforce their resilience and improve their response to life stress and trauma.     

Consequences of Ignoring Guessing Effects on Measurement Invariance Analysis

Pseudo-guessing parameters are present in item response theory applications for many educational assessments. When sample size is not sufficiently large, the guessing parameters may be ignored from the analysis. This study examines the impact of ignoring pseudo-guessing parameters on measurement invariance analysis, specifically, on item difficulty, item discrimination, and mean and variance of ability distribution. Results show that when non-zero guessing parameters are ignored from the measurement invariance analysis, item discrimination estimates tend to decrease particularly for more difficult items, and item difficulty estimates decrease unless the items are highly discriminating and difficult. As the guessing parameter increases, the size of the decrease in item discrimination and difficulty tends to increase, and the estimated mean and variance of ability distribution tend to be inaccurate. When two groups have heterogeneous ability distributions, ignoring the guessing parameter affects the reference group and the focal group differently. Implications of result findings are discussed.     

True or False? Keying Direction and Acquiescence Influence the Validity of Socio-Emotional Skills Items in Predicting High School Achievement

What type of items, keyed positively or negatively, makes social-emotional skill or personality scales more valid? The present study examines the different criterion validities of true- and false-keyed items, before and after correction for acquiescence. The sample included 12,987 children and adolescents from 425 schools of the State of São Paulo Brazil (ages 11–18 attending grades 6–12). They answered a computerized 162-item questionnaire measuring 18 facets grouped into five broad domains of social-emotional skills, i.e.: Open-mindedness (O), Conscientious Self-Management (C), Engaging with others (E), Amity (A), and Negative-Emotion Regulation (N). All facet scales were fully balanced (3 true-keyed and 3 false-keyed items per facet). Criterion validity coefficients of scales composed of only true-keyed items versus only false-keyed items were compared. The criterion measure was a standardized achievement test of language and math ability. We found that coefficients were almost as twice as big for false-keyed items’ scales than for true-keyed items’ scales. After correcting for acquiescence coefficients became more similar. Acquiescence suppresses the criterion validity of unbalanced scales composed of true-keyed items. We conclude that balanced scales with pairs of true and false keyed items make a better scale in terms of internal structural and predictive validity.     

What do we measure and how do we elicit it? The case for the use of repertory grid technique in multi-party psychological contract research

ABSTRACT

The psychological contract is a multi-faceted construct and, with the rise of gig work, increasingly the contract extends beyond the conventional employer-employee relationship to encompass multi-party exchanges. Against this backdrop, the question of what should be measured when assessing the contract and how it should be elicited remains a significant issue for scholars. We argue that the potential of psychological contract theory as an explanatory lens in understanding contemporary multi-party working relationships is constrained by two key limitations inherent in conventional measurement approaches. Firstly, such approaches have favoured singular rather than multiparty perspectives, and secondly, they have broadly accorded equal weight and significance to the content dimensions unearthed, despite the fact that they may differ markedly in how they are understood by each party to the employment relationship. In order to remedy these shortcomings, we make the case for adopting repertory grid technique as a methodological framework to address measurement limitations and to more rigorously assess the content of the complex multi-party psychological contract.