Understanding subgroup differences with general mental ability tests in employment selection: Exploring socio-cultural factors across inter-generational groups

In employment selection, general mental ability (GMA) tests predict training and job performance but also lead to subgroup differences which in turn can produce adverse impact against minority groups. Although researchers have explored genetic, developmental, and environmental explanations for ethnic group differences, few studies have explored socio-cultural factors comparing immigrant and non-immigrant job applicants. Given that many ethnic job applicants may also be immigrants, understanding these factors can provide insight into GMA test score differences. The purpose of this paper is to explore the impact of individual and socio-cultural factors on GMA test scores with immigrant and non-immigrant bus driver applicants. This is the first study of its kind to our knowledge that has attempted to disentangle the effects of socio-cultural factors from race/ethnicity in the study of subgroup differences. Incorporating these variables between non-visible minority and minority groups accounted for considerable variance in GMA test scores across groups. The implications of focusing on socio-cultural variables to enhance our understanding of subgroup differences are discussed. Our results specifically suggest that practitioners attend to the issue of the intersecting grounds of potential discrimination when using GMA tests in personnel selection.     

世界大学排名比较中的再认启发式和线索推断

针对三种世界大学排名比较任务(综合实力、商业与管理专业、农业与林业专业),用问卷调查了208名大学生并考察其利用再认启发式和额外线索作推断的情况。结果发现:(1)被试在前两种任务中的正确率均超过60%,选择可再认学校的比率及其正确率也较高;(2)比较类别对再认的选择率及其正确率均有显著影响,效应量很大;(3)再认效度较低或无法利用再认时,被试的选择在不同程度上符合外国线索或专长线索的预测;(4)多出一条不利线索时,再认选择率比只有再认线索时有所降低但不低于50%,多出一条有利线索时,再认选择率的变化因线索而异,不一定显著地增加。     

Evaluation of a French parent-training program in young children with autism spectrum disorder

Parent training programs (PTs) in young children with autism spectrum disorders (ASDs) are known to reduce parenting stress and improve child's behavior and parent-child interactions. Few PTs are available to French speaking families. In order to provide them with this type of intervention, we developed a French parent-training program of 12 bimonthly sessions and three individual home visits based on applied behavior analysis. The purpose of this study is to evaluate the social validity and efficacy of this new PT on eighteen parents who have a child with ASD and developmental delay. For 16 parents, the PT was considered effective, the objectives targeted important and the strategies learned acceptable for use with children. They have significantly improved their knowledge in ASD and behavioral intervention strategies and their children's socialization skills, and reduce their parental stress. This new French PT program seems to be a promising intervention.     

Effects of Situational Judgment Test Format on Reliability and Validity

Single-response situational judgment tests (SRSJTs) differ from multiple-response SJTs (MRSJTS) in that they present test takers with edited critical incidents and simply ask test takers to read over the action described and evaluate it according to its effectiveness. Research comparing the reliability and validity of SRSJTs and MRSJTs is thus far extremely limited. The study reported here directly compares forms of a SRSJT and MRSJT and explores the reliability, convergent validity, and predictive validity of each format. Results from this investigation present preliminary evidence to suggest SRSJTs may produce internal consistency reliability, convergent validity, and predictive validity estimates that are comparable to those achieved with many traditional MRSJTs. We conclude by discussing practical implications for personnel selection and assessment, and future research in psychological science more broadly.     

Response Time Based Nonparametric Kullback-Leibler Divergence Measure for Detecting Aberrant Test-Taking Behavior

Many important high-stakes decisions—college admission, academic performance evaluation, and even job promotion—depend on accurate and reliable scores from valid large-scale assessments. However, examinees sometimes cheat by copying answers from other test-takers or practicing with test items ahead of time, which can undermine the effectiveness of such assessments in yielding accurate, precise information of examinees' performances. This study focuses on the utility of a new nonparametric person-fit index using examinees' response times to detect two types of cheating behaviors. The feasibility of this method was investigated vis-à-vis a Monte Carlo simulation as well as through analyzing data from a large-scale assessment. Findings indicate that the proposed index was quite successful in detecting pre-knowledge cheating and extreme one-item cheating.     

Social cognitive predictors of academic persistence and performance in engineering: Applicability across gender and race/ethnicity

We examined the utility of social cognitive variables in the longitudinal prediction of academic persistence and success of engineering students. The participants, 908 students enrolled in engineering majors at two state universities, completed measures of academic support, self-efficacy, outcome expectations, interests, satisfaction, positive affect, and intended persistence at the end of each of their first four semesters. In the current study, students' first and second semester responses were used to predict persistence and grade performance in engineering by the end of six semesters. Path analytic findings indicated that second-semester persistence intentions, satisfaction with the major, self-efficacy, and social support each produced direct paths to persistence. Objective ability (mathematics SAT scores), outcome expectations, and interests were linked to persistence indirectly via their relations to other variables in the model. In addition, self-efficacy and objective ability jointly predicted grade performance. Results were stable across gender and racial/ethnic groups. Implications for research and practice on academic adjustment in engineering are considered.     

Testing for negligible interaction: A coherent and robust approach

Researchers often want to demonstrate a lack of interaction between two categorical predictors on an outcome. To justify a lack of interaction, researchers typically accept the null hypothesis of no interaction from a conventional analysis of variance (ANOVA). This method is inappropriate as failure to reject the null hypothesis does not provide statistical evidence to support a lack of interaction. This study proposes a bootstrap‐based intersection–union test for negligible interaction that provides coherent decisions between the omnibus test and post hoc interaction contrast tests and is robust to violations of the normality and variance homogeneity assumptions. Further, a multiple comparison strategy for testing interaction contrasts following a non‐significant omnibus test is proposed. Our simulation study compared the Type I error control, omnibus power and per‐contrast power of the proposed approach to the non‐centrality‐based negligible interaction test of Cheng and Shao (2007, Statistica Sinica, 17, 1441). For 2 × 2 designs, the empirical Type I error rates of the Cheng and Shao test were very close to the nominal α level when the normality and variance homogeneity assumptions were satisfied; however, only our proposed bootstrapping approach was satisfactory under non‐normality and/or variance heterogeneity. In general a × b designs, although the omnibus Cheng and Shao test, as expected, is the most powerful, it is not robust to assumption violation and results in incoherent omnibus and interaction contrast decisions that are not possible with the intersection–union approach.     

Construct validity of the Self-Compassion Scale-Short Form among psychotherapy clients

Interest has been growing in the mental health benefits of self-compassion. Whereas, most research on this topic has been conducted with the 26-item Self-Compassion Scale (SCS), a briefer 12-item version of the instrument, the Self-Compassion Scale-Short Form (SCS-SF), also exists. The SCS-SF has demonstrated good validity and reliability in non-clinical samples, but it has not been used often in research with psychotherapy clients. This study was designed to examine the factor structure and construct validity of the SCS-SF in a clinical population. Data for this study were collected from 1609 college students receiving services at 10 campus counseling centers. The previously proposed factor structure of the SCS-SF was not supported. Instead, analyses revealed two factors, Self Care and Self Disparagement. Evidence for the construct validity of these factors was found via expected relationships with indices of depression, anxiety, social anxiety, hostility, academic distress, eating concerns, family distress, maladaptive perfectionism, suicidality, self-injurious behavior, and social support. SCS-SF scores were unrelated to various measures of substance use. Implications for clinical work and future research are discussed.     

Assessment of acquired capability for suicide in clinical practice

The Interpersonal Psychological Theory of suicide proposes that the interaction between Thwarted Belongingness, Perceived Burdensomeness, and Acquired Capability for Suicide (ACS) predicts proximal risk of death by suicide. Instruments to assess all three constructs are available. However, research on the validity of one of them, the acquired capability for suicide scale (ACSS), has been limited, especially in terms of its clinical relevance. This study aimed to explore the utility of the different versions of the ACSS in clinical assessment. Three versions of the scale were investigated, the full 20-item version, a 7-item version and a single item version representing self-perceived capability for suicide. In a sample of patients recruited from a clinic specialising in the treatment of suicidality and in a community sample, all versions of the ACSS were found to show reasonable levels of reliability and to correlate as expected with reports of suicidal ideation, self-harm, and attempted suicide. The item assessing self-perceived acquired capacity for suicide showed highest correlations with all levels of suicidal behaviour. However, no version of the ACSS on its own showed a capacity to indicate suicide attempts in the combined sample. It is concluded that the versions of the scale have construct validity, but their clinical utility is limited. An assessment using a single item on self-perceived ACS outperforms the full and shortened versions of ACSS in clinical settings and can be recommended with caution for clinicians interested in assessing this characteristic.