Considerations in the choice of interobserver reliability estimates

Two types of interobserver reliability values may be needed in treatment studies in which observers constitute the primary data-acquisition system: trial reliability and the reliability of the composite unit or score which is subsequently analyzed, e.g., daily or weekly session totals. Two approaches to determining interobserver reliability are described: percentage agreement and "correlational" measures of reliability. The interpretation of these estimates, factors affecting their magnitude, and the advantages and limitations of each approach are presented.     

Comparing Chinese youth with American youth on adjustment: An illustration of measurement issues in cross-cultural research

In this article, we used results from two studies to show the need to go beyond linguistic equivalence to establish construct validity and measurement invariance in cross-cultural research. Study 1 examined Rosenberg Self-Esteem (RSE; 10 items) data from 156 Mainland Chinese youth (M = 13.8 years, SD = .53) and 213 Chinese-American youth (M = 13.6 years, SD = 2.1) from high socioeconomic status (SES) families. The Chinese translation of the RSE has been widely used. Study 2 included 1060 Mainland Chinese youth (M = 15.6 years, SD = 2.3) and 412 racially diverse American youth (M = 16.0, SD = 2.9) from all SES backgrounds. Data were collected with the third and newest edition of the Behavioural Assessment System for Children-Self Report of Personality (BASC-3-SRP; 189 items). We translated and back-translated the BASC-3-SRP between English and Chinese to establish linguistic equivalence. All participants were females. Study 1 showed that the RSE had acceptable internal consistency but lacked construct validity. Study 2 showed that the original and the translated BASC-3-SRP had good internal consistency and construct validity, but nine of its 16 subscales lacked measurement invariance. These results highlight measurement issues facing international and cross-cultural research.     

Functional communication training: From efficacy to effectiveness

Functional communication training (FCT; Carr & Durand, 1985) is a common function‐based treatment in which an alternative form of communication is taught to reduce problem behavior. FCT has been shown to result in substantial reductions of a variety of topographically and functionally different types of problem behavior in children and adults (efficacy). The extent to which these reductions maintain in relevant contexts and result in meaningful changes in the lives of those impacted (effectiveness) is the focus of this paper. This review evaluates the degree to which FCT has been established as an evidence‐based practice in psychology (EBPP) according to the definition set out by the American Psychological Association's 2005 Presidential Task Force on Evidence‐Based Practice. Our review finds overwhelming evidence in support of FCT as an efficacious treatment but highlights significant limitations in support of its effectiveness. In order to also be recognized as an EBPP, future research on FCT will need to focus more closely on issues related to home, school, and community application, feasibility, consumer satisfaction, and more general and global changes for the individual.     

校园霸凌行为问卷的编制

目的:从贵州省青少年校园霸凌行为的实际出发,以大样本为基础,遵循心理测量学的方法编制《校园霸凌行为问卷》。方法:经理论建模、题库建设编制初测问卷,以3923名学生为被试进行项目分析和探索性因子分析; 以3899名被试进行信度检验及验证性因子分析,形成最终问卷。结果:问卷由7个一阶因子和2个二阶因子组成,共40个题项。问卷及各维度的内部一致性系数在0.7～0.927之间,重测信度在0.291～0.49之间,结构效度良好,与OBVQ-V和MBVS的相关分别为0.646和0.726。结论:本研究探索、发现并整合创新了反映当代校园霸凌治理难点的“恶整霸凌”; 问卷信效度良好,可作为国内青少年校园霸凌行为的有效测量工具。     

矛盾年龄偏见量表在中国大学生群体中的修订及信效度检验

目的：修订矛盾年龄偏见量表(the Ambivalent Ageism Scale, AAS),并在中国大学生群体中进行信、效度检验。方法：对1182名大学生施测AAS中文翻译版,探索并验证其因子结构,分析信、效度和测量等值性。其中347人还完成老化知识量表(FAQ)和容纳他人量表(AOS),用以检验AAS中文版的校标关联效度。另有74人在4周后重测AAS中文版。结果：AAS中文修订版包含认知帮助/保护、不想要的帮助和敌意年龄偏见三因子,总量表和各维度的Cronbach’s α系数依次为0.83、0.80、0.85、0.76,重测信度依次为0.78、0.62、0.78、0.71。AAS中文修订版及各维度与FAQ和AOS负相关(r=-0.23～-0.48,ps<0.001)。验证因素分析表明AAS中文修订版的拟合良好(χ²/df=3.51,CFI=0.96,TLI=0.94,RMSEA=0.07,SRMR=0.05)。且该量表跨性别形态、弱等值、部分强等值和部分严格测量等值成立。结论：修订后的矛盾年龄偏见量表(AAS)中文版的信、效度良好,具备跨性别的测量部分...     

The Croatian version of the Emotion Regulation Questionnaire: Links with higher- and lower-level personality traits and mood

The Emotion Regulation Questionnaire (ERQ) measures habitual use of two emotion regulation strategies, cognitive reappraisal and expressive suppression. The present study tested the psychometric properties and validity of a newly developed Croatian adaptation of the ERQ. In a sample of 347 participants, we first sought to confirm the ERQ's original factor structure. Next, we tested its convergent, divergent and incremental validity. In the first subsample (N = 140), we linked the ERQ with a measure of the Five-Factor Model dimensions and their facets (Revised NEO Personality Inventory). In the second subsample (N = 207), we tested its ability to predict personality dimensions assessed by a different measure (Big Five Inventory) as well as the traits of positive and negative affect, including its incremental validity in predicting the latter. The results corroborated earlier findings, showing that the Croatian ERQ has equivalent psychometrics and predictive validity as ERQs in other languages. Crucially, the observed links between the ERQ and the facets of the Five-Factor Model dimensions enrich our understanding of the personality mechanisms behind the employment of these emotion regulation strategies.     

Evaluation of a finger prompt variation in the treatment of pediatric feeding disorders

Children with feeding disorders often engage in refusal behavior to escape or avoid eating. Escape extinction combined with reinforcement is a well-established intervention to treat food refusal. Physical guidance procedures (e.g., jaw prompt, finger prompt) have been shown to increase food acceptance and decrease inappropriate mealtime behavior when more commonly employed escape extinction (e.g., nonremoval of the spoon) procedures are ineffective. The finger prompt, however, has not been extensively evaluated as a treatment adjunct to target food refusal, thus necessitating further examination. The purpose of this prospective study was to assess a variation of a finger prompt procedure to treat food refusal and to assess caregivers' acceptability of the procedure. Three children age 1 to 4 years admitted to an intensive feeding disorders program and their caregivers participated. The finger prompt was effective in increasing bite acceptance across all participants and decreasing or maintaining low levels of inappropriate behavior for 2 participants. The procedure was also acceptable to all caregivers.     

Psychometric and Validity Issues in Machine Learning Approaches to Personality Assessment: A Focus on Social Media Text Mining

In the age of big data, substantial research is now moving toward using digital footprints like social media text data to assess personality. Nevertheless, there are concerns and questions regarding the psychometric and validity evidence of such approaches. We seek to address this issue by focusing on social media text data and (i) conducting a review of psychometric validation efforts in social media text mining (SMTM) for personality assessment and discussing additional work that needs to be done; (ii) considering additional validity issues from the standpoint of reference (i.e. ‘ground truth’) and causality (i.e. how personality determines variations in scores derived from SMTM); and (iii) discussing the unique issues of generalizability when validating SMTM for personality assessment across different social media platforms and populations. In doing so, we explicate the key validity and validation issues that need to be considered as a field to advance SMTM for personality assessment, and, more generally, machine learning personality assessment methods. © 2020 European Association of Personality Psychology