An exploration of the interrater agreement of visual analysis with and without context

Visual analysis is integral to the analysis of single-case experimental design (SCED) data. Previous studies have shown that many factors may influence the interrater agreement (IRA) of visual analysis. One factor that has received little direct attention is the impact of contextual information. In the current study, authors of recently published SCED studies were asked to make judgments regarding functional relations based on published datasets that met criteria for design quality. Respondents were randomly assigned to view graphs with or without contextual information and the degree of interrater agreement was compared. Results revealed that contextual information had no impact on IRA for decisions of a functional relation. IRA was high across both groups for 6 of the 7 datasets examined. Implications and recommendations based on these results are discussed.     

The Scale for Assessing Emotional Disturbance: Concurrent Validity

The Scale for Assessing Emotional Disturbance (SAED) is a standardized, norm-referenced measure designed to operationalize the federal definition of Emotional Disturbance. It has demonstrated content validity and reliability. The two studies reported here address the SAED's concurrent validity. Samples in each study consisted of students identified with Emotional Disturbance. In both studies, special education teachers rated students on the SAED and a second measure of children's emotional and behavior problems. In the first study the SAED was compared to the Revised Behavior Problem Checklist. Correlations were generally moderate to high for similar subscales and low for dissimilar subscales. In the second study, the SAED was compared to the Teacher Report Form. Again, correlations generally were as expected and compatible with results of the first study. Results indicate that the SAED emotional and behavior problem subscales measure constructs akin to emotional and behavior problems measured by similar collections of item on the Revised Behavior Problem Checklist and Teacher Report Form. Implications of results and recommendations for use of the SAED are discussed.     

HSK主观考试评分的Rasch实验分析

主观评分中存在的不一致性导致主观评分的信度降低。多面Rasch模型基于项目反应理论,可以应用于评分员效应的识别和消除,从而提高主观评分的信度。该文介绍多面Rasch模型的理论和应用框架,设计了基于该模型的HSK主观考试评分质量控制应用框架,利用HSK作文评分数据进行了实验验证。     

Family Emotional Climate and Sibling Relationship Quality: Influences on Behavioral Problems and Adaptation in Preschool-Aged Children

We examined the impact of family emotional climate and sibling relationship quality on behavioral problems and adaptation in preschool-aged children. Participants were 63 mothers with a preschool-aged child enrolled in a Southern Arizona Head Start Program. Siblings were identified as children closest in age to target child. Mothers of predominantly Mexican descent (95%) participated in home interviews during the Fall and Spring of the year children entered center-based programs. Sibling relationship quality (warmth, agonism/competition) was proposed to predict children’s adjustment (behavioral problems and adaptation) longitudinally. Results indicate that after controlling for child characteristics (temperament, child gender, birth order) and after accounting for family characteristics (family emotional expressiveness, child exposure to interparental conflict, and parental agreement on childrearing), sibling warmth made a significant and unique contribution to child adjustment as reported by mothers and teachers six months later. Findings are consistent with existing research indicating that sibling relationships impact children’s adjustment and shape young children’s lives in meaningful and marked ways. Moreover, these associations were found with an understudied sample of young children of predominantly Mexican descent in low-income families, and thus make an important contribution to knowledge in the field.     

The relationship between cognitive errors,coping strategies,and clients' experiences in session: An exploratory study

Aim: Cognitive errors (CE) and coping strategies (CS) can bear weight on how individuals relate to others and perceive interpersonal relationships. However, there is little research into how clients' erroneous beliefs and maladaptive coping strategies can interfere with the therapeutic process. This study utilised a sample of healthy clients to explore the relationship between their CEs and CSs and their evaluation of therapy. Method: Therapy sessions of undergraduate student clients (N =26) were rated using the Cognitive Error Rating Scale (CERS – 3rd edition), the Coping Patterns Rating Scale (CPRS;), the Session Evaluation Questionnaire (SEQ) and the Session Impact Scale (SIS). Results: Clients who engaged in dichotomous thinking endorsed problem solving less and were more likely to feel unsupported and misunderstood by the therapist. Clients who discounted the positive tended to feel more pressured and judged by therapists. Conversely, those who engaged in problem solving were more likely to find sessions deeper and more valuable as compared to those who reacted to stressful events by submission, escape, or opposition. Implications: Better understanding how and when a client's cognitive errors and coping mechanisms are at play during therapy can help clinicians to address them and intervene appropriately.     

新手考官的工作记忆和人格对其评分有效性的影响——以无领导小组讨论为例

相对于其它评价中心技术而言,在无领导小组讨论中考官因素对评分结果的影响尤为重要.本研究主要探讨无领导小组讨论中新手考官的工作记忆与人格对其评分有效性的影响.结果发现,首先,新手考官的评分者一致性较低,评分准确度较差.其次,工作记忆和人格的部分因素分别从不同方面影响新手考官的评分有效性,具体表现在：（1）利他性越强,新手考官评分总均值的准确性越高,且评分结果越宽松;（2）新手考官的决断性越强,对所有应聘者做出有效区分的准确性越高;（3）新手考官的沉稳性越高,对各维度的区分越有效;（4）注意转换和抑制能力对新手考官的晕轮效应及其在各个维度上进行区分的准确度有抑制作用.     

Agreement of adolescent ratings with mother ratings and teacher ratings of ADHD symptom groups: A correlated trait-correlated method minus one analysis

This study examined the level of agreement of adolescent ratings with mother ratings, and adolescent ratings with teacher ratings of the inattention (IA) and hyperactivity/impulsivity (HI) symptom groups of ADHD. A total of 214 adolescents provided self-ratings of IA and HI, and their IA and HI were also rated by their mothers and teachers. The correlated trait-correlated method minus one model was applied, with adolescent ratings as the reference method, and the other two ratings as the non-reference methods. The findings indicated no additional variance in adolescent ratings for IA and HI that could not be accounted by mother ratings of IA and HI, respectively. In contrast, there was additional variance in adolescent ratings for IA and HI that could was not accounted by teacher ratings of IA and HI, respectively. The findings suggest that when diagnosing ADHD in adolescents, their reports of their own ADHD behaviors are not needed when mother reports of such behaviors are used.     

影响动作图片命名的因素

图片是研究词汇习得与加工的重要材料, 而名词和动词是最主要的两类实词。然而, 目前较少有研究考察汉语中的动词加工过程, 也没有标准化的动词图片库。本研究通过成人图片命名和评定任务, 获得了265张动词图片的中文名称、命名反应时, 以及H值、命名一致性、熟悉性、视觉复杂性、表象一致性和口语习得年龄等指标, 同时也探索了影响动作图片命名反应时的因素。逐步回归分析结果发现, H值、熟悉性和视觉复杂性这三个变量可解释动词图片命名反应时72.4%的变异。此外, 本研究根据图片命名反应时将动词图片加工难度分成了五个等级。研究发现, 与名词图片相比, 动词图片的视觉复杂性更高、命名一致性更低、命名反应时更长。本研究获得的各项心理语言学指标有望为后续关于动词加工的实验研究提供重要的参考资料。     

Further evidence of the invalidity of the magnitude estimation method

IntroductionThe magnitude estimation method is widely applied in diverse areas of psychology. However, Weiss (1972) found that this method may produce judgments that inaccurately represent subjective magnitudes: constructing the stimuli according to a factorial design allowed the bias caused by magnitude estimation to be exposed as a spurious divergence of factorial curves.ObjectiveThe present study experimentally compared magnitude estimation with graphic rating and ratio estimation. The comparison of magnitude estimation with graphic rating retested Weiss's finding. The comparison of magnitude estimation with ratio estimation explored the hypothesis that magnitude estimation may cause a divergence of factorial curves due to the requirement of magnitude estimation to multiply and divide numbers—both ratio estimation and magnitude estimation required participants to judge ratios, but only magnitude estimation required mental multiplication and division.MethodUsing a 3 × 4 factorial experimental design, an achromatic disk was presented concentrically with a larger achromatic square. The brightness of the disk varied with the luminance of the disk and, due to simultaneous contrast, with the luminance of the square. Three different groups of participants judged the brightness of the disk: one group by graphic rating, another by ratio estimation, and the third by magnitude estimation.ResultsIn accord with Weiss's results, graphic rating yielded roughly parallel factorial curves whereas magnitude estimation yielded diverging factorial curves. Ratio estimation also yielded roughly parallel factorial curves, supporting the hypothesis that the magnitude estimation task itself may cause divergence of factorial curves due to the requirement of this method to mentally multiply and divide numbers.ConclusionCaution should be taken in using magnitude estimation, especially in factorial experiments, because this method is likely to cause the researcher to make incorrect inferences about the functional relations between the variables involved in mental information integration. Ratio estimation yields a pattern of factorial curves essentially equivalent to that obtained by graphic rating.