An exploration of the interrater agreement of visual analysis with and without context

Visual analysis is integral to the analysis of single-case experimental design (SCED) data. Previous studies have shown that many factors may influence the interrater agreement (IRA) of visual analysis. One factor that has received little direct attention is the impact of contextual information. In the current study, authors of recently published SCED studies were asked to make judgments regarding functional relations based on published datasets that met criteria for design quality. Respondents were randomly assigned to view graphs with or without contextual information and the degree of interrater agreement was compared. Results revealed that contextual information had no impact on IRA for decisions of a functional relation. IRA was high across both groups for 6 of the 7 datasets examined. Implications and recommendations based on these results are discussed.     

Family Emotional Climate and Sibling Relationship Quality: Influences on Behavioral Problems and Adaptation in Preschool-Aged Children

We examined the impact of family emotional climate and sibling relationship quality on behavioral problems and adaptation in preschool-aged children. Participants were 63 mothers with a preschool-aged child enrolled in a Southern Arizona Head Start Program. Siblings were identified as children closest in age to target child. Mothers of predominantly Mexican descent (95%) participated in home interviews during the Fall and Spring of the year children entered center-based programs. Sibling relationship quality (warmth, agonism/competition) was proposed to predict children’s adjustment (behavioral problems and adaptation) longitudinally. Results indicate that after controlling for child characteristics (temperament, child gender, birth order) and after accounting for family characteristics (family emotional expressiveness, child exposure to interparental conflict, and parental agreement on childrearing), sibling warmth made a significant and unique contribution to child adjustment as reported by mothers and teachers six months later. Findings are consistent with existing research indicating that sibling relationships impact children’s adjustment and shape young children’s lives in meaningful and marked ways. Moreover, these associations were found with an understudied sample of young children of predominantly Mexican descent in low-income families, and thus make an important contribution to knowledge in the field.     

评分者内部一致性的研究和应用

在行为科学的研究和实践中,研究者常常需要将个体层次的评价,整合到群体层次的评价,对于这种自下而上整合模式的一致性问题,国内一些学者常常错误地使用评分者内部信度作为评分者内部一致性的指标。评分者内部一致性和评分者内部信度不仅在理论基础上存在差异,而且在实践中也存在前者很高(或很低),而后者却很低(或很高)的不一致情况。文章阐述了学术界对评分一致性这一问题的提出、争论和取得一致观点的发展脉络,以期学者们对这一问题能够有深入的思索,避免在今后的研究中出现类似的错误。     

Agreement of adolescent ratings with mother ratings and teacher ratings of ADHD symptom groups: A correlated trait-correlated method minus one analysis

This study examined the level of agreement of adolescent ratings with mother ratings, and adolescent ratings with teacher ratings of the inattention (IA) and hyperactivity/impulsivity (HI) symptom groups of ADHD. A total of 214 adolescents provided self-ratings of IA and HI, and their IA and HI were also rated by their mothers and teachers. The correlated trait-correlated method minus one model was applied, with adolescent ratings as the reference method, and the other two ratings as the non-reference methods. The findings indicated no additional variance in adolescent ratings for IA and HI that could not be accounted by mother ratings of IA and HI, respectively. In contrast, there was additional variance in adolescent ratings for IA and HI that could was not accounted by teacher ratings of IA and HI, respectively. The findings suggest that when diagnosing ADHD in adolescents, their reports of their own ADHD behaviors are not needed when mother reports of such behaviors are used.     

Agreement between Parents and Children on Ratings of Post-Concussive Symptoms Following Mild Traumatic Brain Injury

The level of parent-child agreement on post-concussive symptoms (PCS) was examined in children following mild traumatic brain injuries (TBI). As part of a larger longitudinal study, 186 children with mild TBI and 99 with orthopedic injuries (OI), from 8 to 15 years of age, were recruited prospectively. Parents and children completed the PCS Interview (PCS-I) and the Health and Behavior Inventory (HBI) at 2 weeks, 1 month, 3 months, and 12 months postinjury. Item-level correlations between child and parent ratings on both measures of PCS were significant but modest in both groups. Parent-child correlations for composite scales on the HBI and the total score on the PCS-I were significant in both groups, but somewhat higher in the OI group than in the mild TBI group. Mean symptom ratings tended to be significantly higher for children as compared to parents, especially for somatic symptoms. Parents and children display modest agreement when reporting PCS; their ratings correlate significantly, but children report higher mean levels of symptoms than parents.     

Processing biological gender and number information during Chinese pronoun resolution: ERP evidence for functional differentiation

There have been a number of behavioral and neural studies on the processing of syntactic gender and number agreement information, marked by different morpho-syntactic features during sentence comprehension. By using the event-related potential (ERP) technique, the present study investigated whether the processing of semantic gender information and the processing of notional number information can be differentiated and to what extent they might interact during Chinese pronoun resolution. The pronoun (with singular form in Experiment 1 and with plural form in Experiment 2) in a sentence matched its antecedent or mismatched it with respect to either biological gender or notional number or both. While the number mismatch elicited a P600 effect starting from 550 ms (for singular pronoun) or 400 ms (for plural pronoun) post-onset of the pronoun, the gender mismatch elicited an earlier (for singular) and larger (for both singular and plural) P600 effect. More importantly, the double mismatch produced a P600 effect identical to the effect elicited by the single gender mismatch. These results demonstrate that biological gender information and notional number information are processed differentially and have different processing priorities during Chinese pronoun resolution.     

Observer memories may not be for everyone

ABSTRACT

Six studies explored the preponderance of people who experience third-person perspective observer memories during autobiographical memory retrieval. The concept of first-person field versus observer memories has been extensively used in the areas of cognitive, social, and clinical psychology. An implicit assumption is the idea that most people use both of these perspectives. What varies are the circumstances that bias people to use one perspective over another for a given autobiographical memory. We challenge that assumption across six studies by showing that, while there are some people who report to regularly have observer memories, there are also those that report to rarely or never have them. These reports were found to be related to levels of reported dissociative experiences. We discuss how this difference in the experience of observer memories may also reflect other innate characteristics, and may correspond to predispositions for various pathologies, including depression, social phobia, and post-traumatic stress disorder.