Psychometric Evaluation of 5- and 7-Year-Old Children's Self-Reports of Conduct Problems

Past research suggests that young children are incapable of reporting information about their own behavior problems. To test this, we examined the validity and the usefulness of children's self-reports in the E-Risk Study, a nationally representative birth cohort of 2,232 children. We used the Berkeley Puppet Interview to obtain children's self-reports of conduct problems when they were 5-years old and the Dominic-R when they were 7-years old. We also collected information about the children and their families by interviewing mothers, sending questionnaires to teachers, and rating examiners' observations during home visits. Results indicate that when children's self-reports are gathered with structured and developmentally appropriate instruments, they are shown to be valid measures: conduct problems reported by the children themselves were associated with known correlates including individual characteristics (e.g., IQ), related behaviors (e.g., hyperactivity), and family variables (e.g., economic disadvantages). Observed correlations closely matched effect sizes reported in the literature using adults' reports of children's behavioral problems. In addition, children's self-reports can be useful: both measures distinguished children meeting DSM-IV criteria for research diagnoses of conduct disorder. Children's reports also contributed unique information not provided by adults. For research and clinical purposes, young children's self-reports can be viewed as a valuable complement to adults' ratings and observational measures of children's behavior problems.     

Validating self-reported compliance with COVID-19 regulations: Demonstrating group-level sociodemographic self-reported compliance that mirrors actual morbidity rates

Using a novel approach, in this work, we establish an association between self-reported compliance with COVID-19 preventive behaviors and fear of the virus with morbidity rates (i.e., actual tests and their outcome). In two nationally representative samples that were collected in Israel during the first (April 2020: N = 507) and second (August 2020: N = 515) waves of the COVID-19 pandemic, participants responded to items assessing their compliance with the COVID-19 preventive behaviors and their fear of contracting the virus. Participants' compliance and fear self-reports served as a proxy for morbidity rates. Specifically, we assessed the association between sociodemographic variables (gender, age, or belonging to a minority group), self-reports, and morbidity rates (as reported in publicly open databases of the Israeli health ministry). We found that self-reports of compliance and fear were mirrored and aligned with actual morbidity rates across sociodemographic variables and studies. By establishing a clear connection between specific behavior (i.e., compliance with covid regulations) and emotion (i.e., fear of getting infected by the virus), self-reports and sociodemographic variables represent a real related phenomena (i.e., covid 19 morbidity rates), our findings overall validate numerous studies that used self-reports to assess compliance with COVID-19 preventive behaviors.     

Incremental validity of spouse ratings versus self-reports of personality as predictors of marital quality and behavior during marital conflict

The personality traits of neuroticism and agreeableness are consistently related to marital quality, influencing the individual's own (i.e., actor effect) and the spouse's marital quality (i.e., partner effect). However, this research has almost exclusively relied on self-reports of personality, despite the fact that spouse ratings have been found to have incremental validity over self-reports for a variety of other important outcomes. In a study of 300 middle-aged and older married couples, we examined the incremental validity of spouse ratings of neuroticism and agreeableness in predicting concurrent levels of self-reported marital quality, observations of behavior during a marital disagreement task, and depressive symptoms. Neuroticism and agreeableness had expected actor and partner effects on each of these outcomes. Spouse ratings of these traits demonstrated incremental validity in estimates of actor and partner effects on marital quality, marital behavior, and depressive symptoms. Results suggest that spouse ratings of personality may be important additions to the typical reliance on self-reports for research and clinical assessment in marriage.     

Assessment of children's social skills: A review of methods

Social skills of children is a topic receiving increasing attention, particularly from clinical researchers. The present paper reviews methods that have been used to assess children's social skills. Four methods are identified and described: sociometric instruments, behavioral observations, teacher reports, and child self-reports. Their relationships to one another are examined in terms of predictive, concurrent, and construct validity. It appears that the social skills construct is in need of basic development if it is to have any clinical utility. It is suggested that future research utilize knowledge from fields closely related to clinical psychology (e.g., developmental and social psychology) and methods of assessment from traditional test theory.     

What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research

We believe that journal reviewers (as well as editors and dissertation or thesis committee members) have to some extent perpetuated misconceptions about common method bias in self-report measures, including (a) that relationships between self-reported variables are necessarily and routinely upwardly biased, (b) other-reports (or other methods) are superior to self-reports, and (c) rating sources (e.g., self, other) constitute measurement methods. We argue against these misconceptions and make recommendations for what reviewers (and others) should reasonably expect from authors regarding common method bias. We believe it is reasonable to expect (a) an argument for why self-reports are appropriate, (b) construct validity evidence, (c) lack of overlap in items for different constructs, and (d) evidence that authors took proactive design steps to mitigate threats of method effects. We specifically do not recommend post hoc statistical control strategies; while some statistical strategies are promising, all have significant drawbacks and some have shown poor empirical results.     

Discussion of Symposium on Current Research Applications of Rorschach Derived Concepts

In this investigation, we examined the validity of Levenson's Self-Report Psychopathy Scale (LSRP; Levenson, Kiehl, &; Fitzpatrick, 1995) in a sample of undergraduate students (n = 403). Utilizing a step-down hierarchical multiple regression procedure (e.g., Arbisi, Ben-Porath, &; McNulty, 2002), we used LSRP scores to predict psychopathic personality traits to determine the presence of gender-moderated test bias. Results indicate similar correlational magnitudes for men and women. However, systematic over- and underprediction of scores (i.e., differential intercepts) was found for external criteria measuring key affective (i.e., low empathy) and behavioral (i.e., aggression, antisocial behavior) components of the psychopathic personality, although these effects were generally small.     

Screening for trauma in children and adolescents: the validity of the Traumatic Stress Disorder Scale of the screen for child anxiety related emotional disorders

Examined the validity of the Traumatic Stress Disorder scale of the Screen for Child Anxiety Related Emotional Disorders (SCARED), a recently developed self-report questionnaire measuring Diagnostic and Statistical Manual of Mental Disorders (4th ed. [DSM-IV]; American Psychiatric Association, 1994) defined anxiety disorders symptoms in children. A large sample of normal schoolchildren (N = 996) ages 7 to 19 years completed the SCARED. Children who scored high on the SCARED Traumatic Stress Disorder scale (i.e., trauma group; n = 43) and children who scored low on this scale (i.e., control group; n = 43) were then interviewed about their most aversive life event. In addition, children completed self-report questionnaires of traumatic experiences and posttraumatic stress disorder (PTSD) symptomatology. Results showed that children in the trauma group more frequently reported life events that independent judges considered to be 'potentially traumatic' than did control children. Furthermore, children in the trauma group reported having experienced more traumatic incidents and had higher scores on PTSD-related questionnaires compared with control children. Moreover, trauma group children more frequently fulfilled DSM-IV criteria for PTSD than did control children. The results of this study support the validity of the Traumatic Stress Disorder scale of the SCARED.     

Informant reports: A cheap,fast, and easy method for personality assessment

Despite widespread agreement that multi-method assessments are optimal in personality research, the literature is dominated by a single method: self-reports. This pattern seems to be based, at least in part, on widely held preconceptions about the costs of non-self-report methods, such as informant methods. Researchers seem to believe that informant methods are: (a) time-consuming, (b) expensive, (c) ineffective (i.e., informants will not cooperate), and (d) particularly vulnerable to faking or invalid responses. This article evaluates the validity of these preconceptions in light of recent advances in Internet technology, and proposes some strategies for making informant methods more effective. Drawing on data from three separate studies, I demonstrate that, using these strategies, informant reports can be collected with minimal effort and few monetary costs. In addition, informants are generally very willing to cooperate (e.g., response rates of 76–95%) and provide valid data (in terms of strong consensus and self-other agreement). Informant reports represent a mostly untapped resource that researchers can use to improve the validity of personality assessments and to address new questions that cannot be examined with self-reports alone.     

The Children’s Yale-Brown Obsessive Compulsive Scale: Reliability and Validity for Use Among 5 to 8 Year Olds with Obsessive-Compulsive Disorder

The Children’s Yale-Brown Obsessive Compulsive Scale (CY-BOCS) is the instrument of choice for assessing symptom severity in older children (i.e., 8–18 years) diagnosed with obsessive-compulsive disorder (OCD). The reliability and validity of this measure for use among younger children (i.e., 5–8 years of age), however, has never been examined. The primary aim of this study was to examine this scale’s use among those presenting with early childhood OCD. Forty-two children with OCD between the ages of 4 and 8 years of age were recruited as part of a larger treatment outcome study, and the reliability and validity of the CY-BOCS was examined. Results revealed questionable reliability for the measure’s 5-item Obsessions subscale but good reliability (i.e., internal consistency, temporal stability) for the 5-item Compulsions subscale and 10-item total scale. Results also revealed that the CY-BOCS total scale demonstrated mixed discriminant validity but strong convergent validity and sensitive to change. Collectively, the 10-item, CY-BOCS total score yields a reliable and valid scale for the assessment of symptom severity in early childhood OCD. However, we urge caution in use of the Obsessions subscale in isolation for either clinical or research purposes. Limitations and future areas of research are discussed including the potential benefit of developing a measure of OCD-related symptom severity specifically for younger children with greater attention to developmental differences among children within this population.     

Children's self-reported coping strategies: The role of defensiveness and repressive adaptation

Abstract

This study examined differences in self-reported coping strategies across children classified according to Weinberger et al.'s (1979) adaptive style paradigm. Consistent with the larger literature, it was hypothesized that repressors (i.e. characterized by high self-reported defensiveness and low self-reported distress) would endorse fewer behaviorally and cognitively avoidant coping strategies than other adaptive style groups. Participants included 134 children, ranging in age from 10 to 13 (M=11.26, sd=.59), who completed measures of defensiveness, trait anxiety, and coping. Consistent with the hypotheses, results indicated significantly lower endorsement of avoidant coping strategies, and significantly higher endorsement of approach-oriented strategies among repressors, but no significant differences across adaptive style groups for other forms of coping. Results indicate that, consistent with other indicators of psychological functioning, the measurement of coping strategies is subject to the effects of socially desirable responding. Further, results provide evidence that measures of coping may be contaminated by items reflecting adjustment problems.     

Solutions to the problems of incremental validity testing in relationship science

Incremental validity testing (i.e., testing whether a focal predictor is associated with an outcome above and beyond a covariate) is common (e.g., 57% of Personal Relationships articles in 2017), yet it is fraught with conceptual and statistical problems. First, researchers often use it to overemphasize the novelty or counterintuitiveness of findings, which hinders cumulative understanding. Second, incremental validity testing requires that the focal predictor and the covariate represent separate constructs; researchers risk committing the “jangle fallacy” without such evidence. Third, the most common approach to incremental validity testing (i.e., standard multiple regression, 88% of articles) inflates Type I error and can produce invalid conclusions. This article also discusses the relevance of these issues to dyadic/longitudinal designs and offers concrete solutions.     

Social-Emotional Adjustment and Patterns of Alcohol Use among Young Adults

ABSTRACT Individual differences in social-emotional adjustment, jointly defined by levels of distress and self-restraint, were used to evaluate (a) patterns of alcohol use, (b) reasons for use, and (c) associated problems in two college samples of young adults (N= 287 and N= 215). As hypothesized, low self-restraint was associated with high levels of alcohol use, drinking to increase positive affect, and high levels of alcohol-related problems. Subjective distress was not related to levels of use; however, it was associated with drinking to escape negative moods and social discomfort and with excessive alcohol-related problems. Both high distress and low self-restraint predicted problem drinking beyond what could be accounted for by quantity or frequency of alcohol use or by peers' use. Within Weinberger and Schwartz's (1990) six-group typology, reactive individuals (high distress–low restraint) were especially likely to be problem drinkers, even when compared to groups with equivalent alcohol use. In a separate study, knowledgeable peers' reports validated the differences between reactive and repressive individuals, the two groups most likely to have inaccurate self-reports.     

When Choices Are Not Personal: The Effect of Statistical and Social Cues on Children's Inferences About the Scope of Preferences

Individual choices are commonly taken to manifest personal preferences. The present study investigated whether social and statistical cues influence young children's inferences about the generalizability of preferences. Preschoolers were exposed to either 1 or 2 demonstrators’ selections of objects. The selected objects constituted 18%, 50%, or 100% of all available objects. We found that children took a single demonstrator's choices as indicative only of his or her personal preference. However, when 2 demonstrators made the same selection, then children inferred that it generalized to other agents of the same kind as the original demonstrator's, but not to agents of a different kind. Lastly, only when both demonstrators blatantly violated random selection (i.e., in the 18% condition) did children generalize the preference even to an agent of a different kind. Thus, from a young age, social and statistical cues inform children's naïve sociology.     

Latent self-oriented and socially prescribed perfectionism: Tests of factorial,convergent, and discriminant validity using self- and informant reports

Using latent variables for self-oriented perfectionism (i.e., demanding perfection of oneself) and socially prescribed perfectionism (i.e., perceiving others are demanding perfection of oneself) has advantages. However, few studies have specifically examined the psychometric properties of these latent variables. The present study addresses this shortcoming by testing the factorial, convergent, and discriminant validity of self-oriented and socially prescribed perfectionism latent variables using self- and informant reports. It was hypothesized that (a) the factor structure of the self-oriented and socially prescribed perfectionism latent variables would be supported, (b) self- and informant reports would moderately converge, and (c) the self-oriented and socially prescribed perfectionism latent variables would be discriminable. A sample of 242 undergraduate women and 378 informants (218 mothers, 160 fathers) was recruited. Undergraduate women completed self-reports, and mothers and fathers completed informant reports. Results were consistent with hypotheses, thereby supporting (a) the factorial validity of the self-oriented and socially prescribed latent variables using self- and informant reports, (b) the convergent validity of the self-oriented and socially prescribed latent variables via moderately to strongly correlated self- and informant reports, and (c) the discriminant validity of the self-oriented and socially prescribed perfectionism latent variables. Findings suggest research using these latent variables is warranted.     

The role of effort type and intensity in children's decisions about effort-based outcomes

Despite the importance of persistence in early learning, we know little about how children reason about outcomes that result from their efforts. Here we examined the role of effort type (i.e., physical vs. cognitive) and intensity (i.e., high vs. low effort) in shaping children's decision making about effort-based rewards. Five- to 7-year-olds (N = 133) were assigned to one of four conditions (High Physical Effort, Low Physical Effort, High Cognitive Effort, Low Cognitive Effort) and completed a series of tasks to construct a toy. Tasks varied in the type (physical/cognitive) and intensity (high/low) of effort required to complete them. After constructing their toy, children completed a series of tasks to probe how much they valued that toy. Across conditions, children preferred their toy and gave it a higher monetary value, relative to a stranger's. However, when choosing their toy came at a cost, children no longer preferred it. Only children who built their toy through either cognitive or low effort were willing to incur a cost for their toy. Older children, across conditions, were also more likely to incur a cost for their toy. These findings demonstrate that by age five, children are sensitive to variations in effort type and intensity, and these factors shape how they evaluate effort-based rewards.     

Validity of the Sluggish Cognitive Tempo Symptom Dimension in Children: Sluggish Cognitive Tempo and ADHD-Inattention as Distinct Symptom Dimensions

This study examined the validity of the sluggish cognitive tempo (SCT) symptom dimension in children. Ten symptom domains were used to define SCT (i.e., (1) daydreams; (2) attention fluctuates; (3) absent-minded; (4) loses train of thought; (5) easily confused; (6) seems drowsy; (7) thinking is slow; (8) slow-moving; (9) low initiative; and (10) easily bored, needs stimulation). Teacher ratings of 366 children (ages 5 to 13 with 56 % girls) along with parent ratings of 703 children (ages 5 to 13 with 55 % girls) indicated that SCT symptom domains one to eight showed convergent validity (i.e., substantial loadings on the SCT factor) and discriminant validity with the ADHD-IN dimension (i.e., higher loadings on the SCT factor than the ADHD-IN factor). Higher scores on this eight-symptom measure of SCT predicted lower levels of academic and social competence even after controlling for ADHD-IN and ADHD-HI. In addition, higher SCT scores still predicted higher anxiety/depression scores after controlling for ADHD-IN and ADHD-HI. Higher SCT scores also predicted lower ADHD-HI scores after controlling for ADHD-IN and anxiety/depression while higher ADHD-IN and anxiety/depression scores predicted higher ADHD-HI scores after controlling for SCT and anxiety/depression or ADHD-IN. SCT also showed a unique negative relationship with ODD while ADHD-IN and anxiety/depression showed unique positive relationships with ODD. This new measure of the SCT dimension was meaningfully independent from the ADHD-IN and anxiety/depression dimensions and suggests that such an SCT dimension may signify a distinct presentation of ADHD or a different (if highly comorbid) disorder altogether.     

The persistence of attention-deficit/hyperactivity disorder into young adulthood as a function of reporting source and definition of disorder

This study examined the persistence of attention-deficit/hyperactivity disorder (ADHD) into young adulthood using hyperactive (N = 147) and community control (N = 71) children evaluated at ages 19-25 years. ADHD was rare in both groups (5% vs. 0%) based on self-report but was substantially higher using parent reports (46% vs. 1.4%). Using a developmentally referenced criterion (+2 SD), prevalence remained low for self-reports (12% vs. 10%) but rose further for parent reports (66% vs. 8%). Parent reports were more strongly associated with major life activities than were self-reports. Recollections of childhood ADHD showed moderate correlations with actual parent ratings collected in childd hood, which suggests some validity for such recollections. The authors conclude that previous follow-up studies that relied on self-reports might have substantially underestimated the persistence of ADHD into adulthood.     

Photovoice as a Methodological Tool to Address HIV and AIDS and Gender Violence amongst Girls on the Street in Rwanda

There has been limited international and South African research on the career development of rural and socioeconomically disadvantaged children. The present research provides baseline information on the career development of rural, low socioeconomic status, Black upper elementary school children (N = 292; 154 girls and 138 boys) in relation to their occupational interests and aspirations. Interests and aspirations were classified in terms of Holland's typology and status level. The results revealed that the children were more interested in and aspired more towards professional status level occupations in Social (i.e., people) and Investigative (i.e., scientific) type categories. Several significant gender differences were found. Girls aspired more to Social type occupations and boys more to Investigative type occupations, with the children's occupational aspirations reflecting gender traditionality. The implications of the present findings present the field with challenges in terms of career theory, research and practice     

Structure and Validity of Affect Knowledge Test (AKT) in a Sample of Italian Preschoolers

The authors’ main goals were to examine whether the Affect Knowledge Test's (AKT) factor structure would be represented by a two-factor model (i.e., emotion recognition and situation knowledge) or by a one-factor model in Italian preschoolers (N = 164; M = 4.24 years, SD = 1.09 years). The concurrent validity of the AKT was further examined using measures of social competence. The findings replicated a model of emotion knowledge, with emotion recognition and situation knowledge as distinct but interrelated factors. Gender and age differences showed that older children and girls displayed higher scores in situation knowledge than younger children and boys. Additionally, our validity model of the AKT demonstrated that emotion recognition preceded situation knowledge, which in turn was positively related to children's sensitive or cooperative behaviors and negatively associated with anxious or withdrawn behaviors. Our results suggest that the use of the AKT may help the teachers to evaluate children's level on emotional knowledge that in turn might impact on children's positive social relationships within classroom in Italy.