Psychometric properties of the Movement Assessment Battery for Children‐Checklist as a screening instrument for children with a developmental co‐ordination disorder

Background: The Checklist of the Movement Assessment Battery for Children (MABC) was developed to screen children for movement difficulties in the school situation. However, the psychometric properties of the Checklist have not been investigated in detail. Aim: The psychometric properties of the M‐ABC Checklist were investigated including its usefulness as a screening instrument. Samples: A group of 120 children, 6 to 11 years old, randomly selected from mainstream schools and a group of 64 children, 6 to 9 years old, referred for assessment of their motor functioning. Methods: A reliability analysis was performed to investigate whether the 48 items of the Checklist measure the same construct. Construct validity was investigated by means of a factor analysis. And lastly, the sensitivity, specificity and positive predictive value of the Checklist were investigated by comparing the performance of children on both the Test and Checklist of the M‐ABC. Results: The items of the Checklist measure the same construct. Seven factors were obtained after factor analysis, revealing that the Checklist measures a broad range of motor skills. The Checklist met the standards for sensitivity in all age groups, except in the 8‐year‐old group, where too many children with motor problems were not detected. With the exception of the 6‐year‐old children, specificity was poor. The positive predictive value was acceptable, except for the 7‐year‐old children. Conclusion: the Checklist proved to meet standards for reliability and most aspects of validity. Its use by teachers for screening children with movement difficulties can be recommended.     

A pediatric screening instrument to detect problematic infant–parent interactions: Initial reliability and validity in a sample of high‐ and low‐risk infants

The purpose of this study was to determine the initial reliability and validity of a screening instrument developed to detect problematic interactions between infants and parents as part of a pediatric well‐baby exam. Participants included 117 infant–mother dyads (57 preterms and 60 full terms) assessed when infants were 6 to 9 months old. Mothers and infants were observed playing an interactional game such as peek‐a‐boo during the course of the pediatric exam. The game was scored for degree of interactional reciprocity using the Pediatric Infant Parent Exam (PIPE). Acceptable levels of interrater reliability were achieved. As predicted, higher risk infants and their mothers exhibited more problematic interactions than lower risk infants and their mothers. Results indicated that the PIPE was a reliable means of screening for interactional difficulties, that was sensitive to, but not synonymous with, neonatal health indices. ©2001 Michigan Association for Infant Mental Health.     

Validity of the motor observation questionnaire for teachers as a screening instrument for children at risk for developmental coordination disorder

This study investigates validity of the Motor Observation Questionnaire for Teachers (MOQ-T) in 182 children aged 5-10years, 91 children referred for motor problems to a rehabilitation center and 91 comparison children. Performance on the MOQ-T was compared to performance on the Movement Assessment Battery for Children (M-ABC) and the Developmental Coordination Disorder Questionnaire (DCD-Q). Significant correlations were obtained between the MOQ-T and the DCD-Q (r=-.63), and the MOQ-T and the M-ABC (r=.57). The MOQ-T discriminated between children at risk for DCD and comparison children. Sensitivity of the MOQ-T was 80.5%, specificity 62% with the M-ABC as 'gold standard'. These results support the validity of the MOQ-T as a screening instrument for identification of children at risk for DCD.     

The developmental profile: preliminary results on interrater reliability and construct validity

This study presents the preliminary results of research into the interrater reliability and construct validity of the Developmental Profile (DP). In the DP a number of developmental lines, such as Object-Relations, Self-Images, and Problem-Solving Capacities, are assessed and classified according to the level of functioning. A total of 108 profiles were assessed, drawn from three different categories of patients. The weighted kappa values for interrater reliability were sufficient. On the adaptive level, but also on the maladaptive levels Symbiosis and Resistance, significant differences were found between psychiatric patients, "normal controls" (dental patients) and somatic patients. No differences were recorded between the latter two groups. The conclusion is that the DP is a promising instrument, of which the reliability and validity has to be further investigated in order to contribute to scientific support for psychodynamic theory formation.     

The Operational Development and Empirical Testing of the Terrorist Radicalization Assessment Protocol (TRAP–18)

The Terrorist Radicalization Assessment Protocol (TRAP–18) is a structured professional judgment instrument for threat assessment of the individual terrorist. It is a rationally derived theoretical model comprising eight proximal warning behaviors and 10 distal characteristics. Empirical research on the TRAP–18 is reviewed, including both nomothetic and idiographic studies of individual terrorists in both the United States and Europe. Mean interrater reliability is 0.895 (Cohen's kappa), ranging from 0.69 to 1.0. Evidence of criterion validity has been demonstrated, including usefulness of the instrument across various extremist ideologies (jihadism, ethnic nationalism, and single-issue), and its ability to discriminate between thwarted and successful attackers. The instrument appears to advance the domain recommendations of Monahan (2012, 2016) for the risk assessment of the individual terrorist. The TRAP–18 is further discussed as a threat assessment instrument for mental health clinicians. The limitations of the current research provide direction for further studies to assess its reliability and construct, discriminant, and predictive validity.     

The Infant–Toddler Social and Emotional Assessment (ITSEA): Factor Structure, Reliability, and Validity

In this paper the refinement and psychometric properties of the Infant–Toddler Social and Emotional Assessment (ITSEA) are described. Results from a sociodemographically diverse birth cohort sample of 1,235 parents of children between the ages of 12 and 36 months are presented. Confirmatory factor analyses supported the hypothesized Internalizing, Externalizing, Regulatory, and Competence domains as well as the 17 individual scales that comprise the ITSEA. Findings for 3 additional indices useful in identifying significant psychopathology are presented. Subgroup analyses revealed structural invariance and expected mean level differences across both child sex and 6-month age bands. Child sex differences emerged for some problem and most competence scales, with boys rated as higher on Activity–Impulsivity and girls rated higher on Anxiety and most Competence scales. All competence scores increased across age groups. Problem behaviors showed a more mixed developmental pattern. Test–retest and interrater reliability were acceptable. Associations between the ITSEA and independent evaluator ratings and parental ratings of child behavior problems, temperament, and parental distress support the validity of the instrument.     

TENI: A comprehensive battery for cognitive assessment based on games and technology

TENI (Test de Evaluación Neuropsicológica Infantil) is an instrument developed to assess cognitive abilities in children between 3 and 9 years of age. It is based on a model that incorporates games and technology as tools to improve the assessment of children’s capacities. The test was standardized with two Chilean samples of 524 and 82 children living in urban zones. Evidence of reliability and validity based on current standards is presented. Data show good levels of reliability for all subtests. Some evidence of validity in terms of content, test structure, and association with other variables is presented. This instrument represents a novel approach and a new frontier in cognitive assessment. Further studies with clinical, rural, and cross-cultural populations are required.     

The Quality of the Childrearing Environment of Refugee or Asylum‐Seeking Children and the Best Interests of the Child: Reliability and Validity of the BIC‐Q

The Best Interest of the Child Questionnaire (BIC‐Q) has been designed as an instrument for screening the quality of the rearing situation of asylum‐seeking or refugee children. It is intended to aid legal decisions in asylum procedures. The aim of this study was to determine the reliability and the construct validity of the BIC‐Q. Based on a study sample of refugee or asylum‐seeking children in the Netherlands (N = 74), the psychometric quality of the BIC‐Q was investigated using Cohen's kappa for the inter‐ and intrarater reliability and a nonparametric item response model for the construct validity. The interrater and intrarater reliabilities of the BIC‐Q were good (kappa = .65 and .74 respectively). The results of the item response model revealed that the 14 pedagogical environmental conditions formed a strong and valid measurement scale for the quality of the childrearing environment (H = .55; rho = .94). Preliminary results indicate that the BIC‐Q may be applied to support decisions on where the asylum‐seeking or refugee child has the best opportunities for development. Copyright © 2012 John Wiley & Sons, Ltd.     

Developmental normative data for the Baron-Hopkins Board test of spatial location memory

Developmentally appropriate domain-specific tests with strong psychometric properties for preschoolers are lacking and infrequently developed. Baron’s modification of the Hopkins Board test (B-HB) to assess spatial location learning and recall in 3- and 6-year-old children has shown promise in the study of young children born prematurely. Current study data were analyzed on 172 typically developing children at age 3 years and 193 at age 6 years, born at term (≥ 37 weeks; ≥ 2500 grams). Statistically significant gender differences were found and data stratification of T-scores and percentile ranks are provided for each of the eight B-HB measures. The B-HB’s strong interrater reliability (99.5%), low-to-moderate test-retest reliability across the 3-year age span, Pearson correlations showing criterion validity, and differential functioning from other selective attention and visuospatial/visuoperceptual tests provide initial normative data for this novel measure of spatial location memory in young children.     

The Cleveland Scale for Activities of Daily Living (CSADL): Its Reliability and Validity

This study evaluated the reliability and validity of the Cleveland Scale for Activities of Daily Living (CSADL), a scale designed to measure in detail specific activities of daily living in individuals with dementia. Administered to knowledgeable informants by trained examiners, the CSADL demonstrated good reliability in terms of interrater agreement and internal consistency. The validity of CSADL total scores was shown by its sensitivity to degree of cognitive impairment: All comparisons between means of the healthy elderly group and three groups of AD patients differing in severity were statistically significant. The CSADL was highly correlated with the Blessed–Roth Dementia Scale (DS-ADL) and more highly correlated with Mini-Mental State Exam scores than was the DS-ADL.     

Development and Validation of a Parent Report Measure for Assessing Social-Emotional Competencies of Children and Adolescents

Based on the premises that strength-based assessment of children and adolescents is an important emerging area, and that additional tools for this purpose are needed, this study details development and validation efforts on a new strength-based assessment: the Social-Emotional Assets and Resilience Scale, parent form (SEARS-P). Following careful development of a comprehensive research prototype assessment, a large and diverse nationwide sample of more than 2,000 ratings of school-age children and adolescents were obtained from their parents and other caregivers. Factor analytic procedures revealed a robust and replicable underlying factor structure, including Self-Regulation/Responsibility, Social Competence, and Empathy factors. The factor scores and total score of the SEARS-P were shown to have strong internal consistency reliability, as well as strong interrater reliability between mother-father pairs who rated the same child. Convergent construct validity of the SEARS-P was established through findings of significant correlations with two established strength-based rating scales for use by parents. Construct validity of the SEARS-P was further bolstered through findings of significant gender differences in scores (with females rated as having higher levels of competency than males), as well as significant differences in scores based on educational disability status. Limitations and future research needs are discussed, as are implications of this study for research and practice with children and families.     

Reliability, validity and normative data for the Danish Beck Youth Inventories

This study examines reliability and validity and establish Danish norms for the Danish version of the Beck Youth Inventories (BYI) ( Beck, Beck & Jolly, 2001 ), which consists of five self-report scales; Self-Concept (BSCI), Anxiety (BAI), Depression (BDI), Anger (BANI) and Disruptive Behavior (BDBI). A total of 1,116 school children and 128 clinical children, aged 7–14, completed BYI. Internal consistency coefficients were high. Most test-retest correlations were >0.70. A test-retest difference was found for BAI. Exploratory and confirmatory factor analysis indicated that the five factor structure of the instrument was justified. The BSCI, BAI and BDI discriminated moderately between the norming sample and the clinical group, and the latter group included more children who exceeded the 90th percentile of the norming sample. Diagnostic groups scored higher on relevant scales than norms. Only BSCI and BDI differentiated between diagnostic groups. The BYI showed acceptable internal consistency and test-retest stability, except for BAI. The BYI did not adequately differentiate between internalizing disorders.     

Initial psychometric properties of the Denver II in a sample from Northeast Brazil

This paper assesses the initial psychometric properties of the Denver Developmental Screening Test (Denver II), a widely used child development measure in its first population-level administration in Brazil. The Portuguese version was administered to 2755 children under three years of age who were eligible for a home visiting program in Fortaleza, Northeast Brazil. We examine the measure’s internal consistency and verify construct validity by testing the dimensionality through confirmatory factor analysis (CFA) and estimating associations with household socioeconomic variables (e.g., poverty, maternal education, stunting, and parenting practices). The test was found to be psychometrically robust and culturally relevant. Although we found a good fit with the structure proposed by the instrument’s author, a structure of two latent variables (motor and cognitive) provided a better fit. This validity exercise provides useful information for policymakers and researchers interested in using this instrument in the Brazilian context or a similar one in the region.     

The Melbourne decision making questionnaire: an instrument for measuring patterns for coping with decisional conflict

A study was conducted to examine the factorial validity of the Flinders Decision Making Questionnaire (Mann, 1982), a 31-item self-report inventory designed to measure tendencies to use three major coping patterns identified in the conflict theory of decision making (Janis and Mann, 1977): vigilance, hypervigilance, and defensive avoidance (procrastination, buck-passing, and rationalization). A sample of 2051 university students, comprising samples from Australia (n=262), New Zealand (n=260), the USA (n=475), Japan (n=359), Hong Kong (n=281) and Taiwan (n=414) was administered the DMQ. Factorial validity of the instrument was tested by confirmatory factor analysis with LISREL. Five different substantive models, representing different structural relationships between the decision-coping patterns had unsatisfactory fit to the data and could not be validated. A shortened instrument, containing 22 items, yielded a revised model comprising four identifiable factors–vigilance, hypervigilance, buck-passing, and procrastination. The revised model had adequate fit with data for each country sample and for the total sample, and was confirmed. It is recommended that the 22-item instrument, named the Melbourne DMQ, replace the Flinders DMQ for measurement of decision-coping patterns. © 1997 John Wiley & Sons, Ltd.     

New subscales for an anchored version of the Brief Psychiatric Rating Scale: construction, reliability, and validity in acute psychiatric admissions

Attending psychiatrists completed an anchored version of the 18-item Brief Psychiatric Rating Scale (BPRS-A) based on admission and evaluation information on a total of 2,921 adult patients treated at 1 public sector acute psychiatric teaching hospital. Exploratory factor analysis was applied to a 6-month sample to construct 4 nonoverlapping subscales: Resistance, Positive Symptoms, Negative Symptoms, and Psychological Discomfort. Confirmatory factor analysis compared these new subscales to 3 other published subscale models using a second 6-month sample. Internal consistency, rater influence, and interrater agreement were estimated in separate studies. Discriminant validity was explored by comparison of diagnosis-based samples. Application of the BPRS-A as a debriefing instrument in the study of symptomatic change and the multiple challenges inherent in psychometric study of such a rating scale in realistic hospital practice are discussed.     

Short-interval test-retest interrater reliability of the Dutch version of the Structured Clinical Interview for DSM-IV personality disorders (SCID-II)

This study examined the short-interval test-retest reliability of the Structured Clinical Interview (SCID-II: First, Spitzer, Gibbon, & Williams, 1995) for DSM-IV personality disorders (PDs). The SCID-II was administered to 69 in- and outpatients on two occasions separated by 1 to 6 weeks. The interviews were conducted at three sites by ten raters. Each rater acted as first and as second rater and equal number of times. The test-retest interrater reliability for the presence or absence of any PD was fair to good (kappa = .63) and was higher than values found in previous short-interval test-retest studies with the SCID-II for DSM-III-R. Test-retest reliability coefficients for trait and sumscores were sufficient, except for dependent PD. Values for single criteria were variable, ranging from poor to good agreement. Further large-scale test-retest research is needed to test the interrater reliability of more categorical diagnoses and single traits.     

Rorschach Comprehensive System data for two samples of nonpatient children from Italy: 75 aged 5-7 years and 148 aged 8-11 years

This project provides information on how nonpatient children perform on the Rorschach test, administered and scored following Exner's guidelines (1995). Lis, Parolin, Zennaro, and Mazzeschi (2001) previously reported initial data for 70 nonpatient children living in Italy who were administered this instrument by graduate and postgraduate students in a 2-year research course at the Psychotherapy School of the University of Padua between July 1998 and February 2001. The current study is an extension of that work and includes information on an additional 153 participants gathered between November 2002 and December 2006. The total number of participants includes 223 individuals, 75 5-7-year-old children in the first level of elementary school, and 148 8-11-year-old children in the second level of elementary school. Exclusion criteria are described, and interrater reliability statistics at the response level for scoring segments are reported using percent agreement and iota. Rorschach Comprehensive System (CS) findings are presented.     

Self-Perceived Gender Typicality, Gender-Typed Attributes, and Gender Stereotype Endorsement in Elementary-School-Aged Children

This study examined relations among self-perceived gender typicality, gender-typed attributes, and gender stereotype endorsement with a sample of elementary-school-aged children (N?=?100, ages 6–12) from the Midwestern United States. Children who perceived themselves as more gender-typical were more interested in same-gender-typed activities and occupations and less interested in other-gender-typed activities and occupations than children who perceived themselves as less gender-typical. Gender typicality was linked to gender stereotype endorsement, as predicted based on Liben and Bigler’s (2002) dual-pathway model of gender development, with children who perceived themselves as less gender-typical having more egalitarian (less stereotyped) attitudes than children who perceived themselves as more gender-typical. The observed relations between gender-typed attributes and self-perceived gender typicality and between self-perceived gender typicality and gender stereotype endorsement did not differ across gender or age. These findings indicate that even young elementary-school-aged children use their knowledge of cultural gender roles to make subjective judgments regarding the self, and, conversely, that views of the self may influence personal endorsement of cultural gender stereotypes. Although the majority of extant research has focused on negative outcomes associated with low self-perceived gender typicality (e.g., low self-esteem), this research indicates that positive outcomes (e.g., flexible gender role attitudes) may also be associated with low self-perceived gender typicality.     

Estimating Coefficients of Equivalence and Stability for Job Performance Ratings: The importance of controlling for transient error on criterion measurement

Previous research on measurement error in job performance ratings estimated reliability using coefficients: alpha, test–retest, and interrater correlation. None of these three coefficients control for the four main sources of error in performance ratings. For this reason, coefficient of equivalence and stability (CES) has been suggested as the ideal estimate of reliability. This article presents the estimates of CES for a time interval of 1, 2, and 3 years. The values obtained for a single rater were .51, .48, and .44, respectively. For two raters, the values were .59, .55, and .51. The findings suggest that previous reliability estimates based on alpha, test–retest, and interrater coefficients overestimated the reliability of job performance ratings. In the present study, the interrater coefficient overestimates reliability by 13.6–25.4% for an interval time of 1–3 years, as it does not control for transient error. Results also showed that the importance of transient error increases as the length of the interval between the measures increases. Based on the results, it is suggested that corrected validities based on interrater reliability underestimate the magnitude of the validity. The implications of these findings for future efforts to estimate criterion reliability and predictor validity are discussed.