An empirical study of the validity of handwriting analysis

The EPQ was administered to 99 Ss, and a handwriting sample provided by each. A professional graphologist undertook to analyse the handwritings, and fill in the EPQ as she thought would have been done by the respondents. Significant correlations were only obtained for the P category; neither E, nor N, nor the L scale showed significant correlations between Ss and the graphologist.     

An assessment of social validity trends in applied behavior analysis

Research articles published during the first 31 years of Journal of Applied Behavior Analysis were assessed for reports of social validity measures. Two measures of social validity (treatment outcome and treatment acceptability) were assessed for each article. In addition, articles were assessed for the incorporation of analog versus naturalistic settings. Overall, treatment outcome and acceptability measures were reported in less than 13% of articles. In addition, studies conducted in naturalistic settings were more likely to report social validity measures than studies conducted in analog settings. Possible reasons for the deficit in the reporting of social validity measures and potential outcomes of this deficit are discussed. Copyright © 1999 John Wiley & Sons, Ltd.     

Assessing the social validity of telehealth-based applied behavior analysis services for autism spectrum disorder

During the COVID-19 pandemic, applied behavior analysis services for many autistic individuals were transitioned to telehealth. The current study assessed caregiver-reported quality of life (QoL) and social validity for families of autistic children receiving only telehealth services (n = 96) or a combination of telehealth and in-person services (n = 173). Barriers to the telehealth experience were analyzed via an ANOVA, and the impact of funding source was analyzed using an independent samples t-test. Caregivers reported benefit across QoL and social validity items, with scores ranging from 3.31 to 4.44 (1 = least benefit, 5 = most benefit). While many caregivers reported no barriers regarding technology (44.61%), childcare (69.52%), and employment (64.68%), the presence of those barriers significantly impacted QoL and social validity scores. Funding source was not found to have a significant impact. Overall, caregivers found value in their child's telehealth services. Clinicians have an obligation to mitigate barriers to ensure the success of the intervention.     

An examination of the construct validity of the Social Anhedonia Scale

Two studies bearing on the construct validity of the Social Anhedonia Scale (SA) are reported. Study 1 reported convergent validity coefficients between the SA scale and numerous measures of traits reflecting a generalized attitude toward others (e.g., social interest and empathy) as well as several traits reflecting maladjustment without a social component as a test of discriminant validity (e.g., pessimism and rigidity). Study 1 found impressive convergent validity for the SA scale and mixed discriminant validity. Study 2 found that the SA scale was related to two dimensions of striving for security, one of which is strongly influenced by negative interpersonal tendencies, suggesting support for the validity of the SA scale. Implications for the measurement and concept of social anhedonia are presented.     

A further examination of validity for the sexual experiences survey

The Sexual Experiences Survey (SES) is designed to identify victims of sexual assault, including ones whose experiences meet the Ohio legal definitions (Ohio Revised Code, 1980) for rape or attempted rape (Koss, Gidycz, and Wisniewski, 1987). Ratings from 156 Ohio prosecuting attorneys indicate that three of the five items used to identify victims of rape or attempted rape as a result of actual or threatened force are commensurate with the sex offense statutes for these acts, while the two questions describing attempted and completed rape experiences involving the use of drugs and alcohol are not. The ratings could not be accounted for by demographic, work experience, or rape myth acceptance variables. Two additional items not intended to measure specific code violations were found to describe felony sex offenses. The implications of the current findings for identifying sexual assault victims are discussed.     

An investigation into assessment centre validity,fairness, and selection drivers

This study examined the construct‐related validity of an assessment centre (AC) developed by a national distribution company for the selection and development of lower‐grade managers. In five locations throughout Britain, 487 individuals were observed on nine dimensions, each of which was measured through six distinct exercises. Multitrait‐multimethod analyses conducted to investigate the convergent and discriminant validity of the AC revealed strong exercise (“method”) effects. This finding was corroborated by an exploratory factor analysis showing that AC ratings clustered into factors according to exercises, rather than according to performance dimensions. A series of MANOVAs and chi‐squared tests demonstrated that neither the exercise ratings nor the selection decision were biased by sex, ethnicity, or training location, and a logistic regression determined which exercises had most impact on the final decision.     

An examination of the predictive criterion-related validity of professional certification tests

This study examines the predictive criterion-related validity of a series of professional certification tests for water and wastewater management operators. Certification test data were obtained on 164 operators holding one of three jobs in water or wastewater management facilities. The certification test scores were broken down into four component scores and a total score. Criterion data consisted of performance evaluations obtained from the operator's supervisor, a self-rating from the operator, or both. Test scores were correlated with the job performance evaluations. The results indicated that scores on the certification tests were not related to rated job performance by job type, job level, source of performance evaluation, or component of job performance. The findings are discussed in the context of establishing an appropriate criterion against which to validate certification tests, and the practical problems of doing so in an applied setting.     

Concurrent validity of a stress-vulnerability model of suicidal ideation and behavior: a follow-up study

A follow-up study to test the concurrent validity of a stress-vulnerability model of suicidal ideation and behavior was conducted. A total of 202 college students (139 females, 63 males) completed self-report measures of life stress, loneliness, depression, dysfunctional cognitions, reasons for living, hopelessness, current suicide ideation, and predictions of future suicide probability. The results of a multiple-regression analysis indicated that 30% of the variation in suicide ideation scores could be accounted for by the linear combination of negative life stress, depression, loneliness, and few reasons for living. The linear combination of current suicide ideation, hopelessness, dysfunctional cognitions, and few reasons for living explained 56% of the variance in self-predicted future suicide probability. The results are interpreted as being supportive of the proposed model.     

Process assessment: An examination of reinforcer effectiveness and predictive validity

This research describes an assessment procedure based on measures of actual learning. First-grade children (N = 120) learned five sight vocabulary words under feedback only, and were then assigned to one of five conditions where they learned five additional words either under feedback, praise, candy, praise and candy, or reproof. In a sixth condition (reciprocal to the first treatment), students learned the first five works under praise and the second five under feedback only. Although results indicated no differences in learning rate under different reinforcement conditions, learning measures under feedback accounted for approximately 39% of the variance in achievement (r = .62), with combined reinforcement learning measures slightly improving prediction (r = .68). The order of treatments had no effect on learning rate. Implications for this process approach to assessment are discussed. Directions for future research are suggested.     

A comparison of functional analysis methods of inappropriate mealtime behavior

Investigators have evaluated two procedural variations for conducting a functional analysis of inappropriate mealtime behavior exhibited by children with feeding problems. One method involves prompting bites only in the escape condition (e.g., Najdowski et al., 2008). Another method involves prompting bites across all conditions (e.g., Piazza et al., 2003). We assessed the food refusal of 3 children diagnosed with a feeding disorder by comparing the two variations. The two methods resulted in different outcomes for 2 of 3 children. Prompting bites only in the escape condition identified a single function (i.e., escape). Prompting bites across all conditions identified multiple functions (i.e., escape and attention). We then examined the relative effects of extinction procedures (individually and in combination) to determine the validity of each method. Results of the treatment evaluation suggested that the procedural variation that failed to identify an attention function for 2 of 3 children produced false negative findings.     

A comparative analysis of the validity of several approaches to the scoring of the behavior of the preterm infant

A group of very low birthweight preterm infants (mean WEIGHT = 1193.6 g; mean gestational AGE = 31.1 weeks) were examined with the PREMIE. The PREMIE is a modification of the scoring system of the full term Brazelton Neonatal Behavioral Assessment (BNBAS) examination for use with preterm infants. Infants were assessed during the acute phase of cardio-respiratory illness (mean AGE = 7 days) and during the recovery phase (mean AGE = 22 days). Many modifications in procedure were required. Several analyses were performed to assess the redundancy and the comparative validity of the scoring systems of the PREMIE, the BNBAS, and the BNBAS + (the BNBAS plus a set of five additional preterm items). Results indicated that the three scoring systems were highly redundant, that they were equally related to physiologic and clinical variables, and that they were similar in their sensitivity to behavioral change and stability. Overall the results offered little in the way of differentiating among these three scoring systems with this group of infants, raising doubts about the need to use the PREMIE or other scoring systems like it for many research purposes.     

Computer methods and ecological validity in reading research

Computer-based procedures for obtaining word-by-word reading times are evaluated in terms of criteria for basic research and for ecologically valid research. Ecological validity can sometimes compromise experimental designs that should control extraneous variables or separate confounded factors. Two reading paradigms that were developed for basic research on linguistic coding mechanisms are also shown to meet many of the criteria for ecological validity.     

Yielding behavior of Israeli drivers: interaction of age and sex

The main objective of the present study was to explore the yielding behavior of Israeli drivers. A series of observations were carried out at a busy crosswalk during rush hour to determine the association between demographic factors, i.e., the sex and age of both pedestrians and drivers and the rate of compliance with yielding regulations. The rate of yielding observed did not exceed 53%. Drivers within the 26-50 age range, excluding other age groups, tended to exhibit a higher yielding rate towards the members of their own age group.     

Construct validity and content analysis

We clarify points of agreement and disagreement with Schnurr, Rosenberg, and Oxman, as put forth in their article appearing this issue. Speech samples elicited under different conditions may or may not be interchangeable. This is a matter of empirical research, but it is also dependent upon the meaningfulness of the content categories. used in the analysis. We prefer a theory-driven, construct validational approach that employs well validated coding schemes to assess psychologically meaningful concepts.     

The content validity of juvenile psychopathy: an empirical examination

This study examined the content validity of a juvenile psychopathy measure, the Childhood Psychopathy Scale (CPS; D. R. Lynam, 1997), based on a downward translation of an adult instrument, the Hare Psychopathy Checklist-Revised (PCL-R; R. D. Hare, 1991). The CPS was compared with two other indices of juvenile psychopathy: (a) an index derived from expert ratings and (b) an empirical index based on correlations with adult psychopathy. The 100 items of the Common Language Q-Sort (CLQ; A. Caspi et al., 1992) provided a common metric for the comparison. Psychopathy and personality were assessed at age 13 years with the mother-reported CPS and the CLQ. Psychopathy was assessed at age 24 years with the interviewer-rated Psychopathy Checklist: Screening Version (PCL:SV; S. D. Hart, D. N. Cox, & R. D. Hare, 1995). Data from over 250 participants of the middle sample of the Pittsburgh Youth Study were used to examine these relations. Item content analyses demonstrated considerable overlap among the three indices, indicating that the downward translation utilizes criteria similar to those of experts and the empirically-derived measure. In addition, these indices, even after removing overlapping items, demonstrated considerable convergence, also supporting the content validity of the downward translation. These results suggest that the downward translation method is adequate for understanding the juvenile psychopathy construct.     

Reliability and validity of the direct observation form of the child behavior checklist

This article reports reliability and validity data for the Direct Observation Form (DOF) of the Child Behavior Checklist. Observational data were collected on two samples of boys aged 6-11 in classroom settings. Interobserver agreement was high: r = .92 for behavior problem score and r = .83 for on-task score. Generalizability, as measured by the one-way intraclass correlation, was .86 and .71 for behavior problem score and on-task score, respectively. In terms of validity, DOF scores correlated significantly and in the expected directions with teacher-reported problem behavior, school performance, and adaptive functioning. In addition, boys who had been referred by their teachers due to problem behavior obtained significantly higher behavior problem scores and significantly lower on-task scores than a matched sample of normal boys observed in the same classrooms.     

Discriminative validity of the general behavior inventory using youth report

The present study investigated the ability of the General Behavior Inventory (GBI) to discriminate between diagnostic groups using youth self-report. One hundred and ninety-seven youths ages 10–17 years presenting at a midwestern urban outpatient clinic specializing in mood disorders completed the GBI as part of the intake process. Diagnoses were determined by a structured clinical interview (K-SADS) administered by either a child and adolescent psychiatrist or a research assistant trained to a high level of interrater reliability ( > .85). Games–Howell post hoc tests showed that the diagnostic groups significantly differed on the GBI's 2 subscales, Depression and Hypomanic–Biphasic. Logistic regression demonstrated that the scales discriminated between bipolar and disruptive behavior disorders, unipolar and bipolar depression, and mood and disruptive behavior disorders or no diagnosis. Receiver Operating Characteristic (ROC) curves further indicated the good diagnostic efficiency of the scales. Results indicate that the GBI's subscales might aid in making traditionally difficult differential diagnoses, such as between bipolar disorder and Attention Deficit Hyperactivity Disorder (ADHD) and between unipolar and bipolar depression.     

The Error-Oriented Motivation Scale: An examination of structural and convergent validity

The current paper describes an analysis of the factor structure and convergent validity of the Error-Oriented Motivation Scale (EOMS). The EOMS is an attempt to validate a context-general and brief measure of error orientations theoretically similar to the Error Orientation Questionnaire (EOQ) written by (Rybowiak, Garst, Frese, and Batinic (1999)). Motivation theory, particularly approach/avoidance motives and goal theory, was chosen as a foundational model for the new EOMS measure, arguing that errors take on properties of goals when they occur by creating a discrepancy, which generates arousal and direction toward a solution. In this article, the factor structure of the EOMS is examined, as well as expected correlations with subscales of the EOQ. The discussion focuses on the advantages of the EOMS measure and suggestions for its further validation and use in applied settings.