Examination of the reliability and validity of the personality assessment inventory

The reliability, discriminant validity, and construct validity of the Personality Assessment Inventory (PAI) — a multidimensional self-report measure of abnormal personality traits — were examined within the Australian context. Subjects included 151 normals, 30 alcoholics, and 30 schizophrenic patients. A subsample of 70 nonpsychiatric adults responded to the PAI items twice over a test-retest interval of 28 days. The resulting median retest coefficient was 0.7, indicating less than optimal stability. The median alpha (KR₂₁) coefficient was 0.8, suggesting somewhat narrow measurement scales. A significant multivariate main effect was obtained across groups after the effects of age and gender were removed. Multiple comparisons for each of the PAI scales revealed significant differences between the respective groups, as discussed. A higher-order scale factoring did not strongly support the purported PAI structure. In reanalyses of the correlation matrices included in the Professional Manual, the purported PAI factor structure was unable to be replicated for the standardization clinical sample (N=1246), and a confirmatory factor analysis using the normative (validation) correlational data (N=1000) revealed poor fit indices, raising further concerns about construct validity.     

Factor Structure and Discriminative Validity of the Eyberg Child Behavior Inventory With Young Children

This study examined the factor structure and discriminative validity of the Eyberg Child Behavior Inventory (ECBI) with community-based and clinic-referred samples of young children (2–6 years). In the community sample, confirmatory factor analysis indicated a three-factor structure with components reflecting Inattentive, Oppositional Defiant, and Conduct Problem Behavior. In the clinic sample, component scores differentiated children with specific behavior problems from children without significant externalizing symptoms. However, component scores did not differentiate within the externalizing spectrum. The data suggest that ECBI components may be useful to screen community-based and clinic-referred young children for externalizing symptoms, but may be less useful to identify children with specific behavior problems.     

Reliability, diagnostic efficiency, and validity of the Millon adolescent clinical inventory: examination of selected scales in psychiatrically hospitalized adolescents

This study examined the internal consistency, diagnostic efficiency, and validity of selected scales of the Millon adolescent clinical inventory (MACI; Millon et al., Manual for the Millon Adolescent Clinical Inventory, National Computer Systems, Minneapolis, MN, 1993). 241 psychiatrically hospitalized adolescents were administered the MACI and a battery of established self-report measures and a multidisciplinary team independently assigned DSM-IV psychiatric diagnoses at the time of discharge. The internal consistency of MACI scales ranged from 0.71 to 0.93. Conditional probabilities (sensitivity, specificity, positive predictive power, and negative predictive power) were calculated for selected disorders using independently generated clinical diagnoses as the standard. The diagnostic efficiencies for the selected scales were variable, with adequate performance for predicting classes of diagnoses but not for specific diagnoses. The MACI showed good criterion validity for most disorders, with participants with a clinical diagnosis having a significantly higher corresponding MACI scale score than participants not assigned that diagnosis. Concurrent validity, tested by correlating MACI scale scores with those of relevant, validated measures, was generally good. The MACI appears to be a psychometrically sound self-report instrument and appears valuable as a screening instrument for many problems found in adolescent psychiatric inpatients.     

Construct validity of the medical specialty preference inventory: A critical analysis

The Medical Specialty Preference Inventory (MSPI; Zimny, G.H. (1979). Manual for the Medical Specialty Preference Inventory. St. Louis, MO: St. Louis University School of Medicine), a measure of medical students’ interests, was substantively and empirically examined to identify an underlying factor structure. A factor model for the original MSPI based on 38 factors in five general areas was evaluated on a national sample of 1014 medical students and yielded poor fit to the data. Exploratory factor analyses at the item level utilizing the full pool of MSPI items produced an 11 factor solution with 88 items. Sub-scales were identified within this model and an 11-18 higher-order model and an 18 sub-scale model also were proposed. The relative fits of the three models were evaluated by confirmatory factor analysis with the 18 sub-scale model shown to be superior. This model was cross-validated on a separate sample of 1016 medical students and fit the data well. All sub-scales exhibited adequate internal consistency across samples. These findings support the need for a revised MSPI based on 18 scales. Implications of these findings for MSPI scoring practices are discussed along with future directions.     

Psychometric properties of the mobility inventory for agoraphobia: convergent, discriminant, and criterion-related validity

Aims of this study were (a) to summarize the psychometric literature on the Mobility Inventory for Agoraphobia (MIA), (b) to examine the convergent and discriminant validity of the MIA's Avoidance Alone and Avoidance Accompanied rating scales relative to clinical severity ratings of anxiety disorders from the Anxiety Disorders Interview Schedule (ADIS), and (c) to establish a cutoff score indicative of interviewers’ diagnosis of agoraphobia for the Avoidance Alone scale. A meta-analytic synthesis of 10 published studies yielded positive evidence for internal consistency and convergent and discriminant validity of the scales. Participants in the present study were 129 people with a diagnosis of panic disorder. Internal consistency was excellent for this sample, α = .95 for AAC and .96 for AAL. When the MIA scales were correlated with interviewer ratings, evidence for convergent and discriminant validity for AAL was strong (convergent r with agoraphobia severity ratings = .63 vs. discriminant rs of .10–.29 for other anxiety disorders) and more modest but still positive for AAC (.54 vs. .01–.37). Receiver operating curve analysis indicated that the optimal operating point for AAL as an indicator of ADIS agoraphobia diagnosis was 1.61, which yielded sensitivity of .87 and specificity of .73.     

Responsiveness to Threat and Incentive in Bipolar Disorder: Relations of the BIS/BAS Scales with Symptoms

Over the past 10 years, theorists have suggested that bipolar disorder symptoms result from increases and decreases in the activity of the Behavioral Activation or Facilitation System (BAS or BFS) and the Behavioral Inhibition System (BIS). These neurobehavioral systems are thought to determine the intensity of affective and behavioral responses to incentives and threats. This study examined cross-sectional and prospective associations of self-reported BIS and BAS with mania and depression in a sample of 59 individuals diagnosed with Bipolar I disorder. Depression was tied to BIS, pointing to the importance of sensitivity to threats in depression. However, links between BIS and depression appeared state-dependent. BAS subscales did not correlate with manic symptoms in a state-dependent manner; however, BAS (total scale and reward responsiveness subscale) predicted relative intensification of manic symptoms over time. Thus, evidence suggests that BAS sensitivity may constitute a vulnerability to mania among persons diagnosed with bipolar disorder. Discussion focuses on the integrative potential of the BIS/BAS constructs for linking psychosocial and biological research on bipolar disorder.     

The Feeling-Tone Questionnaire: Reliability and Validity of a Direct Patient Assessment Screening Instrument for the Detection of Depressive Symptoms in Cases of Dementia

The purpose of this study was to develop a reliable and valid measure of affective disorder in elderly demented patients. The field lacks instruments which are sensitive to detecting depressive signs in severely as well as mildly and moderately demented subjects. Two samples of subjects were chosen for study. The first sample consisted of subjects from six institutions, which were chosen for study from a probability sample of 25 long-term care institutions in New York City. This sample was part of the Cross-National Institutional Study conducted in New York and London (Gurland et al., 1979; Mann et al., 1984). Thirty patients were selected at random within each institution. The second sample consisted of 52 inpatients at Willard Psychiatric Center, a traditional state psychiatric hospital in upstate New York. All subjects had a chart diagnosis of dementia and were 60 years old or older. The mean age of the sample was 82 years and 56% of the subjects were female. The Feeling-Tone Questionnaire, which was developed for these analyses, consists of 16 dichotomous items and 16 5-point Likert ratings of affect. The reliability of this scale using Cronbach's alpha is .91 for the long-term care institutional sample and .90 for the psychiatric hospital sample. Interrater reliability for two raters on ten cases is .99. Test–retest reliability on ten cases with a 1-day to 2-day interval between trials is .81. A short mood scale was developed from the observational data as a validity measure for the Feeling-Tone Questionnaire. Evidence for the validity of the Feeling-Tone Questionnaire is provided.     

Role of Parenting and Maltreatment Histories in Unipolar and Bipolar Mood Disorders: Mediation by Cognitive Vulnerability to Depression

In this article, we review empirical research on the role of individuals' parenting and maltreatment histories as developmental antecedents for symptoms and diagnosable episodes of unipolar and bipolar spectrum disorders. Our review is focused on the following three overarching questions: (1) Do negative parenting and a history of maltreatment contribute risk to symptoms or diagnosable episodes of unipolar and bipolar disorders? (2) Are the associations of negative parenting and maltreatment histories with bipolar disorders similar to those for unipolar depression? and (3) Are the associations between negative parenting and maltreatment histories and unipolar and bipolar symptoms or disorders mediated by cognitive vulnerability to depression? We begin by discussing the methodological requirements for demonstrating a psychosocial risk factor and the methodological issues that plague the parenting and maltreatment literatures. Next, we review the extant studies on the role of parenting histories in unipolar and bipolar disorders. We consider the specificity and possible moderators of the parenting-mood disorder relationship, as well as cognitive vulnerability to depression as a mediator of this relationship. Then, we review studies on the association of maltreatment histories with unipolar and bipolar disorders and the role of cognitive vulnerability to depression as a mediator of this association. We conclude with an assessment of the state of the parenting and maltreatment literatures in unipolar and bipolar disorder with regard to our guiding questions.     

Parent-perceived child behavior problems: Comparison of normative and clinical factors of the Adelaide-Conners Parent Rating Scale

The Adelaide-Conners Parent Rating Scale (APRS), an instrument developed by studying a large, representative group of schoolchildren, was used with a group of psychiatry attenders. Multimethod factor analysis found satisfactory agreement between the factor structures of the clinical and the normative groups. The patterns of scores on the 12 APRS scales were also compared. Two higher-order factors (Conflict with the Environment and Conflict within the Self) were identified in the clinical sample as previously found in the normative group. Comparison of the factor solutions with previous empirical efforts to identify parent-perceived patterns of child behavior disorder showed that the APRS compares well with other instruments and supports the strategy of proceeding from the study of normative populations to the study of clinically defined groups.This work was supported in part by a grant from the Department of Health, Canberra.     

Comparing the Family Environments of Adolescents with Conduct Disorder or Depression

We attempted to differentiate the family environments of youth with Conduct Disorder (CD) compared to youth with a depressive disorder. Participants were 34 adolescents from a residential treatment facility. The K-SADS-P was used to determine the youth's diagnosis, while their family environment was assessed by the Self Report Measure of Family Functioning Child Version. A MANOVA was used to compare the two diagnostic groups on seven family environment variables. Results indicate that adolescents with CD described their parents as having a permissive and ambiguous discipline style, while adolescents with a depressive disorder described their relationship with their parents as enmeshed. A discriminant function analysis, using the two family environment variables of enmeshment and laissez-faire family style as predictors, correctly classified 82% of the participants. Implications for treatment of youth with both types of diagnoses and their families are discussed.     

An examination of the construct validity of posttraumatic stress disorder with veterans using a revised criterion set

Ongoing concerns exist in the literature regarding the construct of posttraumatic stress disorder (PTSD) and how to best conceptualize and measure this disorder. We compared the traditional DSM-IV PTSD symptom criteria (i.e., symptoms from clusters B, C, and D) to a revised criterion set that omits overlapping mood and other anxiety symptoms on PTSD prevalence, PTSD diagnostic caseness, associated psychiatric comorbidity, functional status, and structural validity using a cross-sectional, multi-site primary care sample of 747 veterans. After removing items theorized to overlap with mood and other anxiety disorders, PTSD prevalence was identical using both criterion sets (i.e., 12%). Overall, there were few statistically significant differences in PTSD caseness, associated psychiatric comorbidity, functional status, and structural validity across the two diagnostic criterion sets. These data provide further support that removing items that overlap with other psychiatric disorders does not significantly impact the prevalence of PTSD, its associated comorbidity and functional impairment, or its structural validity. Although the revised criterion set represents a more parsimonious model, the current study findings generally support the strong construct validity of PTSD. The implications of these study findings for research and clinical practice are discussed.     

A comparative analysis of the validity of several approaches to the scoring of the behavior of the preterm infant

A group of very low birthweight preterm infants (mean WEIGHT = 1193.6 g; mean gestational AGE = 31.1 weeks) were examined with the PREMIE. The PREMIE is a modification of the scoring system of the full term Brazelton Neonatal Behavioral Assessment (BNBAS) examination for use with preterm infants. Infants were assessed during the acute phase of cardio-respiratory illness (mean AGE = 7 days) and during the recovery phase (mean AGE = 22 days). Many modifications in procedure were required. Several analyses were performed to assess the redundancy and the comparative validity of the scoring systems of the PREMIE, the BNBAS, and the BNBAS + (the BNBAS plus a set of five additional preterm items). Results indicated that the three scoring systems were highly redundant, that they were equally related to physiologic and clinical variables, and that they were similar in their sensitivity to behavioral change and stability. Overall the results offered little in the way of differentiating among these three scoring systems with this group of infants, raising doubts about the need to use the PREMIE or other scoring systems like it for many research purposes.     

Testing the ability of children with attention deficit hyperactivity disorder to accurately report the effects of medication on their behavior

Children with attention deficit hyperactivity disorder (ADHD) are often treated with central nervous system stimulants, making the evaluation of medication effects an important topic for applied behavior analysts. Because assessment protocols emphasize informant reports and direct observations of child behavior, little is known about the extent to which children themselves can accurately report medication effects. Double-blind placebo-controlled procedures were used to examine whether 6 children with ADHD could recognize the effects of their medication. The children were given math worksheets to complete for 15 min during each of 14 sessions while on medication and placebo. Children completed a self-evaluation form at the end of each session, and ratings were compared to observed behavior and academic performance. Results indicated that 3 children were able to accurately report their medication status at levels greater than chance, whereas the accuracy of reports by all children was related to dosage level, differences in behavior, and the presence of adverse effects. The implications of these results for placebo-controlled research, self-monitoring of dosage levels, and accuracy training are discussed.     

Measuring moral reasoning using moral dilemmas: evaluating reliability,validity, and differential item functioning of the behavioural defining issues test (bDIT)

ABSTRACT

We evaluated the reliability, validity, and differential item functioning (DIF) of a shorter version of the Defining Issues Test-1 (DIT-1), the behavioural DIT (bDIT), measuring the development of moral reasoning. About 353 college students (81 males, 271 females, 1 not reported; age M = 18.64 years, SD = 1.20 years) who were taking introductory psychology classes at a public University in a suburb area in the Southern United States participated in the present study. First, we examined the reliability of the bDIT using Cronbach’s α and its concurrent validity with the original DIT-1 using disattenuated correlation. Second, we compared the test duration between the two measures. Third, we tested the DIF of each question between males and females. Findings reported that first, the bDIT showed acceptable reliability and good concurrent validity. Second, the test duration could be significantly shortened by employing the bDIT. Third, DIF results indicated that the bDIT items did not favour any gender. Practical implications of the present study based on the reported findings are discussed.