A Psychometric Evaluation of the Approach and Avoidance of Alcohol Questionnaire Among Alcohol-Dependent Patients Attending Residential Treatment

Despite research suggesting that alcohol-dependent individuals have both craving and avoidant tendencies for alcohol, few studies have measured self-report tendencies using the Approach and Avoidance of Alcohol Questionnaire (AAAQ). The goal of this study was to examine the psychometric properties of the AAAQ using a sample of adults receiving 12 step-based residential treatment for alcohol dependence. As part of a larger study, 100 adults receiving residential treatment completed the AAAQ and several other assessments shortly after treatment admission. Analyses of the AAAQ examined its factor structure, internal consistency, and convergent and predictive validity. A maximum likelihood estimation factor analysis using oblique rotation produced 3 factors accounting for 69 % of the variance. A confirmatory factor analysis suggested that the 3-factor model was a moderate fit for data from a second sample of patients. Internal consistency was fairly high and convergent validity was demonstrated by relationships with another scale of alcohol craving, time since last drink, and quantity and frequency of pre-treatment alcohol use. Regarding predictive validity, the level of approach tendencies on the AAAQ was significantly related to abstinence status during the first 6 months following treatment. Avoidance level was not related to abstinence. The results largely replicated past studies utilizing outpatient samples and suggest that the AAAQ shows promise as a psychometrically sound, internally reliable self-report craving measure for individuals with alcohol dependence.     

Validity of self-ratings of abilities and competencies

This study examined the validity of self-estimates of ability on a vocational interest measure (the Self-Directed Search). Self-ratings of 149 female undergraduates were correlated with well-validated measures of abilities corresponding to each of Holland's six interest domains. Employing a multitrait, multimethod methodology, the study found a pattern of, at best, moderate correlations between self-ratings of ability and the objective ratings. Higher correlations were found between self-ratings of abilities and objective measures than for self-ratings of competencies on the Self-Directed Search. However, for both areas there were findings contrary to predictions. Implications for the use of self-ratings in the measurement of vocational interests and related constructs are discussed.     

An Examination of Biodata Theory‐Based Constructs in a Field Context

This study examined whether items from a biodata inventory were consistent with theory‐based constructs as suggested by the ecology model. The model posits five constructs explain biodata predictive ability. Items were sorted using the theory‐based construct domains. The resulting scale scores were assessed for evidence of content, criterion‐related, and construct validity in a sample of 6032 automated systems controllers. Results suggested moderate support for the theory‐based constructs. A notable finding was that items capturing a theoretical construct were impacted by the life stage in which they were anchored. Results further suggest the need to examine if certain life stages are more predictive than others or perhaps if certain constructs are more predictive when related to a particular life stage.     

Converging on quality: Examining multiple measures of teaching effectiveness

The present study explores the convergent and predictive validity for several widely used measures of teaching quality from the Measures of Effective Teaching Project (Bill and Melinda Gates Foundation, 2009-2011). Specifically, the Classroom Assessment Scoring System (CLASS; Pianta, Hamre, & Mintz, 2012), the Framework for Teaching (FFT; Danielson Group, 2013), and the Tripod Student Perceptions Scale (Tripod; Ferguson, 2008) were examined. Correlations among measures were assessed by developmental level and content area (elementary mathematics N = 70; elementary English language arts N = 101; middle school mathematics N = 291, middle school English language arts N = 280). Both average scores and score variability (i.e., coefficient of variation) for the CLASS, FFT, and Tripod were used to predict value-added models (VAM), a high-stakes measure of students' academic growth. For elementary mathematics and ELA, findings indicated the CLASS and FFT exhibited moderate convergent validity while divergent validity was found between the Tripod and the CLASS and FFT. Across content areas in middle school grades, the CLASS, FFT, and Tripod exhibited moderate to high-moderate convergent validity. Average student and observer scores were positively related to VAM scores, whereas variability in scores demonstrated negative relations to VAM scores. Implications of findings for teacher evaluation and professional development are discussed.     

Adapted character styles of Vietnam veterans with Posttraumatic Stress Disorder

A total of 189 male Vietnam veterans who were admitted to a specialized inpatient treatment program were evaluated using the Millon Clinical Multiphasic Personality Inventory to assess character styles. The veterans were assessed for Posttraumatic Stress Disorder by using a subscale of the Minnesota Multiphasic Personality Inventory (MMPI) and 72% of the patients were classified as having Posttraumatic Stress Disorder. The character styles of passive-aggressive, schizoid, avoidant, and borderline were significantly associated with these patients. The most common 2-point profile was passive-aggressive and avoidant (8-2 or 2-8) and was significantly related to the diagnosis. While drug and alcohol abuse were common problem areas for the entire sample, the profile of patients with Posttraumatic Stress was different from those of substance abusers. These results indicate that treating Vietnam veterans with this disorder requires adopting strategies which include a character style focus as well as a symptom focus.     

Reliability and Validity of the Gamblers Anonymous Twenty Questions

One of the earliest instruments to screen for problem gambling, the Twenty Questions (20Q), was developed within Gamblers Anonymous. This instrument has not received serious research attention, however, and its psychometric properties are generally unknown. This study reports reliability and validity data for this instrument in 3 independent samples totaling 456 participants: two samples of problem gamblers in treatment and a non-treatment sample of problem gamblers. The Twenty Questions was shown to possess high reliability as measured by Cronbach’s alpha. Concurrent, convergent and predictive validity of the 20Q supported the use of this instrument as an acceptable screening instrument. Classification analyses indicated that the 20Q is comparable to the DSM-IV diagnostic criteria for pathological gambling in specificity, sensitivity and rates of false negatives and false positives. The 20Q appears to be a reliable and valid measure of problem gambling and warrants continued research attention.     

Observed parenting behavior with teens: measurement invariance and predictive validity across race

Previous reports supporting measurement equality between European American and African American families have often focused on self-reported risk factors or observed parent behavior with young children. This study examines equality of measurement of observer ratings of parenting behavior with adolescents during structured tasks; mean levels of observed parenting; and predictive validity of teen self-reports of antisocial behaviors and beliefs using a sample of 163 African American and 168 European American families. Multiple-group confirmatory factor analyses supported measurement invariance across ethnic groups for four measures of observed parenting behavior: prosocial rewards, psychological costs, antisocial rewards, and problem solving. Some mean-level differences were found: African American parents exhibited lower levels of prosocial rewards, higher levels of psychological costs, and lower problem solving when compared to European Americans. No significant mean difference was found in rewards for antisocial behavior. Multigroup structural equation models suggested comparable relationships across race (predictive validity) between parenting constructs and youth antisocial constructs (i.e., drug initiation, positive drug attitudes, antisocial attitudes, problem behaviors) in all but one of the tested relationships. This study adds to existing evidence that family-based interventions targeting parenting behaviors can be generalized to African American families.     

A dynamic assessment of offender risk, needs, and strengths in a sample of pre-release general offenders

Static, dynamic, and protective factors have been identified as three focal domains significantly related to offender recidivism. However, few measures include comprehensive and inclusive assessment of these variables. The Inventory of Offender Risk, Needs, and Strengths (IORNS) was developed to fill a void in the assessment of risk and needs for offenders. The current study examines the reliability and initial validity of the IORNS in a sample of pre-release offenders assessed for risk and treatment need. Results indicate moderate to high levels of internal consistency and identical IORNS scale results across race, and that the IORNS indexes, scales, and subscales display good convergent validity with self-report and interview measures of static risk, dynamic risk, antisocial behavior, psychopathy, personality pathology, substance abuse, depression, and anxiety. Initial predictive validity examination of the IORNS indicates that several of the indexes, scales, and subscales were able to differentiate offenders who were sent back to prison for half-way house rule violations from those who did not violate rules.     

Taking an individualized approach to the assessment of self-efficacy and the prediction of alcoholic relapse

The present study reports on a clinical instrument designed for assessing self-efficacy in alcoholics. In contrast to studies that construct general measures, it was proposed that taking an individualized approach to assessment might offer an effective methodology. Thirty-four alcoholics in an outpatient, behaviorally oriented treatment program participated as subjects. During therapy, an Individualized Self-Efficacy Survey (ISS) was developed for each subject. The ISS was developed by (a) administering the Drinking Patterns Questionnaire (DPQ) to identify important problem areas (e.g., work, children, marital) and specific drinking antecedents and (b) constructing a 15-item scale using each drinker's most important cues. The utility of having clients choose their own items was supported by finding a significant relationship between problem areas identified as important on the DPQ and the areas reported as surrounding relapse. ISS ratings were reflective of efficacy changes during treatment, while posttreatment ISS scores were predictive of subsequent relapse. Situation-specific prediction of relapse was not found. The advantages of this methodology for clinical use are discussed, while general directions for future research are suggested.     

Assessing Individual Family Members' Constructions of Family Problems

Much contemporary family therapy theory and practice takes into account clients' cognitive constructions of their family problems. Recent calls for therapists to elicit and work with clients' causal explanations and narratives parallel accumulating evidence in the social-clinical literature about the predictive importance of attributions in family relationships. In this article, we introduce the Constructions of Problems Scale (CPS), provide preliminary evidence of its reliability and validity, and suggest ways in which it can be used clinically to reveal new areas for questioning and to generate new ideas. The CPS is a brief questionnaire that can be used to create a profile of each individual family member's private constructions. To complete the CPS, each family member writes a free-form narrative of the presenting problem and then rates his or her perceptions of the contributing causes. The CPS profiles can be used to compare the perspectives of different family members and to assess cognitive constructions at different points in treatment. We discuss its potential for these and other clinical uses.     

Society for Personality Assessment 1971 Program

The aim was to study the validity of 2 personality instruments, the Health-Relevant Personality Inventory (HP5i) and the Junior Temperament and Character Inventory (JTCI), among adolescents with a substance use problem. Clinical interviews were completed with 180 adolescents and followed up after 12 months. Discriminant validity was demonstrated in the lack of correlation to intelligence in both instruments’ scales. Two findings were in support of convergent validity: Negative affectivity (HP5i) and harm avoidance (JTCI) were correlated to internalizing symptoms, and impulsivity (HP5i) and novelty seeking (JTCI) were correlated to externalizing symptoms. The predictive validity of JTCI was partly supported. When psychiatric symptoms at baseline were controlled for, cooperativeness predicted conduct disorder after 12 months. Summarizing, both instruments can be used in adolescent clinical samples to tailor treatment efforts, although some scales need further investigation. It is important to include personality assessment when evaluating psychiatric problems in adolescents.     

科学发明中原型启发的创造性思维成分及其脑机制

目前对创造性思维的测量及神经机制的研究, 国际上大多采用发散思维任务、远距离联想测验、顿悟问题解决等任务。但这些测量工具大多停留在对非科学类问题解决的研究上, 因此生态效度和预测效度都不高。本项目在前面研究的基础上, 探讨更符合现实生活的科学发明中原型启发的创造性思维成分及机制。研究一通过两个行为实验探索原型启发能力的创造性思维成分测试的结构效度; 研究二运用大样本磁共振数据, 从脑机制上进一步验证创造性思维成分的结构效度; 研究三通过3个核磁任务态探索原型启发能力的主要创造性思维成分的脑机制; 研究四试图在高校和企业研发机构进行跟踪研究, 检验创造性思维成分测试的预测效度。通过本项目的开展, 希望开发具有更高预测效度和生态效度的用于发明创造领域的创造性测量工具。     

The predictive validity of the Zung Index of Potential Suicide

Examined the predictive validity of the Zung Index of Potential Suicide. Subjects hospitalized for a suicide attempt were followed up 6 months later. In agreement with earlier studies, the IPS clinical scale was related to suicidal ideation and prior attempting at the time of admission. However, it was not related to further suicidal behavior or ideation at the 6-month followup. It is concluded that the scale lacks predictive validity and its use for assigning suicidal risk is not justified.     

The relationship between psychopathic features, violence and treatment outcome: the comparison of three youth measures of psychopathic features

Few studies have compared self-report and clinician-administered measures of youth psychopathic features in juvenile-justice settings in terms of antisocial behavior and treatment indices. In a sample of 85 adjudicated delinquents, the predictive validities of the Antisocial Process Screening Device (APSD), the modified Childhood Psychopathy Scale (mCPS), and the Hare Psychopathy Checklist: Youth Version (PCL:YV) were tested. Three indices of institutional antisocial behavior (physical aggression; verbal aggression; administrative infractions) and two indices of treatment progress (time to treatment level promotion; whether treatment levels were dropped) were used as external correlates. The self-report measures (mCPS more so than APSD) were more consistently and strongly related to antisocial behavior and to the days required to progress in treatment than the PCL:YV. The following issues are discussed: (i) implications of the potential impact of measurement format on the understanding and predictive validity of youth psychopathy features and measures; (ii) the differential predictive validity of self-report versus clinician-administered measures; and (iii) the potential practical utility of measures of psychopathic features in youth.     

THE STRUCTURE OF CONSCIENTIOUSNESS: AN EMPIRICAL INVESTIGATION BASED ON SEVEN MAJOR PERSONALITY QUESTIONNAIRES

The purpose of this study was to identify the underlying structure of the trait domain of Conscientiousness using scales drawn from 7 major personality inventories. Thirty-six scales conceptually related to Conscientiousness were administered to a large community sample ( N = 737); analyses of those scales revealed a hierarchical structure with 6 factors: industriousness, order, self-control, responsibility, traditionalism, and virtue. All 6 factors demonstrated excellent convergent validity. Three of the 6 factors, industriousness, order, and self-control, showed good discriminant validity. The remaining 3 factors—responsibility, traditionalism and virtue—appear to be interstitial constructs located equally between Conscientiousness and the remaining Big Five dimensions. In addition, the 6 underlying factors had both differential predictive validity and provided incremental validity beyond the general factor of Conscientiousness when used to predict a variety of criterion variables, including work dedication, drug use, and health behaviors.     

The Structured Assessment of Violence Risk in Youth as a predictor of recidivism in a United Kingdom cohort of adolescent offenders with conduct disorder

This prospective study examined the predictive validity of the Structured Assessment of Violence Risk in Youth (SAVRY) and the Psychopathy Checklist: Youth Version (PCL: YV) in 99 male adolescents who were assessed in custody and followed up 12 months post release. Outcome data on recidivism were based on official Home Office records. The base rates for violent and general recidivism, respectively, were 38.4% and 70.7%. The predictive validity of the SAVRY Risk Total and the SAVRY Risk Rating was moderate for both violent and general recidivism, but both showed incremental validity in predicting outcomes compared with the PCL: YV. Data are discussed in relation to the limited published international literature.     

An evaluation of the Quay-Peterson revised behavior problem checklist

The RBPC is perhaps the most valid of all currently available teacher rating scales in terms of factor structure and related measures of validity. Clearly, however, additional research on the concurrent and predictive validity of this instrument is needed. The RBPC is adequately reliable in terms of test-retest reliability and interrater reliability when comparing two teachers and two parents. The lack of representative national norms creates a serious problem for the use of the RBPC by school psychologists, but some useful normative information is available and it would be a relatively easy task to develop local norms.     

Interpreting coronary-prone behaviour: Relationships among type a behaviour,hopelessness, anger management and social contact

Abstract

Two approaches to interpreting relationships among psychosocial risk factors for coronary heart disease are contrasted: the profile approach which focuses on predictive validity and confounding; and the theoretical approach which emphasises internal validity. These approaches are explored by applying them to a set of correlations found among Type A behaviour, hopelessness, anger management and social contact in a female sample. Type A behaviour was positively correlated with hopelessness and with anger expression, whilst anger management was related to the availability of social contact. The relationships between Type A, anger expression and hopelessness also appeared to be moderated by degree of social contact. These results are interpreted from the profile perspective and from that of Price's cognitive social learning theory. The relative merits of the two approaches are considered and a case is made for encouraging more theoretically based research on coronary-prone behaviour.     

Sampling behaviour in estimating predictive validity in the context of selection and latent variable modelling: A Monte Carlo study

While the effect of selection in predictive validity studies has long been recognized and discussed in psychometric studies, little consideration has been given to this problem in the context of latent variable models. In a recent paper, Muthén & Hsu (1993) proposed and compared estimators of predictive validity of a multifactorial test. Both selectivity and measurement error were considered in the estimation of predictive validity. The purpose of the present paper is to expand on Muthén & Hsu (1993) by examining and comparing the sampling behaviour of three estimators for predictive validity, LQL (listwise, quasi-likelihood estimator), FQL (full, quasi-likelihood estimator) and FS (factor score estimator), using a Monte Carlo approach. Effects of selection procedures, selection ratios and sample sizes on the sampling behaviours of the estimators are also investigated. The results show that FQL and FS are the two preferred estimators and each has different strengths and weaknesses. A real data application is presented to illustrate the practical implementation of the estimators.     

Psychometric features related to the acute phase and final outcome of anorexia nervosa

The MMPI responses of a poor and good final outcome group from a follow-up study of anorexia nervosa were compared with responses of a group of anorexic patients in the acute phase. The poor outcome group produced elevated scores in the psychopathological range except on scales 4, 5 and 9. No elevations occurred in the good outcome group and the MMPI thus discriminated significantly between different kinds of final outcome of anorexia nervosa. The profile of the patients in the acute phase at time of testing was not significantly different from the poor outcome group profile. In order to improve the predictive validity of the MMPI related to anorexia nervosa, the paper points to possible directions for further research.