Teaching culturally informed psychological assessment: conceptual issues and demonstrations

Multicultural assessment requires a strong conceptual foundation to address the complex and dynamic nature of culture. I present 3 conceptual issues as well as the demonstrations or exercises that I use to teach these concepts to students in a doctoral program of clinical psychology. The first conceptual issue is that multicultural assessment requires a solid foundation in traditional assessment theory and methods. Second, culturally informed assessors specify and test what about the social and cultural world matters to avoid making inferences based on group labels associated with ethnicity or race. Third, culturally responsive assessors must formulate and test both culture-specific and alternative (impairment or dysfunction) hypotheses, which refers to shifting cultural lenses (Kleinman & Kleinman, 1991). I then review exercises and demonstrations to illustrate these conceptual ideas. My aim is to help instructors guide students of assessment toward integrating a process-oriented way of thinking about culture, one that promotes a critical approach to our understanding of the role of culture in human behavior and its assessment.     

Individual differences in habituation: Some methodological and conceptual issues

The personality correlates of habituation were investigated. A moderate intensity tone was presented 20 times on each of three sessions, and skin conductance and heart rate were recorded. There were no relationships between individual differences in rate of habituation and any of the personality dimensions assessed (which included, among others, manifest anxiety and introversion-extraversion). Some possible reasons are discussed for this lack of results, as well as for conflicting findings which fill the literature. Specifically, various methods of measuring habituation are examined and their interrelationships described. None of the measures derived showed adequate consistency either across sessions or over response modalities.     

The triple response approach to assessment: a conceptual and methodological reappraisal

Despite its positive effects on the increased use of multiple assessments and improved assessment validity, the triple-response concept has led to some conceptual and practical confusion. This is mainly due to two problems: (1) a confounding of the content and method of assessment; and (2) an imprecise and vague use of the 'verbal-subjective mode' which has been expanded to include cognitive elements since the introduction of cognitive-behavioural theories and treatments. A new matrix is proposed that clearly distinguishes content and method of assessment. It also defines a separate cognitive/information-processing content area and introduces affect as an additional content area. Thus, four content areas are suggested: behavioural, physiological, cognitive, and affective, which can be measured in three different ways: by means of self-report, observation, and instruments or technical equipment. We point out the implications of these changes for (1) a more appropriate selection of assessment procedures and outcome measures in clinical research; (2) a more adequate individualization of treatment through matching individual response profiles to specific treatments; and (3) an improved understanding of the interrelationship between behavioural, physiological, cognitive, and affective processes in anxiety and depression. Finally, we suggest that the lack of agreement between measures of physiological, cognitive, behavioural and affective changes in some studies may be as much a reflection of the lack of agreement arising from spurious sources of variance within content areas as it is a reflection of the operation of different processes and systems.     

The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations

In this article, we attempt to distinguish between the properties of moderator and mediator variables at a number of levels. First, we seek to make theorists and researchers aware of the importance of not using the terms moderator and mediator interchangeably by carefully elaborating, both conceptually and strategically, the many ways in which moderators and mediators differ. We then go beyond this largely pedagogical function and delineate the conceptual and strategic implications of making use of such distinctions with regard to a wide range of phenomena, including control and stress, attitudes, and personality traits. We also provide a specific compendium of analytic procedures appropriate for making the most effective use of the moderator and mediator distinction, both separately and in terms of a broader causal system that includes both moderators and mediators.     

Validity of the Sheltered Care Environment Scale: conceptual and methodological issues

The Sheltered Care Environment Scale (SCES) was developed primarily to measure social climate as an attribute of a setting. As such, the SCES was designed to maximize differences between facilities and minimize differences among individuals within a setting. However, Smith and Whitbourne (1990) assessed the validity of the SCES as a measure of individual differences in perceptions of a shared environment. Moreover, they redefined the content coverage of 2 of the SCES subscales (Independence and Physical Comfort), to encompass attributes the SCES is not intended to measure. In general, preliminary evidence indicates that the SCES subscales provide reasonably reliable and valid indices of the social climate of group residential facilities.     

Psychological testing and psychological assessment. A review of evidence and issues

This article summarizes evidence and issues associated with psychological assessment. Data from more than 125 meta-analyses on test validity and 800 samples examining multimethod assessment suggest 4 general conclusions: (a) Psychological test validity is strong and compelling, (b) psychological test validity is comparable to medical test validity, (c) distinct assessment methods provide unique sources of information, and (d) clinicians who rely exclusively on interviews are prone to incomplete understandings. Following principles for optimal nomothetic research, the authors suggest that a multimethod assessment battery provides a structured means for skilled clinicians to maximize the validity of individualized assessments. Future investigations should move beyond an examination of test scales to focus more on the role of psychologists who use tests as helpful tools to furnish patients and referral sources with professional consultation.     

Conceptual,methodological, and clinical issues in cognitive-behavioral assessment

This article reviews cognitive-behavioral assessment principles and procedures. The functions of such assessments are noted, and issues and advances in cognitive assessment are discussed. The need for integrated cognitive, behavioral, and affective assessments is then explored. Finally, conceptual methodological, and clinical issues in the integration of assessments and study of reciprocal determinants are presented.Preparation of this paper was supported in part by a General Research Board Faculty Research Award from the University of Maryland. The author would like to thank Steve Graham, Donald Meichenbaum, Barbara Keogh, and Bernice Wong for their feedback during the preparation of this paper.     

Rethinking current approaches to psychological abuse: Conceptual and methodological issues

Numerous ways in which we currently approach conceptualizing and measuring “psychological abuse” are highly problematic and likely inaccurate for understanding this complex phenomenon. While a major goal of this type of research often appears to be the identification of individuals considered to have been “psychologically abused”, this may be both a premature and misplaced goal. “Psychological abuse” has not been adequately defined, validated, or conceptually anchored in a way which provides a sound basis for its measurement, or which allows for conclusions to be made and applied to real-life settings. Rather, more important for this area of research is the development of sophisticated thought and measurement approaches applied to the broader field of psychological aggression (which does not attempt to determine a threshold for claiming “abuse” has occurred). The conceptualization and measurement of this complicated interpersonal phenomenon needs inclusion of not only the recipient's perspective, but also observers' views, the perspective of the initiator, outcome of the actions, analysis of contextual variables, as well as analysis of the recipient's and initiator's views.     

Assessing psychological change in adulthood: an overview of methodological issues

This article reviews the current status of methods available for the analysis of psychological change in adulthood and aging. Enormous progress has been made in designing statistical models that can capture key aspects of intraindividual change, as reflected in techniques such as latent growth curve models and multilevel (random-effects) models. However, the rapid evolution of statistical innovations may have obscured the critical importance of addressing rival explanations for statistical outcomes, such as cohort differences or practice effects that could influence estimates of age-related change. Choice of modeling technique and implementation of a specific modeling approach should be grounded in and reflect both the theoretical nature of the developmental phenomenon and the features of the sampling design that selected persons, variables, and contexts for empirical observation.     

Conceptual,methodological, and clinical issues in the assessment of anxiety disorders

Many conceptual, methodological, and clinical issues remain unresolved in the assessment of anxiety disorders. Despite the prevalence, incidence, chronicity, and severity of anxiety disorders, research efforts and funding have fallen behind with regard both to other disorders and to addressing critical issues in the field. The primary objective of this paper is to provide a scientific critique regarding a number of often ignored yet salient considerations in anxiety-disorders assessment. Critical analyses of and recommendations regarding the multidimensional nature of anxiety, comorbidity, uniformity myths, synchrony, normative comparisons, psychometric properties of measures, and treatment integrity are offered. Finally, promising areas of clinical research are presented to enhance further the current understanding of the complexities inherent in assessing anxiety disorders.Preparation of this paper was supported in part by NIMH Grant MH36299.     

Teaching psychological assessment: training issues and teaching approaches

Clinical psychology graduate programs need to pay attention to important issues involved in teaching psychological assessment, if graduate students are to be adequately prepared. Recent studies have suggested a gap between academic training in psychological assessment and internship expectations. Graduate students are not as well prepared as many internship settings would like. In addition to learning the fundamentals, students need help in dealing with issues of categorizing individuals, using tests in helpful ways, taking responsibility for decision-making, and developing a balance between critical evaluation of tests and appreciation of their usefulness. Teaching approaches for dealing with these issues are discussed. The importance of academic and clinical agencies working together is stressed. Goals for graduate training in assessment are suggested.     

A comparative study of adolescent risk assessment instruments: predictive and incremental validity

Promising new adolescent risk assessment tools are being incorporated into clinical practice but currently possess limited evidence of predictive validity regarding their individual and/or combined use in risk assessments. The current study compares three structured adolescent risk instruments, Youth Level of Service/Case Management Inventory (YLS/CMI), Structured Assessment of Violence Risk in Youth (SAVRY), and Psychopathy Checklist: Youth Version (PCL:YV), for both predictive and incremental validity with respect to general and violent recidivism. Receiver operating characteristic and hierarchical logistic regression analyses revealed that the risk tools predicted general and violent recidivism to varying degrees of accuracy, but the SAVRY offered the most in incremental validity. Clinical implications and future directions for youth risk assessment are discussed.     

Solutions to the problems of incremental validity testing in relationship science

Incremental validity testing (i.e., testing whether a focal predictor is associated with an outcome above and beyond a covariate) is common (e.g., 57% of Personal Relationships articles in 2017), yet it is fraught with conceptual and statistical problems. First, researchers often use it to overemphasize the novelty or counterintuitiveness of findings, which hinders cumulative understanding. Second, incremental validity testing requires that the focal predictor and the covariate represent separate constructs; researchers risk committing the “jangle fallacy” without such evidence. Third, the most common approach to incremental validity testing (i.e., standard multiple regression, 88% of articles) inflates Type I error and can produce invalid conclusions. This article also discusses the relevance of these issues to dyadic/longitudinal designs and offers concrete solutions.