2010 Bruno Klopfer Distinguished Contribution Award. Some considerations for enhancing psychological assessment

The field of psychological assessment appears to be bogged down in recent decades on refining existing measures and techniques to the detriment of real change. This article attempts to highlight some of the changes that need to take place in psychological assessment in the next few decades if real progress is to be achieved: (a) developing guidelines for psychological tests and measures; (b) establishing explicit criteria for training; (c) establishing guidelines for competencies; (d) recognizing the impact of marketing; (e) embracing electronic technology; and (f) implementing computer adaptive testing.     

Monitoring psychotherapy with performance-based measures of personality functioning

In this commentary, I review a meta-analysis and three original research reports concerning the Rorschach (Exner, 2003; Rorschach, 1921/1942) and the Thematic Apperception Test (TAT; Murray, 1943) assessment in psychological treatment planning and outcome evaluation. The information in these four articles bears witness to the potential utility of performance-based personality assessment measures for this purpose. The strengths and limitations of the articles suggest several guidelines for future research designed to examine this Rorschach and TAT application including an emphasis on effectiveness studies, longitudinal data, integrated independent variables, observable dependent variables, sophisticated data analysis combining nomothetic and idiographic presentation, and the incremental contribution of performance-based measures to psychotherapy-related personality assessment.     

A Psychometric Normative Database for Pre-Lung Transplantation Evaluations

This study describes the quality of life and psychological characteristics of a large sample (N = 201) of adult patients evaluated for lung transplantation. In light of the interdisciplinary nature of pre-lung transplant evaluations, establishing norms for measures commonly used in the assessment of transplant candidates has been a priority for the University of Florida transplant programs. Forty-eight percent of the patients reported symptoms of mild to moderate depression. Although quality of life indices were associated with disease severity and exercise tolerance, psychosocial measures generally were not. These data contribute uniquely to the transplant literature and provide valuable normative information on the largest lung transplant cohort reported to date.     

Goodness-of-Fit Assessment in Multidimensional Scaling and Unfolding

Judging goodness of fit in multidimensional scaling requires a comprehensive set of diagnostic tools instead of relying on stress rules of thumb. This article elaborates on corresponding strategies and gives practical guidelines for researchers to obtain a clear picture of the goodness of fit of a solution. Special emphasis will be placed on the use of permutation tests. The second part of the article focuses on goodness-of-fit assessment of an important variant of multidimensional scaling called unfolding, which can be applied to a broad range of psychological data settings. Two real-life data sets are presented in order to walk the reader through the entire set of diagnostic measures, tests, and plots. R code is provided as supplementary information that makes the whole goodness-of-fit assessment workflow, as presented in this article, fully reproducible.     

The International Test Commission Guidelines on the Security of Tests,Examinations, and Other Assessments

The amount and severity of security threats have increased considerably over the past two decades, calling into question the validity of assessments administered around the world. These threats have increased for a number of reasons, including the popular use of computerized and online technologies for test administration and the use of almost undetectable technologies for capturing test content and illegally sharing it instantly across borders and cultures. No assessment program, large or small, is immune to this potential damage. The International Test Commission has recognized the critical need for every organization with an important assessment program to be aware of these and be prepared to counter them. It was for this purpose that these guidelines were developed. Knowing the threats and the guidelines will lead to effective measures to protect the program and its assets, maintaining the value of the tests and assessments to the international community. The guidelines listed in this article provide recommendations on planning for better security, maintaining security during the development of tests and while they are administered, and responding well when a security breach occurs. Following these guidelines will create a significant protective barrier between those who willingly commit test fraud and the valuable assets a program has spent time and money to build.     

Antonio E. Puente: Award for Distinguished Professional Contributions to Independent Practice

Presents Antonio E. Puente as the 2011 winner of the American Psychological Association Award for Distinguished Professional Contributions to Independent Practice. "For his decades of efforts to enhance the recognition of psychologists in providing health care services, through his work with the Current Procedural Terminology (CPT) Panel to develop and maintain appropriate CPT codes for the breadth of professional practice; for his willingness to participate in litigation establishing the expertise of neuropsychologists to testify in court about their findings; for his tireless work in cross-cultural assessment relative to criminal trials; for his leadership of professional societies in clinical neuropsychology; for his promotion of legislation and policy at all levels of government; and for his countless other contributions to the enhancement of independent practice in psychology. Antonio Puente is a far-thinking visionary who freely shares his knowledge to improve the quality of psychological practice and the reimbursement system that attests to the worth of the profession. He is the very embodiment of the psychologist for whom this award is intended." (PsycINFO Database Record (c) 2011 APA, all rights reserved).     

The appropriate domain of the school psychologist

It is argued that efforts to delineate the roles and functions of school psychologists for the purpose of establishing national guidelines are useless. The “appropriate domain” is a function of the competencies and interests of the psychologist, the characteristics of the situation in which he works, and the effects of the interaction between the two. Preparation in basic areas of behavior and psychological methodology are advocated as essential for adaptability to changes and development of leadership in this field. Efforts should be devoted to increasing effectiveness in the use of psychological knowledge and methods in the school setting.     

Psychological Assessment Training in Clinical Psychology Doctoral Programs

We surveyed American Psychological Association–accredited clinical psychology doctoral programs' (n = 83) training in psychological assessment—specifically, their coverage of various assessment topics and tests in courses and practica, and whether the training was optional or required. We report results overall and separately per training model (clinical science, scientist-practitioner, and practitioner-focused). Overall, our results suggest that psychological assessment training is as active, or even more active, than in previous years. Areas of increased emphasis include clinical interviewing and psychometrics; multimethod, outcomes, health, and collaborative or therapeutic assessment; and different types of cognitive and self-report personality tests. All or almost all practice-focused programs offered training with the Thematic Apperception Test and Rorschach compared to about half of the scientist-practitioner programs and a third of the clinical science programs. Although almost all programs reported teaching multimethod assessment, what constitutes different methods of assessing psychopathology should be clarified in future studies because many programs appear to rely on one method—self-report (especially clinical science programs). Although doctoral programs covered many assessment topics and tests in didactic courses, there appears to be a shortage of program-run opportunities for students to obtain applied assessment training. Finally, we encourage doctoral programs to be familiar with (a) internships' assessment expectations and opportunities, (b) the professional guidelines for assessment training, and (c) the American Psychological Association's requirements for preinternship assessment competencies.     

内隐和外显测量对利他行为的预测:来自IAT和BIAT的证据

利他行为是指人们自愿付出一定代价做出的有益于他人的行为。该研究以联结性-推理性评价模型为理论基础探讨内隐和外显测量对利他行为的预测效度,研究以193名大学生为被试,将4种内隐利他测量方法和1种外显利他测量方法相结合,以自发性水平不同的3种利他行为为结果变量。结果发现,IAT和BIAT的信度和效度较好,BIAT尤其值得采用。内隐利他自我概念测量能有效地预测真实情境中自发性较高的捐助行为,外显测量则预测了意识控制下自我报告的利他行为。结果表明,只有内隐利他自我概念测量能预测真实情境中快速发生的利他行为。其作用是外显利他测量和内隐利他态度测量所不能代替的。     

Does severity predict distress? The relationship between subjective and objective measures of appearance and psychological adjustment,during treatment for facial lipoatrophy

The intuitive or lay belief that the severity of a disfiguring condition predicts psychological distress is not demonstrated in clinical practice, nor in research studies. This within group study used standardised measures repeated at six month intervals, to investigate the relationship between subjective and objective measures of appearance and psychological adjustment in 51 patients undergoing treatment for facial lipoatrophy using a synthetic filler, Newfill^®. Results demonstrate a dissociation between objective and subjective measures with only subjective assessment predicting psychological outcomes. It is recommended that Moss's (2005) hypothesis of discrete group membership (normal/not normal) should be adapted to include an internal standard for comparison, and that all evaluations of treatment modifying disfigurement should include a standardised subjective measure of appearance.     

CONSTRUCTING PARALLEL SIMULATION EXERCISES FOR ASSESSMENT CENTERS AND OTHER FORMS OF BEHAVIORAL ASSESSMENT

Assessment centers rely on multiple, carefully constructed behavioral simulation exercises to measure individuals on multiple performance dimensions. Although methods for establishing parallelism among alternate forms of paper-and-pencil tests have been well researched (i.e., to equate tests on difficulty such that the scores can be compared), little research has considered the why and how of parallel simulation exercises. This paper extends established procedures for constructing parallel test forms to dimension-based behavioral simulations. We discuss reasons for establishing comparable, alternate simulation forms and discuss the issues raised when applying traditional procedures to simulation exercises. After proposing a set of guidelines for establishing alternate forms among simulations, we apply these guidelines to simulations used in an operational assessment center.     

The Belief in a Just World: An Examination of Reliability Estimates Across Three Measures

This paper presents a model for viewing assessment from nine vantage points simultaneously. Each of these dimensions or 'parameters' is divided into sublevels. The power and usefulness of the resultant model stems from the variety of possible unique interactions among these dimensions and their sublevels. The model has the following useful properties: (a) it provides a multidimensional definition of several aspects of psychological assessment, (b) it serves as a checklist and guide for the criticism of existing psychological tests and measures, (c) it has potential heuristic value in the generation of new measures and tests, (d) it is flexible, in that new parameters may be added and sublevels changed to suit specific needs, and (e) it is presented visually as a spatial model, thus allowing the Viewer a more "concrete" appreciation of what are really theoretical interactions.     

Combining Patient Utility with Health Status Assessment to Improve Medical Decision Making

Physicians often use health status assessment tools to evaluate a patient's condition, then apply established guidelines to determine the most medically effective treatment. Yet additional criteria, such as the appropriateness of the treatment given the particular patient's preferences and attitude toward risk, are also highly relevant to quality care. While such preferences could be addressed via patient utility functions, their use in actual practice is somewhat limited because elicitation is often considered too burdensome for patients, unreliable, or redundant given other measures. For a small group of real patients who have suffered a stroke, we measure both traditional health status and patient utility for the current state to determine whether limited, focused utility assessment is a practical means of obtaining additional and relevant patient information. We find that utility assessment is perceived as reasonable and useful by patients, even when quite ill, and that utilities and health status are not redundant. In fact, investigating apparent inconsistencies between patient utility and observed health status can alert the physician to patient concerns and criteria not captured by more traditional measures. We propose an approach to medical decision making that uses both measures to improve patient–physician communication.     

Do automatic mental associations detect a flashbulb memory?

Flashbulb memories (FBMs) are defined as detailed memories for the reception context in which people first heard of a public and emotionally relevant event. For many years researchers have been debating whether FBMs can be considered a special class of emotional memories, or whether they suffer the same fate as ordinary autobiographical formations. The debate on the real existence of this special class of memories reflects the difficulty of establishing their accuracy. Three indices have been defined as proxies for FBM accuracy: specificity of recalled details, individuals’ confidence in their memory, and memory consistency over time. However, all approaches to FBM assessment have been based on explicit self-report measures. In two studies we aimed to detect FBMs for two emotional public events, by simultaneously employing explicit traditional FBM measures and implicit measures based on the autobiographical Implicit Association Test (aIAT). Jointly considered, the results from the two studies showed that the implicit measures were able to discriminate a FBM, and appeared significantly associated with explicit traditional measures of FBM Specificity, Confidence, and Consistency. Both explicit and implicit assessments concurred to correctly estimate a FBM. Implications for the FBM debate are discussed.     

Issues in psychoneuroimmunology research

Careful design of studies is crucial for meaningful progress in this area of inquiry. Along with systematic evaluation of immunologic factors, clear understanding of antecedent factors is also important. Age, sex, and other sociodemographic factors might play a major role in how an individual reacts to a given situation when compared with another individual. Assessment of the impact of these factors on the immune system might be further complicated by immunosuppressive viruses like HIV or by the use of many common medications such as beta-blockers for hypertension (Kiecolt-Glaser & Glaser, 1988). Longitudinal studies are needed to understand the process of change and the dynamic patterning of psychosocial and immunologic relationships over time. Additionally, use of multimodal measures to assess psychological events such as stress is imperative (Baum, Grunberg, & Singer, 1982). It will not serve our understanding of psychological influences on the immune system to jump to the conclusion that an event is "stressful" because it seems as if it should be. Finally, establishing a "core" battery of widely accepted immune tests will be important in establishing comparability across studies. The standardization and acceptance of specific biochemical measures will facilitate the infusion of talented clinical and basic scientists into the area of psychoneuroimmunology.     

Guidelines for psychological practice with girls and women

During recent decades, women and girls of diverse ethnicities, social classes, sexual orientations, and life experiences have encountered dramatic and complex changes in education, health, work, reproductive and caregiving roles, and personal relationships. Although many of these changes have resulted in increased equality, opportunity, and quality of life, girls and women are also at risk for a variety of health concerns and life stresses. The aim of this document is to articulate guidelines that will enhance gender- and culture-sensitive psychological practice with women and girls from all social classes, ethnic and racial groups, sexual orientations, and ability/disability statuses in the United States. These guidelines provide general recommendations for psychologists who seek to increase their awareness, knowledge, and skills in psychological practice with women and girls. The beneficiaries include all consumers of psychological practice, including clients, students, supervisees, research participants, consultees, and other health professionals. Although the guidelines and supporting literature place substantial emphasis on psychotherapy practice, the general guidelines are applicable to psychological practice in its broadest sense. Rather than offering a comprehensive review of content relevant to all areas of practice, this document provides examples of empirical and conceptual literature that support the need for practice guidelines.     

Equine Facilitated Therapy with Children and Adolescents Who Have Been Sexually Abused: A Program Evaluation Study

Child sexual abuse (CSA) is a social problem that often inflicts long lasting psychological trauma and leads to psychopathology, behavioural problems and re-victimization. Treating young people who are presenting with the detrimental effects of CSA is often difficult because these effects off-set efforts at establishing a therapeutic bond. Animals have been found to facilitate the development of the therapeutic alliance between client and practitioner and therapies utilizing horses have the added bonus of empowering clients. This study aimed to evaluate an Equine Facilitated Program (EFT) run by Phoenix House, a sexual assault referral centre in Queensland, Australia. Participants were six boys and nine girls (aged 8–11 years) and 15 adolescent girls (aged 12–17 years). All participants provided several measures of data designed to establish levels of psychological distress at three points in time. That is, Time 1—intake into the service; Time 2—following approximately 6 weeks of in-clinic counselling and pre-EFT; and Time 3 post-EFT (9–10 week duration). Significant improvements in functioning were found between Time 2 and Time 3 assessment across all psychometric measures and for both age groups. No, or non-significant, improvements were found between Time 1 and Time 2 assessments. Overall the results show that EFT proved an effective therapeutic approach for the children and adolescents referred to the service. Of particular note was the finding that efficacy was similar across gender, age and Indigenous/non-Indigenous status. Implications of this and suggestions for further research are discussed.     

Validity Concerns in the Measurement of Women’s and Men’s Report of Intimate Partner Violence

The measurement of intimate partner violence (IPV) has proven to be more complex than originally anticipated and content and construct validity need to be greatly improved for IPV assessment. For measurement of IPV in the United States, these validity issues range from providing the most accurate wording for the content domain to controversies as to when violent actions are counted (e.g., self-defense) or whether to include mild aggression (e.g., psychological conflict tactics) that may be more normative and not harmful. The three major forms of IPV (i.e., physical, sexual, and psychological abuse) have distinct validity issues and may require different modalities for assessment. Gender needs to be considered when establishing construct validity due to differences in the meaning of aggression, impacts of abuse, and even patterns of violence for women and men. External threats to validity include potential bias of self-report and motivations when reporting on a partner, discrepancies in couples’ reports, the influence of response styles, and design issues affecting reporting. Traditional methods used to establish validity for IPV scales are reviewed and critiqued. Recommendations for enhancing validity in IPV assessment are provided.     

Counseling the Hispanic Client: Cuban Americans,Mexican Americans,and Puerto Ricans

This article describes a general framework that may be used when counseling Cuban American, Mexican American, and Puerto Rican clients. The psychological and sociocultural characteristics of these populations are described. Both differences and similarities among the 3 groups are reviewed. The identification of the client's worldview, cultural values, and family values provides a specific framework for counseling these clients. Specific and general guidelines are provided for the psychological assessment of Cuban American, Mexican American, and Puerto Rican clients.