Factor Structure and Incremental Validity of the Original and Modified Versions of the Difficulties in Emotion Regulation Scale

This paper describes a human science approach to the delivery of the feedback component of assessment services. The feedback process is now central to a collaborative assessment that is integrated with intervention. Research has suggested that subject, situational, and assessor variables are relevant for feedback, but such research has been unsystematic. A servicedelivery paradigm for feedback of assessment findings is described that includes four levels of increasing client participation: information, emotional contingencies, transfer of power, and functioning of an assessment system. Communication of assessment findings has been incomplete historically because motivation for feedback, resource accessibility for feedback utilization, and criteria for adequate feedback have been considered as unrelated ingredients. The components of Antonovsky's Sense of Coherence construct – meaningfulness, manageability and comprehensibility – provide one conceptualization for interaction of these ingredients. It is now feasible to do systematic research on assessment that includes feedback of assessment findings and the service-delivery process.     

Personality Assessment and Native Americans

Personality assessment services for Native Americans have been culturally inappropriate and historically underutilized as a consequence. A framework for personality assessment is presented including components of relevant cultural knowledge, assessment techniques, assessor characteristics, and relationship style. Emic and etic approaches are described as serving different assessment functions. Acculturation measures and awareness of acculturation effects on different instruments provide temporary palliatives. A biopsychosocial model for service-delivery with linkages to family, tribal, county, state, and federal resources would be desirable and potentially effective. Ameliorations in techniques and service-delivery cannot substitute for genuine professional commitment to recruitment and training of indigenous assessment service-providers.     

Personality assessment and Native Americans

Personality assessment services for Native Americans have been culturally inappropriate and historically underutilized as a consequence. A framework for personality assessment is presented including components of relevant cultural knowledge, assessment techniques, assessor characteristics, and relationship style. Emic and etic approaches are described as serving different assessment functions. Acculturation measures and awareness of acculturation effects on different instruments provide temporary palliatives. A biopsychosocial model for service-delivery with linkages to family, tribal, county, state, and federal resources would be desirable and potentially effective. Ameliorations in techniques and service-delivery cannot substitute for genuine professional commitment to recruitment and training of indigenous assessment service-providers.     

The Joint Multivariate Modeling of Multiple Mixed Response Sources: Relating Student Performances with Feedback Behavior

The present study concerns a Dutch computer-based assessment, which includes an assessment process about information literacy and a feedback process for students. The assessment is concerned with the measurement of skills in information literacy and the feedback process with item-based support to improve student learning. To analyze students’ feedback behavior (i.e. feedback use and attention time), test performance, and speed of working, a multivariate hierarchical latent variable model is proposed. The model can handle multivariate mixed responses from multiple sources related to different processes and comprehends multiple measurement components for responses and response times. A flexible within-subject latent variable structure is defined to explore multiple individual latent characteristics related to students’ test performance and feedback behavior. Main results of the computer-based assessment showed that feedback-information pages were less visited by well-performing students when they relate to easy items. Students’ attention paid to feedback was positively related to working speed but not to the propensity to use feedback.     

On the mechanisms and effects of feedback in group psychotherapy

Group psychotherapists commonly see feedback as one of the primary mechanism that furthers the goals of the group. This paper will summarize the research that has been done on the mechanisms leading members to produce feedback, the factors that induce members to accept feedback (for example, feedback valence and timing), and the effects of feedback on outcome and aspects of group process such as group cohesion. The article will address the practical implications of these findings for the interventions of the group psychotherapist. As will be discussed, the emphasis on the importance of feedback in the interpersonal group psychotherapy literature exceeds the programmatic research that has been done on basic questions. This paper will identify major lines of future investigation that could yield findings critical to the delivery of effective group psychotherapy such as the information processing sequences that underlie feedback delivery and reception.     

Assessee and Assessor Experiences of Significant Events in Psychological Assessment Feedback

Although a growing body of scholarly work explores the unique utility and therapeutic uses of psychological assessment, less work has focused specifically on feedback, with few studies that have explored empirically the underlying processes that may describe the role of feedback in a successful assessment. The purpose of this project was to add to the discourse on this topic by engaging in an empirical study exploring assessee and assessor experiences of significant events in psychological assessment feedback. The methodology is qualitative and modeled after significant events research in the study of psychotherapy process. I analyze the accounts of 6 assessment clients and 6 assessment clinicians regarding key events in their experience of feedback.     

Assessee and assessor experiences of significant events in psychological assessment feedback

Although a growing body of scholarly work explores the unique utility and therapeutic uses of psychological assessment, less work has focused specifically on feedback, with few studies that have explored empirically the underlying processes that may describe the role of feedback in a successful assessment. The purpose of this project was to add to the discourse on this topic by engaging in an empirical study exploring assessee and assessor experiences of significant events in psychological assessment feedback. The methodology is qualitative and modeled after significant events research in the study of psychotherapy process. I analyze the accounts of 6 assessment clients and 6 assessment clinicians regarding key events in their experience of feedback.     

False feedback and beliefs influence name recall in younger and older adults

Feedback is an important self-regulatory process that affects task effort and subsequent performance. Benefits of positive feedback for list recall have been explored in research on goals and feedback, but the effect of negative feedback on memory has rarely been studied. The current research extends knowledge of memory and feedback effects by investigating face–name association memory and by examining the potential mediation of feedback effects, in younger and older adults, through self-evaluative beliefs. Beliefs were assessed before and after name recognition and name recall testing. Repeated presentation of false positive feedback was compared to false negative feedback and a no feedback condition. Results showed that memory self-efficacy declined over time for participants in the negative and no feedback conditions but was sustained for those receiving positive feedback. Furthermore, participants who received negative feedback felt older after testing than before testing. For name recall, the positive feedback group outperformed the negative feedback and no feedback groups combined, with no age interactions. The observed feedback-related effects on memory were fully mediated by changes in memory self-efficacy. These findings advance our understanding of how beliefs are related to feedback in memory and inform future studies examining the importance of self-regulation in memory.     

Virtual reality in brain damage rehabilitation: review.

Given the high incidence of brain injury in the population, brain damage rehabilitation is still a relatively undeveloped field. Virtual reality (VR) has the potential to assist current rehabilitation techniques in addressing the impairments, disabilities, and handicaps associated with brain damage. The main focus of much of the exploratory research performed to date has been to investigate the use of VR in the assessment of cognitive abilities, but there is now a trend for more studies to encompass rehabilitation training strategies. This review describes studies that have used VR in the assessment and rehabilitation of specific disabilities resulting from brain injury, including executive dysfunction, memory impairments, spatial ability impairments, attention deficits, and unilateral visual neglect. In addition, it describes studies that have used VR to try to offset some of the handicaps that people experience after brain injury. Finally, a table is included which, although not an exhaustive list of everything that has been published, includes many more studies that are relevant to the use of VR in the assessment and rehabilitation of brain damage. The review concludes that the use of VR in brain damage rehabilitation is expanding dramatically and will become an integral part of cognitive assessment and rehabilitation in the future.     

Can false memories be corrected by feedback in the DRM paradigm?

Normal processes of comprehension frequently yield false memories as an unwanted by-product. The simple paradigm now known as the Deese/Roediger-McDermott (DRM) paradigm takes advantage of this fact and has been used to reliably produce false memory for laboratory study. Among the findings from past research is the difficulty of preventing false memories in this paradigm. The purpose of the present experiments was to examine the effectiveness of feedback in correcting false memories. Two experiments were conducted, in which participants recalled DRM lists and either received feedback on their performance or did not. A subsequent recall test was administered to assess the effect of feedback. The results showed promising effects of feedback: Feedback enhanced both error correction and the propagation of correct recall. The data replicated other data of studies that have shown substantial error perseveration following feedback. These data also provide new information on the occurrence of errors following feedback. The results are discussed in terms of the activation-monitoring theory of false memory.     

Parent and child experiences of neuropsychological assessment as a function of child feedback by individualized fable

This study evaluated whether receiving developmentally appropriate feedback in the form of individualized fables would affect how children and their parents reported experiencing a neuropsychological assessment. Participants were 32 children who underwent a neuropsychological assessment, along with one of their parents. The evaluation process, including the provision of parent feedback, was standard for the setting, a private practice of neuropsychology. The only addition was the provision of child feedback through a fable, given to the experimental group prior to the collection of research measures and to the comparison group after the collection of research data. Multivariate and univariate statistics were used to test differences between the two groups. Results indicated that children in the experimental group reported a greater sense of learning about themselves, a more positive relationship with their assessor, a greater sense of collaboration with the assessment process, and a sense that their parents learned more about them because of the assessment than did children in the comparison group. Parents in the experimental group reported a more positive relationship between their child and the assessor, a greater sense of collaboration with the assessment process, and higher satisfaction with clinic services compared to the comparison group. Limitations and implications for future research and assessment practice with children are discussed.     

心理治疗的过程研究

心理治疗的过程研究是辨识心理治疗的活性成分和改变机制,是心理治疗效果研究的重要领域。心理治疗过程研究的最新进展体现在研究内容的扩展,研究方法的改进及研究结果的新发现等方面。对未来研究的几点建议：活性成分的层次性观点,改变机制的双线研究及与治疗过程模型的结合,借鉴邻近学科的研究成果,改善RCTs时间设计,关注质化研究,临床工作者与研究者的合作,以及开展本土化研究。     

360 Degree Feedback and Leadership Development

If we had to identify the major areas of growth in relation to techniques for supporting leadership development, it would have to include use of 360 degree feedback. At two recent US conferences (The 24th International Congress on Assessment Centre Methods, May 1996, held in Washington, DC, and the First Annual Leadership Development Conference held in October 1996 in Boston), dedicated to presentations by researchers and practitioners on the subject of leadership assessment and development, the topic of multi-rater or multi-source feedback, as it is also known, formed a key component. This paper will outline some of the reasons why this is the case, and some of the research findings that have emerged in the last few years including issues relating to gender and perceptions of leadership. It will also describe how the author has been involved in introducing 360 degree feedback processes in several public sector organizations in the UK, together with lessons that have emerged.     

The predictive validity of individual psychological assessments in selecting UK public sector senior managers

Individual Psychological Assessment (IPA) is a very widely offered service in Organizational Psychology. It generally consists of a psychologist or HR practitioner using a combination of interview and psychometrics to arrive at a detailed assessment of an individual's capabilities in relation to a job they are being considered for. Although much used, this practice has limited supporting evidence of its validity—not least because of the methodological difficulties in conducting research on this subject—and has been criticized accordingly. The current study examines the use of IPAs with 115 middle and senior management level candidates in a civil service context. All candidates completed a set of psychometric measures and had an in‐depth interview with a psychologist as part of a standardized process. The ratings made by the assessors were correlated with a criterion measure of potential for promotion derived from multisource feedback ratings obtained on these candidates some months later. Analysis of the results indicated that three of the four attributes rated by assessors correlated significantly with the criterion measure. Further, assessors’ ratings were found to show incremental validity over that provided by psychometric test scores alone. These findings are discussed in terms of the use of IPAs in senior level assessment.     

Can performance-feedback accuracy be improved? Effects of rater priming and rating-scale format on rating accuracy

Performance appraisal information is often used for employee feedback and development. Research has found that assessments that are global (i.e., based on broad aspects of performance) and comparative (i.e., explicit interratee comparisons) may be most accurate in terms of Cronbach's (1955) differential accuracy, a type of accuracy that is directly relevant to the provision of feedback. Unfortunately, a global-comparative assessment may not give recipients the most useful diagnostic feedback. In this experiment, an innovative rater-priming manipulation was developed and tested on a sample of 109 participants. The priming manipulation had the effect of improving differential accuracy and providing diagnostic feedback. A 2nd independent variable involving 2 different Behavioral Observation Scale formats also was investigated. Explanations of findings, limitations of this experiment, directions for future research, and implications for performance appraisal practice are discussed.     

Mnemic neglect is not an artifact of expectancy: The moderating role of defensive pessimism

Research supporting the mnemic neglect model finds that people more easily recall positive than negative personality feedback, even when only asked to imagine that the feedback is real. The same bias is not found when people are asked to recall information about other people. Despite evidence that these findings reflect self‐enhancement motives, more research is needed to rule out the possibility that they instead simply reflect expectancies. Results supported the mnemic neglect model, and revealed that expectancies predicted recall only for a subgroup of participants who did not demonstrate the self–other recall bias characteristic of mnemic neglect: defensive pessimists, who are more likely than other people to process social information by comparing it to their expectancies. These findings suggest that mnemic neglect is not an artifact of expectancies, and is not driven by other self‐evaluation motives (such as self‐verification or self‐assessment). Copyright © 2009 John Wiley & Sons, Ltd.     

What do We Know about Family Interventions for Psychosis at the Process Level? A Systematic Review

The evidence regarding effectiveness of family interventions for psychosis (FIP) is strong and consistent. However, there is a gap in the research on the process of these interventions, and little is known about their active ingredients. This review aims to identify the active ingredients of FIP. We conducted a systematic literature review, focusing on qualitative research, and analyzed 22 papers in total. We found a single study comprehensively exploring the process of FIP. All other studies focused on particular aspects of process‐related variables. The key elements of FIP seem to be the so‐called “common therapeutic factors”, followed by education about the illness and coping skills training. This review supports the value of a stepped model of intervention according to the needs of the families. However, the evidence reviewed also reveals a gap in the research findings based on the limited research available. FIP are complex, psychosocial interventions with multiple components, and more intensive, qualitative research is needed to establish linkages between process and outcome.     

The role of subjective theories for leadership evaluation

This study reviews prior construct-related validity research in assessment centres. Special focus is placed on disentangling possible explanations for the construct-related validity findings. The conclusion is that we now have a much better picture of the reasons behind the construct-related validity findings. Careful assessment centre design and high interrater reliability among assessors seem necessary albeit insufficient conditions to establish assessment centre construct-related validity. The nature of candidate performances is another key factor. This study next discusses how these empirical findings have changed how assessment centres are conceptualized (theoretical advancements framed in the application of trait activation theory), analysed (methodological advancements), and designed (practical advancements).     

L’évaluation thérapeutique et collaborative : preuves empiriques

This paper covers the empirical research that addressed utility and effectiveness of therapeutic assessment or of its components (i.e., providing individualize feedback to clients). Studies vary in terms of methods and problems addressed but provide the consistent picture of therapeutic assessment as a brief approach which increases process variables related to subsequent treatment and has direct effects of symptoms reduction for a variety of psychological problems. Future directions of studies in this are finally provided.     

Interaction of therapeutic process and alliance during psychological assessment

Utilizing a collaborative therapeutic assessment (TA) model proposed by Finn and Tonsager (1997), we examined the interaction between therapeutic alliance and in-session process during the assessment phase of treatment. This study compares the utility of the TA model (n = 38) versus a traditional information gathering model (n = 90) of assessment. The results of this study indicate that the use of a TA model may decrease the number of patients who terminate treatment against medical advice. The Session Evaluation Questionnaire (Stiles & Snow, 1984), Combined Alliance Short Form (Hatcher & Barends, 1996), and Penn Helping Alliance Questionnaire-Revised (Barber & Crits-Christoph, 1996) can reliably measure the patient's experience of the assessment. The psychological assessment process may impact the patient's experience of assessment feedback and aid in the development of a therapeutic alliance. The therapeutic alliance developed during the assessment was found to be related to alliance early in psychotherapy. We discuss the theoretical, clinical, and research implications of these findings.