Differences in Inter‐Rater Reliability and Accuracy for a Treatment Adherence Scale

Inter‐rater reliability and accuracy are measures of rater performance. Inter‐rater reliability is frequently used as a substitute for accuracy despite conceptual differences and literature suggesting important differences between them. The aims of this study were to compare inter‐rater reliability and accuracy among a group of raters, using a treatment adherence scale, and to assess for factors affecting the reliability of these ratings. Paired undergraduate raters assessed therapist behavior by viewing videotapes of 4 therapists' cognitive behavioral therapy sessions. Ratings were compared with expert‐generated criterion ratings and between raters using intraclass correlation (2,1). Inter‐rater reliability was marginally higher than accuracy (p = 0.09). The specific therapist significantly affected inter‐rater reliability and accuracy. The frequency and intensity of the therapists' ratable behaviors of criterion ratings correlated only with rater accuracy. Consensus ratings were more accurate than individual ratings, but composite ratings were not more accurate than consensus ratings. In conclusion, accuracy cannot be assumed to exceed inter‐rater reliability or vice versa, and both are influenced by multiple factors. In this study, the subject of the ratings (i.e. the therapist and the intensity and frequency of rated behaviors) was shown to influence inter‐rater reliability and accuracy. The additional resources needed for a composite rating, a rating based on the average score of paired raters, may be justified by improved accuracy over individual ratings. The additional time required to arrive at a consensus rating, a rating generated following discussion between 2 raters, may not be warranted. Further research is needed to determine whether these findings hold true with other raters and treatment adherence scales.     

Inter‐cultural learning and inter‐religious dialogue: Problems in the way of understanding between Muslims and Christians

There are fundamental difficulties which make dialogue and social communication between Muslims and Christians difficult, and at times impossible. There are already substantial Muslim minorities in most Western countries, and it is thus of enormous importance to find ways of coping with these difficulties. A well‐functioning dialogue between Muslims and the indigenous inhabitants of these societies is essential for the success of a ‘Multi‐cultural Society’. Kandil puts forward his views in ten short propositions, which imply that the difficulties in communication between these two groups are not primarily religious in character; instead, they have cultural and political roots. These he tries to identify.     

Does Motivational Interviewing (MI) Work With Nonaddicted Clients? A Controlled Study Measuring the Effects of a Brief Training in MI on Client Outcomes

This study investigated the relationships between motivational interviewing (MI) and client symptoms, attendance, and satisfaction. Seventy‐nine clients attending a university‐based counseling center were purposefully assigned to treatment or control conditions. Statistical analyses revealed client symptoms in both groups improved. However, clients assigned to treatment conditions attended more sessions and missed fewer sessions than clients in the control group. Implications for using MI and suggestions for additional research are explored within the study.     

Comparison of Patient Versus Trained Observer Assessments of Healthcare Providers’ Use of Motivational Interviewing Techniques for Patients Experiencing Depression and Anxiety in the Dominican Republic

Journal of Clinical Psychology in Medical Settings - In settings with limited mental health system capacity, integrated care and the improvement of patient-provider communication surrounding common...     

Internet‐Based Self‐Help Versus One‐Session Exposure in the Treatment of Spider Phobia: A Randomized Controlled Trial

The authors compared guided Internet‐delivered self‐help with one session of live‐exposure treatment in a sample of spider‐phobic patients. A total of 30 patients were included following screening on the Internet and a structured clinical interview. The Internet treatment consisted of five weekly text modules, which were presented on a web page, a video in which exposure was modelled, and support provided via Internet. The live‐exposure treatment was delivered in a 3‐hr session following a brief orientation session. The main outcome measure was the behavioural approach test (BAT), and as secondary measures the authors used questionnaires measuring anxiety symptoms and depression. Results showed that the groups did not differ at posttreatment or follow‐up, with the exception of the proportion showing clinically significant change on the BAT. At posttreatment 46.2% of the Internet group and 85.7% in the live‐exposure group achieved this change. At follow‐up the corresponding figures were 66.7% for the Internet group and 72.7% for the live treatment. Within‐group effect sizes for the spider phobia questionnaire were large (d = 1.84 and 2.58 for the Internet and live‐exposure groups, respectively, at posttreatment). The authors conclude that guided Internet‐delivered exposure treatment is a promising new approach in the treatment of spider phobia.     

Treatment seeking for posttraumatic stress in Israel Defense Forces veterans deployed in the Second Lebanon War (2006) and “Operation Cast Lead” in the Gaza Strip (2009): a comparative study

Background and objectives: The goal of the study was to determine the long-term prevalence of combat-related treatment seeking and posttraumatic stress disorder (PTSD) in Israel’s veterans deployed to the Second Lebanon War (2006) and “Operation Cast Lead” in the Gaza Strip (2009).

Methods: The prevalence of treatment seeking and DSM-IV-TR diagnoses among Israel Defense Force (IDF) veterans was assessed using seven and five year’s surveillance and records. The whereabouts and combat exposure of veterans during the war was determined based on the IDF’s Operations Directorate records.

Results: Overall prevalence of treatment seeking was 1.32% and 0.38% in the Second Lebanon War and “Operation Cast Lead”, respectively. The prevalence of treatment-seeking veterans from the Second Lebanon War and in “Operation Cast Lead” was significantly higher in soldiers deployed to high combat-exposure zones (2.19% and 3.1%, respectively), relative to low combat-exposure zones (0.24% and 0.06%, respectively), and relative to soldiers deployed elsewhere (0.26% and 0.02%, respectively). PTSD prevalence was similar among treatment-seeking veterans deployed in high combat-exposure zones in both combats.

Conclusions: There is a gap of anywhere between 3% and 11% between treatment seeking by IDF veterans following war deployment and the actual prevalence of PTSD in this soldier population.     

(Neuro)Psychological Interventions for Non-Motor Symptoms in the Treatment of Patients with Parkinson’s Disease: a Systematic Umbrella Review

Neuropsychology Review - Conducted in a multidisciplinary and multimodal setting, the main objectives of neuropsychological treatment are to improve cognition, alleviate affective disorders, and to...     

An Investigation of Interrater Reliability for the Rorschach Performance Assessment System (R–PAS) in a Nonpatient U.S. Sample

The Rorschach Performance Assessment System (R–PAS) aims to provide an evidence-based approach to administration, coding, and interpretation of the Rorschach Inkblot Method (RIM). R–PAS analyzes individualized communications given by respondents to each card to code a wide pool of possible variables. Due to the large number of possible codes that can be assigned to these responses, it is important to consider the concordance rates among different assessors. This study investigated interrater reliability for R–PAS protocols. Data were analyzed from a nonpatient convenience sample of 50 participants who were recruited through networking, local marketing, and advertising efforts from January 2013 through October 2014. Blind recoding was used and discrepancies between the initial and blind coders' ratings were analyzed for each variable with SPSS yielding percent agreement and intraclass correlation values. Data for Location, Space, Contents, Synthesis, Vague, Pairs, Form Quality, Populars, Determinants, and Cognitive and Thematic codes are presented. Rates of agreement for 1,168 responses were higher for more simplistic coding (e.g., Location), whereas agreement was lower for more complex codes (e.g., Cognitive and Thematic codes). Overall, concordance rates achieved good to excellent agreement. Results suggest R–PAS is an effective method with high interrater reliability supporting its empirical basis.     

Reviving the Past for the Future?: The (In)compatibility between Confucianism and Democracy in Contemporary China

The issue of (in)compatibility between Confucianism and modern democracy, particularly in China, has attracted much debate over the decade. This article singles out the particular notion of Minben 民本, which is at the center of the argument for a ‘Confucian democracy’, and argues that it is fundamentally different from modern democracy. However, this does not mean that Confucianism could not be connected with modern democracy. The important question is: what exactly does it mean to ‘connect’ Confucianism to the modern society? The author argues that only by being disconnected with political power could there be meaningful ‘Confucian democracy’ today in China.     

A Critical Examination of the Reliability and Validity of a Gender Role Attitude Scale in Flanders (Belgium): What Lessons Can be Learned?

Western societies have shifted toward more egalitarian gender role attitudes (GRA). Quantitative research on GRA has been critiqued for not having kept up with societal changes in GRA. GRA scales are claimed to lack discriminative power and not fully capture the diversity within non-traditional attitudes. The present study gives an overview of the theoretical critiques with regard to GRA scales and empirically assesses these critiques. A typical example of a GRA scale measuring adolescents’ GRA in Flanders (Belgium) is used to test the scale’s quality across three waves of surveys completed by 4063 early secondary school students. Our analysis identifies the drawbacks of this particular scale. First, a ceiling effect was found, with most respondents being egalitarian. Second, the representativeness of roles inquired about is restricted; relevant societal domains are not questioned and most roles are only questioned for one gender. Third, a gender-binary approach is dominant. Finally, our results confirm that adolescents demonstrate ambivalent feelings toward balancing female employment and motherhood; although paid employment is encouraged, childcare is prioritized. We recommend that other researchers critically examine the usability and quality of GRA scales in today’s society. Using outdated GRA scales might conceal the ambivalence that adolescents feel due to new gender inequities. Also, investing in structures and regulations supporting the work-family balance is key in further promoting gender equity.     

Response to Nadler's Commentary on Arch and Craske's (2011) “Addressing Relapse in Cognitive Behavioral Therapy for Panic Disorder: Methods for Optimizing Long-Term Treatment Outcomes”

Nadler (this issue), in his commentary of our article, “Addressing Relapse in Cognitive Behavioral Therapy for Panic Disorder: Methods for Optimizing Long-Term Treatment Outcomes” (Arch & Craske, 2011), argues that we misrepresent the role of panic attacks within learning theory and overlook cognitive treatment targets. He presents several case studies that he argues demonstrate how to target fears regarding the consequences of panic itself. We appreciate his raising these issues and creating the opportunity for discussion. We take issue, however, with two aspects of his commentary. First, his case studies beautifully illustrate a central point we make in our article regarding the importance of violating patient expectancies, and as such, exemplify our recommendations rather than illustrate what we may have overlooked. Second, Nadler's argument that we misidentify the role of panic attacks contradicts itself in ways that reveal his misunderstanding of the complexity of panic attacks from the perspective of learning theory (e.g., Bouton, Mineka, & Barlow, 2001), and disregard an important point we make in our article.     

Seeing how it’s done: matching conditions for observer rats (Rattus norvegicus) in the bidirectional control

In an attempt to increase the reliability of the demonstrator-consistent responding effect produced in the bidirectional control procedure, experiments 1–4 sought conditions that would magnify the matching effect. The aim was to produce a robust demonstrator-consistent responding effect in order that future analytic experiments could investigate the psychological processes responsible for this effect. The joystick responses of observer rats trained using the standard bidirectional control procedure parameters were compared with those of observers subject to conditions identified in the social learning literature as favourable for imitation. Unlike mice, observer rats in experiments 1 a and 1 b tended to push a joystick in the same direction as their demonstrators when the demonstrators were either familiar or unfamiliar males and females. Comparable demonstrator-consistent responding occurred following observation of a standard and a salient joystick response (experiment 2). Experiment 3 showed that the discriminative accuracy of a demonstrator’s responding was important for matching behaviour, and suggested that matching might be enhanced with more than the conventional single observation session. Experiment 4 confirmed that the bidirectional control effect is sensitive to the amount of observational experience; after six observation sessions, demonstrator-inconsistent responding occurs. The results of experiments 1–3 are, and those of experiment 4 are not, compatible with the hypothesis that demonstrator-consistent responding in the bidirectional control is caused by olfactory cues deposited by demonstrators on the joystick. Received: 29 May 2000 / Accepted after revision: 28 August 2000     

Trends in the creativity literature: An analysis of research in the journal of creative behavior (1967–1989)

Abstract

Many have noted a renewed interest in creativity. However, even with a 40‐year history, little effort has been directed at the study of changes in the field, and no effort has been made to develop a historical perspective of the work being conducted. Which topics have consistently been examined? Which have gone out of favor, and which have shown surges of interest? The present investigation addressed these questions by examining 311 articles, representing a 23‐year span (1967–1989). This span began in 1967 with the founding of the Journal of Creative Behavior. Predictions were based on previous literature reviews and similar studies conducted in other areas of the social sciences. One prediction was that there would be increases in the number of authors per article (women authors in particular) and in the total number of references. Furthermore, empirical articles were expected to be on the rise, as were articles focusing on social and educational issues. The number of articles concerned with personality and related topics were expected to show a decrease. Results generally supported the hypotheses: The number of authors, number of female authors, number of references, and social and educational articles all showed upward trends. However, the number of empirical articles did not increase during the 23‐year period. Overall, the findings suggest that trend‐analytic research is viable and informative. It tells us not only where the field has gone, but also gives hints as to where it may be going.     

Major themes in the Arabic political literature of Islamic revivalism, 1970–1985: The Islamic system of government (al‐nizam al‐islami), shūra democracy and the implementation of the Sharica as opposed to secularism (cilmaniyya)

The analysis of the political literature of Islamic revivalism belongs to the pertinent issues of Muslim‐Christian dialogue. This article is an inquiry into the major themes of this literature published in Arabic. The historical context of the writings of political Islam is the failure of the secular nation‐state in the world of Islam to cope with the processes of modernization and development. The political Islamic response to this failure is the revival of the dream of reconstructing the Islamic state along the model of Medina on the eve of the rise of Islam. The analysis of the intellectual reconstruction of the early Islamic state as an expression of divine order, which ought to replace the secular state, reveals that this construction is imbued with projections of modern times into the Islamic past. Thus the alleged Islamic government of nizam islami/Islamic system as a modern issue is an outgrowth of political Islam. In this sense, the notion that Islam is a din wa‐dawla/ divine order of the state cannot be found in classical Islamic sources. Part one of this two‐part article comes to the conclusion that political Islam is a burden for modern Islam and an obstacle to the accommodation of the needs of the Muslim people to the modern age; it is not a promising future prospect in the present situation of crisis.     

In search of the “Tossed Salad Man” (and others involved in prison violence): New strategies for predicting and controlling violence in prison

This article addresses two fundamental questions: 1) Can we accurately identify a subgroup of high risk inmates who will likely be involved in various forms of prison violence; and if so, 2) Is there an empirical research supporting the contention that current classification systems reduce the risk posed by those offenders predicted to be violent (such as gang/security threat group members)? Based on a review of the empirical evidence from the past two decades, we conclude that current classification strategies do not predict prison violence very accurately and perhaps more importantly, they do not appear to reduce the risk of violence in prison. New classification systems focusing on changing – rather than controlling – offenders while in prison represent one possible alternative strategy, given recent evidence that participation in prison programming/treatment is the most effective prison violence reduction strategy currently available.     

Clients’ experiences of dynamic interpersonal therapy (DIT): opportunities and challenges for brief,manualised psychodynamic therapy in the NHS

Dynamic interpersonal therapy (DIT) is a brief manualised psychodynamic intervention for depression. This is a first study exploring clients’ experiences of DIT specifically and brief, manualised psychodynamic psychotherapy (PP) in general. Interpretative phenomenological analysis was the methodology employed. Five participants completed a semi-structured interview, three weeks to ten months after completing DIT. The scores of pre- and post-therapy outcome measures of depression and anxiety were also available. Two emerging superordinate themes are presented here: (1) ‘The Distinct Features of DIT’, referring to how its therapeutic style and time limitations were experienced and (2) the ‘Impact of Therapy’, referring to perceived outcomes. While previous findings showed that therapist’s perceived limited activity in long-term PP was experienced as hindering/unhelpful, the perceived sense of direction in DIT appeared adequate to most participants. Secondly, the time limitations provoked complex responses. Reactions to the distinct elements of DIT are to be treated both as therapeutic opportunities and as challenges. Further, in line with psychoanalytic theory, most participants described relational changes that went beyond symptom relief and remained in progress after therapy ended. Intriguingly, there was no consistency between participants’ qualitative accounts of change and the scores of the outcome measures.     

Diversity in Individual↔Context Relations as the Basis for Positive Development Across the Life Span: A Developmental Systems Perspective for Theory,Research, and Application (The 2004 Society for the Study of Human Development Presidential Address)

Contemporary, cutting-edge scholarship in human developmental science is framed by developmental systems theories emphasizing that the basic process in development involves mutually influential relations between the individually distinct person and his or her diverse, multilevel context; stressing that relative plasticity in development derives from such individual?context relations; and providing optimism about the possibility that applications of developmental science may promote positive development. These ideas underscore the substantive importance of human diversity, seen both as the potential for systematic intraindividual change across life (plasticity) and as interindividual differences in intraindividual change, and stand in contrast to views about diversity as either unimportant, error, or reflecting deficits in development. I discuss these differing conceptions of human diversity and of their distinct implications for the methodological and ethical conduct of science and of applications to programs and policies aimed at promoting positive development.