Randomization tests as alternative analysis methods for behavior‐analytic data

Randomization statistics offer alternatives to many of the statistical methods commonly used in behavior analysis and the psychological sciences, more generally. These methods are more flexible than conventional parametric and nonparametric statistical techniques in that they make no assumptions about the underlying distribution of outcome variables, are relatively robust when applied to small‐n data sets, and are generally applicable to between‐groups, within‐subjects, mixed, and single‐case research designs. In the present article, we first will provide a historical overview of randomization methods. Next, we will discuss the properties of randomization statistics that may make them particularly well suited for analysis of behavior‐analytic data. We will introduce readers to the major assumptions that undergird randomization methods, as well as some practical and computational considerations for their application. Finally, we will demonstrate how randomization statistics may be calculated for mixed and single‐case research designs. Throughout, we will direct readers toward resources that they may find useful in developing randomization tests for their own data.     

Understanding Pamina's recovery: An application of the hermeneutic single‐case efficacy design

This article reports an effectiveness case study of the individual systemic therapy of a 22‐year‐old Portuguese woman with a diagnosis of paranoid personality disorder, conducted in a university‐based clinic in Lisbon, Portugal. Data were analysed using the hermeneutic single‐case efficacy design, a non‐experimental interpretive approach that aims to determine whether change occurred, whether change was due to therapeutic strategies, and what in therapy caused the change. Results indicate that the treatment was effective and that de‐pathologising Pamina's condition and genogram‐based exploration techniques played a crucial role in her recovery.     

“In‐Group Love” and “Out‐Group Hate” in Repeated Interaction Between Groups

Costly individual participation in intergroup conflict can be motivated by “in‐group love”—a cooperative motivation to help the in‐group, by “out‐group hate”—an aggressive or competitive motivation to hurt the out‐group, or both. This study employed a recently developed game paradigm (Halevy, Bornstein, & Sagiv, 2008) designed specifically to distinguish between these two motives. The game was played repeatedly between two groups with three players in each group. In addition, we manipulated the payoff structure of the interaction that preceded the game such that half of the groups experienced peaceful coexistence and the other half experienced heightened conflict prior to the game. Enabling group members to express in‐group love independently of out‐group hate significantly reduced intergroup conflict. Group members strongly preferred to cooperate within their group, rather than to compete against the out‐group for relative standing, even in the condition in which the repeated game was preceded by conflict. Although both “in‐group love” and “out‐group hate” somewhat diminished as the game continued (as players became more selfish), choices indicative of the former motivation were significantly more frequent than choices indicative of the latter throughout the interaction. We discuss the implications of these findings for conflict resolution. Copyright © 2011 John Wiley & Sons, Ltd.     

The “Islamized Stranger”: On “Chronic” Versus “Contextual” Salience in the Measurement of Anti‐Muslim Prejudice

There is an ongoing debate whether anti‐Muslim prejudice in Western countries is more widespread than prejudice towards other ethno‐cultural groups or general ethnic prejudice. Previous research used different methodologies and yielded contradictory results. In this article, we combine a population‐based split‐sample survey experiment (N = 1,323), where half of the respondents judged items about Muslims and the other half statements about strangers, with an open question probing which groups respondents thought of when thinking about “strangers.” We furthermore extend previous research by not only focusing on general ethnic prejudice, but to differentiate between perceived trustworthiness, economic, cultural, and security threat. Our results strongly support the idea that the difference between the “chronic” and “contextual” salience of the target of prejudice should be taken into account.     

THE PROBLEM OF “GOD” IN PSYCHOLOGY OF RELIGION: LONERGAN'S “COMMON SENSE” (RELIGION) VERSUS “THEORY” (THEOLOGY)

The emphasis on God in American psychology of religion generates the problem of explaining divine‐versus‐natural causality in “spiritual experiences.” Especially “theistic psychology” champions divine involvement. However, its argument exposes a methodological error: to pit popular religious opinions against technical scientific conclusions. Countering such homogenizing “postmodern agnosticism,” Bernard Lonergan explained these two as different modes of thinking: “common sense” and “theory”—which resolves the problem: When theoretical science is matched with theoretical theology, “the God‐hypothesis” explains the existence of things whereas science explains their natures; and, barring miracles, God is irrelevant to natural science. A review of the field shows that the problem is pervasive; attention to “miracles”—popularly so‐named versus technically—focuses the claims of divine‐versus‐natural causality; and specifications of the meaning of spiritual, spirituality, science, worldview, and meaning itself (suffering that same ambiguity: personal import versus cognitive content) offer further clarity. The problem is not naturalism versus theism, but commonsensical versus theoretical thinking. This solution demands “hard” social science.     

“All‐or‐None” Versus “Most‐or‐Some” Options in Risky Choice: Effects of Domain and Handedness

Two methodological variants of Kahneman and Tversky's Asian disease scenario were investigated. One variant involved replacing the “all‐or‐none” outcome scenarios of the risky choice with “most‐or‐some” scenario outcomes, and the second variant involved replacing the negative domain of lives lost with a positive domain of jobs created. In addition, the effects of strength of handedness, a variable related to individual differences in risk perception, were examined. Results indicated that standard framing effects were obtained across both domains, with a decrease in risky choice under the gain domain. Scenario type also interacted with handedness, such that the all‐or‐none scenario yielded framing effects for consistent (strong)‐handers only, whereas the most‐or‐some scenario yielded framing effects for inconsistent (mixed)‐handers only (consistent‐handers are those who use the same hand exclusively for almost all activities). These results demonstrate that framing effects are strongly influenced by the presence versus absence of extreme/absolute outcomes and that individuals (in this case, decision makers with varying degrees of handedness strength) are differentially sensitive to different pieces of information. Copyright © 2014 John Wiley & Sons, Ltd.     

“Heartbreaking” Referrals,Professional “Disgrace”: The Impact of Medicare Ineligibility on the Counseling Profession

To better understand the impact of the Medicare mental health coverage gap, the authors analyzed survey data provided by 1,859 members of the American Counseling Association using a conventional qualitative content analysis. One overarching theme, direct impact of Medicare policy on the counseling profession, is presented, along with 3 thematic categories: emotional impact on providers, economic toll on providers, and negative influence on profession's credibility. Implications for the counseling profession are discussed.     

THE RELIGION‐SCIENCE DISCUSSION AT FORTY YEARS: “REPORTS OF MYDEATH ARE PREMATURE”

Abstract. The startling success of the religion‐science discussion in recent years calls for reflection. Have old walls been broken down, old antagonisms overcome? Have science and religion finally been reconciled? Or is all the activity just so much sound and fury signifying nothing? Postmodern equations of scientific and religious beliefs disregard a number of enduring differences that help make sense of the continuing tensions. Yet the skepticism of authors such as John Caiazza is also ungrounded. I describe five major types of approaches that are being employed in the recent literature. These methods have led to a deeper understanding of the commonalities between science and religion and have produced new productive partnerships between them.     

Comment on “The Self‐Care of Psychologists and Mental Health Professionals” (Dattilio, 2015)

Professor Frank Dattilio's article “The Self‐care of Psychologists and Mental Health Professionals” provides an overview of stress and related mental health problems among psychologists, and a proposition that psychologists are not vigilant in regard to self‐care. Dattilio offers a range of self‐care strategies and recommendations, and highlights self‐care practices within various psychology frameworks, and concludes with some “healthy tips” for managing stress. In my commentary I underscore Dattilio's message that self‐care is of critical importance in psychology practice, given the responsibility of caring for others inherent in the work psychologists undertake. However, I raise additional points of consideration and suggest an alternative approach to addressing the self‐care needs of the profession. My commentary makes the following points: (a) the need to distinguish between psychology trainees and practising qualified psychologists when addressing stress and self‐care requirements in the profession; (b) the importance of developing a culture of self‐care among psychologists by providing self‐care instruction during training; (c) the need to temper research findings on stress and mental health among psychologists by the methodological weakness of the studies in this area; (d) adhering to the recent call from colleagues to shift from a focus on pathology and punishment to a positive acceptance, mindfulness, and values‐based approach for encouraging self‐care among psychologists; (e) the use of a systematic framework for organising the presentation of self‐care strategies that makes them more accessible; and (f) an appeal to professional bodies to take their responsibility in promoting self‐care in the profession.     

“Tell Me Who Your Enemies Are”: Government Reports About the “Cult” Phenomenon in Israel

Between 1982 and 2011, four Israeli governmental reports addressing ostensible dangers from “cults” (new religious movements, or NRMs) were issued. The 1980s reports use a collectivist discourse, in which the state sees itself as defending the collective's borders from external threats and representing various sectors while seeking consensual values. The 1990s report marks an interim stage in which the state tries to balance individual liberties with sectoral interests. The 2011 report focuses solely on harm to individuals and is the harshest of the four. The reports reflect milestones in three processes of change that have taken place in Israeli society: from a collectivist‐hegemonic ethos to a multisectoral one; from a focus upon society to a focus on the individual; and from nationalistic values to universalistic ones. At every point in time, NRMs represented a different perceived threat to Israeli society. We explain how multisectoralism brings about both tolerance toward new religious phenomena and fierce anti‐cultic activity.     

THE “AS‐YET SITUATION” IN WINNICOTT'S “FRAGMENT OF AN ANALYSIS”: YOUR FATHER “NEVER DID YOU THE HONOR OF”… YET

The author proposes a new hypothesis in relation to Winnicott's “Fragment of an Analysis”: that as early as 1955, in the case described in this text, Winnicott is creating the paternal function in his patient's psychic functioning by implicitly linking his interpretations regarding the father to the Freudian concept of Nachträglichkeit. The author introduces an original clinical concept, the as‐yet situation, which she has observed in her own clinical work, as well as in Winnicott's analysis of the patient described in “Fragment of an Analysis” (1955).     

“A definite feel‐it moment”: Embodiment,externalisation and emotion during chair‐work in compassion‐focused therapy

Chair‐work is an experiential method used within compassion‐focused therapy (CFT) to apply compassion to various aspects of the self. This is the first study of CFT chair‐work and is focused on clients' lived experiences of a chair‐work intervention for self‐criticism. Twelve participants with depression were interviewed following the chair‐work intervention and the resulting data were examined using interpretative phenomenological analysis. Three superordinate themes were identified: “embodiment and enactment,” “externalising the self in physical form” and “emotional intensity.” The findings suggest the importance of accessing and expressing various emotions connected with self‐criticism, whilst highlighting the potential for client distress and avoidance during the intervention. The role of embodying, enacting and physically situating aspects of the self in different chairs is also suggested to be an important mechanism of change in CFT chair‐work. The findings are discussed in terms of clinical implications, emphasising how core CFT concepts and practices are facilitated by the chair‐work process.     

“Victims” Versus “Righteous Victims”: The Rhetorical Construction of Social Categories in Historical Dialogue Among Israeli and Palestinian Youth

Informed by social identity theory and a rhetorical approach to the study of social category construction in social interaction, this study analyzed the nature and function of participant utterances in two conditions of intergroup dialogue about history between Israelis and Palestinians. Across conditions that sought to either emphasize recategorization into a common in‐group identity or subcategorization into mutually differentiated identities, Palestinian and Arab Israeli utterances primarily reflected the theme of victimization, while Jewish Israeli utterances primarily reflected themes of justification and victimization. The way in which these utterances produced social competition for victim and perpetrator roles and reproduced master historical narratives of Palestinian victimization versus Jewish Israeli “righteous” victimization is illustrated. Findings are discussed in terms of the role of narrative and rhetoric about social categories in settings of intractable political conflict, and implications for dialogue‐based intervention about history are addressed.     

The “analysis of competing hypotheses” in intelligence analysis

The intelligence community uses “structured analytic techniques” to help analysts think critically and avoid cognitive bias. However, little evidence exists of how techniques are applied and whether they are effective. We examined the use of the analysis of competing hypotheses (ACH)—a technique designed to reduce “confirmation bias.” Fifty intelligence analysts were randomly assigned to use ACH or not when completing a hypothesis testing task that had probabilistic ground truth. Data on analysts' judgement processes and conclusions were collected using written protocols that were then coded for statistical analyses. We found that ACH‐trained analysts did not follow all of the steps of ACH. There was mixed evidence for ACH's ability to reduce confirmation bias, and we observed that ACH may increase judgement inconsistency and error. It may be prudent for the intelligence community to consider the conditions under which ACH would prove useful and to explore alternatives.     

On the Psychological Function of Nationalistic “Whitelash”

A noticeable feature of the political discourse accompanying the rise of nationalism in white‐majority countries is that white people fare worse than other ethnic groups in their societies. However, it is unclear based on the extant literature why group‐based relative deprivation (GRD) would correlate with majority‐group nationalism. Here, we propose that the psychological function of nationalism for majority‐group members lies in its ability to assuage the negative feelings arising from GRD. Accordingly, in a New Zealand national probability sample (N = 15,607), we found that GRD among whites was negatively associated with well‐being. However, we also found an opposing indirect association mediated by nationalism. GRD was associated with higher nationalism, which was in turn associated with higher well‐being. These findings suggest that endorsing beliefs about national superiority is one way a nation’s dominant ethnic group can cope with the negative psychological consequences of perceiving that their group is deprived.     

While We Wait: The Foolishness of Scarcity,the “Devalued Other,” and Pedagogies of “Becoming”

This article considers how Christian women leaders might, in the absence of global economic equality for women, reframe theological dialogue that affirms the work and worth of the “devalued other” – 21st‐century women living in economic insecurity – and to declare that Jesus' eschatological hope is in the feminization of abundance. The article engages the parable of the wise and foolish virgins as a messianic requirement to deconstruct the barriers that keep the devalued other from seeing her full potential and to challenge the foolishness of scarcity that has taken hold of the daughters of privilege. It seeks to engage an African feminist hermeneutic as the primary methodology and to craft an emerging pedagogy of “becoming” that speaks to the cosmic shift to strengthen the agency of women as we await the coming Parousia.     

Community Power Structure Analysis and the Ethical Considerations of “Studying Up”

This narrative outlines our challenges in studying power and power structures within an individual‐level ethical framework. Taking a social ethics perspective, we share the story of our “sticky situation” (Campbell, 2016 ) that transpired during a multi‐year community partnership. We were asked, by our community partners, to help collect interview data without informed consent. As a team of community‐engaged university researchers, we were faced with a seemingly easy ethical situation (no consent, no research) that had unexpectedly complicated and long‐lasting consequences. This experience revealed to us how community‐engaged research and action, under a traditional ethics framework, can often work to protect those in positions of power and offer little to disrupt the status quo. Reflecting on the tension between individual and social ethics, we discuss the limitations of an individual‐level framework, including the definitions for respect for persons, justice, and beneficence, on our ability as a field to understand, critique, and contribute to the dismantling of oppressive power structures.