Pre‐registration is a Game Changer. But,Like Random Assignment,it is Neither Necessary Nor Sufficient for Credible Science

We identify 15 claims Pham and Oh (2020) make to argue against pre‐registration. We agree with 7 of the claims, but think that none of them justify delaying the encouragement and adoption of pre‐registration. Moreover, while the claim they make in their title is correct—pre‐registration is neither necessary nor sufficient for a credible science—this is also true of many our science’s most valuable tools, such as random assignment. Indeed, both random assignment and pre‐registration lead to more credible research. Pre‐registration is a game changer.     

Pre‐registration: Why and How

In this article, we (1) discuss the reasons why pre‐registration is a good idea, both for the field and individual researchers, (2) respond to arguments against pre‐registration, (3) describe how to best write and review a pre‐registration, and (4) comment on pre‐registration’s rapidly accelerating popularity. Along the way, we describe the (big) problem that pre‐registration can solve (i.e., false positives caused by p‐hacking), while also offering viable solutions to the problems that pre‐registration cannot solve (e.g., hidden confounds or fraud). Pre‐registration does not guarantee that every published finding will be true, but without it you can safely bet that many more will be false. It is time for our field to embrace pre‐registration, while taking steps to ensure that it is done right.     

Gamma is a Measure of the Accuracy of Predicting Performance on One Item Relative to Another Item,not of the Absolute Performance on an Individual Item Comments on Schraw (1995)

The recent paper by Schraw ( Measures of feeling-of-knowing accuracy: a new look at an old problem , Applied Cognitive Psychology, 1995, 9, 321—332) is flawed by several inaccuracies and by Schraw's failure to distinguish between two fundamentally different aspects of the accuracy of metacognitive predictions: (1) calibration (aka absolute accuracy, defined in terms of whether the predicted value assigned to a single item is followed by the occurrence of that value on the criterion test), and (2) resolution (aka relative accuracy, defined in terms of whether the predicted performance on one item relative to another item is followed by the occurrence of that ordering of the two items on the criterion test). Because of these (and other) problems, his recommendations seem misleading and counterproductive.     

Ethical Decision Making in Autonomous Vehicles: The AV Ethics Project

Science and Engineering Ethics - The ethics of autonomous vehicles (AV) has received a great amount of attention in recent years, specifically in regard to their decisional policies in accident...     

Capturing system level activities and impacts of mental health consumer-run organizations

Since the 1970s mental health consumer-run organizations have come to offer not only mutual support, but they have also adopted agendas for broader social change. Despite an awareness of the need for system level efforts that create supportive environments for their members, there has been limited research demonstrating how their system level activities can be documented or their impacts evaluated. The purpose of this paper is to feature a method of evaluating systems change activities and impacts. The paper is based on a longitudinal study evaluating four mental health consumer-run organizations in Ontario, Canada. The study tracked system level activities and impacts using both qualitative and quantitative methodologies. The article begins by describing the development and implementation of these methods. Next it offers a critical analysis of the methods used. It concludes by reflecting on three lessons learned about capturing system level activities and impacts of mental health consumer-run organizations.     

Ralph Burhoe and Teilhard De Chardin: an Affinity in Mysticism?

Religious experience is conditioned and influenced by our understanding of reality, and scientific knowledge contributes to that understanding. Spirituality will be related to knowledge of nature in that experience of God will be mediated in and through a relation to the universe and out of the fulfillment of the creation. Thus a mystical knowledge of God is experienced in and out of a developing evolution of nature, society, and culture. Ralph Burhoe and Teilhard de Chardin share a vision of mystical unity with God as arising out of an integration involving the systems of nature and society.     

The role of cognitive factors in the pathogenesis of obsessive-compulsive symptoms: a prospective study

Cognitive models of obsessive-compulsive disorder (OCD) posit that specific kinds of dysfunctional beliefs (e.g., pertaining to responsibility and the significance of intrusive thoughts) underlie the development of this disorder. The present study was designed to prospectively evaluate whether dysfunctional beliefs thought to underlie OCD act as a specific vulnerability factor in the pathogenesis of obsessive-compulsive symptomatology. Eighty-five individuals were prospectively followed over a period of time thought to be associated with an increased onset of OCD symptoms -- childbirth and the postpartum. The majority of these new mothers and fathers experienced intrusive infant-related thoughts and performed neutralizing behaviors similar to, but less severe than, those observed in OCD. Scores on a measure of dysfunctional beliefs thought to underlie OCD predicted the development of obsessive-compulsive symptoms after controlling for pre-existing OCD symptoms, anxiety, and depression. Dysfunctional beliefs also predicted the severity of checking, washing, and obsessional OCD symptom dimensions, but not neutralizing, ordering, or hoarding symptom dimensions. These data provide evidence for specific dysfunctional beliefs as risk factors in the development of some types of OCD symptoms.