Pre‐registration is a Game Changer. But,Like Random Assignment,it is Neither Necessary Nor Sufficient for Credible Science

We identify 15 claims Pham and Oh (2020) make to argue against pre‐registration. We agree with 7 of the claims, but think that none of them justify delaying the encouragement and adoption of pre‐registration. Moreover, while the claim they make in their title is correct—pre‐registration is neither necessary nor sufficient for a credible science—this is also true of many our science’s most valuable tools, such as random assignment. Indeed, both random assignment and pre‐registration lead to more credible research. Pre‐registration is a game changer.     

Pre‐registration: Why and How

In this article, we (1) discuss the reasons why pre‐registration is a good idea, both for the field and individual researchers, (2) respond to arguments against pre‐registration, (3) describe how to best write and review a pre‐registration, and (4) comment on pre‐registration’s rapidly accelerating popularity. Along the way, we describe the (big) problem that pre‐registration can solve (i.e., false positives caused by p‐hacking), while also offering viable solutions to the problems that pre‐registration cannot solve (e.g., hidden confounds or fraud). Pre‐registration does not guarantee that every published finding will be true, but without it you can safely bet that many more will be false. It is time for our field to embrace pre‐registration, while taking steps to ensure that it is done right.     

Gamma is a Measure of the Accuracy of Predicting Performance on One Item Relative to Another Item,not of the Absolute Performance on an Individual Item Comments on Schraw (1995)

The recent paper by Schraw ( Measures of feeling-of-knowing accuracy: a new look at an old problem , Applied Cognitive Psychology, 1995, 9, 321—332) is flawed by several inaccuracies and by Schraw's failure to distinguish between two fundamentally different aspects of the accuracy of metacognitive predictions: (1) calibration (aka absolute accuracy, defined in terms of whether the predicted value assigned to a single item is followed by the occurrence of that value on the criterion test), and (2) resolution (aka relative accuracy, defined in terms of whether the predicted performance on one item relative to another item is followed by the occurrence of that ordering of the two items on the criterion test). Because of these (and other) problems, his recommendations seem misleading and counterproductive.     

Re-exposure to reinforcement in Context A during treatment in Context B reduces ABC renewal

Previous work from our laboratory showed that intermittently re-exposing rats to reinforcement for lever pressing in a training (A) context, while eliminating lever pressing in a second (B) context, increased ABA renewal of lever pressing relative to rats that experienced only Context B during response elimination. In the current study, we replicated these procedures while assessing renewal in the presence of a novel context (i.e., ABC renewal). Unlike the findings described above, renewal was reduced in the group that experienced re-exposure to Context A during lever-press elimination relative to rats that experienced only Context B. These findings suggest that alternating between contexts associated with reinforcement and extinction during treatment reduces the probability that organisms will respond in novel contexts. These outcomes may be the result of discrimination and/or generalization processes. Moreover, this training procedure may offer a potential mitigation strategy for ABC renewal.     

Aggression-consistent, -inconsistent,and -irrelevant priming effects on selective exposure to media violence

Priming with aggressive concepts increases males' attraction to media violence. It was hypothesized that priming with schema-irrelevant concepts would decrease interest relative to the effects of schema-relevant concepts, whether or not the schema-relevant concepts were also schema-consistent. Thirty male undergraduates used lists including aggressive (schema-consistent and schema-relevant), positive or prosocial (schema-inconsistent yet relevant), or entirely neutral (schema-irrelevant) words to write short stories (priming task), then received an opportunity to select videotaped film clips for viewing. Subjects primed by aggressive word lists included more aggression, anger, fear, and violence in their stories than did those in the aggression-inconsistent and aggression-irrelevant conditions, whereas aggression-inconsistent priming yielded more fun, helping, and joy than did other conditions. Aggressively primed subjects expressed more interest in films containing violence and hostility than did neutrally primed subjects, whereas aggression-inconsistent priming did not differ significantly from either aggressive (schema-consistent) or neutral (schema-irrelevant) priming. Findings indicate that the aggressive priming activates aggressive concepts that make violence and hostility more salient to individuals. Because male undergraduates typically express interest in violence, enhanced salience leads to increased interest. © 1992 Wiley-Liss, Inc.     

Ethical Decision Making in Autonomous Vehicles: The AV Ethics Project

Science and Engineering Ethics - The ethics of autonomous vehicles (AV) has received a great amount of attention in recent years, specifically in regard to their decisional policies in accident...     

Use of the Beck Scale for suicide ideation with psychiatric inpatients diagnosed with schizophrenia,schizoaffective, or bipolar disorders

To ascertain how useful the Beck Scale for Suicide Ideation (BSI; Beck & Steer, Manual for Beck Scale for Suicide Ideation (1991)) would be for assessing the severity of suicidal ideation in patients who were diagnosed with schizophrenia, schizoaffective, or bipolar disorders, 142 inpatients were asked to complete the BSI. Eight (6%) patients refused, and four patients (3%) were unable to complete the BSI because they were unable to concentrate. Of the 130 patients who completed the BSI, 53 (41%) had schizoaffective, 37 (28%) had paranoid schizophrenia, 30 (23%) had manic bipolar, and 10 (8%) had depressed bipolar disorders. The coefficient alpha for the BSI was .96, and its one-week test-retest reliability for a subsample of 15 inpatients was 0.88, p < 0.001. The BSI total scores were positively correlated with having ever attempted suicide, r = 0.46, p < 0.001. According to the BSI, 36 (28%) patients were classified as current suicide ideators. The results were discussed as supporting the use of the BSI with inpatients who are diagnosed with schizophrenia, schizoaffective, or bipolar disorders.