How to become a Bayesian in eight easy steps: An annotated reading list

In this guide, we present a reading list to serve as a concise introduction to Bayesian data analysis. The introduction is geared toward reviewers, editors, and interested researchers who are new to Bayesian statistics. We provide commentary for eight recommended sources, which together cover the theoretical and practical cornerstones of Bayesian statistics in psychology and related sciences. The resources are presented in an incremental order, starting with theoretical foundations and moving on to applied issues. In addition, we outline an additional 32 articles and books that can be consulted to gain background knowledge about various theoretical specifics and Bayesian approaches to frequently used models. Our goal is to offer researchers a starting point for understanding the core tenets of Bayesian analysis, while requiring a low level of time commitment. After consulting our guide, the reader should understand how and why Bayesian methods work, and feel able to evaluate their use in the behavioral and social sciences.     

Melioration and self-experimentation

Operant researchers rarely use the arena of applied psychology to motivate or to judge their research. Absence of tests by application weakens the field of basic operant research. Early in their development, the physical and biological sciences emphasized meliorative aspects of research. Improvement of human life was a major goal of these young sciences. This paper argues that if basic operant researchers analogously invoked a melioration criterion, the operant field might avoid its tendency toward ingrowth and instead generate a broadly influential science. Operant researchers could incorporate melioration by (a) creating animal models to study applied problems; (b) confronting questions raised by applied analysts and testing hypotheses in applied settings; or (c) performing self-experiments—that is, using experimental methods and behavioral techniques to study and change the experimenter's behavior.     

Ethical Decision Making and Research Deception in the Behavioral Sciences: An Application of Social Contract Theory

Despite significant ethical advances in recent years, including professional developments in ethical review and codification, research deception continues to be a pervasive practice and contentious focus of debate in the behavioral sciences. Given the disciplines' generally stated ethical standards regarding the use of deceptive procedures, researchers have little practical guidance as to their ethical acceptability in specific research contexts. We use social contract theory to identify the conditions under which deception may or may not be morally permissible and formulate practical recommendations to guide researchers on the ethical employment of deception in behavioral science research.     

Listener: A tool for client-side investigation of hypermedia navigation behavior

Behavioral researchers have employed hypermedia-based software applications in their experiments for some time. More recently, interest in the World-Wide Web has developed among researchers in the social sciences, and popular use of this new medium continues to grow at an incredible rate. This paper describes Listener, a tool developed to log users’ hypermedia and World-Wide Web navigation behavior using Apple Macintosh computers in a laboratory setting. Listener is able to capture navigation actions through cached documents, overcoming some of the problems associated with analyzing standard web server logs.     

Methods for the Behavioral,Educational, and Social Sciences: An R package

Methods for the Behavioral, Educational, and Social Sciences (MBESS; Kelley, 2007b) is an open source package for R (R Development Core Team, 2007b), an open source statistical programming language and environment. MBESS implements methods that are not widely available elsewhere, yet are especially helpful for the idiosyncratic techniques used within the behavioral, educational, and social sciences. The major categories of functions are those that relate to confidence interval formation for noncentral t, F, and chi2 parameters, confidence intervals for standardized effect sizes (which require noncentral distributions), and sample size planning issues from the power analytic and accuracy in parameter estimation perspectives. In addition, MBESS contains collections of other functions that should be helpful to substantive researchers and methodologists. MBESS is a long-term project that will continue to be updated and expanded so that important methods can continue to be made available to researchers in the behavioral, educational, and social sciences.     

Balancing Treatment and Control Groups in Quasi‐Experiments: An Introduction to Propensity Scoring

Organizational and applied sciences have long struggled with improving causal inference in quasi‐experiments. We introduce organizational researchers to propensity scoring, a statistical technique that has become popular in other applied sciences as a means for improving internal validity. Propensity scoring statistically models how individuals in a quasi‐experiment have been assigned to conditions in order to estimate treatment effects among individuals with approximately equal probabilities of receiving the treatment. If propensity scores are created from relevant covariates, matching on the propensity score makes treatment assignment ignorable and approximates a true experimental design. We illustrate how matching on the propensity score can be applied by using 2 examples: examining the effects of online instruction and estimating the benefits of preparatory coaching for the SAT. In both cases, propensity‐scoring methods effectively reduced inequivalence between treatment and control groups on many variables. Propensity scoring stands out as a valuable technique capable of improving causal inference from many of organizational research's quasi‐experiments.     

Board on Behavioral, Cognitive, and Sensory Sciences

Many of the key policy issues now facing the nation are behavioral in nature. Among these are educating and training citizens who can earn and keep jobs in a changing global economy; changing the behaviors that now cause half of all deaths in the country (e.g., smoking, poor diet and exercise patterns, and alcohol and drug abuse); reducing crime and violence; providing for an aging population; harnessing new information technologies to improve our quality of life; and reducing environmental pollution. These problems contrast with the defining policy challenges of the Cold War era, which demanded expertise primarily from the physical sciences.
Fortunately, the pressing need to solve behavioral problems arises at a time when rapid advances in behavioral, cognitive, and sensory sciences are improving our ability to address the problems. The time is ripe to strengthen the links between scientists and the policy community to harness new scientific advances to pressing public needs. To help forge these links, the National Research Council's (NRC) Commission on Behavioral and Social Sciences and Education (CBASSE) established a Board on Behavioral, Cognitive, and Sensory Sciences. This paper explains the need for this effort, and its potential. The report discusses the new promise of behavioral, cognitive, and sensory sciences, outlines the CBASSE record in these fields and its broadening focus on science-related policy questions; notes a range of emerging issues in which policy can benefit from expertise in these areas; and describes the functions of the new board.     

Conducting behavioral research on Amazon’s Mechanical Turk

Amazon’s Mechanical Turk is an online labor market where requesters post jobs and workers choose which jobs to do for pay. The central purpose of this article is to demonstrate how to use this Web site for conducting behavioral research and to lower the barrier to entry for researchers who could benefit from this platform. We describe general techniques that apply to a variety of types of research and experiments across disciplines. We begin by discussing some of the advantages of doing experiments on Mechanical Turk, such as easy access to a large, stable, and diverse subject pool, the low cost of doing experiments, and faster iteration between developing theory and executing experiments. While other methods of conducting behavioral research may be comparable to or even better than Mechanical Turk on one or more of the axes outlined above, we will show that when taken as a whole Mechanical Turk can be a useful tool for many researchers. We will discuss how the behavior of workers compares with that of experts and laboratory subjects. Then we will illustrate the mechanics of putting a task on Mechanical Turk, including recruiting subjects, executing the task, and reviewing the work that was submitted. We also provide solutions to common problems that a researcher might face when executing their research on this platform, including techniques for conducting synchronous experiments, methods for ensuring high-quality work, how to keep data private, and how to maintain code security.     

Intentional memory and online data collection: A test of the effects of animacy and threat on episodic memory

As research in the behavioural sciences increasingly relies on Amazon’s Mechanical Turk (MTurk) for recruiting participants, it is an empirical question whether an intentional memory experiment could be conducted online and whether performance of MTurk participants and college students would be comparable. College students and MTurk participants viewed threatening and nonthreatening items that were animate or inanimate and completed a recall test. Recent research indicates that human memory systems evolved to prioritise survival-relevant information, including animacy of items. The results of both studies indicated that participants recalled more animate than inanimate items and recalled more threatening items than nonthreatening items. The results indicate that it is possible to conduct memory experiments online and that results match patterns found in laboratory studies of the animacy effect (Nairne, VanArsdall, Pandeirada, Cogdill, & LeBreton, 2013), but that researchers should include safeguards to ensure the online participants are attending to and following directions.     

Building and managing an online panel with phpPanelAdmin

Online data collection within social and behavioral research is burgeoning. For surveying individuals online, researchers are increasingly relying on online panels and similar subject pools. phpPanelAdmin is a Web-based platform that is intended to assist researchers in quickly setting up and managing an online panel. phpPanelAdmin solves many problems that can arise when one is collecting data in online panels. As an open-source program placed under GNU General Public License, phpPanelAdmin (www.goeritz.net/panelware) is not only free of charge but free of restrictions on its use, modification, and distribution. Building a new online panel—which before required weeks and special skills—is now possible within minutes and at no cost. Furthermore, phpPanelAdmin can be connected to an existing online panel or even be used for managing offline subject pools. Functions include creating a panel sign-up form; automatically unfolding the panel database; searching for panelists; viewing, modifying, and deleting panelists’ data; deleting and cloning variables; drawing samples; sending e-mail to panelists; exporting data; displaying panel statistics at a glance; identifying duplicates; creating and managing e-mail templates; executing user-defined SQL statements; and obtaining help.     

UNDERSTANDING THE POW EXPERIENCE: STRESS RESEARCH AND THE IMPLEMENTATION OF THE 1955 U.S. ARMED FORCES CODE OF CONDUCT

Facing accusations about weak military discipline following the supposedly poor behavior of American soldiers held captive during the Korean War, President Dwight Eisenhower instituted a Code of Conduct for the Armed Services in 1955. In response, military leaders hired numerous social and behavioral scientists to investigate the nature of the prisoner‐of‐war (POW) experience. These researchers not only challenged official government accounts of POW activities but opened up a new field of study—stress research. They also changed military training policy, which soon focused more on stress inoculation training, and, in so doing, helped lead the shift in psychology away from behaviorism to ego and cognitive psychology. In this sense, my article ties shifts within the social and behavioral sciences in the 1950s to the military history of the early Cold War, a connection generally missing from most accounts of this period.     

Interrupted time-series analysis and its application to behavioral data

This paper uses a question-and-answer format to present the technical aspects of interrupted time-series analysis (ITSA). Topics include the potential relevance of ITSA to behavioral researchers, serial dependency, time-series models, tests of significance, and sources of ITSA information.     

Two open source designs for a low‐cost operant chamber using Raspberry Pi™

After almost a century of use and development, operant chambers remain a significant financial investment for scientists. Small powerful single‐board computers such as the Raspberry Pi? offer researchers a low‐cost alternative to expensive operant chambers. In this paper, we describe two new operant chambers, one using nose‐poke ports as operanda and another using a touchscreen. To validate the chamber designs, rats learned to perform both visual discrimination and delayed alternation tasks in each chamber. Designs and codes are open source and serve as a starting point for researchers to develop behavioral experiments or educational demonstrations.     

Practical advice for conducting ethical online experiments and questionnaires for United States psychologists

It is increasingly easy and, therefore, increasingly common to conduct experiments and questionnaire studies in online environments. However, the online environment is not a data collection medium that is familiar to many researchers or to many research methods instructors. Because of this, researchers have received little information about how to address ethical issues when conducting online research. Researchers need practical suggestions on how to translate federal and professional ethics codes into this new data collection medium. This article assists United States psychologists in designing online studies that meet accepted standards for informed consent, deception, debriefing, the right to withdraw, security of test materials, copyright of participants’ materials, confidentiality and anonymity, and avoiding harm.     

评分者内部一致性的研究和应用

在行为科学的研究和实践中,研究者常常需要将个体层次的评价,整合到群体层次的评价,对于这种自下而上整合模式的一致性问题,国内一些学者常常错误地使用评分者内部信度作为评分者内部一致性的指标。评分者内部一致性和评分者内部信度不仅在理论基础上存在差异,而且在实践中也存在前者很高(或很低),而后者却很低(或很高)的不一致情况。文章阐述了学术界对评分一致性这一问题的提出、争论和取得一致观点的发展脉络,以期学者们对这一问题能够有深入的思索,避免在今后的研究中出现类似的错误。     

Possibilities, Intentions and Threats: Dual Use in the Life Sciences Reconsidered

Due to the terrorist attacks of 9/11 and the anthrax letters of a few weeks later, the concept of dual use has spread widely in the life sciences during the past decade. This article is aimed at a clarification of the dual use concept and its scope of application for the life sciences. Such a clarification would greatly facilitate the work of policymakers seeking to ensure security while avoiding undesirable interventions of government in the conduct of science. The article starts with an overview of the main developments in life sciences in relation to dual use. This is illustrated by discussions on synthetic biology and dual use. The findings lead to a reconsideration of the dual use concept. An area in need of further attention is to what extent threats and intentions should have impact on the definition of dual use. Possible threats are analyzed against the background of the phenomenon of securitization of health care and life sciences: considering these sectors of society in security terms. Some caveats that should be taken into account in a dual use policy are described. An acceptable, adequate and applicable definition of the dual use concept could help researchers, universities, companies and policy makers. Such a definition should build upon, but go beyond, the view developed in the influential Fink-report, which concentrates on the so-called ??experiments of concern??, e.g. experiments that enhance the virulence of pathogens (National Research Council of the National Academies 2004) It will be argued that??in addition to these more technical aspects??a definition of dual use should include the aspect of threats and intentions.     

Commentary on high-performance computing and psychological models: Theory-building and model-fitting processes

For a psychological theorist, a merging of the interactive capability of a desktop computer and the speed/ memory capability of a supercomputer is needed. Ready-to-use modeling software is especially useful in the behavioral sciences so that researchers do not need to reinvent each other’s wheels. Dynamical models of psychological processes require different analyses from routine statistical treatments.     

Consumer stress‐handling strategies: theory and research findings

• Although stress research has received increased attention in the behavioral and social sciences, it has been virtually ignored by marketing and consumer researchers. This paper attempts to advance the concept of stress as a viable construct in consumer studies. A conceptual model is developed based on theory and research, and cross‐sectional and longitudinal data are used to test specific hypotheses, producing results consistent with the general stress model.

Copyright © 2006 John Wiley & Sons, Ltd.