Editorial: Evidence on Questionable Research Practices: The Good,the Bad,and the Ugly

Purpose

Questionable research or reporting practices (QRPs) contribute to a growing concern regarding the credibility of research in the organizational sciences and related fields. Such practices include design, analytic, or reporting practices that may introduce biased evidence, which can have harmful implications for evidence-based practice, theory development, and perceptions of the rigor of science.

Design/Methodology/Approach

To assess the extent to which QRPs are actually a concern, we conducted a systematic review to consider the evidence on QRPs. Using a triangulation approach (e.g., by reviewing data from observations, sensitivity analyses, and surveys), we identified the good, the bad, and the ugly.

Findings

Of the 64 studies that fit our criteria, 6 appeared to find little to no evidence of engagement in QRPs and the other 58 found more severe evidence (91 %).

Implications

Drawing upon the findings, we provide recommendations for future research related to publication practices and academic training.

Originality/value

We report findings from studies that suggest that QRPs are not a problem, that QRPs are used at a suboptimal rate, and that QRPs present a threat to the viability of organizational science research.

     

IRB and Research Regulatory Delays Within the Military Health System: Do They Really Matter? And If So,Why and for Whom?

Institutional review board (IRB) delays may hinder the successful completion of federally funded research in the U.S. military. When this happens, time-sensitive, mission-relevant questions go unanswered. Research participants face unnecessary burdens and risks if delays squeeze recruitment timelines, resulting in inadequate sample sizes for definitive analyses. More broadly, military members are exposed to untested or undertested interventions, implemented by well-intentioned leaders who bypass the research process altogether. To illustrate, we offer two case examples. We posit that IRB delays often appear in the service of managing institutional risk, rather than protecting research participants. Regulators may see more risk associated with moving quickly than risk related to delay, choosing to err on the side of bureaucracy. The authors of this article, all of whom are military-funded researchers, government stakeholders, and/or human subject protection experts, offer feasible recommendations to improve the IRB system and, ultimately, research within military, veteran, and civilian populations.     

On Fork Arrow Logic and its Expressive Power

We compare fork arrow logic, an extension of arrow logic, and its natural first-order counterpart (the correspondence language) and show that both have the same expressive power. Arrow logic is a modal logic for reasoning about arrow structures, its expressive power is limited to a bounded fragment of first-order logic. Fork arrow logic is obtained by adding to arrow logic the fork modality (related to parallelism and synchronization). As a result, fork arrow logic attains the expressive power of its first-order correspondence language, so both can express the same input–output behavior of processes.     

The challenge of prejudice: counsellors’ talk about challenging clients’ prejudices

This paper considers the implications for training and practice of counsellors’ responses to the notion of challenging clients’ prejudices. It explores tensions in counselling discourse between social responsibility, responsibility to the client and responsibility for one's self as counsellor. Three focus groups of counsellors were asked whether a counsellor should challenge clients’ prejudices. Responses were categorised as challenge, not-challenge or exit responses. Discursive themes identified in the responses are: managing congruence and being non-judgemental; self-care and self-respect; and social responsibility. Strategies for managing the discursive conflicts identified in responding to counsellor-identified client prejudices are summarised.     

Production deficits in aphasia: A voice-onset time analysis

An experimental study was conducted to examine phonetic and phonemic deficits in the speech production of aphasics. Subjects included four Broca's aphasics, four Conduction aphasics, five Wernicke's aphasics, one nonaphasic dysarthric patient, and four normal controls. The subjects read a list of words containing word-initial stop consonants which were subsequently measured acoustically for voice-onset time. The results showed that Broca's aphasics exhibit a more severe production disorder than Conduction aphasics who in turn exhibit a more severe disorder than Wernicke's aphasics, in accord with clinical observations. In addition, although Broca's aphasics produced both phonetic and phonemic errors, the results showed that they have a pervasive phonetic disorder which affects their correct target productions as well as the total number of phonetic errors produced. This deficit however seems to be a speech deficit rather than a low-level motor control problem. In contrast, the Wernicke's aphasics show a deficit characterized by isolated phonemic mistargeting errors. Finally, the pattern of productions for the Conduction aphasics indicates that some patients show a predominantly phonetic disorder similar to the Broca's aphasics and others show predominantly a phonemic disorder similar to the Wernicke's aphasics.     

Psychology and Aging: the first 20 years

This article provides a review of the first 20 years of Psychology and Aging, the American Psychological Association's first and only scholarly journal devoted to the topic of aging. The authors briefly summarize its history, its contributions to the study of aging, and its broader status as a scholarly publication. One theme highlighted in our review is the diversity of content in the journal throughout its history. Another is the strong impact that articles published in the journal have had on both basic and applied topics in aging. Efforts to encompass the breadth of topics and methodologies in aging research while retaining excellent quality remain the exciting but essential challenge for Psychology and Aging.     

A half century of scalloping in the work habits of the United States Congress

It has been suggested that the work environment of the United States Congress bears similarity to a fixed-interval reinforcement schedule. Consistent with this notion, Weisberg and Waldrop (1972) described a positively accelerating pattern in annual congressional bill production (selected years from 1947 to 1968) that is reminiscent of the scalloped response pattern often attributed to fixed-interval schedules, but their analysis is now dated and does not bear on the functional relations that might yield scalloping. The present study described annual congressional bill production over a period of 52 years and empirically evaluated predictions derived from four hypotheses about the mechanisms that underlie scalloping. Scalloping occurred reliably in every year. The data supported several predictions about congressional productivity based on fixed-interval schedule performance, but did not consistently support any of three alternative accounts. These findings argue for the external validity of schedule-controlled operant behavior as measured in the laboratory. The present analysis also illustrates a largely overlooked role for applied behavior analysis: that of shedding light on the functional properties of behavior in uncontrolled settings of considerable interest to the public.