Perpetuation of Retracted Publications Using the Example of the Scott S. Reuben Case: Incidences,Reasons and Possible Improvements

In 2009, Scott S. Reuben was convicted of fabricating data, which lead to 25 of his publications being retracted. Although it is clear that the perpetuation of retracted articles negatively effects the appraisal of evidence, the extent to which retracted literature is cited had not previously been investigated. In this study, to better understand the perpetuation of discredited research, we examine the number of citations of Reuben’s articles within 5 years of their retraction. Citations of Reuben’s retracted articles were assessed using the Web of Science Core Collection (Thomson Reuters, NY). All citing articles were screened to discriminate between articles in which Reuben’s work was quoted as retracted, and articles in which his data was wrongly cited without any note of the retraction status. Twenty of Reuben’s publications had been cited 274 times between 2009 and 1024. In 2014, 45 % of the retracted articles had been cited at least once. In only 25.8 % of citing articles was it clearly stated that Reuben’s work had been retracted. Annual citations decreased from 108 in 2009 to 18 in 2014; however, the percentage of publications correctly indicating the retraction status also declined. The percentage of citations in top-25 %-journals, as well as the percentage of citations in journals from Reuben’s research area, declined sharply after 2009. Our data show that even 5 years after their retraction, nearly half of Reuben’s articles are still being quoted and the retraction status is correctly mentioned in only one quarter of the citations.     

Analysis of Citations to Biomedical Articles Affected by Scientific Misconduct

We describe the ongoing citations to biomedical articles affected by scientific misconduct, and characterize the papers that cite these affected articles. The citations to 102 articles named in official findings of scientific misconduct during the period of 1993 and 2001 were identified through the Institute for Scientific Information Web of Science database. Using a stratified random sampling strategy, we performed a content analysis of 603 of the 5,393 citing papers to identify indications of awareness that the cited articles affected by scientific misconduct had validity issues, and to examine how the citing papers referred to the affected articles. Fewer than 5% of citing papers indicated any awareness that the cited article was retracted or named in a finding of misconduct. We also tested the hypothesis that affected articles would have fewer citations than a comparison sample; this was not supported. Most articles affected by misconduct were published in basic science journals, and we found little cause for concern that such articles may have affected clinical equipoise or clinical care.     

The nature of social and personality psychology as reflected in JPSP, 1965-2000

A bibliometric analysis of the first 36 years (1965-2000) of the Journal of Personality and Social Psychology (JPSP) is presented. The authors analyzed the structure of JPSP on the basis of contents and other aspects related to productivity, such as growth in the number of articles and authors, and "invisible colleges." In 2001, JPSP articles were cited over 23,000 times. An increasing number of older, classic articles are cited, suggesting that there are an accumulating number of citations whose influence endures over time. JPSP articles have grown in length, number of studies included, number of references, and number of authors and have become more international with an increasing proportion of authors from outside the United States. The pattern of findings suggests an increasingly complex and mature science.     

RETRACTED ARTICLE: Child Soldiers as Adults: The Mozambique Case Study

Statement of Retraction

We, the Editors and Publisher of the Journal of Aggression, Maltreatment & Trauma, have retracted the following article:

Neil Boothby & Blake Thomson, Child Soldiers as Adults: The Mozambique Case Study, Journal of Aggression, Maltreatment & Trauma, Vol. 22 2013, 735–756, DOI 10.1080/10926671.2013.814742.

The senior author has identified computational mistakes in this article and problems with the data analyses.

The senior author has also identified that significant portions of this article were previously published in other articles by the author.

We have been informed in our decision-making by our policy on publishing ethics and integrity and the COPE guidelines on retractions.

The retracted article will remain online to maintain the scholarly record, but it will be digitally watermarked on each page as “Retracted”.     

Retractions in the Engineering Field: A Study on the Web of Science Database

This study assesses the retractions of scientific articles in engineering journals indexed on the Web of Science from 1945 to 2015. The data set was built based on documents containing the keywords retracted, retraction, withdrawal, or redress. We used database exploration techniques, including Structured Query Language and analysis of variance, for data analysis. We analyzed 238 retractions published by 117 journals. The most common reason for retraction was unethical research, and higher impact factors journals tended to publish more retractions. In conclusion, most of the analyzed retractions were the result of unethical research and were retracted by editors.     

A bibliometric analysis of the recovered memory controversy in the 21st century

In the 1990s, repressed and recovered memories were at the heart of intense debates within the clinical field as well as in academia. Recent data suggest that this controversy has not yet been resolved in the clinical field. However, it is unclear to what extent repressed and recovered memories are studied in peer‐reviewed outcomes in the 21st century. The current article examined the volume of publications and citations regarding repressed and/or recovered memories during the years 2001–2018. Analysis of the 145 articles retrieved shows that these issues are still being investigated within the academic sphere. Proponents and opponents of repressed memories regularly published articles, and these were cited as often as articles published during the 1990s. These issues were also multidisciplinary (i.e., social/clinical/experimental psychology, psychiatry, and law) and often dealt with dissociation, child abuse, and/or false memory. The results are encouraging for furthering the research field and for the understanding of traumatic memory mechanisms.     

Three decades of suicide and life-threatening behavior: a bibliometric study

The purpose of this study is to quantify certain characteristics of the articles published in Suicide and Life-Threatening Behavior in three 5-year periods, namely, 1971-1975, 1984-1988, and 1997-2001. The characteristics in question include geographic origin of articles, number of authors per article, number of references listed per article, and number of times an article is cited in the literature. Changes across the three periods in terms of distribution of subjects/participants by age group and gender are also examined. The discussion focuses on explanations for the trends and characteristics that are described.     

Sleeping beauties in psychology: comparisons of "hits" and "missed signals" in psychological journals

Scientific publications tend to be forgotten quickly. A few works, however, are still cited 100 years and more after their publication. The author used bibliometric methods to compare "hits" (works noticed by the scientific community soon after their publication) with "missed signals" (works that went unnoticed until much later) by investigating 2 psychological journals founded in the 1890s: Zeitschrift für Psychologie and Psychological Review. All articles that were published in either of these journals up to 1920 and cited more than 25 times in the Web of Science up to the year 2000 were considered for inclusion in the analysis. It emerged that hits corresponded more closely to the focus of scientific attention at the time of the publications than missed signals.     

Describing citation structures in sport burnout literature: A citation network analysis

ObjectivesTo evaluate sport burnout research using citation network analysis.DesignA citation network analysis.MethodsWe began by searching the term “sport and burnout” in SportDiscus, Physical Education Index, and PsycINFO. From the returned search, we then selected and analyzed all peer-reviewed English articles that were published before 2012. This allowed us to create a network of inter-citations.ResultsOur search yielded 102 articles, of which there were 11 reviews (11%), 13 qualitative articles (13%), 76 quantitative articles (75%), and two mixed methods (qualitative and quantitative) articles (2%). The 11 most cited articles were published between 1984 and 2006, appearing in 5 journals (7 of them in the same journal). Merely 2 of the most cited articles investigated coach burnout. Top-cited articles typically conducted original research using male and female individual sport athletes and were published by North American authors, with two recent exceptions. The most cited article, and also most influential burnout model, was Smith's (1986) cognitive-affective stress model.ConclusionsThe findings show that following an initial focus on coach burnout, more recent studies examine athletes. In this paper we have identified some strengths amongst the most cited papers, including a wide range of publication dates and a focus on both male and female athletes; however, there were also limitations such as a scarcity of articles investigating team sport athletes.     

The impact of papers published in Intelligence 1977–2007 and an overview of the citation classics

This editorial discusses the impact of the journal of Intelligence between 1977 and 2007. The impact factor of Intelligence has been increasing over the past decade, and currently stands at 3.27. This relatively high impact factor reflects the influence of the journal in the science of individual differences in cognitive abilities. Typical articles published in Intelligence are cited between four and ten times. The 25 most cited papers in Intelligence are described. The work published in Intelligence is widely cited and reflects nicely the multi-disciplinary nature of the field.     

On the impact of human operant research: Asymmetrical patterns of cross-citation between human and nonhuman research

Reactions to published accounts of research with human subjects, as well as research with nonhuman subjects, were assessed by examining citations in several samples of empirical articles in the Journal of the Experimental Analysis of Behavior. A stable, asymmetrical pattern emerged: Nonhuman research was cited in both human and nonhuman articles, but human research was cited primarily in human articles. Thus, human operant research appears to have had little influence on the nonhuman research which constitutes the bulk of the experimental analysis of behavior. Interpretation of this lack of impact depends on the functions one envisions for human research, several of which are discussed.     

Citation Networks of Communication Journals, 1977–1985 Cliques and Positions,Citations Made and Citations Received

This article analyzes the pattern of citations among all communication journals covered by the first nine years of the Journal Citation Reports volume of the Social Sciences Citation Index (Garfield, 1977–1985). It approaches these analyses from two perspectives: (1) bibliometric analysis of citation flows, ratios, and impact factors, and (2) network analysis of both cohesion-based and position-based citation patterns. The field of communication exhibits clear clustering and inbreeding, consisting of cliques of interpersonal journals, mass media journals, and residual isolate journals. Citation patterns within and across these cliques have been very stable from 1977 through 1985. The cohesion analyses show that Human Communication Research and Communication Education provide weak ties from mass media journals to interpersonal communication journals. The Journal of Communication is cited the most strongly by the most journals, and provides, by means of citations, bidirectional channels for the flow of scientific information between mass media journals and interpersonal journals. The positional analyses show that the set of journals that has similar citing patterns is somewhat different from the set of journals that is cited similarly. In particular, the set of sources for the research reported in articles in these journals is not similar to the set of journals that refer to the articles in these journals.     

A Retrospective Analysis of the Trend of Retracted Publications in the Field of Biomedical and Life Sciences

Among the many forms of research misconduct, publishing fraudulent data is considered to be serious where the confidence and validity of the research is detrimentally undermined. In this study, the trend of 303 retracted publications from 44 authors (with more than three retracted publications each) was analysed. The results showed that only 6.60% of the retracted publications were single-authored and the discovery of fraudulent publications had reduced from 52.24 months (those published before the year 2000) to 33.23 months (those published on the year 2000 and onwards). It appears that with the widely accessible public databases like PubMed, fraudulent publications can be detected more easily. The different approaches adopted by authors who had previous publications retracted are also discussed herein.     

Predictors of Article Impact in Suicidology: The Bereavement Literature,A Research Note

Citation analysis has been neglected in suicidology. The present note applies a mixed‐methods approach to both test and suggest hypotheses for the variation in article impact in the bereavement literature. One hundred three articles from three core suicidology journals met the criteria for inclusion in the investigation. Citations to the articles were obtained from the Web of Science. Predictor variables included structural characteristics of the author (e.g., gender) and the article itself (e.g., years since publication). A multivariate regression analysis determined that, controlling for the other variables, the most important predictor of citations was the review article (β = .461), followed by year of publication (β = ?.414), the multiauthored article (β = .302), publication in Suicide and Life‐Threatening Behavior (SLTB) (β = .161), and male gender (β = .156). The 12 most cited articles were published between 1979 and 2004 in SLTB. The majority of these papers was written by males, were U.S. authors, and had more than one author. Four of the most cited articles were reviews. The study concludes that structural characteristics of articles and authors explained 41% of the variance in citations. The qualitative analysis determined that review papers, and papers on characteristics of suicide bereavement and psychological autopsies have been most frequently cited. Replication studies are needed for other subfields of suicidology.     

Citation trends of applied journals in behavioral psychology 1981-2000

One variable with which to evaluate scientific journals is how often their articles are cited in the literature. Such data are amenable to longitudinal analysis and can be used as a measure of a journal's impact on research within a discipline. We evaluated multiple citation measures for a number of applied journals in behavioral psychology from 1981 to 2000. The results indicate a relatively consistent impact across these journals, with some evidence of growth.     

Correction and use of biomedical literature affected by scientific misconduct

The purpose of this study was to identify and describe published research articles that were named in official findings of scientific misconduct and to investigate compliance with the administrative actions contained in these reports for corrections and retractions, as represented in PubMed. Between 1993 and 2001, 102 articles were named in either the NIH Guide for Grants and Contracts ("Findings of Scientific Misconduct") or the U.S. Office of Research Integrity annual reports as needing retraction or correction. In 2002, 98 of the 102 articles were indexed in PubMed. Eighty-five of these 98 articles had indexed corrections: 47 were retracted; 26 had an erratum; 12 had a correction described in the "comment" field. Thirteen had no correction, but 10 were linked to the NIH Guide "Findings of Scientific Misconduct", leaving only 3 articles with no indication of any sort of problem. As of May 2005, there were 5,393 citations to the 102 articles, with a median of 26 citations per article (range 0-592). Researchers should be alert to "Comments" linked to the NIH Guide as these are open access, and the "Findings of Scientific Misconduct' reports are often more informative than the statements about the retraction or correction found in the journals.     

Age and scholarly impact

The claim that older scientists generate research of lower quality than do younger scientists was tested through two analyses in which the age distribution of authors of frequently cited articles in psychology journals was compared with the age distribution of authors of low-impact articles published in the same journals. Most high-impact articles were published by relatively young psychologists, but so were most low-impact articles. When allowance was made for relative numerical representation, there was no evidence that publications from older scientists have less impact. Results are discussed in the context of methodological issues in evaluation of relations between age and scientific achievement.     

Self- and cross-citations in the Journal of Applied Behavior Analysis and the Journal of the Experimental Analysis of Behavior: 1993-2003

Self- and cross-citations in JABA and JEAB from 1993 through 2003 were examined. Yearly mean levels of self-citation for JABA and JEAB were 34.9% and 33.2%, respectively. Overall, 7.8% of JABA citations were JEAB articles, and 0.6% of JEAB citations were JABA articles. The former value, but not the latter, is substantially higher than the cross-citation level reported for earlier years. The two JEAB articles most often cited in JABA were published over 20 years ago and are concerned with establishing operations and the matching law.