Analysis of Citations to Biomedical Articles Affected by Scientific Misconduct

We describe the ongoing citations to biomedical articles affected by scientific misconduct, and characterize the papers that cite these affected articles. The citations to 102 articles named in official findings of scientific misconduct during the period of 1993 and 2001 were identified through the Institute for Scientific Information Web of Science database. Using a stratified random sampling strategy, we performed a content analysis of 603 of the 5,393 citing papers to identify indications of awareness that the cited articles affected by scientific misconduct had validity issues, and to examine how the citing papers referred to the affected articles. Fewer than 5% of citing papers indicated any awareness that the cited article was retracted or named in a finding of misconduct. We also tested the hypothesis that affected articles would have fewer citations than a comparison sample; this was not supported. Most articles affected by misconduct were published in basic science journals, and we found little cause for concern that such articles may have affected clinical equipoise or clinical care.     

Perpetuation of Retracted Publications Using the Example of the Scott S. Reuben Case: Incidences,Reasons and Possible Improvements

In 2009, Scott S. Reuben was convicted of fabricating data, which lead to 25 of his publications being retracted. Although it is clear that the perpetuation of retracted articles negatively effects the appraisal of evidence, the extent to which retracted literature is cited had not previously been investigated. In this study, to better understand the perpetuation of discredited research, we examine the number of citations of Reuben’s articles within 5 years of their retraction. Citations of Reuben’s retracted articles were assessed using the Web of Science Core Collection (Thomson Reuters, NY). All citing articles were screened to discriminate between articles in which Reuben’s work was quoted as retracted, and articles in which his data was wrongly cited without any note of the retraction status. Twenty of Reuben’s publications had been cited 274 times between 2009 and 1024. In 2014, 45 % of the retracted articles had been cited at least once. In only 25.8 % of citing articles was it clearly stated that Reuben’s work had been retracted. Annual citations decreased from 108 in 2009 to 18 in 2014; however, the percentage of publications correctly indicating the retraction status also declined. The percentage of citations in top-25 %-journals, as well as the percentage of citations in journals from Reuben’s research area, declined sharply after 2009. Our data show that even 5 years after their retraction, nearly half of Reuben’s articles are still being quoted and the retraction status is correctly mentioned in only one quarter of the citations.     

A Study on Journal Self-Citations and Intra-Citing within the Subject Category of Multidisciplinary Sciences

For academic research outcomes, there is an increasing emphasis on the bibliometric scorings like the journal impact factor and citations when the assessment of the scientific merits of research or researchers is required. Currently, no known study has been conducted to explore the bibliographical trends of the subject category of multidisciplinary sciences as indexed by the annual Journal Citation Reports of the Thomson Scientific. The effect of journal self-citations and intra-citing within a discipline to the bibliometric data computation can be confounding. In this study, six journals were selected from the multidisciplinary sciences subject category where the trend of self-citations and intra-citing were analysed. These journals were chosen as they published more than 450 citable articles in the year 2007 and had available bibliometric data for a 10-year period. The results showed that self-citations rose as much as +23.98% while intra-citing declined up to ?5.80% over the observed period. The retrospective impacts and influences of these observations were also discussed in this study.     

Plagiarism Allegations Account for Most Retractions in Major Latin American/Caribbean Databases

This study focuses on retraction notices from two major Latin American/Caribbean indexing databases: SciELO and LILACS. SciELO includes open scientific journals published mostly in Latin America/the Caribbean, from which 10 % are also indexed by Thomson Reuters Web of Knowledge Journal of Citation Reports (JCR). LILACS has a similar geographical coverage and includes dissertations and conference/symposia proceedings, but it is limited to publications in the health sciences. A search for retraction notices was performed in these two databases using the keywords “retracted”, “retraction” “withdrawal”, “withdrawn”, “removed” and “redress”. Documents were manually checked to identify those that actually referred to retractions, which were then analyzed and categorized according to the reasons alleged in the notices. Dates of publication/retraction and time to retraction were also recorded. Searching procedures were performed between June and December 2014. Thirty-one retraction notices were identified, fifteen of which were in JCR-indexed journals. “Plagiarism” was alleged in six retractions of this group. Among the non-JCR journals, retraction reasons were alleged in fourteen cases, twelve of which were attributed to “plagiarism”. The proportion of retracted articles for the SciELO database was approximately 0.005 %. The reasons alleged in retraction notices may be used as signposts to inform discussions in Latin America on plagiarism and research integrity. At the international level, these results suggest that the correction of the literature is becoming global and is not limited to mainstream international publications.     

The Evaluative Use of Citation Analysis for Communication Journals

This study investigated the impact of the omission of scholarly communication journals from Social Sciences Citation Index (SSCI) and Arts and Humanities Citation Index (AHCI) on citation-based appraisals of communication literature. Citation data were collected from reference lists in articles appearing in 27 communication journals published during 1990, including 14 not indexed by SSCI or AHCI. The 14 journals not included in SSCI or AHCI contributed 1,953, or 26%, of the 7,640 citations to authors during 1990, and 1,156, or 25%, of the 4,587 citations to journals in 1990. Twenty-seven of the 50 most frequently cited authors received 25% or more of their citations from journals omitted by SSCI and AHCI. This study found that an accurate evaluation of a scholar's articles based on citations received will not be possible until SSCI and/or AHCI choose to include the omitted journals, and that computer applications could be used to provide a convenient and inexpensive on-line citation index for communication literature. The Journal Impact Rating, a measure for use in comparing journals’impact on the basis of citations received, was introduced.     

Retractions in the Engineering Field: A Study on the Web of Science Database

This study assesses the retractions of scientific articles in engineering journals indexed on the Web of Science from 1945 to 2015. The data set was built based on documents containing the keywords retracted, retraction, withdrawal, or redress. We used database exploration techniques, including Structured Query Language and analysis of variance, for data analysis. We analyzed 238 retractions published by 117 journals. The most common reason for retraction was unethical research, and higher impact factors journals tended to publish more retractions. In conclusion, most of the analyzed retractions were the result of unethical research and were retracted by editors.     

Scientific misconduct: Present problems and future trends

Substantial progress in handling scientific misconduct cases has been made since the first cases were investigated by the NIH Office of Scientific Integrity in 1989. The successor Office of Research Integrity (ORI) has simultaneously reduced the backlog of cases and increased the professionalism with which they are handled. However, a spate of lawsuits against universities, particularly those brought under the federal False Claims Act, threatens to undermine the ORI by encouraging use of the courts as an alternate route for resolving claims of research misconduct. Next steps should include establishing a government-wide definition of scientific misconduct, providing immunity from lawsuits for institutions that follow proper procedures in investigating charges of scientific misconduct, and participating in the development of international guidelines for maintaining scientific integrity. An earlier version of this paper was presented at the symposium entitled “Misconduct in Science: A Decade of Progress or Merely Years of Controversy” held during the Annual Meeting of the American Association for the Advancement of Science, Philadelphia, Pennsylvania, 13 February, 1998.     

Citation rates for experimental psychology articles published between 1950 and 2004: Top-cited articles in behavioral cognitive psychology

From citation rates for over 85,000 articles published between 1950 and 2004 in 56 psychology journals, we identified a total of 500 behavioral cognitive psychology articles that ranked in the top 0.6?% in each half-decade, in terms of their mean citations per year using the Web of Science. Thirty nine of these articles were produced by 78 authors who authored three or more of them, and more than half were published by only five journals. The mean number of cites per year and the total number of citations necessary for an article to achieve various percentile rankings are reported for each journal. The mean number of citations necessary for an article published within each half-decade to rank at any given percentile has steadily increased from 1950 to 2004. Of the articles that we surveyed, 11?% had zero total citations, and 35?% received fewer than four total citations. Citations for post-1994 articles ranking in the 50th-75th and 90th-95th percentiles have generally continued to grow across each of their 3-year postpublication bins. For pre-1995 articles ranking in the 50th-75th and 90th-95th percentiles, citations peaked in the 4- to 6- or 7- to 9-year postpublication bins and decreased linearly thereafter, until asymptoting. In contrast, for the top-500 articles, (a) for pre-1980 articles, citations grew and peaked 10-18-year postpublication bins, and after a slight decrease began to linearly increase again; (b) for post-1979 articles, citations have continually increased across years in a nearly linear fashion. We also report changes in topics covered by the top-cited articles over the decades.     

Sociology and psychology within the scope of scientific dishonesty

A survey is undertaken based on qualitative analyses of the cases of scientific misconduct from the Danish Committee on Scientific Dishonesty’s first five years of collecting data, with additional information from selected international sources, in which underlying psychological motivations can be judged. An carlier version of this paper was presented at a symposium, Scientific Misconduct. An International Perspective, organised by The Medical University of Warsay, 16 November, 1998.     

Incidence of Data Duplications in a Randomly Selected Pool of Life Science Publications

Since the solution to many public health problems depends on research, it is critical for the progress and well-being for the patients that we can trust the scientific literature. Misconduct and poor laboratory practice in science threatens the scientific progress, leads to loss of productivity and increased healthcare costs, and endangers lives of patients. Data duplication may represent one of challenges related to these problems. In order to estimate the frequency of data duplication in life science literature, a systematic screen through 120 original scientific articles published in three different cancer related journals [journal impact factor (IF) <5, 5–10 and >20] was completed. The study revealed a surprisingly high proportion of articles containing data duplication. For the IF < 5 and IF > 20 journals, 25 % of the articles were found to contain data duplications. The IF 5–10 journal showed a comparable proportion (22.5 %). The proportion of articles containing duplicated data was comparable between the three journals and no significant correlation to journal IF was found. The editorial offices representing the journals included in this study and the individual authors of the detected articles were contacted to clarify the individual cases. The editorial offices did not reply and only 1 out of 29 cases were apparently clarified by the authors, although no supporting data was supplied. This study questions the reliability of life science literature, it illustrates that data duplications are widespread and independent of journal impact factor and call for a reform of the current peer review and retraction process of scientific publishing.     

Prior Publication and Redundancy in Contemporary Science: Are Authors and Editors at the Crossroads?

We discuss prior publication and redundancy in contemporary science in the context of changing perceptions of originality in the communication of research results. These perceptions have been changing in the publication realm, particularly in the last 15 years. Presenting a brief overview of the literature, we address some of the conflicts that are likely to arise between authors and editors. We illustrate our approach with conference presentations that are later published as journal articles and focus on a recent retraction of an article that had been previously published as a conference proceedings. Although we do not make definitive pronouncements on the matter—as many concepts are evolving—we do argue that conference papers that contain sufficient details for others to attempt a replication and are indexed in scientific databases such as PubMed, challenge some currently held assumptions of prior publication and originality in the sciences. Our view is that these important issues are in need of further clarification and harmonization within the science publishing community. This need is more evident when we consider current notions of research integrity when it comes to communication to peers. Revisiting long-standing views about what constitutes prior publication and developing a clearer set of guidelines for authors and editors to follow should reduce conflicts in the research environment, which already exerts considerable pressure, especially on newcomers in academia. However, while clearer guidelines are timely, developing them is only part of the challenge. The present times seem to call for deeper changes in the research and publication systems.     

Self‐ and cross‐citations in the Journal of Applied Behavior Analysis and the Journal of the Experimental Analysis of Behavior: 2004‐2018

We examined self‐ and cross‐citations in the Journal of Applied Behavior Analysis (JABA) and the Journal of the Experimental Analysis of Behavior (JEAB) from 2004 through 2018. Mean annual levels of self‐citations for JABA and JEAB were 40.1% and 28.7%, respectively. Overall, 5.1% of JABA citations were JEAB articles, and 2.3% of JEAB citations were JABA articles. Although overall cross‐citation levels were relatively low, 28.7% of the JABA articles reviewed had at least one JEAB citation, and 27.5% of the JEAB articles reviewed had at least one JABA citation. Authors in both journals cited articles addressing the topics of matching and motivating operations. The extent to which the basic and applied sectors of behavior analysis interact depends on how the interaction is measured. Nonetheless, the degree of interaction is growing, which is a good thing for the discipline.     

Cultural Ethnocentrism and Imperialism in Citations of American and Scandinavian Psychological Research

The present study was conducted in order to document the extent to which ethnocentrism and imperialism exist in American and Scandinavian reports of psychological research. Journal citation analyses indicated that articles appearing in the Scandinavian Journal of Psychology referenced numerous U.S. resources but also many resources from Europe and other parts of the world. In contrast, articles published in American journals cited a preponderance of U.S. sources and, for the most part, excluded reference to Scandinavian psychological research. These findings were interpreted as indicating the existence of empirical ethnocentrism in U.S. journal citations, and media-based cultural imperialism in Scandinavian reports of psychological research.     

The legal basis for the Danish committee on scientific dishonesty

The author, a High Court Judge, has chaired the Danish Committee on Scientific Dishonesty (DCSD) since its establishment in 1992. The Committee has worked in the health sector, but from 1999 the scope has been broadened to cover all fields of science. The article describes how the work is organised and the experiences gained. It is stressed, that the difficulty in connection with scientific dishonesty is, first and foremost, to organise a system suitable for investigating cases effectively, professionally, and with proper respect to the fundamental legal rights of the parties involved. The Committee has also spent much effort in determining what can be termed scientific dishonesty and what falls outside this category but which may, nevertheless, be characterised as breaching of good scientific practice. It is emphasised that these rules are not arbitrarily established by the Committee, but formulated in accordance with norms general accepted by opinion leaders in the scientific community. An carlier version of this paper was presented at a symposium, Scientific Misconduct. An International Perspective, organised by The Medical University of Warsaw, 16 November, 1998. The article is based on more comprehensive articles by the same author in DCSD’s Annual Reports for 1993 and 1995.     

Of whistleblowers, investigators, and judges

Conclusion: Deliberate misrepresentation continues. Needleman attacks the whistleblowers, the NIH, and his own University to deflect attention from the indications of misconduct in his research. Federal agencies base policies on his research and on his assertions regarding the purported effects of low-level lead exposure on children. The policies divert resources and attention from the real needs of children. Misconduct issues will ultimately be resolved by the ORI and the courts. Public policy issues may require reconsideration in light of further evidence.     

A comparative view of the new journal: Assessment

The reference sections from all articles in the 1997 volumes of Assessment, Journal of Personality Assessment, and Psychological Assessment were entered into a database and analyzed. An article published in Assessment averaged almost 31 references. An article published in Journal of Personality Assessment contained an average of 33 references. Psychological Assessment averaged 38 references per article. The median age of the references in the three journals was 8 years with an interquartile range of 4 to 14 years. The Journal of Personality Assessment had the largest number of citations in this database of 5,316 references. Each of these received a relatively large number of their citations from articles published in the same journal (self-citations). Randomly selected articles from the 1997 volume of Assessment received fewer citations in the Social Science Citation Index than a similar set of articles from the other two journals. However, the data on Assessment, when compared with data available on other new scientific publications, suggests that Assessment is doing as well as other fledgling journals.     

From case management to prevention of scientific dishonesty in Denmark

In 1992, The Danish Medical Research Council established a national committee on scientific dishonesty with the twofold task of handling cases of scientific misconduct and taking preventive initiatives. Scientific dishonesty was proven in only five cases, but in another nine cases lesser degrees of deviations from good scientific practice were found. The experiences from a total of 24 treated cases indicated that three key areas were at the basis of most of the accusations and the deviations from good practice: uncertainty about 1) authorship, about 2) rights and duties to use scientific data and about 3) agreements at the initiation of joint studies. As a consequence guidelines on good practice have been issued on these key subjects. An earlier version of this paper was presented at a symposium, Scientific Misconduct. An International Perspective, organised by The Medical University of Warsaw, 16 November, 1998.     

Citation Analysis of Skinner's Verbal Behavior: 1984-2004

The present study undertook an updated citation analysis of Skinner's (1957)Verbal Behavior. All articles that cited Verbal Behavior between 1984 and 2004 were recorded and content analyzed into one of five categories; four empirical and one nonempirical. Of the empirical categories, studies that employed a verbal operant from Skinner's analysis were assigned to either basic, applied, or observational categories. Empirical studies that did not employ a verbal operant were categorized as other-empirical. The total number of citations remained stable across the review period and averaged just over 52 per year. Of these, 80% were from nonempirical articles, 13.7% were from other-empirical articles, 4% were from applied articles, 1.4% were from basic articles, and 0.9% were from observational articles. An "obliteration" analysis was also conducted to identify articles that employed Skinner's verbal operant terms but did not cite Verbal Behavior. This analysis identified 44 additional articles, suggesting that a degree of obliteration had occurred in the half century since the publication of Verbal Behavior. In particular, the analysis suggests that the verbal operant of manding has sufficient presence in the applied empirical literature to render citation of Verbal Behavior redundant. Overall, Verbal Behavior continues to make an important contribution to the psychological literature.     

Multicultural Counseling: A 10‐Year Content Analysis of the Journal of Counseling & Development

The emphasis on multicultural counseling during the past 20 years has influenced the increase in scholarly publications on this topic. The authors report the findings of a content analysis of 102 multicultural‐centered articles. Journal of Counseling & Development issues spanning 1990–2001 were evaluated. Findings are reported for methodology, populations discussed, applied settings, and authors' roles and institutional affiliations. Findings indicate that there has been an increase of multicultural‐focused publications since 1990 and that publications are more exploratory and developmental rather than pathology‐oriented.