A BIBLIOMETRIC EVALUATION OF CORE JOURNALS IN COMMUNICATION RESEARCH

Bibliometrics is a method of assessing scientific activity based on the citation links between journal articles. Nine core journals in the field of communication were studied to evaluate their influence on each other and on journals outside the field. Most of the data were drawn from the Social Sciences Citation Index Journal Citation Reports, 1977–1979 issues. It was found that communication journals make only about 13% of their cites to other communication journals, and 44% of these are self-citations. With the exception of Public Opinion Quarterly, communication journals make five citations for every one they receive. A network analysis showed that the nine journals clustered into two groups: speech-communication journals and mass communication journals. Human Communication Research has the most influence within the communication discipline, and Public Opinion Quarterly has the most influence outside the discipline. Communication remains a field with separate subliteratures and is very dependent on journals outside communication research.     

A comparative view of the new journal: Assessment

The reference sections from all articles in the 1997 volumes of Assessment, Journal of Personality Assessment, and Psychological Assessment were entered into a database and analyzed. An article published in Assessment averaged almost 31 references. An article published in Journal of Personality Assessment contained an average of 33 references. Psychological Assessment averaged 38 references per article. The median age of the references in the three journals was 8 years with an interquartile range of 4 to 14 years. The Journal of Personality Assessment had the largest number of citations in this database of 5,316 references. Each of these received a relatively large number of their citations from articles published in the same journal (self-citations). Randomly selected articles from the 1997 volume of Assessment received fewer citations in the Social Science Citation Index than a similar set of articles from the other two journals. However, the data on Assessment, when compared with data available on other new scientific publications, suggests that Assessment is doing as well as other fledgling journals.     

Ethical Assurance Statements in Political Science Journals

Many journals in the physical sciences require authors to submit assurances of compliance with human subjects and other research ethics standards. These requirements do not cover all disciplines equally, however. In this paper we report on the findings of a survey of perceptions of ethical and managerial problems from journal editors in political science and related disciplines. Our results show that few journals in political science require assurance statements common to journals for other scientific disciplines. We offer some reasons for this as well as some recommendations for implementing ethical assurance safeguards for political science.     

Calculating Impact Factor: How Bibliographical Classification of Journal Items Affects the Impact Factor of Large and Small Journals

As bibliographical classification of published journal items affects the denominator in this equation, we investigated how the numerator and denominator of the impact factor (IF) equation were generated for representative journals in two categories of the Journal Citation Reports (JCR). We performed a full text search of the 1st-ranked journal in 2004 JCR category “Medicine, General and Internal” (New England Journal of Medicine, NEJM, IF = 38.570) and 61st-ranked journal (Croatian Medical Journal, CMJ, IF = 0.690), 1st-ranked journal in category “Multidisciplinary Sciences” (Nature, IF = 32.182) and journal with a relative rank of CMJ (Anais da Academia Brasileira de Ciencias, AABC, IF = 0.435). Large journals published more items categorized by Web of Science (WoS) as non-research items (editorial material, letters, news, book reviews, bibliographical items, or corrections): 63% out of total 5,193 items in Nature and 81% out of 3,540 items in NEJM, compared with 31% out of 283 items in CMJ and only 2 (2%) out of 126 items in AABC. Some items classified by WoS as non-original contained original research data (9.5% in Nature, 7.2% in NEJM, 13.7% in CMJ and none in AABC). These items received a significant number of citations: 6.9% of total citations in Nature, 14.7% in NEJM and 18.5% in CMJ. IF decreased for all journals when only items presenting original research and citations to them were used for IF calculation. Regardless of the journal’s size or discipline, publication of non-original research and its classification by the bibliographical database have an effect on both numerator and denominator of the IF equation. Preliminary results of the study were presented at the 2006 ORI Research Conference on Research Integrity, Tampa, FL, December 1–3, 2006.     

On raising the international dissemination of German research: Does changing publication language to English attract foreign authors to publish in a German basic psychology research journal?

It has been proposed that German basic psychology journals should change publication language to English in order to facilitate access to research from German-speaking countries. However, to truly increase the dissemination of German research, it seems crucial to progress towards an internationalization of authors and readers. We applied bibliometric analysis to investigate the impact of the transition to English on the rate of foreign authors publishing in Zeitschrift für Experimentelle Psychologie/Experimental Psychology, as well as possible associated changes in citation patterns. There was an increase in the rate of articles published by foreign authors from 14.6 and 8.7 per cent, respectively, for the last biannual periods as German-language journal, to 52.7 per cent in the first biannual period as English-language journal. Regarding citations patterns, the clearest changes emerged for domestic authors. The results illustrate possible consequences of a transition to English as publication language, and reveal that Experimental Psychology has successfully established certain prerequisites for an increase of the international dissemination of German psychology research.     

Differential item functioning: a bibliometric analysis of journals published in Spanish

Differential item functioning: a bibliometric analysis of journals published in Spanish. This study aims to provide an overview of scientific productivity with respect to articles published in Spanish on the issue of DIF. The documents included in the study were identified using the Psicodoc database, as well as the Science Citation Index and Social Science Citation Index from the Web of Science. The analyses carried out are focused mainly on presenting the frequencies and percentages of publications with respect to various bibliometric indicators. The results reveal that interest in the issue of DIF has increased, and that the universities are the most productive institutions. The majority of articles have been published in the journal Psicothema.     

Le JCR facteur d’impact (IF) et le SCImago Journal Rank Indicator (SJR) des revues françaises : une étude comparative

One of the major functions of academic journals is to contribute to the evaluation of research activities and scientists. Invented more than 50 years ago, the ISI impact factor (IF) became the most important indicator of the quality of journals, in spite of well-known problems and critics such as the over-representation of English-language journals. This is a specific problem for French publishers and scientists; publishing in French is not valorising. Since 2007, the new SCImago Journal Rank Indicator (SJR) offers an alternative to the IF. SJR applies the Google algorithm (PageRank) to the journals of the SCOPUS bibliographic database that indexes more journals than ISI Web of Science. The goal of our study is to compare the two indicators for French academic journals, with three questions: Which is the coverage of French journals by ISI and SCOPUS (title number, scientific disciplines)? Which are the differences of the two indicators IF and SJR for the ranking of French journals? How do they cover the French academic journal publishing market (representativity)? The results of our study of 368 French journals with IF and/or SJR are in favour of the usage of the new indicator, at least as a complement to the IF. (1) Coverage: 166 journals are indexed by ISI (45%), 345 journals are indexed by SCOPUS (94%), 143 journals are indexed by both (39%). 82% of the journals are from STM, 18% are from SS&H. In particular, SCOPUS covers much better the medical and pharmacological sciences. (2) Ranking: The correlation of IF and SJR for the 143 journals with both indicators is high (0.76). The IF better differentiates the journals than the SJR indicator (155 vs. 89 rankings). On the other side, because of the larger source database, more French titles become visible on an international level through SJR than through IF. (3) Representativity: The SJR is more interesting and representative of the French academic journal publishing market than the IF (19% vs. 9%), especially for STM titles (38% vs. 19%), much less for SS&H titles (6% vs. 2%). Nevertheless, ISI (Web of Science) and SCOPUS index journals from only a small part of the French academic publishers (10%–20%). Again, SCOPUS is more representative than the ISI dababase (17% of the publishers vs. 10%). Methodological problems and perspective of a multidimensional evaluation are discussed. Our study compares the ISI impact factor (IF) with the new SJR for 368 French academic journals with IF and/or SJR. The results: The SJR coverage is better than of the IF (94% vs. 45%), especially in medical sciences. The correlation of IF and SJR for journals with both indicators is high (0.76). The IF better differentiates the journals than the SJR indicator (155 vs. 89 rankings). The SJR coverage is more representative of the French academic journal publishing market than ISI/IF (19% vs. 9%), especially for STM titles (38% vs. 19%), less for SS&H titles (6% vs. 2%).     

Incidence of Data Duplications in a Randomly Selected Pool of Life Science Publications

Since the solution to many public health problems depends on research, it is critical for the progress and well-being for the patients that we can trust the scientific literature. Misconduct and poor laboratory practice in science threatens the scientific progress, leads to loss of productivity and increased healthcare costs, and endangers lives of patients. Data duplication may represent one of challenges related to these problems. In order to estimate the frequency of data duplication in life science literature, a systematic screen through 120 original scientific articles published in three different cancer related journals [journal impact factor (IF) <5, 5–10 and >20] was completed. The study revealed a surprisingly high proportion of articles containing data duplication. For the IF < 5 and IF > 20 journals, 25 % of the articles were found to contain data duplications. The IF 5–10 journal showed a comparable proportion (22.5 %). The proportion of articles containing duplicated data was comparable between the three journals and no significant correlation to journal IF was found. The editorial offices representing the journals included in this study and the individual authors of the detected articles were contacted to clarify the individual cases. The editorial offices did not reply and only 1 out of 29 cases were apparently clarified by the authors, although no supporting data was supplied. This study questions the reliability of life science literature, it illustrates that data duplications are widespread and independent of journal impact factor and call for a reform of the current peer review and retraction process of scientific publishing.     

Building the boundaries of a science: First representations of Italian social psychology between 1875 and 1954

The present study embraces the critical traditions of "New History" and of social representations theory articulated with the mainstream historiographical tradition of a bibliometric approach. The historical analysis deals with the early representations of Italian social psychology articulated and disseminated by some of the main Italian scientific-cultural and philosophical journals. We examined seven journals published between 1875 and 1954, and gathered 2,030 texts dealing with the various forms of social and collective psychology. We have applied a grid of content analysis whose data have been transcribed to a numerical file. At the same time, we have created a textual file containing the titles of the contributions as well as the names of the authors and scholars reviewed. The two files have been processed by SPAD-T for a correspondence analysis in which both lexical data and category variables have been considered as active variables. Through the scree-test, two factors that explain 18.90% of the variance have been singled out. Their combination has produced a factorial plan able to highlight three distinct areas differently characterized from journals and years. The results are also discussed with regard to the contextual historical frame.     

Benefits to the Spanish research community of regional content expansion in Web of Science

The regional content expansion of Thomson Reuters (formerly ISI) Web of Science added approximately 1,600 journals to the database with a regional as opposed to international focus. Web of Science coverage has grown to reflect the changing nature of global research publication trends and the additional regional journals provide greater visibility to high quality local studies beyond their traditional boundaries. The cited references indexed from the regional journals represent the influence of those journals on both the global and local research communities. This study analyses the impact of adding Spanish regional journals to Web of Science on the publication and citation patterns of Spanish research. The findings demonstrate a recent increase in research output from Spain and this is explained by more Spanish research being produced rather than due to the indexing of more Spanish journals; indeed it is shown that the majority of Spanish research is not published in Spanish journals. An analysis of Spanish journal citations uncovers a Spanish regional citation network previously undetected and serves as valuable information for evaluators of Spanish journals.     

The Evolutionary Nature of Counseling and Values

The purpose of this qualitative research study is to discover the evolutionary nature of Counseling and Values, the professional journal of the Association for Spiritual, Ethical, and Religious Values in Counseling. The authors used 4 recorded telephone interviews conducted with previous editors of the journal over the last 25 years as the principal source of data. Findings suggest that the evolutionary nature of the journal is characterized by a dynamic tension among 6 interrelated categories of influence. Implications of this research suggest the need for increased collaborative participation in support of professional journals between institutions and sponsoring associations and between diversity in readership and the professional forces that influence publication decision, as well as an increased openness between professional associations and the society that they serve.     

Journal Reprints as Dissemination of Psychological Research: Courtesy,Obligation, or Obsolescence?

The proliferation of journals and the escalation of journal prices have made it difficult for psychologists, especially those in rural areas without access to comprehensive libraries, to obtain journal articles. A traditional source of otherwise unavailable papers is to request a reprint directly from the author. Although previous researchers found this method to be 60%-80% successful, there have been major changes in journal operations and alternative media since this research was conducted. In the present study, reprints were requested from 473 corresponding authors from 10 American Psychological Association journals. The compliance rate was 84% and reprints took, on average, 32 days to arrive. There was no difference in the rate or in the speed of response due to the requestor's status as an academic or applied psychologist. Although functional, the traditional reprint request method was slow, uncertain, and costly. It is suggested that a demand still exists for reprints, but that electronic reprints should replace the traditional paper format.     

Effects of a token reinforcement system on journal reshelving

A token reinforcement program involving two levels of token value and backup reinforcers to increase journal reshelving behavior in a large university library was experimentally evaluated. Results showed that instructions (in which signs asked users to reshelve journals) had no impact. By contrast, token reinforcement contingent on reshelving behavior led to a marked increase in journals reshelved. A return to instructions-only conditions, when data were corrected for library usage, showed an increase in unreshelved journals over the token reinforcement period, though the increase was not to baseline levels. For the next 11 months, library staff maintained a modified token program. Follow-up data collected after that interval showed that number of unreshelved journals remained markedly lower than levels at baseline and the first instructions-only period, though they were slightly higher than at the token reinforcement period. Token reinforcement of the variety employed in this study constitutes an efficient, economical means of changing the behavior of library users who fail to reshelve books and journals.     

Journal reprints as dissemination of psychological research: courtesy, obligation, or obsolescence?

The proliferation of journals and the escalation of journal prices have made it difficult for psychologists, especially those in rural areas without access to comprehensive libraries, to obtain journal articles. A traditional source of otherwise unavailable papers is to request a reprint directly from the author. Although previous researchers found this method to be 60%-80% successful, there have been major changes in journal operations and alternative media since this research was conducted. In the present study, reprints were requested from 473 corresponding authors from 10 American Psychological Association journals. The compliance rate was 84% and reprints took, on average, 32 days to arrive. There was no difference in the rate or in the speed of response due to the requestor's status as an academic or applied psychologist. Although functional, the traditional reprint request method was slow, uncertain, and costly. It is suggested that a demand still exists for reprints, but that electronic reprints should replace the traditional paper format. Key words: reprints, scientific communication     

Bibliometric Review of the Repertory Grid Technique: 1998–2007

This bibliometric review covers the scientific production with or about the repertory grid technique (RGT; Kelly, 1955/1991) between 1998 and 2007. An analysis of previous reviews suggests the need for a more careful and broad process of bibliographic research. With this aim, 24 bibliographic sources were used to cover a wide range of specialties. We began by drawing up an explicit protocol in which the research terms were detailed. Then we consulted the bibliographic sources, taking into account a specification of inclusion and exclusion criteria. As a result of this process, 973 references were obtained: 468 journal papers, 335 book chapters, 108 doctoral theses, and 62 books. The review also evaluates the types of documents found, the evolution of the number of works published, the repertory grid's fields of application, and the degree of openness to other disciplines. The most relevant authors, their affiliations, countries, and the publication language are also revealed in this article, as well as the major journals contributing to dissemination of the work done with this technique.     

Possible research area bias in the Excellence in Research for Australia (ERA) draft journal rankings

An analysis of the Excellence in Research for Australia (ERA) draft rankings of 661 psychology journals points to systematic differences between research areas in the distribution of ranks. Journals in experimental, biological and neuroscientific psychology obtained higher mean ranks, consistent with a tendency for “hard‐science” areas to have higher bibliometric journal impact. The ERA will influence the distribution of resources and rewards within psychology and create powerful incentives for institutions and researchers, so differences in ranks across research areas may alter the shape of the discipline. Although they do not necessarily imply bias, such differences raise the possibility that psychology researchers will not operate on a level playing field.     

Smoking research: basic research, intervention, prevention, and new trends

Smoking is a behavior that is influenced by a variety of factors that cut across methodologies, disciplines, and content areas within health psychology. The present article is designed to show the diversity and richness of smoking research by examining smoking from four perspective: basic laboratory research, intervention, prevention and deterrence, and new directions in smoking research. Methodologies that were derived from such varied sources as psychopharmacology, behavioral pharmacology, behavior therapy, clinical psychology, public health and health promotion, and social and developmental psychology have been used to study the smoking problem. The subject populations in these investigations ranged from animal models, to the individual smoker attempting to quit, to communities involved in health promotion and public health approaches. Future research should seek to provide new and improved examples of interdisciplinary research within the field of health psychology to multidisciplinary approaches from the basic and applied sciences.     

SIGNIFICANCE TESTING IN PSYCHOLOGICAL RESEARCH:

Abstract— Empirical surveys show that reports of significance tests appear in the vast majority of articles in psychological research journals and are relied on by both investigators and journal reviewers when making decisions about replication of experiments and submission and acceptance of research reports Evaluation of claims by critics that significance testing is, nonetheless, counterproductive yields suggestions for improvements of prevailing practices, but also the recommendation that decisions about significance testing versus alternative procedures should remain the province of the individual investigator, unconstrained by mandates or prohibitions by publishers or officials of scientific associations. The prime focus for efforts toward improvement of research design and data analysis in psychology and other behavioral sciences should be upgrading the mathematical and general scientific preparation of students preparing for research careers in these fields