Leading North American Programs in Clinical Assessment Research: An Assessment of Productivity and Impact

To identify doctoral programs with strong concentrations in clinical assessment, I measured productivity and impact of faculty at North American institutions with American Psychological Association accredited clinical programs. Publications, citations, and h-indexes derived from 4 top assessment journals were calculated over a 10-year period (1999–2009). I identified a total of 42 leading programs that collectively accounted for more than half of the publications and citations in these journals. I found a moderate relationship between assessment productivity and both US News & World Report program rankings as well as general productivity rankings of clinical programs reported in an earlier study.     

Citation rates for experimental psychology articles published between 1950 and 2004: Top-cited articles in behavioral cognitive psychology

From citation rates for over 85,000 articles published between 1950 and 2004 in 56 psychology journals, we identified a total of 500 behavioral cognitive psychology articles that ranked in the top 0.6?% in each half-decade, in terms of their mean citations per year using the Web of Science. Thirty nine of these articles were produced by 78 authors who authored three or more of them, and more than half were published by only five journals. The mean number of cites per year and the total number of citations necessary for an article to achieve various percentile rankings are reported for each journal. The mean number of citations necessary for an article published within each half-decade to rank at any given percentile has steadily increased from 1950 to 2004. Of the articles that we surveyed, 11?% had zero total citations, and 35?% received fewer than four total citations. Citations for post-1994 articles ranking in the 50th-75th and 90th-95th percentiles have generally continued to grow across each of their 3-year postpublication bins. For pre-1995 articles ranking in the 50th-75th and 90th-95th percentiles, citations peaked in the 4- to 6- or 7- to 9-year postpublication bins and decreased linearly thereafter, until asymptoting. In contrast, for the top-500 articles, (a) for pre-1980 articles, citations grew and peaked 10-18-year postpublication bins, and after a slight decrease began to linearly increase again; (b) for post-1979 articles, citations have continually increased across years in a nearly linear fashion. We also report changes in topics covered by the top-cited articles over the decades.     

Of Nobel class: A citation perspective on high impact research authors

The purpose of this paper was to determine if quantitative rankings of highly cited research authors confirm Nobel prize awards. Six studies covering different time periods and author sample sizes were reviewed. The number of Nobel laureates at the time each study was published was tabulated, as was the number of high impact authors who later became laureates. The Nobelists and laureates-to-be were also compared with non-Nobelists to see if they differed in terms of impact and productivity. The results indicate that high rankings by citation frequency identify researchersof Nobel class — that is, a small set of authors that includes a high proportion of actual Nobelists and laureates-to-be. Also, the average impact (citations per author) of Nobelists and laureates-to-be is sufficiently high to distinguish them from non-Nobelists in these rankings. In conclusion, a simple, quantitative, and objective algorithm based on citation data can effectively corroborate —and even forecast — a complex, qualitative, and subjective selection process based on human judgement.     

Research Productivity and Performance of Journals in the Creativity Sciences: A Bibliometric Analysis

A bibliometric approach was employed to analyze the research productivity and performance of creativity studies between 1965 and 2012. A dataset was constructed using all publications and citations retrieved from four key journals that publish creativity research: Journal of Creative Behavior (JCB), Gifted Child Quarterly (GCQ), Creativity Research Journal (CRJ), and Psychology of Aesthetics, Creativity, and the Arts (PACA). Major findings in this study include: (a) During the study period, the four journals have published 1,891 articles on creativity and they have been cited 11,709 times; (b) the impact factors of the four journals increased from lower than .50 in 2002 to over 1.0 in 2012; in 2012 PACA had the highest impact factor, followed by CRJ; (c) JCB published the most creativity papers and CRJ had the most citations; (d) about a third of the articles published in the four journals have never been cited. Implications for the field of creativity are discussed.     

ACADEMIC RESEARCH INSIDE ORGANIZATIONS: INPUTS, PROCESSES, AND OUTCOMES

Although many opinions have been expressed about the potential merits and pitfalls of conducting academic research inside organizations, empirical research on the question is nearly nonexistent. Consequently, the present study examined the origins, processes, and outcomes of 141 academic research projects that were conducted in (nonacademic) organizations and published in 4 top-tier industria organizational psychology and management journals over a 3-year period. Three outcomes were assessed: implementation of research findings, academic organizational relationship continuation, and research impact (as measured by other-author citations). Results suggested a number of relationships between the way projects began, the relative contributions of organizations and authors to the research process, and eventual outcomes. Suggestions for future research are offered.     

近10年SCI人格心理学研究文献计量分析

本研究以美国科技信息研究所出版的《科学引文索引》（SCI）为数据源检索人格心理学文献,并从文献量、学科、国家、作者、期刊、引文等多角度进行文献计量分析。结果显示：人格心理学研究近10年进入了快速发展阶段,但论文数量与在高影响因子学术刊物中所占数量不相称;我国人格心理学研究在文献量等方面与国际先进水平比较有很大差距;人格与神经科学、精神机能障碍关系的研究是具有重要临床价值以及富有挑战性的研究重点。     

Scientific productivity and Hirsch's h index of Spanish social psychology: convergence between productivity indexes and comparison with other areas

This article describes Hirsch's h index as a measure of researchers' scientific productivity and quality, examining its convergent validity with other productivity and quality measures (total citations, maximum citation, sexennials, years since earning Ph.D., and years as a full professor). It shows the distribution of the index among Spanish Social Psychology professors, and a comparison is made among the ten professors with highest h index of the six knowledge areas into which academic Psychology is divided in Spain. The results show that the index largely correlates with the citations but only very modestly with the number of sexennial investigations. The distributions by areas show that Psychobiology and Basic Psychology, as a whole, have a higher h index than the other areas, with Social Psychology in fourth place. Lastly, we discuss the implications of these results and we offer some recommendations for using the index in academic and research decision making.     

Quality,quantity, and impact in academic publication

Publication records of 85 social‐personality psychologists were tracked from the time of their doctoral studies until 10 years post‐PhD. Associations between publication quantity (number of articles), quality (mean journal impact factor and article influence score), and impact (citations, h‐index, g‐index, webpage visits) were examined. Publication quantity and quality were only modestly related, and there was evidence of a quality‐quantity trade‐off. Impact was more strongly associated with quantity than quality. Authors whose records weighed quality over quantity tended to be associated with more prestigious institutions, but had lesser impact. Quantity‐ and quality‐favoring publication strategies may have important implications for the shape and success of scientific careers. Copyright © 2009 John Wiley & Sons, Ltd.     

The nature of social and personality psychology as reflected in JPSP, 1965-2000

A bibliometric analysis of the first 36 years (1965-2000) of the Journal of Personality and Social Psychology (JPSP) is presented. The authors analyzed the structure of JPSP on the basis of contents and other aspects related to productivity, such as growth in the number of articles and authors, and "invisible colleges." In 2001, JPSP articles were cited over 23,000 times. An increasing number of older, classic articles are cited, suggesting that there are an accumulating number of citations whose influence endures over time. JPSP articles have grown in length, number of studies included, number of references, and number of authors and have become more international with an increasing proportion of authors from outside the United States. The pattern of findings suggests an increasingly complex and mature science.     

Symbolic self‐completion in academia: evidence from department web pages and email signature files

Symbolic self‐completion theory proposes that individuals use symbols of attainment to define themselves as accomplished in self‐defining areas and to communicate their accomplishments to others. The goal of the present research was to examine whether individual professors and academic departments strive for symbolic self‐completion when communicating through the Internet. We hypothesized that publications, citations, and departmental rankings by the National Research Council (NRC) represent important indicators of attainment for professors, whereas professional titles (i.e., “doctor,” “professor,” or “Ph.D.”) may serve as alternate symbols of attainment. We predicted that a lack of important indicators of attainment would motivate the display of professional titles in web pages and email signature files. In Study 1, academic departments with less prestigious NRC rankings listed more professional titles on their departmental web pages compared to departments with more prestigious rankings. In Studies 2 and 3, professors with lower annual rates of publications and citations displayed more professional titles in their email signatures compared to professors with higher publication and citation rates. These results suggest that self‐completion motives help to shape naturalistic Internet communications. The results further suggest that analyses of Internet communications can provide externally valid tests of theories concerned with motivation and self‐processes. Copyright © 2008 John Wiley & Sons, Ltd.     

Political Psychology: Submissions,Acceptances, Downloads,and Citations

Political Psychology has experienced a marked increase in the number of submissions, downloads, citations, and global exposure over the past few years. It is also a more influential journal than it was at the beginning of the decade. Specifically, the journal is now available in more than 4,200 libraries worldwide, compared with 2,200 five years ago; the number of downloads has recently increased to more than 620,000(!), compared with about 100,000 five years ago; the number of new submissions has increased drastically over the past five years to more than 300 per year; and the impact factor has risen to 1.771—the highest in the history of the journal. In 2014 alone, more than 40 articles published in the journal have been downloaded more than 500 times each. In this article, we analyze submissions to Political Psychology, acceptances, downloads, and citations by area of study and methodology.     

Performance of british university psychology departments as measured by number of publications in BPS journals

The aim of this investigation was to gauge the comparative research performance of university departments of psychology in Britain. The performance indicator was the number of publications per departmental staff member in the journals of the British Psychological Society (BPS) during the seven-year period 1983–1989. The contents of these journals were thoroughly searched, and articles written by members of university psychology departments in Britain were counted. The number of publications of each psychology department was divided by the size of the department in the corresponding year and the resulting annual figures were summed to determine the number of publications in BPS journals per departmental staff member over the seven-year period. These research performance figures correlated significantly with an earlier measure of departmental research performance based on publications in the seven European psychological journals with the highest citations per published article and with recent performance indicators based on other criteria     

Performance of british university psychology departments as measured by number of publications in BPS journals

The aim of this investigation was to gauge the comparative research performance of university departments of psychology in Britain. The performance indicator was the number of publications per departmental staff member in the journals of the British Psychological Society (BPS) during the seven-year period 1983–1989. The contents of these journals were thoroughly searched, and articles written by members of university psychology departments in Britain were counted. The number of publications of each psychology department was divided by the size of the department in the corresponding year and the resulting annual figures were summed to determine the number of publications in BPS journals per departmental staff member over the seven-year period. These research performance figures correlated significantly with an earlier measure of departmental research performance based on publications in the seven European psychological journals with the highest citations per published article and with recent performance indicators based on other criteria     

TREND: A tool for rapid online research literature analysis and quantification

The Research Explicator for oNline Databases (TREND) tool was developed out of a need to quantify large research literatures rapidly and objectively on the basis of online research database output. By parsing such output with TREND, a researcher can in minutes extract the most commonly cited articles, the most frequently published authors, a distribution of publication dates, and a variety of other information from a research literature several thousand articles in size. This tool thus enables an increase in productivity both for researchers venturing into new areas of interest and for advisors and instructors putting together core reading lists. The processing of citations from articles represents a unique challenge, however, because deviations from strict APA formatting cause problems that are sometimes difficult to correct mechanically. A case study of one particularly troublesome citation (Baron & Kenny, 1986) is presented. Usage and implications are discussed.     

Citation Classics in Suicide and Life Threatening Behavior: A Research Note

The number of citations a scholarly work receives is a common measure of its impact on the scientific literature; “citation classics” are the most highly cited works. The content of Suicide and Life‐Threatening Behavior (SLTB) citation classics is described here. The impact of SLTB citation classics is compared to their counterparts in journals having published the most suicide papers. All data are from the ISI electronic venue on the Web of Science and refer to the number of citations the top 1% of works received in each of ten journals from 1975 through August 10, 2011. Among all ten journals, SLTB ranked first in the number of works on suicide. The principle theme of half of SLTB suicide classics was literature review. The median number of citations for SLTB citation classics (top 1%) was 121.5, with a range between 96 and 279 citations, but classics from generalized psychiatric journals received more citations as anticipated. Journal impact factors explained 73% of the variance in classic’s citation counts across journals. On average, suicide classics received 30% more citations than all classics. Among a second group of five specialized suicide journals, however, SLTB ranked first in average 5‐year impact. Although SLTB produced the highest number of suicide articles of any journal, SLTB’s citation classics received fewer citations than suicide classics in high‐impact/prestige, general journals. Future work is needed to assess what predicts which SLTB articles ultimately become citation classics.     

Citation Networks of Communication Journals, 1977–1985 Cliques and Positions,Citations Made and Citations Received

This article analyzes the pattern of citations among all communication journals covered by the first nine years of the Journal Citation Reports volume of the Social Sciences Citation Index (Garfield, 1977–1985). It approaches these analyses from two perspectives: (1) bibliometric analysis of citation flows, ratios, and impact factors, and (2) network analysis of both cohesion-based and position-based citation patterns. The field of communication exhibits clear clustering and inbreeding, consisting of cliques of interpersonal journals, mass media journals, and residual isolate journals. Citation patterns within and across these cliques have been very stable from 1977 through 1985. The cohesion analyses show that Human Communication Research and Communication Education provide weak ties from mass media journals to interpersonal communication journals. The Journal of Communication is cited the most strongly by the most journals, and provides, by means of citations, bidirectional channels for the flow of scientific information between mass media journals and interpersonal journals. The positional analyses show that the set of journals that has similar citing patterns is somewhat different from the set of journals that is cited similarly. In particular, the set of sources for the research reported in articles in these journals is not similar to the set of journals that refer to the articles in these journals.     

A Study on Journal Self-Citations and Intra-Citing within the Subject Category of Multidisciplinary Sciences

For academic research outcomes, there is an increasing emphasis on the bibliometric scorings like the journal impact factor and citations when the assessment of the scientific merits of research or researchers is required. Currently, no known study has been conducted to explore the bibliographical trends of the subject category of multidisciplinary sciences as indexed by the annual Journal Citation Reports of the Thomson Scientific. The effect of journal self-citations and intra-citing within a discipline to the bibliometric data computation can be confounding. In this study, six journals were selected from the multidisciplinary sciences subject category where the trend of self-citations and intra-citing were analysed. These journals were chosen as they published more than 450 citable articles in the year 2007 and had available bibliometric data for a 10-year period. The results showed that self-citations rose as much as +23.98% while intra-citing declined up to ?5.80% over the observed period. The retrospective impacts and influences of these observations were also discussed in this study.     

Research productivity and scholarly impact of APA-accredited school psychology programs: 2005-2009

This study examined the research productivity and scholarly impact of faculty in APA-accredited school psychology programs using data in the PsycINFO database from 2005 to 2009. We ranked doctoral programs on the basis of authorship credit, number of publications, and number of citations. In addition, we examined the primary publication outlets of school psychology program faculties and the major themes of research during this time period. We compared our results with those of a similar study that examined data from a decade earlier. Limitations and implications of this study are also discussed.     

Perpetuation of Retracted Publications Using the Example of the Scott S. Reuben Case: Incidences,Reasons and Possible Improvements

In 2009, Scott S. Reuben was convicted of fabricating data, which lead to 25 of his publications being retracted. Although it is clear that the perpetuation of retracted articles negatively effects the appraisal of evidence, the extent to which retracted literature is cited had not previously been investigated. In this study, to better understand the perpetuation of discredited research, we examine the number of citations of Reuben’s articles within 5 years of their retraction. Citations of Reuben’s retracted articles were assessed using the Web of Science Core Collection (Thomson Reuters, NY). All citing articles were screened to discriminate between articles in which Reuben’s work was quoted as retracted, and articles in which his data was wrongly cited without any note of the retraction status. Twenty of Reuben’s publications had been cited 274 times between 2009 and 1024. In 2014, 45 % of the retracted articles had been cited at least once. In only 25.8 % of citing articles was it clearly stated that Reuben’s work had been retracted. Annual citations decreased from 108 in 2009 to 18 in 2014; however, the percentage of publications correctly indicating the retraction status also declined. The percentage of citations in top-25 %-journals, as well as the percentage of citations in journals from Reuben’s research area, declined sharply after 2009. Our data show that even 5 years after their retraction, nearly half of Reuben’s articles are still being quoted and the retraction status is correctly mentioned in only one quarter of the citations.     

Trends in school psychology research: 1974–1980

Research articles appearing in five major journals from 1974 to 1980 were categorized in 1 of 16 categories as determined by the major theme of the paper. A chi-square analysis was used to determine whether years differed in relative distribution of observations across the categories. Spearman's rho correlation coefficients were calculated for the rank order of categories between each pair of years, allowing for comparison of the current data with O'Callaghan's (1974) data. Results indicate a significant change in content of articles published over the 7-year period. Articles concerning instrument development and validation account for the relatively largest percentage of total articles published in the 1974–1980 period and have continued to increase since the 1967–1973 period examined by O'Callaghan. Schools and agencies primarily contributing to this research are identified across the 7-year time span. Results are discussed in terms of the professional literature's potential reflection of the role of the school psychologist.