Introduction to the model guidelines for preemployment integrity testing

TheModel Guidelines for Preemployment Integrity Testing Programs are described. These guidelines have implications for both test publishers and test users.Companies may request a copy of the Association of Personnel Test Publisher'sModel Guidelines for Preemployment Integrity Testing Programs by writingModel Guidelines, APTP, 655 Fifteenth Street, N.W., Suite 320, Washington, D.C. 20005.     

Peer review for journals: Evidence on quality control, fairness, and innovation

This paper reviews the published empirical evidence concerning journal peer review consisting of 68 papers, all but three published since 1975. Peer review improves quality, but its use to screen papers has met with limited success. Current procedures to assure quality and fairness seem to discourage scientific advancement, especially important innovations, because findings that conflict with current beliefs are often judged to have defects. Editors can use procedures to encourage the publication of papers with innovative findings such as invited papers, early-acceptance procedures, author nominations of reviewers, structured rating sheets, open peer review, results-blind review, and, in particular, electronic publication. Some journals are currently using these procedures. The basic principle behind the proposals is to change the decision from whether to publish a paper to how to publish it. The author, a professor of marketing at the Wharton School since 1968, was a founder editor of the Journal of Forecasting and the International Journal of Forecasting. This paper is based on a presentation at a workshop, “Advances in Peer Review Research”, American Association for the Advancement of Science Meeting, Baltimore, MD, February 9, 1996.     

Publication patterns in developmental psychology: Trends and social networks

Interest in publication patterns has been steady. Journals have instituted policies in an effort to curb bias and provide globally representative research. This study aimed to examine if publication patterns were present in two developmental psychology journals. It also explored the social networks of prominent authors and the prevalence of informal author–editor relationships, searching for any potential power groups. Data were taken from empirical articles published between 2005 and 2014 in Child Development (CD) and The International Journal of Early Childhood (IJEC) data points were geographical authorship affiliation, informal author relationships as established by co‐publishing, and connections to journal editors via identical affiliation. Results confirmed the previously established North American dominance in published research. In CD a strongly interlinked social network was identified between authors over the 10 years, with 15 chief influentialists binding groups of authors together. Results suggest that patterns are still present in published research in the realm of developmental psychology. To conclude, the potential implications of these patterns within developmental psychology are presented.     

Adaptation transculturelle de tests et échelles de mesure psychologiques : guide pratique basé sur les Recommandations de la Commission Internationale des Tests et les Standards de pratique du testing de l’APA

Thirty years ago, Vallerand (1989) wrote a pioneering article entitled “Toward a methodology for the transcultural validation of psychological questionnaires: Implications for research in the French language”, whose success has never failed, as well as its usefulness. However, considerable progress has been made in the field of test development and test adaptation since the publication of this article, notably with the publications (and their updates) of the ITC Guidelines for Translating and Adapting Tests (2017) by the International Test Commission, and of the Standards for Educational and Psychological Testing (2014) by the American Educational Research Association (AERA), the American Psychological Association (APA), and the National Council on Measurement in Education (NCME). Based on these two key references, the present article aimed to update the procedure proposed by Vallerand. Without claiming to replace these major references, on the contrary, our objective here is to propose a 10-step procedure for adapting tests and psychological measures originally developed for other cultures and/or languages, a sort of framework guiding in step-by-step manner the adaptation of tests and the validation of their scores.     

Excursions in Rorschachlandia: Surveying the scientific and philosophical landscape of Hermann Rorschach's Psychodiagnostics

This article examines the milieu of Hermann Rorschach's Psychodiagnostics (1921/2021) under development between 1911 and his death in 1922 and explores new evidence about the direction Rorschach's test might have taken after publication of Psychodiagnostics. This includes direct and indirect influences from turn of the century continental philosophy and science and innovative colleagues in the Swiss psychiatric and psychoanalytic societies. The availability of newly translated scholarship, including the correspondence between Ludwig Binswanger and Hermann Rorschach following the 1921 publication of Psychodiagnostics, Binswanger's posthumous 1923 commentary in the International Journal of Psychoanalysis, and recent new translation of Psychodiagnostics, permits a fresh appraisal of the milieu and foundations of Rorschach's development. Understanding these sources and influences opens new vistas in reappraising the nature of Rorschach's “test theory” which Rorschach considered undeveloped at the time of his death. This paper presents new evidence that, under the influence of Rorschach's close colleague, Ludwig Binswanger, the Geisteswissenschaften and phenomenology might have figured prominently in future developments. The paper concludes that Rorschach, preoccupied with considerations of kinesthetic subjectivity in his innovative conceptualization of human movement responses, was a nascent phenomenologist whose untimely death cut short further developments in his theory of the test.     

NEW PERSPECTIVES ON TEILHARD PUBLICATIONS

Abstract. Teilhard's texts were published in two complementary publications, the more philosophical-theological ones in the L'Oeuvres (OV), the scientific ones in the L'Oeuvre Scientifique (OS)¹. His letters were published in a nonsystematic way. The publication of the Oeuvres presented thematic compilations. The papers had their own production history, creating different versions. Scientific texts were published by Teilhard in widely dispersed journals and have been collected into L'Oeuvre Scientifique. The scientific status of Teilhard is related to his positions in the scientific world and the continued use of his publications. The influences causing different versions of theological and philosophical papers are analyzed. The present accessibility of the diaries and their importance for a full understanding of Teilhard is elaborated.     

A Pursuit Device for Obtaining both Quantitative and Qualitative Records

Fifth and sixth grade students (N = 87) were divided into High Test Anxious and Low Test Anxious groups on the basis of galvanic skin responses (GSR). Ss identified as High Anxious responded positively to group systematic desensitization procedures, exhibiting significantly (p < .05) lower autonomic indices of test anxiety and significantly (p < .001) improved criterion test scores. Low Anxious Ss exposed to the systematic desensitization program demonstrated no significant change in criterion test scores.     

Retracted: The Three-Step Theory of Suicide: An Independent Replication and Conceptual Extension

Retraction: Christopher R. Hagan PhD, Jennifer J. Muehlenkamp PhD, “The Three-Step Theory of Suicide: An Independent Replication and Conceptual Extension,” Suicide and Life-Threatening Behavior, Wiley, © American Association of Suicidology The above article, published online on 30 September 2019 in Wiley Online Library ( wileyonlinelibrary.com ), has been retracted by agreement between the authors, the journal Editor in Chief, Thomas Joiner, PhD, and John Wiley and Sons Ltd. The retraction has been agreed due to errors in variable calculation and a post-publication reviewer's concerns that some analyses did not accurately test the theoretical model. An updated version of this article will soon undergo review for publication at Suicide and Life-Threatening Behavior, and if accepted for publication, will be accompanied by an editorial from the Editor-in-Chief.     

Predictors of Article Impact in Suicidology: The Bereavement Literature,A Research Note

Citation analysis has been neglected in suicidology. The present note applies a mixed‐methods approach to both test and suggest hypotheses for the variation in article impact in the bereavement literature. One hundred three articles from three core suicidology journals met the criteria for inclusion in the investigation. Citations to the articles were obtained from the Web of Science. Predictor variables included structural characteristics of the author (e.g., gender) and the article itself (e.g., years since publication). A multivariate regression analysis determined that, controlling for the other variables, the most important predictor of citations was the review article (β = .461), followed by year of publication (β = ?.414), the multiauthored article (β = .302), publication in Suicide and Life‐Threatening Behavior (SLTB) (β = .161), and male gender (β = .156). The 12 most cited articles were published between 1979 and 2004 in SLTB. The majority of these papers was written by males, were U.S. authors, and had more than one author. Four of the most cited articles were reviews. The study concludes that structural characteristics of articles and authors explained 41% of the variance in citations. The qualitative analysis determined that review papers, and papers on characteristics of suicide bereavement and psychological autopsies have been most frequently cited. Replication studies are needed for other subfields of suicidology.     

Medical journals' conflicts of interest in the publication of book reviews

The purpose of the study was to assess medical journals’ conflicts of interest in the publication of book reviews. We examined book reviews published in 1999, 2000, and 2001 (N=1,876) in five leading medical journals: Annals of Internal Medicine, British Medical Journal (BMJ), Journal of the American Medical Association (JAMA), Lancet, and New England Journal of Medicine. The main outcome measure was journal publication of reviews of books that had been published by the journal’s own publisher, that had been edited or authored by a lead editor of the journal, or that posed another conflict of interest. We also surveyed the editors-in-chief of the five journals about their policies on these conflicts of interests. During the study period, four of the five journals published 30 book reviews presenting a conflict of interest: nineteen by the BMJ, five by the Annals, four by JAMA, and two by the Lancet. These reviews represent 5.8%, 2.7%, 0.7%, and 0.7%, respectively, of all book reviews published by the journals. These four journals, respectively, published reviews of 11.9%, 25.0%, 0.9%, and 1.0% of all medical books published by the journals’ publishers. Only one of the 30 book reviews included a disclosure statement addressing the conflict of interest. None of the journals had a written policy pertaining to the conflicts of interest assessed in this study, although four reported having unwritten policies. We recommend that scientific journals and associations representing journal editors develop policies on conflicts of interest pertaining to book reviews. Disclosure: R.M. Davis was North American editor of the BMJ from 1998 to 2001, and is a member of the Board of Trustees of the American Medical Association, which publishes JAMA. The opinions expressed in this paper are those of the authors and do not reflect the official policy of any organization with which the authors have been affiliated.     

Evaluation of publication bias in response interruption and redirection: A meta-analysis

Publication bias is the disproportionate representation of studies with large effects and statistically significant findings in the published research literature. If publication bias occurs in single-case research design studies on applied behavior-analytic (ABA) interventions, it can result in inflated estimates of ABA intervention effects. We conducted an empirical evaluation of publication bias on an evidence-based ABA intervention for children diagnosed with autism spectrum disorder, response interruption and redirection (RIRD). We determined effect size estimates for published and unpublished studies using 3 metrics, percentage of nonoverlapping data (PND), Hedges' g, and log response ratios (LRR). Omnibus effect size estimates across all 3 metrics were positive, supporting that RIRD is an effective treatment for reducing problem behavior maintained by nonsocial consequences. We observed larger PND for published compared to unpublished studies, small and nonsignificant differences in LRR for published compared to unpublished studies, and significant differences in Hedges' g for published compared to unpublished studies, with published studies showing slightly larger effect. We found little, if any, difference in methodological quality between published and unpublished studies. While RIRD appears to be an effective intervention for challenging behavior maintained by nonsocial consequences, our results reflect some degree of publication bias present in the RIRD research literature.     

Some reflections on writing the history of the IFPS

Abstract

A knowledge of the history of psychoanalysis strengthens our understanding of its concepts. A specific characteristic of psychoanalysis is that its creative development unfolds in confidential processes. One way to remedy this ‘basic fault’ is extensive and intensive interviews with analysts. In earlier times, collections of correspondence between analysts provided such information. There is very little material on the International Federation of Psychoanalytic Societies (IFPS) and its importance in the development of psychoanalysis. The first forums of the IFPS were published in Fortschritter der Psychoanalyse, whereas from 1992 onwards, significant papers have been published in the International Forum of Psychoanalysis. Although not bound to any specific school of psychoanalysis, the journal has been especially open to developments with roots in the so-called Budapest school.     

The Space–Time Congruency Effect: A Meta‐Analysis

Several reaction time (RT) studies report faster responses when responses to temporal information are arranged in a spatially congruent manner than when this arrangement is incongruent. The resulting space–time congruency effect is commonly attributed to a culturally salient localization of temporal information along a mental timeline (e.g., a mental timeline that runs from left to right). The present study aims to provide a compilation of the published RT studies on this time–space association in order to estimate the size of its effect and the extent of potential publication bias in this field of research. In this meta‐analysis, three types of task are distinguished due to hitherto existing empirical findings. These findings suggest that the extent to which time is made relevant to the experimental task has a systematic impact on whether or not the mental timeline is activated. The results of this meta‐analysis corroborate these considerations: First, experiments that make time a task‐relevant dimension have a mean effect size of d = 0.46. Second, in experiments in which time is task irrelevant, the effect size does not significantly deviate from zero. Third, temporal priming studies have a surprisingly high mean effect size of d = 0.47, which, however, should be adjusted to d = 0.36 due to publication bias.     

A state of anarchy and a call to arms: The research and treatment of post-traumatic stress disorder

Despite rapid growth and high visibility since the publication of DSM III, the research and treatment of post-traumatic stress disorder have generally been characterized by confusion and a failure to generalize from or to build on earlier findings and clinical experience. Several structural, psychological, and political reasons why this particular field is fraught with such confusion are discussed.     

Performances on Symbol Digit Modalities Test,Color Trails Test,and modified Stroop test in a healthy,elderly Danish sample

ABSTRACT

This study presents Danish data for the Symbol Digit Modalities Test (SDMT), Color Trails Test (CTT), and a modified Stroop test from 100 subjects aged 60–87 years. Among the included demographic variables, age had the highest impact on test performances. Thus, the study presents separate data for different age groups. For SDMT and CTT1, Danish Adult Reading Test (DART) score also had a significant impact on test performances. The incongruent version of the modified Stroop test was significantly correlated to education. Moderate and significant correlations were found between the three tests. Even though the three tests are commonly used, few normative data for elderly exists. SDMT and CTT performances from this study were in the same range as previously published international norms, but the validity of the result from the modified Stroop test could not be investigated.     

A study of the effects of cranial electrical stimulation on attention and concentration

There have been several anecdotal accounts that cranial electrical stimulation (CES) enhances attention and the ability to learn new tasks in a normal population, but only one published investigation confirms that CES improves attention using the Alpha Stim CES (Madden and Kirsch, 1987). The purpose of this study was to corroborate the findings of Madden and Kirsch, using more precise measures of attention, such as a Continuous Performance Test (CPT). A pretest and posttest CPT was given to two groups using the LISS CES device. The control group consisted of twenty-one subjects who received the placebo treatment. The experimental group of thirty-one subjects received twenty minutes of CES. Four measures of the CPT show significant gains in attention: Number of Hits,p=.010 Hit RT ISI Change,p=.016, Risk Taking,p=.055; and Attentiveness,p=.054. Based on subjects who demonstrated improvement by one standard deviation on two different measures of the CPT, thirty-one percent of the experimental group improved versus four percent of the control group. The use of CES as a method of increasing attention is a promising are that requires further investigation.     

Effects of Test Order and Modality on Sustained Attention in Children With Epilepsy

Neurological conditions affect sustained attention, but the effects of modality and interactions with test order have not been examined. In a 2?×?2 (Order?×?Modality) design using 54 children with chronic epilepsy, performance was compared on an auditory measure (modified Seashore Rhythm Test) versus a visual measure of attention (modified Conners’ Continuous Performance Test). Auditory scores were worse than visual, F(1,?52)?=?98.93, p<.001, but there was no order effect or interaction (p>.05). Implications for assessment and intervention are discussed.     

Job analysis for managerial selection: A guidelines-based approach

This research note describes a job analysis study which was conducted for the purpose of deriving selection standards for entry-level management jobs in a public utility. It is aimed toward practitioners with the responsibility of conducting legally-defensible job analyses. Each step of the study was guided by the legal and professional guidelines on testing and selection (viz.,Uniform Guidelines, 1978;Principles, 1986;Standards, 1985). Procedures employed to identify job content, job groups, the importance of various work behaviors, and a set of important knowledge, skills, abilities, and personal characteristics (KSAPs) are described.The authors would like to thank the following individuals for their help in the data collection phase of the study described here: Kimberly Clark, Lynn Clark, Gary Hayes, Candice Poole, Susan Rizhaupt, Phillip Randall, Sheri Elmore, and Ann Money.