The importance of assessing treatment integrity: An example in the anxiety disorders

One purpose of this investigation was to examine the importance of assessing treatment integrity in a study evaluating a treatment for specific anxiety disorders. Three subjects, two social phobics and one simple phobic, received self-instruction training (Phase I) followed by exposure and self-instruction training (Phase II) in a multiple baseline across subjects design. All subjects were assessed during a pretreatment baseline and throughout treatment using measures of treatment integrity and measures of change in phobic severity. Improvement took place at different times for different subjects. Measures of treatment integrity, which consisted of monitoring of self-statements as well as practice outside the session, indicated that treatment was not always received as intended and that improvement was correlated with practice. The usefulness of measures of treatment integrity in both clinical and research settings is highlighted.     

BIOLOGY AND THE SOCIAL SCIENCES

Abstract. The sciences may be conceptualized as a hierarchy ranked by level of organization (e.g., many-body physics ranks above particle physics). Each science serves as an antidiscipline for the science above it; that is, between each pair, tense but creative interplay is inevitable. Biology has advanced through such tension between its subdisciplines and now can serve as an antidiscipline for the social sciences—for anthropology, for example, by examining the connection between cultural and biological evolution; for psychology, by addressing the nature of learning and the structure of the unconscious; for economics, by examining economically irrational behavior and by comparing economic activity in humans and other species. Sociology, concerned mainly with advanced literate societies, is relatively remote from the genetic basis of human social behavior. However, moving between biological and social levels of organization generates richness and points to new and unexpected principles.     

Child and adolescent services research at the national institute of mental health: Research opportunities in an emerging field

This article describes an important new area of research on services for children and adolescents with mental disorders at the National Institute of Mental Health, the parameters of mental health services research for youth, and the opportunities that are available for grant-funded investigations in this area.     

Linking qualitative and quantitative methods in cross-cultural survey research: Techniques from cognitive science

Survey research with diverse cultural and ethnic minority groups is a complex and challenging endeavor that confronts the researcher with problems related to linguistic and conceptual equivalence and measurement as well as problems related to difficulties that respondents have with the sociocultural dimensions of the survey/interview process. One way to improve the quality of cross-cultural surveys and to insure that the findings are culturally relevant and accurate is to combine qualitative and quantitative methods. This paper proposes that certain qualitative techniques from cognitive science, specifically cognitive anthropology and cognitive psychology, are particularly well suited to being combined with survey research. These techniques provide information corresponding to the underlying thought processes of respondents and enable researchers to better understand how different cultural and ethnic groups construe the world. The information obtained can be used improve the formulation of survey questions, design and structure questionnaire formats to coincide with the way particular groups organize concepts, and help researchers understand difficulties respondents may have with the survey/interview process. In addition, the techniques produce data that are easily codifiable and more manageable than traditional qualitative techniques including participant observation and in-depth interviews.     

Use and misuse of metrics in research evaluation

This paper addresses some critical issues in the applicability of quantitative performance measures (including bibliometric, economic, and co-occurrence measures) to the assessment of basic research. The strengths and weaknesses of metrics applied as research performance measures are examined. It is concluded that metrics have a useful role to play in the evaluation of research. Each metric employed, whether bibliometric, economic, co-occurrence, or others, brings a new dimension of potential insight to the complex problem of research assessment. However, when used in a stand-alone mode, metrics can be easily misinterpreted and result in misleading conclusions. Metrics should be an integral part of a more comprehensive approach to research evaluation, in which the leading role is assumed by expert peer review. Under this structure, the reviewers must be broadly constituted, so that the technical correctness of the research approaches being taken (doing the job right) can be evaluated by technical experts and the correctness of the research target (doing the right job) can be evaluated as well. This comprehensive approach insures quality in the implementation of existing research paradigms and allows the introduction of revolutionary new research paradigms as well. The views contained in this paper are solely those of the author and do not represent the views of the Department of the Navy. Ronald Kostoff received a Ph.D. from Princeton University, performed technical and economic research at Bell Laboratories, managed energy programs at U.S. Department of Energy, was Director of Technical Assessment at the Office of Naval Research for many years and presently manages the Navy’s In-House Laboratory Independent Research Program.     

The Journal of Abnormal Child Psychology at 25

This issue, redesigned in a new format, marks the beginning of Volume 25, the beginning of the silver anniversary year of the Journal of Abnormal Child Psychology. Data were compiled from the first 24 volumes to study changes over time, and Pearson correlations were calculated to determine linear trends in the journal's development The number of articles per volume has doubled, from about 25 to 50. In recent years the first authors of articles were more likely to be located outside the U.S. (up from about 5% to about 25%). Also, in recent years the first authors of articles were less likely to be affiliated with nonmedical school university departments and more likely to be affiliated with medical schools or research institutes. An introduction to this special 25th anniversary issue is provided.     

Internal Objects - A Theoretical Analysis of Jungian and Kleinian Models

In this paper I discuss the ways in which experimental and objective research from cognitive science and developmental psychology can help analysts evaluate the theoretical models of mental objects which we use; I indicate the ways in which such evidence tends to support models of internal objects as mental representations or developmental capacities rather than as wish-fulfilling expressions of instinctual drives. This land of empirical evidence is not just of academic interest but also has direct clinical relevance, particularly with borderline patients; such patients' sense of identity is totally dependent on the analyst's understanding of their internal world and for this to be misunderstood by the analyst can be catastrophic. An accurate theoretical model of mental objects can therefore help analysts to contain their patients more effectively.     

Self- and cross-citations in the Journal of Applied Behavior Analysis and the Journal of the Experimental Analysis of Behavior: 1983-1992

We examined self- and cross-citation practices in JABA and JEAB from 1983 through 1992. Mean levels of self-citation for JABA and for JEAB were 22.6% and 36.1%, respectively. Overall, 2.4% of JABA citations were JEAB articles, and 0.6% of JEAB citations were JABA articles, which suggests limited integration of basic and applied research.     

Jungian Psychology, the Body, and the Future

Impressive reaffirmation of Jung's archetypal hypothesis has come from developments in behavioural biology (Tinbergen 1951; Cosmides 1985), psycholinguistics (Chomsky 1965), structural anthropology (Lévi-Strauss 1967), developmental psychology (Bowlby 1969), dream research (Jouvet 1975). neuroscience (MacLean 1976), sociobiology (Wilson 1978), and evolutionary psychiatry (Gardner 1988; Gilbert 1989). A close correspondence exists between Jungian theories of dreaming in human beings and modern biological theories of dreaming in animals. A paradigm shift is under way in the direction of a growing cross-disciplinary awareness that all human sciences are about archetypal manifestations and that these apply as much to the body as to the mind. Jungian psychology must keep abreast of these developments if it is not to be sidelined and superseded by less humane therapeutic philosophies.     

A general linear model for estimating effect size in the presence of publication bias

When the process of publication favors studies with smallp-values, and hence large effect estimates, combined estimates from many studies may be biased. This paper describes a model for estimation of effect size when there is selection based on one-tailedp-values. The model employs the method of maximum likelihood in the context of a mixed (fixed and random) effects general linear model for effect sizes. It offers a test for the presence of publication bias, and corrected estimates of the parameters of the linear model for effect magnitude. The model is illustrated using a well-known data set on the benefits of psychotherapy.Authors' note: The contributions of the authors are considered equal, and the order of authorship was chosen to be reverse-alphabetical.