Use and misuse of metrics in research evaluation

This paper addresses some critical issues in the applicability of quantitative performance measures (including bibliometric, economic, and co-occurrence measures) to the assessment of basic research. The strengths and weaknesses of metrics applied as research performance measures are examined. It is concluded that metrics have a useful role to play in the evaluation of research. Each metric employed, whether bibliometric, economic, co-occurrence, or others, brings a new dimension of potential insight to the complex problem of research assessment. However, when used in a stand-alone mode, metrics can be easily misinterpreted and result in misleading conclusions. Metrics should be an integral part of a more comprehensive approach to research evaluation, in which the leading role is assumed by expert peer review. Under this structure, the reviewers must be broadly constituted, so that the technical correctness of the research approaches being taken (doing the job right) can be evaluated by technical experts and the correctness of the research target (doing the right job) can be evaluated as well. This comprehensive approach insures quality in the implementation of existing research paradigms and allows the introduction of revolutionary new research paradigms as well. The views contained in this paper are solely those of the author and do not represent the views of the Department of the Navy. Ronald Kostoff received a Ph.D. from Princeton University, performed technical and economic research at Bell Laboratories, managed energy programs at U.S. Department of Energy, was Director of Technical Assessment at the Office of Naval Research for many years and presently manages the Navy’s In-House Laboratory Independent Research Program.     

Using the Web to facilitate international academic exchange

Use of the World-Wide Web among academics has grown explosively during the last few years. To date, most applications of the Web have focused on the storage and dissemination of relatively static information, in part because of the cost associated with manual collating and updating of data. This paper presents an example of a dynamic worldwide database devoted to maintaining inherently transient information: The database accepts international travel itineraries submitted by individual academic psychologists, and makes them publicly available to potential hosts on the basis of various search keys. The objective of the database (http://www.psy.uwa.edu.au/wave/) is to facilitate international exchange among academics.     

The perception of shape and curvedness from binocular stereopsis and structure from motion

The integration of binocular stereopsis and kinetic depth was measured for two distinct aspects of 3-Dstructure: (1)shape index, which is a measure of scale-independent structure, and (2)curvedness, which is a measure of scale-dependent structure. We found that motion contributes significantly more to judged shape index than it does to judged curvedness, and stereo contributes significantly more to judged curvedness than it does to judged shape index. This suggests that the differences in the relative contribution of motion and stereo reported here occurred because these two sources do not equally specify the scale-dependent and scale-independent aspects of surface structure. Furthermore, these results seem to be inconsistent with integration models in which the different visual cues all initially contribute to the same single representation of 3-Dstructure.     

Asymmetries and errors in perception of depth from disparity suggest a multicomponent model of disparity processing

In three experiments, asymmetries between the processing of crossed and uncrossed disparities were investigated. The target was a luminance-defined circle concentric to a fixation mark, viewed stereoscopically on a computer monitor for 105 msec. Fifteen disparities were presented according to the method of constant stimuli. Observers indicated the apparent direction of target depth relative to fixation. All experiments measured both the accuracy and latency of this response. Experiment 1 showed fewer errors and shorter reaction times for identifying crossed disparities. Experiments 2 and 3 replicated Experiment 1 and also showed that observers may often perceive a target in the direction opposite that prescribed by the disparity information. We propose that the asymmetries and reversals result from differences in computation of sign, not of magnitude. This notion is consistent with a scheme of continuous disparity tuning and accounts for such asymmetries and errors without positing disparity pooling mechanisms.     

Tic douloureux, Parkinson’s disease and the herpes connection

Several cases encountered in psychiatric practice are described in which herpetic involvement of the trigeminal nerve appeared to be crucial to the pathophysiology of the patients’s illness. A brief history of herpes is discussed in terms of the anatomy and physiology of the trigeminal nerve. Particular attention is given to the effects of intraneuronal herpes on gasserian ganglion and spinal nuclei discharge threshoolds, as well as viral pathways directly impacting the substantia nigra. Evidence characterizing Parkinson’s disease as one of several important manifestations of CNS herpes is covered. This article will be presented, by invitation, at the Neuroscience Seminar, Department of Medicine, University of Otago, Dunedin, New Zealand, on 19 August 1997.     

Adult Attachment Styles, the Desire to Have Children, and Working Models of Parenthood

ABSTRACT College students who had yet to marry and begin a family were asked about their desire to have children and their beliefs and expectations about themselves as parents (Study 1) and the characteristics of their prospective children (Study 2). Persons with more avoidant and anxious-ambivalent models of close adult relationships harbored more negative models of parent-hood and parent-child relationships. These findings indicate that working models of parenting and parent-child relationships form well before marriage and the birth of children and that these models are systematically associated with attachment styles in adult relationships. The findings also suggest ways in which insecure attachments between child and parent may be influenced by the caregiver's models of parenting and parent-child relationships.