Methodological issues in Navy Surveys

A number of important methodological issues involving surveys have emerged in Navy research. One such issue is whether results from computer-administered sur- veys are equivalent to those obtained from paper-and-pencil surveys. After a review of relevant Navy studies, we concluded that computer and paper surveys generally yield equivalent results. The Navy's efforts and success at computerizing command- level equal opportunity surveys is described, and the advantages of this approach are discussed. The Navy's survey work on diversity issues (e.g., Hispanics, sexual harassment, and pregnancy) is described and the problems posed by attempting to use surveys to identify who is Hispanic and to determine accurate rates of sexual harassment and pregnancy are outlined. Future issues to be addressed by Navy survey research are discussed.     

Methodological issues in pediatric neuroimaging

The emergence of new technologies to study brain function in vivo has resulted in an explosion of interest in cognitive neuroscience within the last ten years. While most research in functional neuroimaging has been geared toward adult normal volunteers, the development of functional magnetic resonance imaging (fMRI) has made it possible to study neural development in normal children, as well as those with developmental disorders. This technology provides an unprecedented opportunity to expand our knowledge of brain function throughout childhood. A variety of technological, experimental, and practical difficulties are amplified when imaging children. This paper reviews some of the more challenging theoretical and practical concerns and provides suggestions for their management.     

Methodological issues in short-term motor memory research

Four methodological issues identified and studied by short-term motor memory researchers were examined in this paper: (a) the distributions of three commonly used measures of error (AE, CE, and VE); (b) statistical analysis of these scores as dependent measures in an experiment; (c) within-cell and experiment-wise estimates of the reliability of CE; and (d) the power of the statistical test with CE as the dependent measure. The first two sub-problems were explored theoretically, while the latter two were subjected to empirical examination using four data sets from previously published experiments. The distributions of AE and VE scores were described as non-normal under certain conditions, while the CE score distribution was shown to be normal. Therefore analyses of these three dependent measures may require different statistical procedures. In light of this information, the assumptions affecting estimates of reliability and power in an experimental framework were examined. Based on an analysis of the four data sets, a strategy was proposed in which a relatively small number of subjects could be utilized in an experiment without sacrificing desired experimental controls.     

Methodological and theoretical issues in neuropsychological assessment

While there are philosophical and theoretical differences between neuropsychologists and behavior therapists, it is suggested that a significant reconciliation can be achieved in regard to assessment and treatment of the brain-damaged patient. While brain damage is often viewed as an irreversible disorder, there is evidence that substantial recovery of function can occur, particularly when adequate retraining is provided. There are practical and empirical considerations that suggest that neuropsychological tests are currently the best tools available for behavioral assessment of brain-damaged patients. However, the results of these tests can be used not only diagnostically but also to identify target behavioral deficits that may be rehabilitated through systematic retraining efforts. Such rehabilitation efforts can be optimally planned, implemented, and evaluated through an alliance between the neuropsychologist, who identifies the ability and deficit pattern, and the behavior therapist, who devises and evaluates the retraining program. It is possible that the successes of behavior therapy in numerous clinical and educational applications can be repeated in the cases of brain-damaged patients. However, such success would appear to be contingent on appreciation of the high degree of specificity often seen in neurological deficit patterns and the great complexities involved in the relationships between brain function and behavior.     

Methodological issues in event-related brain potential research

Event-related brain potential (ERP) measures have become increasingly popular in experimental psychology and are often employed by researchers who are not formally trained in electrophysiology. A proper application of these measures requires knowledge about the methodological principles and practical issues that are relevant to ERP measurement, analysis, and interpretation. A brief introductory survey of different aspects of ERP methodology (recording, data processing and signal extraction, statistical analysis and interpretation of ERP effects) is presented, and the contributions collected in this special issue on ERP methodology are introduced.     

Cerebral lateralization in bilinguals: Methodological issues

The literature on lateralization for language in bilinguals manifests two apparent contradictions. Some papers demonstrate differences in lateralization between bilinguals and monolinguals; others demonstrate none. In studies with exclusively bilingual subjects, some papers demonstrate differences between the lateralization for the two languages, while others demonstrate none. This paper discusses the range of methodological parameters which must be borne in mind when conducting or evaluating studies of lateralization for language in bilinguals. These include issues of subject selection, language and stimulus selection, testing procedures, data analysis, and interpretation of results.     

Methodological issues in the assessment of sustained performance

In both military and industrial work settings, it has become desirable, and in many instances necessary, to require sustained performance beyond the apparently optimal 8-h workday. Research in this area may be viewed historically as having been focused in three major areas: (1) determining appropriate methodologies for measuring sustained performance, (2) investigating factors that influence sustained performance, and (3) searching for ways to enhance performance during sustained operations. On the basis of discussions held in Toronto in August 1984, observations are drawn and recommendations are made concerning the directions and content of future research.     

Methodological issues in cross-cultural and multicultural rorschach research

Hermann Rorschach researched the utility of his inkblot experiment to understand psychopathology and cultural differences. Contemporary research with the Rorschach has evaluated its utility as a test, although it may more properly represent a clinical method with somewhat different evaluation criteria. Recent controversy regarding the adequacy of the Rorschach as a test and the adequacy of its normative data has at times distorted and oversimplified important methodological issues inherent in the study of cultural difference. Cultural processes remain a central and inadequately examined variable in Rorschach research; an important emergent area of inquiry is the Rorschach's clinical utility as a cross-cultural assessment instrument. We review multicultural and cross-cultural methodological issues intrinsic to contemporary Rorschach research here. Consideration of cultural issues enlarges and enriches the Rorschach clinical utility debate and suggests underexplored research strategies that can contribute to its resolution.     

Methodological issues in measures of imitative reaction times

Ideomotor (IM) theory suggests that observing someone else perform an action activates an internal motor representation of that behaviour within the observer. Evidence supporting the case for an ideomotor theory of imitation has come from studies that show imitative responses to be faster than the same behavioural measures performed in response to spatial cues. In an attempt to replicate these findings, we manipulated the salience of the visual cue and found that we could reverse the advantage of the imitative cue over the spatial cue. We suggest that participants utilised a simple visuomotor mechanism to perform all aspects of this task, with performance being driven by the relative visual salience of the stimuli. Imitation is a more complex motor skill that would constitute an inefficient strategy for rapid performance.     

Methodological issues in the study of sex-related differences

Ten ubiquitous methodological problems are described in relation to group differences research and particularly sex-related research. Substantive issues in sex-related research are used as illustrations of the methodological problems.     

Methodological issues for evaluation of alcohol and other drug effects: Examples from flight-simulator performance

Individual differences and idiosyncratic responses to alcohol and other drugs present challenges to researchers concerning how tasks should be structured and performance analyzed. Defined scenarios allow operators to perform known maneuvers over a predetermined time course to the best of their abilities, whereas episodic scenarios embed specific situations into more dynamic, realistic, and interactive testing sessions. Degraded performance in the defined scenarios is easily defined as deviations from a hypothetically perfect performance profile, but assessment of alcohol and other drug effects on individual performances in dynamic situations requires flexible analytic procedures. An example of scoring an episodic flight scenario event using flight-simulator data is given, and an interactive analysis system developed to analyze idiosyncratic pilot responses is described.     

Methodological issues in the quantitative analysis of dream content

Reviews measurement approaches applied to dream reports and proposes some methodological cautions that may result in more effective utilization of the dream report in research and assessment. Standardization of dream collection techniques and controls for variability in the length of dream reports are suggested. Further investigation of the intraindividual consistency of dream report measures is seen as necessary for a discussion of their validity. Though there are indications that a variety of dream report measures are potentially valid for psychological assessment, measures based on general dream report characteristics show greater promise than specific content analysis. Research on the differences between normal and disturbed subjects highlights the potential, and the problems, inherent in the use of dream reports as tools of psychological inquiry.     

Methodological issues in language acquisition research with very young children

It is suggested that the dominance of observational methods in child language research with very young children has limited progress in understanding the language acquisition process. Evidence is presented that, contrary to popular belief, naturalistic methods do not guarantee ecological validity, nor are they free of task biases. Furthermore, observational studies do not necessarily provide better measures of linguistic competence than do more structured methods. Instead, it is argued that new insights from cognitive developmental research are applicable in studying language production in children younger than 3 years. A number of structured techniques are reviewed that have been used or could be used to study language production. It is concluded that a combination of methods is necessary in order to disentangle and control the many variables that enter into the language acquisition process.     

Methodological issues in the use of the concurrent activities paradigm

This paper presents a critical analysis of one type of dual-task procedure, the lateralized concurrent activities paradigm. Extrinsic and intrinsic factors that may influence the interpretation of results obtained with this paradigm are isolated and methodological refinements in experimental design and analysis are suggested.     

Development and evaluation of school-based violence prevention programs

Discusses key issues in developing and evaluating school-based violence prevention interventions. Schools provide a natural setting for implementing programs directed at teaching youth attitudes, knowledge, and skills to reduce their involvement in violence. Although multitudes of these programs exist, few have been rigorously evaluated. Developers of violence prevention programs need to pay particular attention to the type of violence being addressed, the target population, relevant risk and protective factors, and the target of the intervention. Conducting sound evaluations of such programs requires careful attention to the unit of randomization, treatment conditions, outcome measures, timing of data collection, and potential moderator variables. Efforts to develop effective prevention programs can be greatly facilitated by adopting an action-research strategy in which evaluation findings provide a basis for continual program refinement.     

Methodological issues in growth‐curve analyses with married couples

Because longitudinal data are increasingly being used to test predictions regarding close relationships, researchers are also increasingly being confronted with methodological issues unique to the analysis of longitudinal data. In this paper, four issues in conducting growth‐curve analyses with married couples are examined: assessing statistical assumptions about homoscedastic and independent errors, handling information about missing data, dealing with couples with only one assessment, and estimating quadratic effects. Each issue is illustrated with actual data, and syntax from the multilevel module in LISREL 8.52 is provided for specific analyses. Guidelines are presented for helping researchers think through each issue with their own data set.     

Dream research in schizophrenia: Methodological issues and a dimensional approach

Dreaming in patients with schizophrenia was and is of particular interest to researchers and clinicians due to the phenomenological similarities between the dreaming state and schizophrenic daytime symptomatology such as bizarre thoughts or hallucinations. Extensive literature reviews have shown that dream studies in the field of psychopathology often do not fulfill common scientific criteria. The present paper focuses on the methodological issues like sampling methods, the dream collection method, and dream content analysis that are crucial with regard to the validity of the findings. It is also suggested that the so-called dimensional approach (linking severity of daytime symptoms directly to specific dream characteristics) will be very helpful for identifying which psychopathological symptoms of schizophrenia are most closely linked to dream content.