Abstracts

Abstract

This special issue of the American Journal of Family Therapy focuses on recent developments in Behavioral Marital Therapy (BMT). At first glance, one might expect an issue with such a title to be devoted exclusively to clinical practice. Yet only three of the six papers bear directly on clinical issues, although all of them have clinical implications. Two of the nonclinical papers are validational studies of assessment instruments associated with BMT. The sixth paper explores an important theoretical question regarding the relationship between childbirth and marital distress.     

Sex education for parents using behavior rehearsal

Abstract

In reviewing the family assessment literature, there appears to be a need for behaviorally based report procedures capable of describing important aspects of family functioning. Thus far, most activity in this direction has involved the development of methods of evaluating marital relationships with relatively little attention to parent-adolescent assessment. This article introduces an adaptation of the Areas of Change Questionnaire (originally developed for work with marital pairs) for the assessment of parent-adolescent relationships. The potential utility of this instrument in clinical and research efforts is described, and initial psychometric evaluations are presented.     

Systematic Review of Self‐Report Family Assessment Measures

A systematic review of self‐report family assessment measures was conducted with reference to their psychometric properties, clinical utility and theoretical underpinnings. Eight instruments were reviewed: The McMaster Family Assessment Device (FAD); Circumplex Model Family Adaptability and Cohesion Evaluation Scales (FACES); Beavers Systems Model Self‐Report Family Inventory (SFI); Family Assessment Measure III (FAM III); Family Environment Scale (FES); Family Relations Scale (FRS); and Systemic Therapy Inventory of Change (STIC); and the Systemic Clinical Outcome Routine Evaluation (SCORE). Results indicated that five family assessment measures are suitable for clinical use (FAD, FACES‐IV, SFI, FAM III, SCORE), two are not (FES, FRS), and one is a new system currently under‐going validation (STIC).     

"Factor analyses of the family assessment device," by Ridenour, Daley, & Reich

Ridenour, Daley, and Reich conducted a series of factor analyses using the correlational matrix of the subscale scores of the Family Assessment Device (FAD), published in Family Process, December, 1999. They conclude that "the FAD subscales be reorganized from their current seven-subscale format" (p. 507). We propose that this suggestion for reorganization is premature and based on the inappropriate application of an "internal consistency" model of scale construction to the FAD. We further suggest that the most important criteria regarding an assessment instrument are those of reliability, validity, and clinical utility. In the absence of this kind of data regarding alternative organizations of the FAD, we believe that the original subscales remain the best choice.     

The equivalence of computerized and paper-and-pencil psychological instruments: Implications for measures of negative affect

The use of computerized psychological assessment is a growing practice among contemporary mental health professionals. Many popular and frequently used paper-and-pencil instruments have been adapted into computerized versions. Although equivalence for many instruments has been evaluated and supported, this issue is far from resolved. This literature review deals with recent research findings that suggest that computer aversion negatively impacts computerized assessment, particularly as it relates to measures of negative affect. There is a dearth of equivalence studies that take into account computer aversion’s potential impact on the measurement of negative affect. Recommendations are offered for future research in this area.     

Examining the feasibility of the integrated hope scale in American college students

The Integrated Hope Scale (IHS) provides a multi-dimensional evaluation of factors common across measures of hope, examining social relationships, trust and confidence, perspectives of the future, and a lack of hopefulness. Despite promise for the instrument’s utility, research on the IHS is sparse has been limited to non-English-speaking populations, requiring translated items, and the cross-cultural transportability of hope constructs has previously been raised. Predominant theories of hope used in American populations have been criticized for not measuring important aspects that are included within the IHS. Using confirmatory factor analysis and latent class analysis, this study explored the IHS’s structural integrity and interpretive potential using a regionally and racially diverse sample of American college students. Results suggest that the IHS offers a valid global assessment of hope as well as for targeted measurement of discrete areas identified by instrument factor scores. The IHS also shows promise in differentiating individuals according to their level of hopefulness.     

Early infant cognitive assessment:

The present study represents a contribution to the assessment of infant cognitive development by presenting a valid instrument for observing the development of logical reasoning and executive function during the second year of life—key processes in the construction of human knowledge. The instrument constructed, called ELEDA (Early Logical and Executive Development Assessment), was a combined or mixed observation instrument composed of field formats and category systems. Its validity was calculated using generalizability theory, which enables different sources of error affecting a behavioral measurement to be analyzed jointly. The need for valid early cognitive assessment instruments such as the one in the present article is evident, since the sooner assessment is performed, the sooner action can be taken, thus optimizing the results.     

Contributions of modern measurement theory to measuring executive function in early childhood: An empirical demonstration

This study demonstrates the merits of evaluating a newly developed battery of executive function tasks, designed for use in early childhood, from the perspective of item response theory (IRT). The battery was included in the 48-month assessment of the Family Life Project, a prospective longitudinal study of 1292 children oversampled from low-income and African American families. IRT models were applied to a select set of tasks to demonstrate empirically (a) a principled method for item evaluation, including the utility of item characteristic curves; (b) how to explicitly test whether the measurement properties of executive function tasks are invariant across mutually exclusive subgroups of youths; (c) how the precision of measurement of a given task can vary according to underlying child ability; and (d) the utility of using IRT-based versus percentage correct scores. Results are discussed with respect to the importance of developing psychometrically sound and scalable instruments that facilitate the measurement of interindividual differences in intraindividual change of executive function across the early childhood period.     

Computer-administered interviews and rating scales

To evaluate the value of computer-administered interviews and rating scales, the following topics are reviewed in the present article: (a) strengths and weaknesses of structured and unstructured assessment instruments, (b) advantages and disadvantages of computer administration, and (c) the validity and utility of computer-administered interviews and rating scales. Computer-administered evaluations are more comprehensive and reliable and less biased than evaluations routinely conducted in clinical practice. Also, the use of continuous monitoring systems, which increasingly entail the use of computer administration, has been related to improved treatment outcome. However, the use of computer-administered interviews and rating scales will sometimes lead to false positive diagnoses, and for this reason, it is recommended that computer assessment be combined with clinical judgment.     

Methodological issues in cross-cultural and multicultural rorschach research

Hermann Rorschach researched the utility of his inkblot experiment to understand psychopathology and cultural differences. Contemporary research with the Rorschach has evaluated its utility as a test, although it may more properly represent a clinical method with somewhat different evaluation criteria. Recent controversy regarding the adequacy of the Rorschach as a test and the adequacy of its normative data has at times distorted and oversimplified important methodological issues inherent in the study of cultural difference. Cultural processes remain a central and inadequately examined variable in Rorschach research; an important emergent area of inquiry is the Rorschach's clinical utility as a cross-cultural assessment instrument. We review multicultural and cross-cultural methodological issues intrinsic to contemporary Rorschach research here. Consideration of cultural issues enlarges and enriches the Rorschach clinical utility debate and suggests underexplored research strategies that can contribute to its resolution.     

Construction and Validation of a Biodata Selection Instrument

Abstract

Biodata instruments can be used in selection for several purposes (including screening, prediction, analysis of decision strategies). This article is concerned with the construction and validation of a biodata instrument for the selection of intermediaries by a profit-making employment agency in the Netherlands. The instrument was constructed according to the sample approach and measures work experiences with regard to relevant tasks and job dimensions. A field study gathered biodata scores from applicants (n £ 300) and present employees (n £ 70), interview ratings from the applicants, and ratings of job performance for the employees. The results obtained indicated that the instrument was a potentially useful selection device. The homogeneity of scale scores was sufficient and the scores show little overlap with other selection devices (interview ratings). In addition, particular scores correlate at a statistically significant level (P < 0.01) with ratings of job performance of present employees (r £ 0.30 to 0.40). Estimates of the utility (financial gains) of using the instrument in selection revealed that the instrument may yield considerable pay-offs. It is concluded that the construction and validation of the instrument yielded several positive results, and that the sample approach in constructing biodata selection instruments is an option worth considering.     

Forensic and correctional applications of the personality assessment inventory

The relative utility of psychological tests for addressing legal issues is an area of considerable debate in the field. Regardless of the merits of psychological testing, it is apparent that such instruments are used widely both to address specific psycholegal issues and to evaluate offender populations more generally. One instrument gaining prominence in terms of its use in both forensic and correctional settings is the Personality Assessment Inventory (PAI; Morey, 1991), which was developed to assess various constructs relevant to clinical settings (e.g. psychopathology, response distortion, and personality traits). This paper reviews the psychometric properties of the PAI specifically in reference to its ability to assess factors relevant to forensic decision-making, as well as its utility to provide clinically relevant information about offender populations more generally.     

Family measurement techniques: The family health scales (fhs): Review and critique

Abstract

Kinston, Loader and Miller (1987) have developed the Family Health Scale (FHS), a research instrument designed to assess a family's level of overall functioning based upon the clinical observation of family interaction. The authors state that the FHS is primarily a research tool, allowing its users to test hypotheses about family dysfunction, to examine changes in the family longitudinally, and to categorize families by “degree of disturbance.” While not its principal use, the scale is also thought to have teaching utility.     

Psychosocial and Behavioural Assessment of Chronic Pain: Recommendations for Clinicians and Researchers

Abstract

A variety of methods have been developed for the assessment of chronic benign pain. In research or in clinical practise, choosing an adequate measurement technique can be a laborious task. This article has two main purposes: to report on some basic features to consider when selecting assessment instruments, and to present a review of some psychosocial and behavioural measurement methods for the assessment of chronic benign pain. The selected methods have, with one exception, been evaluated on Swedish chronic pain populations and are used in international pain research. In conclusion, we recommend the use of psychometrically sound instruments, and that the purposes for use of a measure have to be thoroughly considered in advance. We also emphasize that in clinical practise, each separate measure must be interpreted in a wider context, where clinical findings and judgements are considered as a whole. In addition, none of the single reviewed assessment techniques can replace the communication between the patient and the clinician.     

Validity of the Family Relations Test: A Review of Research

The rationale and construction of the Bene-Anthony Family Relations Test suggest that it could be a valuable clinical projective technique. Little research involving the instrument has been reported, and most studies have been hampered by failure to report essential information, small sample size, poor design, and inappropriate statistical procedures. Investigations reported to date have yielded equivocal evidence of the test's validity. Additional research, for which specific directions are suggested, is needed to indicate the instrument's validity and usefulness or call for its abandonment or revision.     

Assessment of Stress Risks and Learning Opportunities in the Work Organization

Abstract

Organizational innovation and recent European legislation on work organization require instruments, to be used by practitioners, for the assessment of jobs and the redesign of the structure of the division of labour. In The Netherlands the so-called WEBA-instrument (conditions for well-being at work) has been developed to assess stress risks and learning opportunities. The foundation of the instrument refers to the Dutch modern sociotechnical systems theory, the Karasek demand-control theory and the German action regulation theory. Its application is becoming widespread because, among other reasons, this instrument is supported by the Labour Inspectorate of The Netherlands. Besides a presentation of the instrument and its foundation, some examples will be given and some theoretical and practical problems discussed.     

A comparative review of total family functioning measures

Abstract

Three categories of instruments or methods have been used to assess family functioning: unstandardized measures of total family functioning; instruments which measure family subsystems or unitary processes; and standardized total family assessment procedures. Six methods, comprising the standardized total family functioning category, are reviewed and compared. It is concluded that methods of total family assessment are nearing the formation of a family systems paradigm, although the psychometric qualities of the instruments lag behind theoretical development. Recommendations are made for further development of procedures to assess family systems.     

Sexual predator evaluations and phrenology: considering issues of evidentiary reliability

This article reviews six assessment procedures used for assessing the recidivism risk of previously convicted sexual offenders. The review of these procedures examines whether they comply with generally accepted ethical and practice standards. With few exceptions, most risk assessment instruments fail to comply with these standards. Currently used instruments for risk assessment continue to rely excessively on clinical judgment; and, as a result, they remain at a preliminary stage of development. Consequently, these instruments amount to experimental procedures; and, therefore, they cannot support expert testimony in a legal proceeding.     

Acculturative Hassles and Immigrant Adolescents: A Life-Domain Assessment for Soviet Jewish Refugees

Abstract

In a sample of 146 adolescents, the authors developed and validated a measure of acculturative hassles for Soviet Jewish refugees. They based the measure on an ecological perspective, which focuses on hassles involving person-environment transactions occurring in life domains of school, family, peers, and language. The authors reviewed conceptual and methodological issues in existing instruments and incorporated efforts to address current limitations into instrument development. The measure was correlated with psychological distress, level of acculturation to Russian and U.S. cultures, and outcomes in life domains; it contributed to outcomes over and above effects of nonacculturative hassles. Implications for measurement of acculturative hassles are discussed.