On doing research: the dream and the reality

The principal concern of this essay is to offer practical and personal guidance to professional therapists who wish to engage in research in family therapy. It is not a paper about research design or experimental/observational/survey methods; rather the focus is upon the experience of engaging in research. It attempts to destroy a few common myths about researchers, research, and the motives of researchers and those whom they research. Research is seen as a continuing and evolving process (rather than a product) which can intrude in many aspects of the individual's life; it can affect motives, working relationships, organizational composure, personal family life, and personal self-esteem. Research is thus like most other forms of employment. Research, as an activity, must be seen in terms of systems dynamics, resistance to change, and hopefully, in terms also, of self-actualization and the refreshment of professional parts that other addictions cannot reach.
Recommendations are made for the structuring of research activity, in the light of the research model presented.     

Learned helplessness deficits: Uncontrollable outcomes or perceived failure?

An experiment is described showing that learned helplessness deficits are produced by prior exposure to uncontrollable outcomes rather than perceived failure. Although the controllability manipulation did produce differences in perceived success or failure, similar differences were also induced by means of instructional feedback. These latter differences, within the controllable and uncontrollable groups, were not associated with poorer performance by subjects given failure feedback. Moreover, the instructional feedback did not influence subjects' perceptions of controllability or uncontrollability. The results confirm that helplessness deficits cannot be explained as reactions to task failure.This research was supported by Research Grant A28015473 from the Australian Research Grants Scheme.     

A developmental study of children's preferences for paintings

In order to study the influence of style and subject matter on the development of children's art preferences, 60 randomly selected subjects from three grade levels, with an equal number of males and females, were shown ten color slides of paintings representing five categories of subject matter and two broad categories of style. Results indicated that style was the dominant variable at each grade level, and consistently accounted for more of the overall variance than subject matter. Unexpectedly, no appreciable developmental differences were evident in preference judgments across grade levels observed in this study.     

Finite-state recall revealed by backward learning curves constructed from confidence ratings

Two experiments were carried out to show that the constancy of Type II d’ in recall is not an artifact, but is due to finite-state processes as suggested by Bernbach (1967). The following conclusions were reached: (1) The constancy of Type II d’ is not an artifact due to the inclusion of intralist intrusions in the class of incorrect responses; (2) backward learning curves constructed from confidence ratings gave clear evidence of all-or-none recall; (3) recall appeared to be all or none whether the subjects learned by rote or with a mnemonic; (4) the discriminability index derived from Luce’s (1959) choice theory did not exhibit constancy over trials, unlike Type II d’ and despite the fact that backward rating curves indicated all-or-none processes.     

An ecological study of the reliability of clinical judgment in executive appraisal

This research was a study of the reliability of clinical judgment findings (multitrait) across three different information sources (psychometric tests, structured interview, and psychometric tests and interview). Subjects (N = 74) were middle and senior executives of Western Canadian technical companies; clinicians (N = 3) were trained and experienced industrial psychologists. The study investigated the similarity of clinical evaluation of personological characteristics (based on an 18-factor multitrait paradigm) across the three different information sources. Subjects were independently rated by a single clinician on 18 criterion factors in each of the three information source categories. Test information source categories required the administration of approximately 12 hrs of standardized psychological assessment questionnaires to each of the 74 subjects. Interview source category involved a 1.5-hr structured interview per subject. Combined condition pooled both test and interview conditions. Generalizability of the findings was maximized by the undertaking of the experiment in a natural situation thus increasing ecological validity. Statistical treatments used were designed to assess the similarity of a clinician's evaluation of a subject based on the different category of information available about that client. Convergence (intrarater reliability) indexes range from a high of .64 to a low of .05. Results indicate a varying degree of convergence of multitrait clinical ratings dependent on clinician and trait being rated. Results are discussed in terms of implications for practitioners involved in executive personnel selection.     

AN INDEX FOR ASSESSING WEIGHT CHANGE IN CHILDREN: WEIGHT/HEIGHT RATIOS1

Weight and height data from two studies were recomputed, and original data were computed using a Weight Index formula that accounts for the interaction of actual weight/height changes in growing children and compares this ratio with that of normed weight/height ratios for equal-aged children. Recomputing the data of one study showed that the Weight Index is a more sensitive procedure for assessing long-term behavioral treatment of obesity for girls than weight alone. Recomputing the data of a second study showed that the Weight Index formula is consistent for boys and girls and is a more sensitive procedure for assessing long-term effects of a variety of medical treatments for obesity than the Ponderal Index or weight alone. Computation of the data for 17 “normal” children in a preschool class showed a zero Weight Index score before and after a six-month interval elapsed without treatment. The procedure may be useful in assessing ponderosity or anorexia over intervals of six months or more with growing children or difference between actual and normed weight over shorter intervals.     

Multiple-answer multiple-choice test items: Responding and scoring through bayes and minimax strategies

A multiple-answer multiple-choice test item has a certain number of alternatives,any number of which might be keyed. The examinee is also allowed to mark any number of alternatives. This increased flexibility over the one keyed alternative case is useful in practice but raises questions about appropriate scoring rules. In this article a certain class of item scoring rules called thebinary class is considered. The concepts ofstandard scoring rules and equivalence among these scoring rules are introduced in the misinformation model for which the traditional knowledge model is a special case. The examinee's strategy with respect to a scoring rule is examined. The critical role of a quantity called the scoring ratio is emphasized. In the case of examinee uncertainty about the number of correct alternatives on an item, a Bayes and a minimax strategy for the examinee are developed. Also an appropriate response for the examiner to the minimax strategy is outlined.Research partially supported under Grants N00014-67-A-0314-0022 from the Office of Naval Research and GS-32514 and MPS 75-07539 from the National Science Foundation.