The Program Environment Scale: Assessing Client Perceptions of Community-Based Programs for the Severely Mentally Ill

The Program Environment Scale (PES) was developed for use with clients of community-based programs for the severely mentally ill. It is intended to fill the gap in available tools for assessing clients' perceptions of program functioning as it affects their quality of life in a program. Formal pretests were conducted with 121 clients at 12 randomly selected programs near Washington, DC. The final field test used a revised form (29 domains; 129 items) with 221 clients in 22 programs selected randomly throughout the U.S., including Clubhouse, day treatment, psychosocial rehabilitation, and social club programs. Twenty-three subscales met at least five of eight psychometric criteria for internal consistency and discriminant validity. A 24th subscale was retained because of its substantive importance. Successful subscales cover program atmosphere and interactions (program cares about me, energy level, friendliness, openness, staff-client and client-client respect, reasonable rules, availability of positive physical contact, protection from bad touch, staff investment in their jobs, and confidentiality), client empowerment/staff-client equality (program and treatment empowerment, egalitarian space use), and service components (support for paid work, work importance, emergency access, family activities, housing, public benefits, community activities, medications, substance abuse, and continuity). Subscale validity is indicated by associations of specific service offerings with scores on scales measuring client perceptions of those services, and by an ability to differentiate among program models (i.e., Clubhouses, day treatment programs, and psychosocial rehabilitation programs look different from each other). Subscale scores were not influenced by client characteristics (gender, race, age, diagnosis, number of hospitalizations, length of time in program). The final scale has 97 items and takes about 25 minutes to complete. The PES succeeds in measuring different aspects of programs as clients perceive them. In the programs we visited, directors felt the PES covers the important things they want to know about how clients perceive their program. The PES should become a useful tool both for researchers interested in how client responses to programs may influence their therapeutic outcomes, and for practitioners interested in improving their clients' program experiences and/or increasing convergence of staff and client views of their program.     

Neuropsychological Evaluation of Everyday Memory

The evaluation of everyday memory (EM) was reviewed and reconceptualized. EM has established new objectives of study and the development of new methods to reach these objectives . At the basic level, this approach has already produced important discoveries and the development of new principles about memory and functioning. At the clinical level, this new area of investigation has resulted in evaluating deficits of EM, which is defined as what daily life functions remain impaired after a deficit pathology has occurred. A type of evaluation has evolved that is oriented toward treatment and extremely useful in designing rehabilitation programs for individuals with alterations in memory.     

PROGRAMMING FOR SURVIVAL: A MEETING SYSTEM THAT SURVIVES 8 YEARS LATER

Effective and useful interventions often deteriorate when researchers withdraw their direct supervision. We tested the survival of an intervention designed to produce effective weekly meetings in a student housing cooperative without direct researcher supervision. Chairperson performance, proposals completed per hour, and ratings of chairperson performance all increased when resident staff used a training manual, prompting checklist, and performance reviews. Eight years of follow-up revealed continuing high levels of meeting effectiveness. This study demonstrates a methodology for the direct observation and experimental analysis of intervention survival.     

Neuropsychological changes in children with cancer: The treatment of missing data in longitudinal studies

Researchers conducting longitudinal studies with children or adults are inevitably confronted with problems of attrition and missing data. Missing data in longitudinal studies is frequently handled by excluding from analyses those cases for whom data are incomplete. This approach to missing data is not optimal. On the one hand, if data are missing at random, then dropping incomplete cases ignores information collected on those cases that could be used to improve estimates of population parameters (e.g., means, variances, covariances, and growth rates) and improve the power of significance tests of statistical hypotheses. On the other hand, if data are not missing at random, then dropping incomplete cases leads to biased parameter estimates and hypothesis tests that may be internally and externally invalid. This study uses three years of follow-up data from a longitudinal investigation of neuropsychological outcomes of cancer in children to demonstrate the problems presented by missing data in repeated measures designs and some solutions. In evaluating potential biasing effects of attrition, the study extends previous research on neuropsychological outcomes in pediatric cancer by inclusion of patients whose disease had relapsed, and by comparison of surviving and nonsurviving patients. Although the data presented have specific relevance to the study of neuropsychological outcome in pediatric cancer, the problems of missing data and the solutions presented are relevant to a wide variety of diseases and conditions of interest to researchers in child and adult neuropsychology.     

Tests of sphericity of normal distributions and the analysis of repeated measures designs

The locally best invariant test statistic for testing sphericity of normal distributions is shown to be a simple function of the Box/Geisser-Greenhouse degrees of freedom correction factor in a repeated measures design. Because of this relationship it provides a more intuitively appealing test of the necessary and sufficient conditions for valid F-tests in repeated measures analysis of variance than the likelihood ratio test. The properties of the two tests are compared and tables of the critical values of the Box/Geisser-Greenhouse correction factor are given.     

Sorting out what's in a word from what's not: Evaluating Clark's Semantic Features Acquisition theory

The Semantic Features Acquisition theory of semantic development which is due to E. Clark (e.g., 1973b) is reviewed and evaluated against the recent experimental literature, with special reference to the acquisition of English antonyms. The review critically examines the three major ontogenetic principles of Clark's theory in light of numerous recent findings, many of which are at variance in some major way with predictions from the theory. In many instances, new data are available which call into question previous findings. A recurrent problem has been that children's comprehension task performance is confounded with their response biases which are specific to the linguistic and nonlinguistic contexts in which the lexical terms are presented. Methodological implications are discussed, with recommendations for employing the logic of converging operations.     

Test theory without true scores?

This paper traces the course of the consequences of viewing test responses as simply providing dichotomous data concerning ordinal relations. It begins by proposing that the score matrix is best considered to be items-plus-persons by items-plus-persons, and recording the wrongs as well as the rights. This shows how an underlying order is defined, and was used to provide the basis for a tailored testing procedure. It also was used to define a number of measures of test consistency. Test items provide person dominance relations, and the relations provided by one item can be in one of three relations with a second one: redundant, contradictory, or unique. Summary statistics concerning the number of relations of each kind are easy to get and provide useful information about the test, information which is related to but different from the usual statistics. These concepts can be extended to form the basis of a test theory which is based on ordinal statistics and frequency counts and which invokes the concept of true scores only in a limited sense.1979 Psychometric Society presidential address.I want to recognize the contributions which others have made to whatever I have accomplished. First to mention here are my teachers: principally Harold Gulliksen, Ledyard Tucker, and the late Edith Jay. Second, I would like to recognize the importance of my graduate students. Tom Reynolds has been especially important in developing the ideas that I will talk about here today, but at various times, the others have made major contributions in this and other topics. I would like to express also a debt to my family, primarily my wife, Rosemary, who herself has a longterm interest in the psychometric area. Finally, I must acknowledge the financial support of the NIMH some time ago, the Office of Naval Research, until about a year ago, and of the James McKeen Cattell Fund this past year.     

An implicit technology of generalization

Traditionally, discrimination has been understood as an active process, and a technology of its procedures has been developed and practiced extensively. Generalization, by contrast, has been considered the natural result of failing to practice a discrimination technology adequately, and thus has remained a passive concept almost devoid of a technology. But, generalization is equally deserving of an active conceptualization and technology. This review summarizes the structure of the generalization literature and its implicit embryonic technology, categorizing studies designed to assess or program generalization according to nine general headings: Train and Hope; Sequential Modification; Introduce to Natural Maintaining Contingencies; Train Sufficient Exemplars; Train Loosely; Use Indiscriminable Contingencies; Program Common Stimuli; Mediate Generalization; and Train "To Generalize".     

Call for new measures suitable for intensive longitudinal studies: Ideas and suggestions

The intensive longitudinal studies (ILS) has recently gained prominence as one of the most developing and promising approaches in psychological research. It is suitable for studying intraindividual dynamics, since it collects many repeated measurements for multiple persons. However many existing psychometric scales that are suitable for cross-sectional studies cannot be used successfully in ILS. That is why it would be advisable to develop them. This article presents potential solutions and future directions that may be helpful in developing such tools. It focuses on and discusses three issues: (1) appropriate tool length, so that the person completing them multiple times does not feel too tired; (2) parallel forms of questionnaires to reduce the problem of remembering previous answers; (3) complementary types of measure, that would allow approaching certain characteristics in slightly different ways.