Psychometric instability of measures in novel settings: Use of psychiatric rating scales in nursing homes

Researchers have become increasingly concerned about problems of the quality of measurement in applied evaluation settings. Of particular importance is change in both the reliability and the validity of a measure that is used in a novel setting. This problem is illustrated by an attempt to use psychiatric rating scales to assess the behavior of chronic mental patients currently residing in nursing homes. Methods for assessing changes in both reliability and validity are presented, along with suggestions for how to deal with these problems.This research was supported in part by an Extramural Research Grant from the State of Illinois Department of Mental Health and Developmental Disabilities.