| Abstract: | Data collected at two law enforcement agencies were used to address three specific issues concerning the development and implementation of frame-of-reference rater training. First, the prototype-anchored rating system was presented as a comprehensive method for generating an appropriate frame of reference in an organizational setting. Second, sensitivity and threshold analyses were used to demonstrate a method for identifying idiosyncratic raters (i.e., raters deviating from the appropriate frame of reference) in the rater population. Finally, areas of performance where supervisors and subordinates were likely to disagree on the frame of reference were identified. Concerning this latter issue, analyses indicated supervisors viewed poor-performance incidents more severely than did patrol officers on several dimensions of performance. To a lesser degree, supervisors and patrol officers also differed on their perceptions of the importance of poor-performance incidents. The implications of these findings are discussed in relation to the development and implementation of frame-of-reference rater training. |
