Comparability of methods of observation for global ratings of heterosexual social skill and anxiety: A generalizability study

This research examined the degree to which skill and anxiety ratings vary as a function of audio, video, or live rating conditions. The question was addressed through a generalizability analysis which indicated that ratings of skill may generalize across audio, video, or live rating modes and across judges within a mode. However, results for anxiety show that while one can generalize across modes, there is a lack of comparability across judges within modes. This finding indicates the need for more judges in order to obtain acceptable levels of reliability for anxiety. Additional validity analyses suggest that the use of videotapes for ratings of skill maximizes the information obtained from role-play techniques for the assessment of heterosexual social performance.Appreciation is expressed to Jan Wallander, Betsy Firth, Dave Ward, Susan Keane, and Judy Dygdon, without whom this project could not have been completed.