Personalized versus standard role plays in the assessment of depressed patients' social skill

Chronically depressed outpatients participated in a study of the role-play assessment of social skill. Patients role-played a series of standard situations typical of those employed in social-skills research and additional scenes drawn from critical situations in their personal lives. These “personalized” role-play situations were perceived as more relevant by patients and resulted in more discomfort and less skillful interpersonal behavior than standard scenes. Behavioral measures derived from personalized role plays were also found to be more strongly related to measures of depression than the same measures derived from the standard role-play scenes. Implications of these findings for the role-play assessment of social skill are discussed.     

The effects of confederate prompt delivery style in a standardized social simulation test

Role plays or social simulations are presently one of the most common methods for assessing social skills. Although social simulation techniques have become quite popular, little is known about the psychometric adequacy of many of the role-play instruments which have been developed. This investigation was an attempt to determine certain properties of one particular social skills assessment instrument: the Simulated Social Interaction Test. The effects of various confederate prompt delivery styles on the judged social competency level of subjects in the Simulated Social Interaction Test were examined. Two confederates, one male and one female, were trained to portray three confederate prompt delivery styles: (a) unreceptive, (b) neutral, and (c) receptive. In order to determine if judges would compensate for the different confederate prompt delivery styles, two sets of trained judges rated the levels of skill and anxiety generated by the 30 subjects tested. One set of judges was screened from the confererate delivery while observing the simulation; the other set of judges followed the more common rating procedure (i.e., they were not screened from the confederates' deliveries). Data analysis examined variation in subject performance under each condition and according to each set of judges for both overall social skills and anxiety ratings. Confederate prompt delivery style was found to affect subjects' rated performance. There was also suggestive evidence that judges were sometimes able to compensate for different confederate delivery styles. The practical and theoretical implications of the results are discussed.This study was funded in part by a research grant from the Veterans Administration.     

Assessment of role-play generalization across qualitatively different situations

Role-play generalization of newly acquired assertive behavior was assessed across different response situations in a clinical outpatient sample. Prior to assertive training, subjects completed two paper-and-pencil inventories and a series of role-play situations. Behavioral role-play scenes included four response forms: making requests, expressing affection, standing up for rights, and expressing displeasure. Subjects were randomly assigned to treatment or test-retest conditions and the treatment subjects received six 2-hr sessions of assertion training using modeling, behavior rehearsal, instruction, positive reinforcement, assignedin vivo homework, bibliotherapy, and daily recordings of assertive behavior. Posttreatment, subjects completed the paper-and-pencil measures, trained role-play scenes, and a set of dissimilar untrained scenes requiring different response forms (giving compliments, receiving compliments; refusing unreasonable requests and expressing justified anger). Videotapes were rated blindly and in random order at the conclusion of the study by trained judges. Treatment and test-retest subjects were equivalent prior to training. Posttreatment for the two groups differed in self-report, role-play behavior in trained situations, and role-play behavior in untrained dissimilar situations (allp<.001). MANOVA with repeated measures confirmed that trained and generalization role-play scenes were quantitatively, as well as qualitatively, different, confirmed that treatment and test-retest subjects exhibited different performance levels posttreatment on both trained and generalization scenes, and revealed four significant interactions (allp<.001). Implications of the interactions are discussed. Canonical correlation revealed that subjects displayed significant commonality in their behavioral profiles across different response forms. The findings indicate that complex training resulted in generalization from trained situations to untrained and dissimilar generalization scenes for the clinical outpatient sample.     

The effects of situational variations in role-play scenes on assertive behavior

The study was conducted to determine the extent to which variations in the situational parameters of role-play scenes affect subjects' levels of assertiveness. Thirty-six psychology undergraduate students were randomly assigned to one of three role-play conditions that differed in the situation-setting characteristics presented in the scenes: a Difficult condition, designed to inhibit assertive responding; an Easy condition, designed to facilitate assertive responding; and a Neutral condition. Subjects also completed a self-report assertion inventory. Videotapes of the role-played interactions were rated for a variety of component responses. Results indicate that subjects responded differently in the three conditions. Subjects in the Difficult and Neutral conditions were more compliant, and those in the Easy and Difficult conditions were more fluent. It is suggested that failure to specify the situational parameters of role-play scenes may affect the validity of this assessment procedure.This research was supported in part by NIMH Grant, MH28279 to the third author.     

SOCIAL SKILLS TRAINING WITH CHILDREN: PROCEED WITH CAUTION

Three learning disabled children, selected on the basis of peer sociometric ratings and teacher referral, received social skills training. A group training procedure consisting of coaching, modeling, behavior rehearsal, and feedback was used to teach children the target behaviors of eye contact and appropriate verbal responses. A multiple baseline analysis across target behaviors was used to demonstrate treatment effectiveness on role-play scenes trained during treatment sessions. Duration of speech was measured as an untrained, corollary measure. The following measures were also obtained during baseline, posttreatment, and 1-mo follow-up for the experimental subjects and three control subjects: (a) performance on role-play scenes not trained during treatment sessions; (b) behavioral observations in a free play setting, and (c) sociometric ratings. In addition, the trained and untrained role-play scenes were administered by novel experimenters following treatment. The results indicated that socially unskilled, learning disabled children can be taught to respond appropriately to role-play situations. However, improved performance did not generalize to the natural school setting and treatment did not effect ratings of peer acceptance. The implications of these findings for future social skills training with children are discussed.     

Psychometric properties of the Multidimensional Anxiety Scale for Children (MASC) among Icelandic schoolchildren

A psychometric assessment of the Icelandic version of the Multidimensional Anxiety Scale for Children (MASC) was undertaken among Icelandic schoolchildren, between 10 and 15 years of age. In a first study 625 children between 10 and 15 years of age filled in the MASC. A confirmatory factor analysis indicated that the four-factor structure of the instrument was justified. Further, means and standard deviations of the total scale and the subscales were similar to the original normative data reported by March (1997). In a second study the MASC, the Children Depression Inventory (CDI) and the Revised Children's Manifest Anxiety Scale (RCMAS) were administered to a sample of 249 schoolchildren between 10 and 15 years of age. The results supported the convergent and divergent validity of the MASC. Together the two studies show satisfactory psychometric properties of the Icelandic version of the MASC in a normal population.     

Recurrent problems in the behavioral assessment of social skill

Behavioral strategies for assessing social skill have been subjected to extensive analysis and criticism in the past few years. Many problems with earlier strategies have been corrected, yet the literature continues to be marked by a number of serious errors and invalid procedures. The purpose of this paper is to identify some of these recurrent difficulties, and recommend alternatives where possible. The discussion covers three general topics: the measures employed, the assessment format and conceptual issues which bear on assessment. Specific issues addressed include the respective value of molecular and molar ratings, the extent to which subjects actually engage in role playing, the utility of single prompt role-play tests, the selection and form of role-play scenarios and the role of skill deficits in interpersonal dysfunction. Some of the major assumptions and persistent dilemmas in the existing literature are examined in the light of questionable and often invalid assessment procedures.     

Factors affecting the social validity of a role-play test of children's social skills

The social validity of a role-play test of children's social skills, the Social Skills Test for Children (SST-C), was evaluated by 63 subjects (33 adults and 30 children) who subjectively judged the quality of three children's role-play performances. The three children were selected as having high, medium, or low social skill based upon their performance on the SST-C. Assessment of the effects of subject characteristics upon judgments of social skill suggested that similarities in age and race between the subjects and the three children tended to diminish perceived differences in social skill among the three children. It was concluded that the social validity of the role-play test was supported only if the persons evaluating social behavior were dissimilar in age and racial characteristics from the persons who were being evaluated.     

Attentional dysfunction, social perception, and social competence: what is the nature of the relationship?

The aim of this study was to examine the nature of the relationship between attentional dysfunction and social competence deficits in patients with schizophrenia. Attentional functioning, social perception, and social competence were assessed in 56 inpatients. Measures of vigilance and span of apprehension were administered to assess attentional functioning. Social perception was assessed with an audiovisual measure of affect recognition. Social competence was rated from a role-play task. Span of apprehension and auditory vigilance emerged as specific predictors of social competence. Affect recognition was tested as a mediator and a moderator of the relationship between attentional dysfunction and social competence. Affect recognition was found to moderate the relationship between span of apprehension and social competence.     

Validation of a component model of social skill with outpatient adults

Little social skills research has been generated from applied outpatient settings. The present study examined the relationship of behavioral social skill components to independent judges' social skill judgments. A secondary question was whether nonverbal components would demonstrate a curvilinear relationship to social skill ratings. Forty-two outpatient adults at a community mental health center were videotaped role-playing eight scenes (four commendatory and four refusal). Videotapes were viewed in random order by community members who rated the subject's social skill in the situation. Trained raters scored the videotapes on standard behavioral components. While both nonverbal and verbal components accounted for significant portions of unique variance, the percentage of eye contact was an overwhelmingly large contributor to skill judgments. No curvilinear trend was evidenced for the nonverbal components. The study extended prior findings with psychiatric inpatients into applied outpatient settings and indicated that a component social skills model is equally applicable with outpatient adults. The findings replicated with a second sample of outpatient adults.     

Intervention to Strengthen Emotional Self-Regulation in Children with Emerging Mental Health Problems: Proximal Impact on School Behavior

A model for teaching children skills to strengthen emotional self-regulation is introduced, informed by the developmental concept of scaffolding. Adult modeling/instruction, role-play and in vivo coaching are tailored to children’s level of understanding and skill to promote use of skills in reallife contexts. Two-hundred twenty-six kindergarten—3rd grade children identified with elevated behavioral and social classroom problems from a population-based screening participated in a waitlisted randomized trial of the Rochester Resilience Project derived from this model. In 14 lessons with school-based mentors, children were taught a hierarchical set of skills: monitoring of emotions; selfcontrol/ reducing escalation of emotions; and maintaining control and regaining equilibrium. Mentors provided classroom reinforcement of skill use. Multi-level modeling accounting for the nesting of children in schools and classrooms showed the following effects at post-intervention: reduced problems rated by teachers in behavior control, peer social skills, shy-withdrawn and off-task behaviors (ES 0.31–0.47). Peer social skills improved for girls but not for boys. Children receiving the intervention had a 46% mean decrease in disciplinary referrals and a 43% decrease in suspensions during the 4-month intervention period. Limitations and future directions to promote skill transfer are discussed.     

Using Motor-Based Role-Play to Enhance Social Skills in a Nonverbal Adolescent With High Functioning Autism: A Case Report

In this study the authors collected pilot data about the effect of a motor-based role-play intervention on the social skills of a nonverbal adolescent with high functioning autism. Single subject design was used to tally frequency of targeted social skills at baseline, intervention, and 3-month probe. Intervention was delivered once per week in 1-hour sessions over 4 weeks. The Evaluation of Social Skills was also used at baseline and 3-month probe to assess changes in social skill quality. Although the participant's verbal use did not change, the quality and frequency of nonverbal social skill use increased significantly from baseline to 3-month probe (p = .038, t = ?3.556).     

Validation of a role-play measure of children's social skills

A videotape-administered role-play test of children's social skills was developed and its psychometric properties tested. Performance criteria for the test were derived from popular children's ratings of the effectiveness of different role-play responses. The test was administered to 157 fourth- and fifth-grade boys and girls who had been classified as popular, average, neglected, or rejected, on the basis of sociometric testing. The test evidenced good interrater, test-retest, and internal consistency reliabilities. Children's role-play performance correlated significantly with teacher ratings of social competence and with peer-liking ratings. Neglected children performed more poorly on the role-play test than popular children. When differences in intelligence among social status groups were statistically controlled, social status groups did not differ on the role-play test. Results of the discriminant analyses support the conclusion that teacher ratings are better than role-play tests for identifying rejected children, whereas role-play tests and measures of intelligence appear more accurate than teacher ratings for identifying neglected children.     

Analogue observational methods in the assessment of social functioning in adults

This article provides a clinically oriented overview of analogue observational methods used in the assessment of problematic social functioning, specifically skill deficits and social anxiety. This article emphasizes role-play assessment methods, the predominant method used in clinical settings. An examination of the psychometric characteristics of analogue assessment methods is presented, followed by a review of procedural and structural considerations that may impact the quality of assessment data. Of special concern are the potential impacts of instructional variables, structured versus ideographic role-played situations, confederate characteristics and behavior, molar and molecular levels of assessment, self-ratings versus clinician ratings of functioning, and physical attractiveness. Finally, published and empirically evaluated analogue observation tests are critically reviewed with an emphasis on features that may impact their utility in clinical practice.     

Convergent and concurrent validation of four measures of assertion

This study examined the relationship among the College Self-Expression Scale (CSES), the Dominance Scale of the California Psychological Inventory (Do), role-play assessment, and peer ratings of assertion. Peer ratings served as the criterion measure. Fifty-three members of a college sorority completed the CSES and the Do Scale, role played eight scenes requiring an assertive response, and rated each other on a five-point scale of assertion. Peer ratings were significantly correlated with the Do Scale and the CSES. A significant correlation was also obtained between the CSES and the Do. Role-play ratings were not significantly related to any measure. Results are discussed in terms of convergent and concurrent validity for the Do and CSES as measures of assertion. A precautionary note is presented regarding the use of role-play assessment for measuring assertion and as a behavioral validation procedure.     

Correlates of adult and child perceptions of social competency

In this study, the relationship between two commonly used measures of social competency, peer ratings of perceived status and adult ratings of assertiveness, were examined. In Phase I, high and low sociometric status children were videotaped responding to a series of role-play scenes; performance on these scenes was then rated retrospectively by adults for overall assertiveness. In Phase II, a second group of children who were unfamiliar with the videotaped children observed the taped scenes and provided ratings of likability, intelligence, working together, and attractiveness. In general, results revealed that children and adults differed in their ratings of the videotaped children. Further, boys used different cues in their ratings than did girls. More specifically, the sociometric status of girls was related to perceived attractiveness, whereas the sociometric status of boys was more closely related to perceived intelligence. Such findings suggest that children and adults look for and use different cues in their judgments. Given these differences, it is concluded that child and adult ratings should not be used interchangeably in the assessment of, and evaluation of, social competency in children.Portions of this research were supported by a grant from the Virginia Department of Criminal Justice Services.     

Sex role orientation and social skill: A naturalistic assessment of assertion and conversational skill

This study evaluated the relationship between sex role orientation and social skill, improving upon previous research by utilizing a more naturalistic role-play assessment, and by assessing both assertion and conversational skills. Fifty-nine female psychology students were classified as masculine, feminine, androgynous, or undifferentiated based on the PRF-ANDRO scale. These subjects interacted with a confederate who engaged them in a standardized conversation including requests to borrow psychology class notes. The masculine, feminine, and androgynous groups displayed similar levels of assertion and conversational skill, even though masculine subjects rated themselves as more skillful and had fewer negative thoughts associated with being assertive than feminine subjects. Correlational analyses among continuous sex role and behavioral measures revealed that both masculinity and femininity scores were positively correlated with overall conversational skill. These results are interpreted in light of methodological difficulties in previous research, and in light of recent evidence that both masculine and feminine capabilities contribute to social competence in certain behavioral domains.This research was supported in part by a Baylor University sabbatical grant awarded to the first author. Both authors wish to thank Jack Baty for statistical consultation, Ross Williams for serving as the confederate, and Elaine McFarlane for serving as a rater.     

Psychometric Properties of the Behavioral Assertiveness Test for Children (BAT-C)

The Behavioral Assertiveness Test for Children (BAT-C) is a widely used role-play test for assessing assertive responding in children. Past research has indicated that this assessment technique is sensitive to treatment and generalization effects, however, the psychometric properties of the BAT-C have not been previously addressed. The present study was designed to examine several internal psychometric properties of this assessment method. Both verbal and nonverbal measures were used to assess the BAT-C's internal consistency, item-total correlation and to perform step-wise multiple regression analyses. Results and implications for further use of this role-play test are discussed.     

Can I trust you? Negative affective priming influences social judgments in schizophrenia

Successful social interactions rely on the ability to make accurate judgments based on social cues as well as the ability to control the influence of internal or external affective information on those judgments. Prior research suggests that individuals with schizophrenia misinterpret social stimuli and this misinterpretation contributes to impaired social functioning. We tested the hypothesis that for people with schizophrenia, social judgments are abnormally influenced by affective information. Twenty-three patients with schizophrenia and 35 healthy control participants rated the trustworthiness of faces following the presentation of neutral, negative (threat-related), or positive affective primes. Results showed that all participants rated faces following negative affective primes as less trustworthy than faces following neutral or positive primes. Importantly, this effect was significantly more pronounced for participants with schizophrenia, suggesting that schizophrenia may be characterized by an exaggerated influence of negative affective information on social judgment. Furthermore, the extent that the negative affective prime influenced trustworthiness judgments was significantly associated with patients' severity of positive symptoms, particularly feelings of persecution. These findings suggest that for people with schizophrenia, negative affective information contributes to an interpretive bias, consistent with paranoid ideation, when judging the trustworthiness of others. This bias may contribute to social impairments in schizophrenia.