Scale analysis and the measurement of social attitudes

This paper discusses and compares the methods of attitude scale construction of Thurstone (method of equal-appearing intervals), Likert (method of summated ratings), and Guttman (method of scale analysis), with special emphasis on the latter as one of the most recent and significant contributions to the field. Despite a certain lack of methodological precision, scale analysis provides a means of evaluating the uni-dimensionality of a set of items. If the criteria for uni-dimensionality are met, the interpretation of rank-order scores is made unambiguous, and efficiency of prediction from the set of items is maximized. The Guttman technique, however, provides no satisfactory means of selecting the original set of items for scale analysis. Preliminary studies indicated that both the Likert and the Thurstone methods tend to select scalable sets of items and that their functions in this respect are complementary. A method of combining the Likert and Thurstone methods in order to yield a highly scalable set of items is outlined. Sets of 14 items selected by the method have, in the two cases where the technique has been tried, yielded very satisfactory scalability.     

Decoding deficits and social competency: A continuous rating approach

Males who self-reported heterosocial difficulties and whose performance in a role-played interaction was judged to be of low social competence were compared to high-competent males on a continuous rating task. The rating task required that subjects make continual, ongoing social competency ratings of their own and six other males' performance in a role-play situation. The continuous measurement of performance provided a profile of ratings that was compared on frequency, latency-to-first ratings, profile elevation or level, scatter, and patterning. Low-competent males had longer latencies-to-first ratings than high-competent males and less scatter in their continuous ratings than did the high-competent group. The reduced scatter effect for continuous ratings replicates previous work done with global ratings and suggests that the low-competent group may not be able to discriminate among social stimuli as well as the high-competent group. The research also suggests that the continuous rating methodology may hold promise as a tool to investigate social perception processes.     

VALIDATION OF SOCIAL SKILLS OF ADOLESCENT MALES IN AN INTERVIEW CONVERSATION WITH A PREVIOUSLY UNKNOWN ADULT

Seventy convicted young male offenders were videotaped during a 5-min standardized interview with a previously unknown adult. In order to determine the social validity of the behavioral components of social interaction for this population, measures of 13 behaviors were obtained from the tapes. These measures were then correlated with ratings of friendliness, social anxiety, social skills performance, and employability made by four independent adult judges from the same tapes. It was found that measures of eye contact and verbal initiations were correlated significantly with all four criterion rating scales. The frequencies of smiling and speech dysfluencies were both significantly correlated with ratings of friendliness and employability. The amount spoken was found to be a significant predictor of social skills performance whereas the frequency of head movements influenced judgments of social anxiety. The latency of response was negatively correlated with social skills and employability ratings and the frequency of question-asking and interruptions correlated significantly with friendliness, social skills, and employability ratings. Finally, the levels of gestures, gross body movements, and attention feedback responses were not found to influence judgments on any of the criterion scales. The implications of the study for selection of targets for social skills training for adolescent male offenders are discussed.     

The effects of various rater training procedures on the perception of social skills and social anxiety

Procedures for the behavioral assessment of social skills typically rely on judges' perceptions of subjects' behavior in several simulated situations. This study examined two methodological variables which could influence the degree of situational specificity perceived by social skill judges. Forth-eight judges were presented videotapes of 15 actors who role played responses to eight simulated social situations. Half of the judges viewed the situations in a sequential fashion and the remaining half viewed the tapes grouped by situations. The second factor of this design included three different expectancy conditions included in an analogue training procedure. Differences in observed variability were examined for both social skill and social anxiety constructs. Order of stimulus presentation had no effect on variability. The expectancy manipulation significantly increased variability among social skill ratings but had no effect on reliability.This study was supported in part by the Veterans Administration.     

SOCIAL VALIDATION OF COMPONENT BEHAVIORS OF FOLLOWING INSTRUCTIONS,ACCEPTING CRITICISM,AND NEGOTIATING

This study evaluated whether behaviors often taught as part of social skills training are judged favorably by others. Community judges evaluated the performances of people in various situations requiring one of three social skills: following instructions, accepting criticism, and negotiating to resolve conflicts. These skills were displayed in videotaped scenes by actors with and without mental retardation who acted out roles that had different types of authority relationships, and when different components or clusters of behavior (nonverbal, specific verbal, or general verbal behaviors) were performed well or poorly. The highest ratings by judges were of videotaped scenes that depicted correct use of all behaviors, regardless of which skill was being examined, whether or not the actor had mental retardation, or what the relationship was between the two actors. The lowest ratings were of videotaped scenes that depicted poor performance of all behaviors, and intermediate ratings were obtained when only some of the behaviors were performed poorly. These results, as well as the verbal responses of judges to questions, indicated that the different behaviors commonly used in teaching the skills of following instructions, accepting criticism, and negotiating are relevant to judgment of social performance, and are likely to be reinforced and maintained by social contingencies.     

Evidence for the external validity of a social simulation measure of social skills

Two studies were conducted in order to obtain evidence regarding the external validity of a social simulation measure of social skills. The first study employed a contrasted group design, with the groups consisting of National Guardsmen and psychiatric patients. As predicted, trained judges rated the performances of the National Guardsmen in the simulations as more skillful and appearing less anxious than the psychiatric patients. In the second study, trained judges' ratings of psychiatric patients' performances in the simulations were found to be significantly related to ratings made by interviewers who had conducted a structured social history interview with the patients, nurses' ratings based on their observations of patients after 3 days on the psychiatric unit, a research assistant's ratings based on contact with the patient during the experiment, and finally, the subject's own self-ratings. In discussing the findings, it is hypothesized that one reason why support was found for the external validity of the simulation strategy in this study, in contrast to some previously reported studies, was the use of molar ratings in this study as opposed to the more molecular rating procedures used in those previous studies.These studies were funded in part by a research grant from the Veterans Administration.     

A comparison of skill-building and desensitization strategies for intervention with aggressive children

Social skills training and desensitization interventions were conducted with 41 institutionalized aggressive children aged 7–13. Subjects were randomly assigned after blocking by aggression and cooperative play to either of the treatments. Dependent measures were direct observations of playground play and teacher ratings. Subjects in the social skills program mastered the basic cognitive skills presented to them. Observational data indicated that both groups experienced marked reduction in aggressive behavior and increases in cooperative play. The social skills training intervention engendered incremental improvement in aggression in comparison to the desensitization condition. However, none of the behavioral changes evident in the observations were reflected in teacher ratings.     

IDENTIFICATION AND VALIDATION OF CRITICAL CONVERSATIONAL SOCIAL SKILLS

In this study, we used a four-step social validation process to identify and validate critical skill components that constitute high school students' conversational behavior. The four steps were nominating target behaviors, establishing a normative range of performance, manipulating simulations of behavioral dimensions, and comparing ratings of judges to levels of performance on those behavioral dimensions. Multiple measures, both quantitative and qualitative, suggested that the rate and percentage of time initiating and responding verbally, the percentage of time attending, and the percentage of time not engaging in distracting motor behavior related to favorable ratings by a wide variety of 60 judges. Findings are discussed in relation to the utility of the multistep social validation process and the identification of critical social skill components as targets of interventions.     

Racial bias in behavioral assessment of children's social skills

The social skills of 20 second- and sixth-grade students were assessed by 20 trained raters using the Social Skills Test for Children (SST-C). Rater and child characteristics were examined to determine whether differences in social skills ratings were due to the race of the rater or the race of the children being rated or due to the interactive effects of these characteristics, which would suggest racial bias in the ratings procedure. The results showed that the race of the rater did affect some behavioral observations. Black raters gave higher scores than white raters on four behavioral categories: response latency, appropriate assertion, effective assertion, and smiling. White raters gave higher scores for head position and gestures. The results of this study replicated earlier findings of significant differences in social skills ratings due to the race and age of the child being rated. The results also showed modest racial bias effects in that black and white raters scored black and white children differentially on two behavioral categories: overall skill ratings and smiling. These results suggested that most behavioral categories of the SST-C were not systematically affected by racial bias. However, the most subjective rating, overall skill, did evidence racial bias effects. This finding is consistent with previous data showing that subjective ratings may be most affected by racial bias.     

Validation of a Swedish short self-report measure of core affect

This research aimed at validating two self-report composite rating scales of core affect that are useful when quick assessments are required, for instance, of current mood or recalled, anticipated, and experienced emotional reactions. The ratings were derived from the Swedish Core Affect Scales (SCAS) comprising six self-report rating scales of the two orthogonal dimensions of core affect, valence (unpleasantness-pleasantness) and activation (quietness-excitement). In three samples of university students who were requested to rate current moods, affect-inducing sounds, or affect-inducing pictures, the composite ratings were compared to SCAS, two widely used graphical rating scales of valence and activation, and skin conductance responses and the acceleratory peak of heart rate. Three different rating formats were also compared. The results showed that the composite ratings were reliable and yielded the expected correlations with the other ratings and with the physiological affect indicators. No effects of rating format were detected. It is concluded that the composite ratings of valence and activation may be used if quick assessments are called for. Choices can be made of any of three rating formats depending on purpose with the assessments.     

Comparability of methods of observation for global ratings of heterosexual social skill and anxiety: A generalizability study

This research examined the degree to which skill and anxiety ratings vary as a function of audio, video, or live rating conditions. The question was addressed through a generalizability analysis which indicated that ratings of skill may generalize across audio, video, or live rating modes and across judges within a mode. However, results for anxiety show that while one can generalize across modes, there is a lack of comparability across judges within modes. This finding indicates the need for more judges in order to obtain acceptable levels of reliability for anxiety. Additional validity analyses suggest that the use of videotapes for ratings of skill maximizes the information obtained from role-play techniques for the assessment of heterosexual social performance.Appreciation is expressed to Jan Wallander, Betsy Firth, Dave Ward, Susan Keane, and Judy Dygdon, without whom this project could not have been completed.     

The effect of social skills training procedures on the acquisition of appropriate interpersonal skills for mentally retarded adults

A pretest/posttest control group design was utilized to examine the effect of social skills training on social interactions with peers, conversational interactions with a novel partner, and ratings of overall social functioning. The results failed to support the hypothesis that social skills training could increase the generalization of overall conversational responding of mentally retarded adults. The results showed that social skills training augmented with self-monitored videotape feedback could not optimize the effects of social skills training alone. The subjects did demonstrate acquisition of the targeted behaviors during training by meeting preestablished criteria for all of the training sessions. However, the subjects failed to generalize those behaviors across settings to in vivosocial situations.     

Single‐item big five ratings in a social network design

To develop and validate an ultra‐short measure to assess the Big Five in social network designs, the unipolar items of the Ten‐Item Personality Inventory were adapted to create a bipolar single‐item scale (TIPI‐r), including a new Openness item. Reliability was examined in terms of the internal consistency and test–retest stability of self‐ratings and peer‐rating composites (trait reputations). Validity was examined by means of convergence between TIPI‐r and Big Five Inventory (BFI) scores, self‐peer agreement and projection (intra‐ individual correlation between self‐ and peer‐ratings). The psychometric quality of the TIPI‐r differed somewhat between scales and the different reliability and validity criteria. The high reliability of the peer‐rating composites motivates to use the TIPI‐r in future studies employing social network designs. Copyright © 2007 John Wiley & Sons, Ltd.     

The relevance of specific conversational behaviors to ratings of social skill: An experimental analysis

Research on the social effectiveness of specific conversational behaviors is reviewed and a new study is presented. Eight versions of the same tape-recorded conversation between a man and a woman were prepared in a 2×2×2 design, where the woman systematically varied her conversation either high or low on questions, compliments, and 4-sec latencies. Subjects listened to one of these tapes and rated the female's social skill. Results of the major social skill variable showed that high questions and high compliments elicited higher skill ratings. The effect of low latencies was only marginally significant. While other factors such as personal appearance or self-evaluation differences may also be important, this study suggests that it may be valuable to include assessment and training relevant to compliments and questions (and possibly latencies) in programs for women who are socially anxious.     

SOCIAL SKILLS TRAINING WITH CHILDREN: PROCEED WITH CAUTION

Three learning disabled children, selected on the basis of peer sociometric ratings and teacher referral, received social skills training. A group training procedure consisting of coaching, modeling, behavior rehearsal, and feedback was used to teach children the target behaviors of eye contact and appropriate verbal responses. A multiple baseline analysis across target behaviors was used to demonstrate treatment effectiveness on role-play scenes trained during treatment sessions. Duration of speech was measured as an untrained, corollary measure. The following measures were also obtained during baseline, posttreatment, and 1-mo follow-up for the experimental subjects and three control subjects: (a) performance on role-play scenes not trained during treatment sessions; (b) behavioral observations in a free play setting, and (c) sociometric ratings. In addition, the trained and untrained role-play scenes were administered by novel experimenters following treatment. The results indicated that socially unskilled, learning disabled children can be taught to respond appropriately to role-play situations. However, improved performance did not generalize to the natural school setting and treatment did not effect ratings of peer acceptance. The implications of these findings for future social skills training with children are discussed.     

Efficacy and social validity of procedures for improving conversational skills of college students with autism

Better conversational skills correspond to a higher quality of life for adults diagnosed with autism spectrum disorder (ASD). In this study, we taught vocal–verbal responses discriminated by compound arrangements of concealed conversation partner mands to two college students with ASD. Participants learned to engage in self-questioning about their conversation partner's behavior and to reinforce three concealed mands for termination of an aversive conversation scenario. We assessed generalization to conversation probes with trained confederates and to interactions with untrained conversational partners (e.g., peers, professors). Finally, we collected peer ratings of the social validity of changes in conversational behavior as well as participants' ratings of study goals, procedures, and outcomes.     

Social validation of a conversational skills-training program

This study sought to demonstrate the social validity of a conversational skills-training program administered to two male clinical cases. Multiple-baseline, single-subject experimental designs were used to evaluate the effects of training on nonverbal and verbal behavior as assessed in unstructured dyadic interactions with experimentally naive peers. The interpersonal attractiveness of subjects also was rated by conversational partners following assessment interactions. Behavioral measures and attraction ratings were converted toT scores relative to means and standard deviations derived from normal subjects. Subject 1 demonstrated posttreatment behavioral skills which were between one and two standard deviations above the norm. Behavioral improvement was associated with comparable improvement in rated interpersonal attractiveness. Following treatment, Subject 2 demonstrated average behavioral competence, but interpersonal attractiveness was not notably enhanced by skills training. These findings are discussed relative to experimental and therapeutic criteria for evaluating treatment outcome.Portions of this research were completed while the authors were affiliated with the University of Georgia. Special thanks are extended to Michael Breakwell for his assistance in completing behavior ratings.     

神经质人格迫选量表的开发及其抗作假效果研究

传统的迫选量表得分是自模式数据,最近提出的Thurstone IRT模型建构了被试对迫选量表反应的数学模型,能够更精确地度量被试的特质水平.研究自编了神经质人格迫选量表,与常用的测量神经质的Likert量表一起,在无压力、模拟应聘和实际应聘三种情境下进行施测.结果发现,迫选量表的实测数据能够较好地拟合Thurstone IRT模型,该模型估计的特质得分不具有自模式数据的性质,比传统计分更能够抵抗作假.无论采用哪种计分方式,迫选量表都比Likert量表更能够抵抗作假.     

Between-measure consistency in social-skills assessment

The purpose of the present study was to assess the between-measure consistency of general and specific social-skills assessment strategies. Nineteen mentally retarded adults were assessed using both common and newly devised measures of social skills: (1) specific (molecular) behavior ratings from role-play assessments, (2) general (molar) ratings based on the role plays, staff (3) molar and (4) molecular predictions of client social skills use in the described role-play situations, (5) peer sociometric ratings, and molecular in vivoobservations conducted in (6) cafeteria and (7) party settings. For all molecular measures, the subjects were assessed on eye contact, response relevance, response latency, voice volume, and appropriate affect, which allowed for direct comparisons to be made between each of these assessment modalities. In addition, the role-play assessment was conducted under two distinct conditions to determine whether role-play performance varied between standard and reinforced administrations; however, multivariate analyses (MANOVA) revealed no differences between the two assessments. Correlations between the molar and the molecular measures suggested a substantial overlap between the measures, with staff ratings having the highest consistency with the other measures. Furthermore, MANOVAs calculated between role-play ratings and those of staff revealed little difference between the two. The limitations on and practical significance of these findings are discussed.     

Factors predictive of a fetal alcohol spectrum disorder diagnosis: Parent and teacher ratings

Diagnostic assessment in Fetal Alcohol Spectrum Disorder (FASD) is informed by multidisciplinary assessment incorporating objective (i.e., test measures) and subjective means, such as parent and teacher behavior ratings. The purpose of this study was to extend our previous neuropsychological test findings by identifying parent and teacher ratings of academic achievement, attention, executive functioning, and adaptive functioning as predictors of an FASD diagnosis. The charts of 315 children and adolescents with prenatal alcohol exposure (PAE) who underwent assessment for FASD were retrospectively reviewed. Direct logistic regressions analyzed the contribution of different ratings on the likelihood of an FASD diagnosis. The results suggest that a number of rating measures do contribute toward accurately differentiating those with FASD from within a PAE population, including teacher ratings of learning problems, inattention, and adaptive skills. The classification accuracy for each regression was clinically significant (59.1–70.8%). Children with worse ratings on these variables are approximately 1.5 to 2 times more likely to receive an FASD diagnosis. Only teacher ratings (not parent) significantly contributed to whether a diagnosis was made, suggesting that teacher observational rating scales are a critical component of an FASD assessment. Together with our previous research examining neuropsychological evaluation and FASD diagnostic assessment, this study helps to further guide decisions to streamline care in multidisciplinary assessment and intervention planning.