Effects of Instructions and Rating Scales on Item Selection for the BSRI Scales

Walkup and Abbott (1978) stated that Edwards and Ashworth's (1977) failure to replicate Bem's (1974) selection of items for the Masculinity and Femininity Scales of the Bern Sex Role Inventory (BSRI) may be attributed to differences in the instructions and anchored rating scales used in the two studies. The present study tested the hypothesis that presence of various interaction effects involving instructions and rating scales would influence the acceptability of items for the BSRI Masculinity and Femininity Scales. Results based on the evaluation of individual items by Bem's item selection criteria in each of the four experimental conditions obtained by systematically manipulating two instructions (Bem's and Edwards' instructions) and two rating scales (Bem's and Edwards' rating scales) and also those based on the analysis of variance of item mean desirability ratings from the four experimental conditions supported the hypothesis.     

Evaluation of the BSRI masculine and feminine items using desirability and stereotype ratings

This study empirically tested Bem's (1974) assumption that the BSRI Masculinity and Femininity scales measure sex-typed standards of desirable behavior for men and women in American society. The adequacy of items in the two scales was evaluated by Bem's (1974) criteria using two types of desirability and stereotype ratings. Results obtained in all the experimental conditions except one involving Bem's desirability instructions and Bem's rating scale did not support the tested assumption. Implications of these results for revising the BSRI scales were discussed.     

Effects of three conditions of administration on Bem Sex Role Inventory scores

In order to assess the validity of the technique employed in selecting items for the Bern Sex Role Inventory (BSRI) 58 male and 62 female undergraduates took the BSRI under three different sets of instructions. Both males and females were able to produce extremely masculine and extremely feminine BSRI profiles which differed (p < .01) from their own BSRI profiles. The results support Bem's (1974) assertion that the BSRI Masculinity and Femininity scales are comprised of items which are consistent with widely held sex-role sterotypes.     

Using Reliability Generalization Methods to Explore Measurement Error: An Illustration Using the MMPI–2 PSY–5 Scales

This study empirically tested Bem's (1974) assumption that the BSRI Masculinity and Femininity scales measure sex-typed standards of desirable behavior for men and women in American society. The adequacy of items in the two scales was evaluated by Bem's (1974) criteria using two types of desirability and stereotype ratings. Results obtained in all the experimental conditions except one involving Bem's desirability instructions and Bem's rating scale did not support the tested assumption. Implications of these results for revising the BSRI scales were discussed.     

A psychometric study of the PRF ANDRO Scale

This study investigated the adequacy of the items in the PRF ANDRO Masculinity (M) and Femininity (F) Scales, in terms of the content themes specified by Berzins, Welling, and Wetter (1978), and empirically tested their appropriateness using Bem's (1974) criteria. Results indicated that the PRF ANDRO M and F scales contain a large proportion of items that are theoretically irrelvant and that did not satisfy Bem's criteria. In addition, these scales were found to contain several items with low content saturation. Implications of the results are discussed.     

Effects of Three Conditions of Administration on Bem Sex Role Inventory Scores

In order to assess the validity of the technique employed in selecting items for the Bern Sex Role Inventory (BSRI) 58 male and 62 female undergraduates took the BSRI under three different sets of instructions. Both males and females were able to produce extremely masculine and extremely feminine BSRI profiles which differed (p < .01) from their own BSRI profiles. The results support Bem's (1974) assertion that the BSRI Masculinity and Femininity scales are comprised of items which are consistent with widely held sex-role sterotypes.     

Masculinity and Femininity in Japanese Culture: A Pilot Study

This study examined masculinity and femininityin Japanese culture. Two hundred sixty-five collegestudents (male = 104; female = 161) took the Japaneseversion of the Bem Sex Role Inventory (BSRI) with pertinent demographic questions. Subjects wereall Japanese and no other races were included. Theresults showed no significant difference betweenJapanese male college students and Japanese femalecollege students on both the Masculinity and Femininityscale of the BSRI. It was also found that both male andfemale Japanese college students scored higher on theFemininity scale than on the Masculinity scale of the BSRI. A confirmatory factor analysisalso supported that Bem's gender role model did not fitthe data collected in Japan. The limitations andimplications of the study are also discussed.     

Factor and discriminant analysis of the Bem Sex-Role Inventory

Several studies have recently recommended that items which fail to load substantially (< .40) on one of several primary factors characterizing the Bem Sex-Rote Inventory (BSRI) could be deleted without substantial loss of interpretability. This recommendation is questioned on the basis that the extent of interrelatedness of the items is an insufficient indicator of the contribution each item makes towards the classification (identifying sex-types by Bem's median split technique) efficiency of the inventory. Empirical support of this contention was provided by conducting several discriminant analyses (predicting sex-types) on a sample of 1117 BSRI protocols and excluding the various items suggested by the earlier research. These results were then compared with the results of a discriminant analysis using the 40 masculine and feminine items. The analyses using less. than all 40 items produced substantially poorer discrimination than when all 40 items were included. The results Suggest that decisions to exclude items on the basis of factor analysis may be inappropriate and risk serious loss of power in classifying individuals by sex-type.     

Adaptive Visual Analog Scales (AVAS): A modifiable software program for the creation,administration, and scoring of visual analog scales

The Adaptive Visual Analog Scales is a freely available computer software package designed to be a flexible tool for the creation, administration, and automated scoring of both continuous and discrete visual analog scale formats. The continuous format is a series of individual items that are rated along a solid line and scored as a percentage of distance from one of the two anchors of the rating line. The discrete format is a series of individual items that use a specific number of ordinal choices for rating each item. This software offers separate options for the creation and use of standardized instructions, practice sessions, and rating administration, all of which can be customized by the investigator. A unique participant/patient ID is used to store scores for each item, and individual data from each administration are automatically appended to that scale’s data storage file. This software provides flexible, time-saving access for data management and/or importing data into statistical packages. This tool can be adapted so as to gather ratings for a wide range of clinical and research uses and is freely available at www.nrlc-group.net.     

A confirmatory factor analysis of the Bem Sex Role Inventory: Old questions,new answers

LISREL analyses of data from a sample of 671 adults (90% Caucasian, 10% Black) evaluated (a) item factor structure of the Bem Sex Role Inventory (BSRI), (b) second-order factor model for the item factors, and (c) structural equation models estimating age and gender differences in these factors. Seven first-order item factors were extracted and found to have equivalent factor loadings for males and females. Item factors were related to two second-order factors: Masculinity and Femininity. There were relatively small age and gender differences in the first- and second-order factors. There was a differential relationship between self-rated masculinity and femininity and the first-order BSRI item factors for males and females. Results suggest that the BSRI best assesses gender-related personality traits and represents only one component of the complex multidimensional construct of gender roles.We thank Herbert W. Marsh and an anonymous reviewer for valuable comments on previous drafts of this article.     

The Relationship Between Masculinity,Femininity, and Criminal Thinking in Male and Female Offenders

The 4 factor scales of the Psychological Inventory of Criminal Thinking Styles (PICTS) were correlated with the Femininity and Masculinity scales of the Bem Sex Role Inventory (BSRI) in 100 adult male (33% Caucasian, 44% African American, 21% Hispanic, 1% other) and 100 adult female (50% Caucasian, 30% African American, 8% Hispanic, 12% other) federal prison inmates. It was hypothesized that the BSRI Masculinity scale would correlate negatively with the PICTS problem avoidance scale and positively with the PICTS self-deception/assertion scale, and that the BSRI Femininity scale would correlate negatively with the PICTS interpersonal hostility scale and positively with PICTS denial of harm scale. In male inmates, as predicted, the BSRI masculinity scale correlated negatively with the PICTS problem avoidance scale and positively with the self-deception/assertion scale, although the latter coefficient fell short of statistical significance. In the case of female inmates the BSRI femininity scale correlated positively with denial of harm but failed to correlate significantly with interpersonal hostility. The implications of these results are discussed.     

Psychometric Properties of the Wisconsin Schizotypy Scales in an Undergraduate Sample: Classical Test Theory,Item Response Theory,and Differential Item Functioning

The Wisconsin Schizotypy Scales are widely used for assessing schizotypy in nonclinical and clinical samples. However, they were developed using classical test theory (CTT) and have not had their psychometric properties examined with more sophisticated measurement models. The present study employed item response theory (IRT) as well as traditional CTT to examine psychometric properties of four of the schizotypy scales on the item and scale level, using a large sample of undergraduate students (n = 6,137). In addition, we investigated differential item functioning (DIF) for sex and ethnicity. The analyses revealed many strengths of the four scales, but some items had low discrimination values and many items had high DIF. The results offer useful guidance for applied users and for future development of these scales.     

Rating scales for hyperactivity: Concurrent validity,reliability, and decisions to label for the Conners and Davids abbreviated scales

Rating scales have become the instrument of choice in labeling and assessing change in behavior of hyperactive children. However, several criticisms have recently have levied against their use. The present investigation examined the concurrent validity, and inter- and intrarater reliability for the Abbreviated Teacer Questionnaire (ATQ, Conners, 1973) and the Rating Scales for Hyperkinesis (Davids, 1971). Sixteen teachers from two special and two regular schools (grades 1-4) rated 211 normal and 49 special children using both scales. High correlations were found suggesting excellent predictability between scales and considerable stability across time and rater. Lower scores on a subsequent rating relative to an initial rating were demonstrated, dependent on time between ratings but independent of (a) teacher expectation of treatment gains, (b) bias produced by rating selected children, and (c) whether children were hyperactive or normal. Use of initial and infrequent rating scores versus subsequent, closely spaced ratings was related to the rater's objective (e.g., diagnosis, treatment, or assessment).     

First steps in developing the Dutch version of the Bayley III: Is the original Bayley III and its item sequence also adequate for Dutch children?

The Bayley Scales of Infant and Toddler Development [Bayley III, Bayley, N. (2006). The Bayley scales of infant and toddler development. San Antonio, TX: The Psychological Corporation] is currently developed and exclusively normed for American children. In this study, the appropriateness of the Bayley III item content and item sequence for Dutch children was evaluated. The translated version, the Bayley-III-NL was evaluated in two phases. In phase 1 (N = 100), analyses showed that overall the item content seemed to be appropriate for Dutch children. In addition, the item sequence was found to be suitable for Dutch children. After phase 1, small adaptations were made to the instructions of a few items based on the experiences of the examiners to improve standardization in performance. In phase 2 (N = 400), the findings of phase 1 were confirmed in a larger sample. It is concluded that Dutch norms can be based upon the current version of the Bayley-III-NL.     

Masculine Instrumentality and Feminine Expressiveness: Their Relationships with Sex Role Attitudes and Behaviors

Data from the Bern Sex Role Inventory (BSRI) and the Personal Attributes Questionnaire (PAQ) Masculinity and Femininity scales have led to the hypothesis that androgynous individuals are more "behaviorally flexible" than others, manifesting both masculine and feminine role behaviors. Sex-role androgyny is also said to have other beneficial consequences such as high self esteem. The content of these instruments, however, is largely confined to socially desirable instrumental (masculine) and expressive (feminine) personality traits. A review of the literature indicates that these abstract trait dimensions have only minimal relationships with sex-role attitudes and sex-role behaviors not tapping instrumentality and expressiveness, and provide little support for the general behavioral flexibility hypothesis. Although PAQ and BSRI findings cannot be generalized to sex-role behaviors in general, the literature suggests that instrumentality and expressiveness per se have important implications. Appreciation of their contributions may be advanced more rapidly if these trait dimensions are disentangled from global concepts of sex-roles or masculinity, femininity, and androgyny.     

Homosexual and heterosexual sex-role orientation on six sex-role scales

A comparison was made of the sex roles of homosexual and heterosexual men and women on the Bem Sex Role Inventory, Personality Attributes Questionnaire, Personality Research Form Androgyny Scale, Adjective Checklist Masculinity and Femininity Scales, Extended Personality Attributes Questionnaire and Undesirable Characteristics Scale. The results indicated that homosexuals and heterosexuals differ in their response to different aspects of sex roles. The most consistent difference was the greater femininity of male homosexuals in respect to male heterosexuals. Other differences were scale-specific and the low interscale comparability indicated such scales should not be used interchangeably. Differences between results of studies comparing sex roles of the homosexuals and heterosexuals appear attributable to sample heterogeneity and distinctions between sex-role scales.     

Self-rated adjustment and sex-typing on the Bem Sex-Role Inventory: Is masculinity the primary predictor of adjustment?

Questions concerning the relationship between self-rated adjustment and the Bem Sex-Role Inventory (BSRI) were examined in two studies. In Study I, whether sex-typing was defined by Bem's original t-test criterion or the newer median-split criterion, superior adjustment was associated with androgynous vs. traditional typing only among women, not men. Also in conflict with the androgyny position, adjustment differences among sex-types were accounted for by differences in masculinity, not in femininity or androgyny per se. The greater contribution of masculinity vs. femininity to self-rated adjustment may be exaggerated because BSRI femininity includes items which do not load on a unidimensional femininity factor. In Study II, inspection of these unrelated items suggested that they reduce the desirability of BSRI femininity, thereby reducing its relationship to adjustment. Comparisons between standard BSRI scoring and an alternative based on unidimensional subscales revealed that the alternative femininity subscale was judged to be more desirable, and it reduced the degree of difference between masculinity and femininity in their relationships to adjustment. Superior adjustment, however, was again associated with androgynous vs. traditional sex-typing only among women, and adjustment differences among sex-types were again accounted for by differences in masculinity.The authors acknowledge the assistance of the following persons who helped in the administration, scoring, or preparation of questionnaire materials: Jill Jamison, Eric Isberg, Kay Peter, Steve Zalinger, Walter Davis, James Ball, Mark Jensen, and Heidi Sanft. Correspondence should addressed to Dr. Louise Silvern, Psychology Department, University of Colorado, Boulder, Colorado 80309.     

Units of analysis and item statistics for environmental assessment scales

Choice of units of analysis is a critical problem in evaluating environmental assessment items. The “Ecological Fallacy” involves interpreting results based on ecological entities, such as environmental settings, as applying to individuals. A less familiar error, the “Individual Differences Fallacy,” involves interpreting results based on individuals as applying to settings. Although this second error has been ubiquitous, little is known about the empirical consequences of using different units of analysis in item analysis. This study examined this issue when the units were (1) individuals, (2) observed settings, or (3) “artificial” or random settings. Neither item validities based on individuals nor item validities based on settings yielded unequivocal results. However, a measure developed specifically for environmental research, the Split-Sample Correlation, appeared useful for identifying environmental items. Researchers constructing environmental assessment scales should select items with both high Split-Sample Correlations and high setting-level item validities.     

Units of analysis and item statistics for environmental assessment scales

Choice of units of analysis is a critical problem in evaluating environmental assessment items. The “Ecological Fallacy” involves interpreting results based on ecological entities, such as environmental settings, as applying to individuals. A less familiar error, the “Individual Differences Fallacy,” involves interpreting results based on individuals as applying to settings. Although this second error has been ubiquitous, little is known about the empirical consequences of using different units of analysis in item analysis. This study examined this issue when the units were (1) individuals, (2) observed settings, or (3) “artificial” or random settings. Neither item validities based on individuals nor item validities based on settings yielded unequivocal results. However, a measure developed specifically for environmental research, the Split-Sample Correlation, appeared useful for identifying environmental items. Researchers constructing environmental assessment scales should select items with both high Split-Sample Correlations and high setting-level item validities.