Students' Perceptions of Multicultural Training in Counseling Psychology Programs

The Multicultural Competency Checklist (Ponterotto, Alexander, & Grieger, 1995) was used to assess counseling psychology students' perceptions of multicultural training in their programs. Results revealed that most students perceived their programs to (a) have a required multicultural counseling course, (b) employ diverse teaching strategies and procedures, (c) use varied methods of evaluating performance, and (d) have faculty members whose primary research interest was in multicultural issues. Alternatively, many students reported that their programs did not (a) have appropriate representation of bilingual individuals on the faculty, (b) demonstrate adequate leadership and support with regard to multicultural issues, (c) use assessment instruments in evaluating their level of multicultural competency, and (d) make available a “multicultural resource center” for their use. The importance of integrating multicultural issues throughout academic programs is also discussed.     

Development of the Multicultural Mental Health Awareness Scale

The present study describes the development of an instrument to assess the multicultural competencies of mental health professionals in Australia. The scale was developed to assess the effectiveness of a multicultural mental health training program. Mental health professionals from Queensland, Australia (N = 268) participated in the study by completing a questionnaire battery. Items on the new scale were generated to parallel the Queensland Transcultural Mental Health Centre (QTMHC) training program's objectives. The results describe a 35‐item Multicultural Mental Health Awareness Scale. Factor analysis of the scale indicated three factors of multicultural counselling competencies: Awareness, Knowledge, and Skills. These factors were in line with the Sue et al. (1982) multicultural counselling competencies. The scale has satisfactory internal consistency, test–retest reliability, concurrent validity, and discriminant validity and can be used to evaluate the effectiveness of the multicultural competency training programs in mental health.     

Multicultural competency in research: examining the relationships among multicultural competencies, research training and self-efficacy, and the multicultural environment

Research on multicultural competencies has mainly focused on the practice dimension of psychology training and practice. Little theoretical or empirical research has examined multicultural research training and self-efficacy. In this study, 119 psychology graduate students filled out a Web survey focusing on the research training environment, research self-efficacy, multicultural competency, the multicultural environment, and social desirability. Results showed that multicultural competency, research training, and the multicultural environment were related to multicultural research self-efficacy. Hierarchical regressions showed that multicultural competency predicted students' research anxiety; social desirability predicted multicultural research utility, multicultural competency, and the research training environment; and multicultural competency predicted students' confidence in research and perceptions that their graduate training programs were multicultural. Implications are discussed.     

A REVIEW AND EVALUATION OF THE PSYCHOMETRIC PROPERTIES OF THE JOB DIAGNOSTIC SURVEY

Empirical research is reviewed to evaluate the test-retest reliability, internal consistency, scale discrimination, factorial validity, convergent validity across raters and methods, and methods bias of the Job Diagnostic Survey (JDS) of Hackman and Oldham (1975, 1980). The review shows that the JDS has important psychometric limitations, but is able–when used properly–to provide useful information about perceived job properties. Suggestions are made for improving the JDS and for developing additional instruments that assess a broader array of job dimensions and that assess them more objectively than current measures. Job characteristics researchers need a diverse portfolio of measures to accomplish different purposes.     

Issues of Reliability in Measuring Intimate Partner Violence during Courtship

The current paper focuses on problems in conceptualizing and establishing reliability when using self-administered measures of intimate partner violence to assess dating violence. Establishing reliability is an important step in the development of dating violence assessment instruments. However, the nature of dating violence can make it difficult to establish reliability. Most notably, measures of intimate partner violence in courtship yield data that are positively skewed, with almost no one reporting high levels of violence. This could have implications for the calculation of several forms of reliability that assume normality (e.g., Pearson correlations, intraclass correlations). In addition, there are other characteristics of dating violence that could impact reliability. For example, partner violence perpetrators do not necessarily use multiple acts (internal consistency reliability) or repeat specific acts (test-retest reliability). And, gender differences in the perception of partner violence may influence intra-couple reliability in heterosexual couples. Finally, statistical interdependence within couples makes current intra-couple reliability assessment suspect. Research is reviewed and recommendations are made concerning the establishment of test-retest reliability, intra-couple reliability, and internal consistency reliability for measures of dating violence.     

Clients' ratings of counselor multicultural competency

Differences in perceptions between Euro American and ethnic minority respondents were examined to compare the role of counselor multicultural competency in multicultural versus traditional counseling. Results showed a strong positive correlation between clients' ratings of counselors' multicultural competencies and clients' ratings of counselors' general competency and empathy. However, when comparisons were made between Euro American and ethnic minority clients' on satisfaction, counselor multicultural competency explained a large and significant amount of variance for the ethnic minority sample only, above and beyond counselor general competency and empathy. Results are discussed in the context of relevant literature and suggestions for future research.     

Multicultural Training in Spirituality: An Interdisciplinary Review

Is spiritual diversity a neglected dimension in preparation for multicultural competency? The authors present an interdisciplinary overview of research related to multicultural training in spirituality and religion to address this issue. Findings indicate that counseling program leaders have minimal preparation in spiritual and religious diversity and interventions. In addition, spiritual and religious themes appear to be minimally included in counseling program curricula. Some evidence also indicates that religious and spiritual diversity is not considered as important in multicultural training as are other kinds of diversity. A movement to include spirituality and religious content in accreditation guidelines, however, points to a possible shift to expand preparation for religious and spiritual competency. The article concludes with implications for counselor preparation and supervision.     

Measurement issues in family assessment: the case of the Family Environment Scale

The internal consistency reliabilities of 5 subscales of the Family Environment Scale were re-examined in a study of 311 stressed and 74 control families. The reliability coefficients generated were lower than those originally reported for this instrument; most coefficients generated were below the acceptable level for practical or research use, and there was considerable variation in the reliabilities across type of stressed family. An attempt to generate more reliable scales using the original items was unsuccessful, and questions about the validity of the subscales were raised. Our results illustrate the importance of examining reliabilities of instruments, even well-known and widely used instruments, for each sample studied.     

测验信度估计：从α系数到内部一致性信度

沿用经典的测验信度定义, 简介了信度与a 系数的关系以及a系数的局限。为了推荐替代a系数的信度估计方法, 深入讨论了与a 系数关系密切的同质性信度和内部一致性信度。在很一般的条件下, 证明了a 系数和同质性信度都不超过内部一致性信度, 后者不超过测验信度, 说明内部一致性信度比较接近测验信度。总结出一个测验信度分析流程, 说明什么情况下a 系数还有参考价值; 什么情况下a 系数不再适用, 应当使用内部一致性信度(文献上也常称为合成信度)。提供了计算同质性信度和内部一致性信度的计算程序, 一般的应用工作者可以直接套用。     

Parental beliefs and practices concerning motor development: Testing new tools

The parental beliefs on motor development (PB-MD) and the motor habits (MOHAB) questionnaires are new instruments measuring parental beliefs, practices, infant MOHAB, and environmental features regarding motor development. Psychometric properties of these questionnaires were tested using data of parents of 268 Dutch and Israeli infants aged 1-to-8-months. Face- and convergent validity of both questionnaires, as well as internal consistency and test–retest reliability of the PB-MD were satisfactory. Exploratory factor analysis revealed five factors in the PB-MD. Altogether, both questionnaires are valid, reliable and culturally sensitive instruments potentially useful for research and clinical practice.     

Internal Consistency and Power When Comparing Total Scores from Two Groups

Researchers now know that when theoretical reliability increases, power can increase, decrease, or stay the same. However, no analytic research has examined the relationship of power to the most commonly used type of reliability—internal consistency—and the most commonly used measures of internal consistency, coefficient alpha and ICC(A,k). We examine the relationship between the power of independent samples t tests and internal consistency. We explicate the mathematical model upon which researchers usually calculate internal consistency, one in which total scores are calculated as the sum of observed scores on K measures. Using this model, we derive a new formula for effect size to show that power and internal consistency are influenced by many of the same parameters but not always in the same direction. Changing an experiment in one way (e.g., lengthening the measure) is likely to influence multiple parameters simultaneously; thus, there are no simple relationships between such changes and internal consistency or power. If researchers revise measures to increase internal consistency, this might not increase power. To increase power, researchers should increase sample size, select measures that assess areas where group differences are largest, and use more powerful statistical procedures (e.g., ANCOVA).     

Using a Multicultural Framework to Assess Supervisees' Perceptions of Culturally Competent Supervision

Multicultural competency has been identified as essential to effective and ethical practice, particularly in the area of trainee supervision. Yet little is known about how multicultural issues are addressed in the supervision process. Counseling and psychology trainees who indicated a high degree of interest in multicultural issues were interviewed about their supervisory experiences to assess their perceptions of culturally competent supervision. Constant comparative methodology was used to analyze the data. Limitations and implications for research are discussed.     

Multicultural and Social Justice Counseling Competency Research: Opportunities for Innovation

The development of the Multicultural and Social Justice Counseling Competencies (Ratts, Singh, Nassar-McMillan, Butler, & McCullough, 2015) provides a framework to reflect upon previous scholarship and explore further approaches for methodological innovation in counseling. The author presents available counseling and interdisciplinary scholarship related to multicultural and social justice competency, identifies gaps and future research directions of that research, and proposes innovative strategies and methods for conducting rigorous multicultural and social justice research. Implications for preparing future counseling scholars are also included.     

Battered Woman Syndrome Questionnaire (BWSQ) Subscales: Development,Reliability, and Validity

ABSTRACT

The current study describes the development and evaluation of the reliability and validity of four components of a comprehensive assessment designed for the purpose of identifying women who manifest symptoms due to an intimate partner violence (IPV) relationship: The Battered Woman Syndrome Questionnaire (BWSQ). More specifically, the purpose of this study was to evaluate the factor structure, validity, temporal stability and internal consistency of four instruments for measuring current functioning of IPV survivors; (a) Interpersonal relationship (BWSQ-IR), (b) Sexual Dysfunction (BWSQ-SD), (c) Body Image (BWSQ-BI), and (d) Post-Traumatic Stress Checklist (BWSQ-PTSC). Overall, results indicate the BWSQ subscales have good temporal stability and internal consistency. Exploratory factor analysis of the four subscales indicate that each has a unidimensional factor structure. Internal consistency was high for each of the subscales. A two-way mixed effects model, intraclass correlation was used to demonstrate a high degree of test-retest reliability. Convergent and discriminant validity was demonstrated by comparing each subscale with the Revised Adult Attachment Scale (AAS), the Derogatis Interview of Sexual Functioning – Sexual Response (DISF-SR), the Objectified Body Consciousness Scale (OBCS) and the Trauma Symptom Inventory (TSI). The four instruments demonstrate sound psychometric properties as standalone measures as well as subscales of the BWSQ.     

Development and Validation of a Parent Report Measure for Assessing Social-Emotional Competencies of Children and Adolescents

Based on the premises that strength-based assessment of children and adolescents is an important emerging area, and that additional tools for this purpose are needed, this study details development and validation efforts on a new strength-based assessment: the Social-Emotional Assets and Resilience Scale, parent form (SEARS-P). Following careful development of a comprehensive research prototype assessment, a large and diverse nationwide sample of more than 2,000 ratings of school-age children and adolescents were obtained from their parents and other caregivers. Factor analytic procedures revealed a robust and replicable underlying factor structure, including Self-Regulation/Responsibility, Social Competence, and Empathy factors. The factor scores and total score of the SEARS-P were shown to have strong internal consistency reliability, as well as strong interrater reliability between mother-father pairs who rated the same child. Convergent construct validity of the SEARS-P was established through findings of significant correlations with two established strength-based rating scales for use by parents. Construct validity of the SEARS-P was further bolstered through findings of significant gender differences in scores (with females rated as having higher levels of competency than males), as well as significant differences in scores based on educational disability status. Limitations and future research needs are discussed, as are implications of this study for research and practice with children and families.     

A Multicultural Competency Checklist for Counseling Training Programs

This brief report presents a Multicultural Competency Checklist that can be used by counseling training programs as a pragmatic guide in multicultural program development. The Checklist includes 22 items organized along six major themes: minority representation, curriculum issues, counseling practice and supervision, research considerations, student and faculty competency evaluation, and physical environment. Guidelines for using the Checklist are provided.     

The reliability of eyetracking to assess attentional bias to threatening words in healthy individuals

Eyetracking is commonly used to investigate attentional bias. Although some studies have investigated the internal consistency of eyetracking, data are scarce on the test–retest reliability and agreement of eyetracking to investigate attentional bias. This study reports the test–retest reliability, measurement error, and internal consistency of 12 commonly used outcome measures thought to reflect the different components of attentional bias: overall attention, early attention, and late attention. Healthy participants completed a preferential-looking eyetracking task that involved the presentation of threatening (sensory words, general threat words, and affective words) and nonthreatening words. We used intraclass correlation coefficients (ICCs) to measure test–retest reliability (ICC > .70 indicates adequate reliability). The ICCs(2, 1) ranged from –.31 to .71. Reliability varied according to the outcome measure and threat word category. Sensory words had a lower mean ICC (.08) than either affective words (.32) or general threat words (.29). A longer exposure time was associated with higher test–retest reliability. All of the outcome measures, except second-run dwell time, demonstrated low measurement error (<6%). Most of the outcome measures reported high internal consistency (α > .93). Recommendations are discussed for improving the reliability of eyetracking tasks in future research.     

A behaviorally-based measure of manifest needs in work settings

This investigation represents an attempt to develop and validate a research instrument (Manifest Needs Questionnaire) capable of measuring the four needs of achievement, affiliation, autonomy, and dominance using behaviorally-based scales. The instrument is designed to measure such needs with specific reference to work settings and with minimal time requirements for completion. Results of both laboratory and field studies among 640 subjects indicate that the instrument exhibits acceptable levels of convergent, discriminant, and predictive validity, as well as reasonably high test-retest reliability and internal consistency. Results are compared to other, lengthier instruments designed to measure similar needs.     

The Relationship Between Racial Identity Development and Multicultural Counseling Competency: A Second Look

The relationship between racial identity development and multicultural counseling competency across a 2‐year period of time was examined in this study. Significant increases were found in multicultural counseling competency but not in their levels of racial identity development across time. Possible explanations for and limitations of this research are discussed. La relación entre el desarrollo de la identidad racial y la competencia para consejería multicultural a través de un período de dos años se examina en esta investigación. Se encuentran aumentos significantes en la competencia para consejería multicultural, pero no en el nivel de desarrollo de identidad racial a través del tiempo. Se examinan las posibles explicaciones y las limitaciones de esta investigación también.