Differential Item Functioning of the Emotional and Behavioral Screener for Caucasian and African American Elementary School Students

The present study examined the psychometric properties of a universal screening instrument called the Emotional and Behavioral Screener (EBS), which is designed to identify students exhibiting emotional and behavioral problems. The primary purposes of this study were to assess the measurement invariance of EBS items between Caucasian and African-American students and to assess the impact of differential item functioning (DIF) on EBS scores. The sample consisted of 946 elementary students from throughout the U.S. The findings suggested that EBS items exhibited small to negligible levels of DIF, and that DIF did not significantly impact EBS scores. The results supported the EBS as universal screening instrument that is fair in measuring the emotional and behavioral risk of elementary students. Research limitations and implications for school professionals are discussed.     

The Illness/Injury Sensitivity Index: Validation of a German Version of the ISI-R

Three fundamental fears-anxiety sensitivity, fear of negative evaluation, and illness/injury sensitivity-are considered integral components of anxiety-related psychopathology and also bear connections with chronic pain. Scales measuring the first two fears, the Anxiety Sensitivity Index and the Fear of Negative Evaluation Scale, have been translated into German; however, the nine-item Illness/Injury Sensitivity Index-Revised (ISI-R) that measures fears of injury and illness has not been available in German language yet. The aim of this study therefore was a translation of the ISI-R into German language and an initial validation of the translated scale in two different samples. The German ISI-R was translated by both professionals and laypersons, and a final version was decided on by consensus. In Study 1, participants included 96 undergraduate students (85% women) who completed the German version of the ISI as part of a larger study. An exploratory factor analysis with oblique rotation was conducted and suggested a two-factor-solution with one factor representing fears of illness and the other fears of injury. This factor structure was confirmed via a confirmatory factor analysis (CFA) in Study 2. Participants included 117 community members (79% women). Convergent validity was supported using a visual analogue scale for fear of illness in both samples and the German translation of the Whiteley Index in Study. Overall, the results supported the German translation of the ISI-R. Comprehensive results, limitations, and directions for future research are discussed.     

The Illness/Injury Sensitivity Index: Validation of a German Version of the ISI-R

Three fundamental fears—anxiety sensitivity, fear of negative evaluation, and illness/injury sensitivity—are considered integral components of anxiety-related psychopathology and also bear connections with chronic pain. Scales measuring the first two fears, the Anxiety Sensitivity Index and the Fear of Negative Evaluation Scale, have been translated into German; however, the nine-item Illness/Injury Sensitivity Index-Revised (ISI-R) that measures fears of injury and illness has not been available in German language yet. The aim of this study therefore was a translation of the ISI-R into German language and an initial validation of the translated scale in two different samples. The German ISI-R was translated by both professionals and laypersons, and a final version was decided on by consensus. In Study 1, participants included 96 undergraduate students (85% women) who completed the German version of the ISI as part of a larger study. An exploratory factor analysis with oblique rotation was conducted and suggested a two-factor-solution with one factor representing fears of illness and the other fears of injury. This factor structure was confirmed via a confirmatory factor analysis (CFA) in Study 2. Participants included 117 community members (79% women). Convergent validity was supported using a visual analogue scale for fear of illness in both samples and the German translation of the Whiteley Index in Study. Overall, the results supported the German translation of the ISI-R. Comprehensive results, limitations, and directions for future research are discussed.     

Direct behavior rating as a school-based behavior universal screener: Replication across sites

The purpose of this study was to evaluate the utility of Direct Behavior Rating Single Item Scale (DBR–SIS) targets of disruptive, engaged, and respectful behavior within school-based universal screening. Participants included 31 first-, 25 fourth-, and 23 seventh-grade teachers and their 1108 students, sampled from 13 schools across three geographic locations (northeast, southeast, and midwest). Each teacher rated approximately 15 of their students across three measures, including DBR–SIS, the Behavioral and Emotional Screening System (Kamphaus & Reynolds, 2007), and the Student Risk Screening Scale (Drummond, 1994). Moderate to high bivariate correlations and area under the curve statistics supported concurrent validity and diagnostic accuracy of DBR–SIS. Receiver operating characteristic curve analyses indicated that although respectful behavior cut scores recommended for screening remained constant across grade levels, cut scores varied for disruptive behavior and academic engaged behavior. Specific cut scores for first grade included 2 or less for disruptive behavior, 7 or greater for academically engaged behavior, and 9 or greater for respectful behavior. In fourth and seventh grades, cut scores changed to 1 or less for disruptive behavior and 8 or greater for academically engaged behavior, and remained the same for respectful behavior. Findings indicated that disruptive behavior was particularly appropriate for use in screening at first grade, whereas academically engaged behavior was most appropriate at both fourth and seventh grades. Each set of cut scores was associated with acceptable sensitivity (.79–.87), specificity (.71–.82), and negative predictive power (.94–.96), but low positive predictive power (.43–.44). DBR–SIS multiple gating procedures, through which students were only considered at risk overall if they exceeded cut scores on 2 or more DBR–SIS targets, were also determined acceptable in first and seventh grades, as the use of both disruptive behavior and academically engaged behavior in defining risk yielded acceptable conditional probability indices. Overall, the current findings are consistent with previous research, yielding further support for the DBR–SIS as a universal screener. Limitations, implications for practice, and directions for future research are discussed.     

Score comparability of a state mathematics assessment across students with and without reading accommodations

This study investigated the factorial invariance of a fourth-grade state mathematics assessment across groups of general education students and students with learning disabilities with and without reading accommodations. Confirmatory factor analysis was used to assess the fit of a 2-factor model to each of the 3 groups. In addition to the overall fit of this model, several levels of constraint were investigated. Invariance across the 3 groups was supported for factor loadings and intercepts. However, invariance of the factor covariances across the general education group and the groups of students with learning disabilities was not supported. Because of the implications for aggregating reported scores, further research is needed into the relationship between the factors in the different groups.     

University Student Depression Inventory: Measurement model and psychometric properties

University Student Depression Inventory (USDI) was developed to assess the symptoms of depression among the university students. Considering the debilitating nature of depression among university students globally, USDI was translated in Persian and validated using university students from Iran. A battery including the Persian version of USDI and scales measuring suicide, depression, and stress was administered to a normative sample of 359 undergraduate students, and an additional clinical sample of 150 students referred to the university's mental health centre. The results supported the factor structure and the psychometric properties of the translated version. Confirmatory factor analysis upheld the previously reported three‐factor first‐order and one‐factor second‐order structure. The internal consistency, test‐retest reliability, and concurrent and discriminant validity of the Persian version were supported. Cut‐off points using receiver operating characteristic curve analysis were established to identify students at risk. Gender differences on the symptoms of depression were evident only in the normative sample, where male participants, compared with female students, had higher mean scores in lethargy, cognitive/emotion, and academic motivation subscales. The translated scale can be used with Persian‐speaking students in Iran and the neighbouring countries as well as those settled in the West to identify symptoms of depression for further evaluation and management.     

Curriculum-based measurement of oral reading (R-CBM): A diagnostic test accuracy meta-analysis of evidence supporting use in universal screening

A great deal of research over the past decade has examined the appropriateness of curriculum-based measurement of oral reading (R-CBM) in universal screening. Multiple researchers have meta-analyzed available correlational evidence, yielding support for the interpretation of R-CBM as an indicator of general reading proficiency. In contrast, researchers have yet to synthesize diagnostic accuracy evidence, which pertains to the defensibility of the use of R-CBM for screening purposes. The overall purpose of this research was to therefore conduct the first meta-analysis of R-CBM diagnostic accuracy research. A systematic search of the literature resulted in the identification of 34 studies, including 20 peer-reviewed articles, 7 dissertations, and 7 technical reports. Bivariate hierarchical linear models yielded generalized estimates of diagnostic accuracy statistics, which predominantly exceeded standards for acceptable universal screener performance. For instance, when predicting criterion outcomes within a school year (≤ 9 months), R-CBM sensitivity ranged between .80 and .83 and specificity ranged between .71 and .73. Multiple moderators of R-CBM diagnostic accuracy were identified, including the (a) R-CBM cut score used to define risk, (b) lag in time between R-CBM and criterion test administration, and (c) percentile rank corresponding to the criterion test cut score through which students were identified as either truly at risk or not at risk. Follow-up analyses revealed substantial variability of extracted cut scores within grade and time of year (i.e., fall, winter, and spring). This result called into question the inflexible application of a single cut score across contexts and suggested the potential necessity of local cut scores. Implications for practices, directions for future research, and limitations are discussed.     

Factorial invariance and latent mean differences of the Beck Depression Inventory – second edition (BDI-II) across gender in South African university students

This study examined the measurement invariance of scores from the BDI-II as well as the differences in latent mean scores by gender. Participants were 919 South African university students (females = 72%). They completed the BDI-II, which is a measure of Negative Attitude (NA), Performance Difficulty (PD), Somatic Complaints (S) and Depression (D). The data were analysed utilising multigroup confirmatory factor analyses (MCFA). Evidence of factorial invariance was established at the level of configural, metric and scalar invariance, across gender groups. Females scored significantly higher latent means on measures of NA and S compared to males.     

The Italian version of the Inventory of Interpersonal Problems Personality Disorders Scales (IIP-47): psychometric properties and clinical usefulness as a screening measure

The Inventory of Interpersonal Problems-47 (IIP-47) is a brief and valid self-report measure for screening Personality Disorders (PDs). This study examined internal consistency, factor structure, criterion validity, temporal stability, and operating characteristics of the Italian version of the IIP-47 in two independent samples: PD subjects (n = 120) and nonclinical subjects (n = 475). Alpha coefficients ranged from .70 to .90. Multiple-Group Confirmatory Factor Analyses showed that the five-correlated-factor model reported in literature had the highest measurement invariance across the two groups. Criterion validity was supported by correlations among IIP-47 scale scores and scores on established measures of personality dimensions and pathology. Test-retest indices ranged from .71 to .95. PD subjects scored significantly higher than nonclinical subjects on all IIP-47 scales and cut-off scores for different levels of specificity and sensibility are reported. It is concluded that the psychometric properties of the original IIP-47 were preserved in its Italian version.     

Measurement invariance of the Utrecht Work Engagement Scale for Students: A study across secondary school pupils and university students

School engagement is a multidimensional construct characterized by vigour, dedication, and absorption towards academic work that is related to school achievement. This study aimed to examine the measurement invariance of a school engagement measure – the Utrecht Work Engagement Scale-Students (UWES-S) – across secondary school pupils and university students. Two samples of secondary school pupils (n = 251) and university students (n = 229) were used. The results supported the original three-factor structure (vigour, dedication and absorption) of the UWES-S instead of a two- or a one-factor structure in both samples. Evidence for the metric and scalar invariance of the measure across secondary school pupils and university students was also found. The university sample had higher scores in vigour and absorption but not in dedication. These findings demonstrate that the UWES-S can be used for developmental studies where school engagement and its relation with other variables needs to be compared across distinct educational levels.     

A closer look at the measurement of dispositional reasoning: Dimensionality and invariance across assessor groups

Despite the growing interest in dispositional reasoning as a construct and determinant of good raters (‘good judges’), its measurement still requires attention. We address two measurement issues in the present study. First, this study tests a hierarchical model as a more parsimonious account for dispositional reasoning than component‐ or general‐factor models that were examined in earlier studies. So, this provides a more comprehensive test of the different measurement models underlying dispositional reasoning data. Second, we assess the measurement invariance of dispositional reasoning measure scores across two different populations of assessors that are often trained and used in workplace assessments, namely psychology students (N = 161) and managers (N = 160). Results showed that dispositional reasoning is well represented as componential in nature, with a higher‐order construct underlying three lower‐order components. A comparison of managers and psychology students through measurement invariance analysis showed relatively similar factor structures underlying dispositional reasoning scores across these groups, but metric invariance could be only partially established.     

Measuring adult attachment: a construct validation of two self-report instruments

This study reports the Swedish construct validation of two translated attachment style scales. The factor structure of the attachment construct was investigated via exploratory and confirmatory factor analyses of attachment scores from 515 students of a Swedish university. Results supported the expected two-factor solution, but found a three-factor solution to be a viable alternative. In addition, the attachment scales were compared with the Big Five personality inventory (NEO-PI), using a sample of 87 Swedish students, and found to have expected correlation to this scale.     

Assessment of Anxiety in Older Adults: Translation and Psychometric Evaluation of the German Version of the Geriatric Anxiety Scale (GAS)

Anxiety occurs frequently among older adults, and can have deleterious impacts on the quality of daily life. Due to the dearth of well-validated elder-specific anxiety screening instruments available in the German language, this study aimed to translate the Geriatric Anxiety Scale (GAS), a reliable and valid 30-item self-report screening instrument for assessing anxiety based on DSM-IV-TR diagnostic criteria (Segal et al. Journal of Anxiety Disorders, 24(7), 709–714, 2010a), into German, and to validate the new measure. The German version of the GAS was developed through a translation and back translation process, with careful attention paid to culturally-sensitive expressions of anxiety in the German older adult population. The final version of the German GAS was tested in a sample of 242 community-dwelling older adults (M_age?=?72.0 years, SD?=?6.9 years; 59 % women) who completed either an online (26 %) or a paper-pencil (74 %) version of the questionnaire. The findings confirmed the successful translation of the GAS into German and provided psychometric support for the new measure. The validation of the factor structure based on confirmatory factor analyses was in support of a unidimensional structure of the GAS-G. Correlational analyses with inventories measuring anxiety related and non-anxiety related personality traits additionally confirmed the convergent and discriminant validity of the GAS for use as an assessment measure for anxiety among German older adults.     

A culture-sensitive approach in the development of the Career Adapt-Abilities Scale in Iceland: Theoretical and operational considerations

The aim of this study was to develop a culturally sensitive version of the Career Adapt-Ability Scale (CAAS) in Iceland. First the translated international version of the 55-item CAAI designed to measure the four dimensions of career adaptability (concern, curiosity, control, and confidence) plus additional dimension called co-operation was administered to a sample of 491 secondary school students. Confirmatory factor analysis indicated that both the four- and five-dimensional model show an adequate fit in the sample. An emic evaluation of the international model indicated that new facets tentatively called fatalism and contribution might be relevant in Iceland. New contextualized Icelandic items were written resulting in a combined 89-item measure of international and indigenous items administered to a sample of 1249 university students. Exploratory factor analysis supported contribution as a separate dimension and was used to create Icelandic scales measuring six dimensions: co-operation, contribution, and the four original dimensions. Confirmatory factor analysis supported the fit of three alternative 4–6-dimensional international and Icelandic models and measures of career adaptability in Iceland. An emic approach is needed to understand the cultural specificity and universal aspects of career adaptability and to develop culturally sensitive measures for use in career counseling. Further research on co-operation and contribution as relational constructs is suggested.     

Collective moral disengagement: Initial validation of a scale for adolescents

Collective moral disengagement refers to shared group beliefs that morally justify negative actions. This study reports an initial validation of the newly developed Classroom Collective Moral Disengagement Scale (CCMDS) for adolescents. This self-report instrument assesses the degree to which mechanisms of moral disengagement are shared by students in their class. Data were collected from two samples of 486 and 654 adolescents attending middle and high schools in Italy. Through exploratory and confirmatory factor analyses the unidimensional structure of the scale was established. Multigroup analyses demonstrated configural, metric and scalar invariance of the model across age and gender groups. The final version of the scale consists of 17 items and it has good internal consistency and validity. It is concluded that the scale is a promising measure for research concerning group level morality.     

Validity of the German Test Anxiety Inventory (TAI‐G) in an Australian sample

Test anxiety (TA) is a prevalent issue among students that can result in deleterious consequences, such as underachievement. However, a contemporary measure that has been validated for use with Australian students seems to be lacking. This study, therefore, investigated the suitability of the German Test Anxiety Inventory (TAI‐G) for use with Australian university students. While the original TAI‐G contains 30 items and was designed to measure four factors (worry, emotionality, interference, and lack of confidence), differing factorial models have been supported in the literature using either the original or a shortened 17‐item version of the measure. These differing TAI‐G models were tested and compared in the current study via confirmatory factor analysis using 224 Australian university students. As expected, results supported the superior fit of the 17‐item four‐factor model. Additionally, the convergent validity of the measure was supported since measures of self‐esteem, self‐efficacy, and general anxiety were all found to correlate significantly with the TAI‐G in the hypothesised directions. Finally, the finding that all of the TAI‐G subscales had acceptably high reliabilities led to the conclusion that the 17‐item TAI‐G is a valid and reliable measure of TA in an Australian university population.     

Personal Values and Intended Self‐Presentation during Job Interviews: A Cross‐Cultural Comparison

This study examined the impact of personal values on intended self‐presentation during job interviews among German, Ghanaian, Norwegian, and Turkish students (total N= 1,474). We also sought to explain cultural differences in self‐presentation among these groups. The Cultural Impression Management Scale for applicants (CIM‐A) and the Portrait Values Questionnaire were administered. A multigroup MIMIC model with invariant measurement and structural weights was supported, in which achievement, security, and benevolence values predicted a latent impression management factor. Intended impression management scores were significantly higher in the Ghanaian and Turkish samples than in the Norwegian and German samples. Values (achievement and security) accounted for 19.6 per cent of the cross‐cultural differences in self‐presentation. Adding acquiescence as an additional predictor (interpreted here as a measure of communication style) decreased the cross‐cultural differences by 52.8 per cent. It is concluded that values are similarly related to intended self‐presentation across these four groups, even though the cross‐cultural differences in mean scores in both sets of variables were considerable.     

Children's Depression Inventory: invariance across children and adolescents with and without depressive disorders

In the study, the authors examined the measurement (configural, factor loadings, thresholds, and error variances) and structural (factor variances, covariances, and mean scores) invariance of the Children's Depression Inventory (CDI; Kovacs, 1992) across ratings provided by clinic-referred children and adolescents with (N = 383) and without (N = 412) depressive disorders. Multiple-group confirmatory factor analysis of the Craighead, Smucker, Craighead, and Ilardi (1998) CDI model supported full measurement invariance and invariance for structural variances and covariances. Invariance for thresholds was also supported by multiple indicators multiple causes (MIMIC) procedures that controlled for the effects of age; sex; and the presence or absence of anxiety disorders, attention-deficit/hyperactivity disorder, and oppositional defiant/conduct disorders. The MIMIC analyses showed that for latent mean scores, the group with depressive disorders had higher scores, with at least medium effect sizes, for Self-Deprecation and Biological Dysregulation. The theoretical, psychometric, and clinical implications of the findings are discussed.     

Measurement invariance of the Emotion Regulation Questionnaire (ERQ). A cross-national validity study

The goal of this research was to examine the measurement invariance of the Emotion Regulation Questionnaire (ERQ; Gross & John, 2003) across two European nations. Participants were Italian and German undergraduate students. First, confirmatory factor analysis was used to test for the two-factor structure of the ERQ; subsequently, measurement invariance was analysed. The results showed acceptable fit indices for the German and Italian sample; however, results with regard to the Italian sample showed lower fit indices than results regarding the German one. Measurement invariance of the ERQ across Italy and Germany was confirmed. Despite the fact that we assumed measurement invariance of the ERQ, future research is needed to deal with the lower fit regarding the Italian version.     

Monitoring and Fostering Elementary School Students' Life Satisfaction: A Case Study

Research on the importance of complete mental health has led to increased focus on students' subjective well-being (i.e., happiness and life satisfaction) coupled with the traditional attention to psychopathology. Although screeners for psychopathology abound, the present project is novel in applying best practices in universal screening to grade level-wide assessment of children's life satisfaction, followed by implementation of a positive psychology intervention for students identified through the screener. In this case study of 375 third- to fifth-grade students in one elementary school, 93.6% participated in the screening, 11.2% qualified for supplemental services based on screening cutoff scores, and 4.8% took part in the targeted intervention to improve subjective well-being. Repeated measures analysis of mean scores revealed the intervention increased children's life satisfaction, lending support for the value of universal screeners in the process of service delivery. Implications for practice regarding universal screening and intervention for life satisfaction are discussed.