Measuring moral reasoning using moral dilemmas: evaluating reliability,validity, and differential item functioning of the behavioural defining issues test (bDIT)

ABSTRACT

We evaluated the reliability, validity, and differential item functioning (DIF) of a shorter version of the Defining Issues Test-1 (DIT-1), the behavioural DIT (bDIT), measuring the development of moral reasoning. About 353 college students (81 males, 271 females, 1 not reported; age M = 18.64 years, SD = 1.20 years) who were taking introductory psychology classes at a public University in a suburb area in the Southern United States participated in the present study. First, we examined the reliability of the bDIT using Cronbach’s α and its concurrent validity with the original DIT-1 using disattenuated correlation. Second, we compared the test duration between the two measures. Third, we tested the DIF of each question between males and females. Findings reported that first, the bDIT showed acceptable reliability and good concurrent validity. Second, the test duration could be significantly shortened by employing the bDIT. Third, DIF results indicated that the bDIT items did not favour any gender. Practical implications of the present study based on the reported findings are discussed.     

Analyses of Model Fit and Robustness. A New Look at the PISA Scaling Model Underlying Ranking of Countries According to Reading Literacy

This paper addresses methodological issues that concern the scaling model used in the international comparison of student attainment in the Programme for International Student Attainment (PISA), specifically with reference to whether PISA’s ranking of countries is confounded by model misfit and differential item functioning (DIF). To determine this, we reanalyzed the publicly accessible data on reading skills from the 2006 PISA survey. We also examined whether the ranking of countries is robust in relation to the errors of the scaling model. This was done by studying invariance across subscales, and by comparing ranks based on the scaling model and ranks based on models where some of the flaws of PISA’s scaling model are taken into account. Our analyses provide strong evidence of misfit of the PISA scaling model and very strong evidence of DIF. These findings do not support the claims that the country rankings reported by PISA are robust.     

A Cross-Cultural Examination of the Relationship between Egalitarian Gender Role Attitudes and Life Satisfaction

In the present study, we investigated the relationship between egalitarian gender role endorsement, gender role satisfaction, and satisfaction with life among women in two cultural contexts, Kurdistan in Iraq and Norway, which differ widely in their acceptance of gender inequality according to the World Values Survey and the UN Gender Inequality Index. We predicted the relationship between egalitarian gender role endorsement (measured by the ENRICH- Equalitarian Roles Scale) and gender role satisfaction would vary across these two cultural contexts, but that gender role satisfaction would predict satisfaction with life in both cultures. Responses from 899 female university students (252 Kurdish and 246 Norwegian student teachers; 211 Kurdish and 190 Norwegian student nurses) confirmed our hypotheses. Egalitarian gender attitudes more strongly predicted gender role satisfaction in Norway than in Kurdistan (student teachers: r = .17 vs .07; nursing students: r = .37 vs. .18), but gender role satisfaction predicted life satisfaction in both cultures (r = .40 and .47; r = .49 and .47, respectively). Analyses confirmed that the mediating role of gender satisfaction was moderated by country. Our results shed light on the important role of gender satisfaction in explaining cultural differences in the relationship between egalitarian gender role attitudes and life satisfaction.     

Analysis of the gender variable in the EDTC using differential item functioning techniques

The aim of this work is to analyze the gender differences in the scales of a recently constructed test: the so-called EDTC. This test measures the following traits: sensation seeking, fearlessness, and impulsivity. Gender differences will be studied using Differential Item Functioning (DIF) techniques, in order to determine whether these differences are true differences in the assessed dimensions or if, on the contrary, they are the result of a mere artefact of the measuring instrument used. The methods used to study DIF are standardization, SIBTEST, logistic regression, Lord's chi 2 test, and indices based on the DFIT model. Despite the fact that some items with DIF exist, the gender differences observed seem to be the result of true differences in the measured personality constructs and they don't seem to be artificially produced by a bias in the test items.     

ASSESSING THE EFFECT OF COHORT,GENDER, AND RACE ON DIFFERENTIAL ITEM FUNCTIONING (DIF) IN AN ADAPTIVE TEST DESIGNED FOR MULTI-AGE GROUPS

Differential item functioning (DIF) statistics were computed using items from the Peabody Individual Achievement Test (PIAT)-Reading Comprehension subtest for children of the same age group (ages 7 through 12 respectively). The pattern of observed DIF items was determined by comparing each cohort across age groups. Differences related to race and gender were also identified within each cohort. Characteristics of DIF items were identified based on sentence length, vocabulary frequency, and density of a sentence. DIF items were more frequently associated with short sentences than with long sentences. This study explored the potential limitation in the longitudinal use of items in an adaptive test.     

The Gender Difference in the Association Between Early Onset of Drinking and Problem Drinking Between the U.S. and Japan

Using comparable survey data from the GENACIS Project, collected from representative samples of people aged 20 to 70 years old in the U.S. (n = 2,598) and Japan (n = 1,734), this study examined, across these two diverse societies, the gender difference in the association between the early onset of drinking and the development of drinking problems. The results of this study suggest that there does not appear to be a cross-national causal relationship between the early onset of drinking and problem drinking because of significant country and gender variations in this association and because there is no association found among Japanese females. As hypothesized, the early onset of drinking predicted problem drinking among males more strongly than among females in both countries.     

Measurement Equivalence Across Racial/Ethnic Groups of the Mood and Feelings Questionnaire for Childhood Depression

As research continues to document differences in the prevalence of mental health problems such as depression across racial/ethnic groups, the issue of measurement equivalence becomes increasingly important to address. The Mood and Feelings Questionnaire (MFQ) is a widely used screening tool for child and adolescent depression. This study applied a differential item functioning (DIF) framework to data from a sample of 6th and 8th grade students in the Seattle Public School District (N = 3,593) to investigate the measurement equivalence of the MFQ. Several items in the MFQ were found to have DIF, but this DIF was associated with negligible individual- or group-level impact. These results suggest that differences in MFQ scores across groups are unlikely to be caused by measurement non-equivalence.     

The role of language skills in perceived prosocialityin kindergarten boys and girls

The main goal of this study is to clarify the role of language in perceived prosociality according to the gender of the child by using a sample of 209 French-speaking children (93 girls and 116 boys) attending kindergarten (M = 66.8 months, SD = 3.7). In keeping with many studies on this subject, our results showed significant gender differences with respect to the prosociality of kindergarten children as perceived by their teachers. In parallel with gender differences in prosociality, hierarchical regression analyses revealed that the relation between language skills and assessments of prosociality by kindergarten teachers varies according to the gender of the child: language has an explanatory role in perceived prosociality for boys, but not for girls. Implications of these findings concerning the social role of sexes in education and avenues for future research are presented.     

Coping,social support,stigma, and gender difference among people living with HIV in Guangxi,China

The current study examined whether gender, HIV-related stigma, social support, and the interaction between gender and social support are associated with coping responses among people living with HIV and AIDS (PLWHA) in Guangxi, China. A total of 2987 PLWHA in Guangxi participated from October 2012 to August 2013. Multivariate analysis of covariance was conducted with gender and social support as main factors in the model, and stigma and other variables as covariates. After controlling for demographic variables and stigma, there were significant main effects of emotional social support (F = 1.61, p < .001), functional social support (F = 1.67, p < .001), and informational social support (F = 3.67, p < .001) on various coping strategies. The interaction between gender and informational social support (F = 1.33, p < .05), internalized stigma (F = 37.03, p < .001) and perceived stigma (F = 9.16, p < .001) were associated with various coping strategies. Findings signify the importance of HIV-related stigma and social support differences in the coping strategies among PLWHA in Guangxi, China.     

Investigation of Psychometric Properties of the Georgian Version of Posttraumatic Growth Inventory

This paper reports the analysis of psychometric properties of the Georgian version of the Posttraumatic Growth Inventory (PTGI-Geo). In particular, factor structure, internal consistency of the subscales, gender differences, and relation between traumatic event category and posttraumatic growth (PTG) are examined. The study had 641 participants in two studies (study 1, n = 300; study 2, n = 341 participants). The study revealed that PTGI-Geo consists of four factors, instead of the original five factors; namely, the first three factors (New Possibilities, Relation to Others, and Personal Strength) remained unchanged, while the fourth (Spiritual Change) and the fifth (Appreciation of Life) factors merged and formed a new fourth factor. All four new factors have similar internal consistency as the original inventory. There were also some between-person differences for gender consistent with other research.     

Illustration of MIMIC-Model DIF Testing with the Schedule for Nonadaptive and Adaptive Personality

This research provides an example of testing for differential item functioning (DIF) using multiple indicator multiple cause (MIMIC) structural equation models. True/False items on five scales of the Schedule for Nonadaptive and Adaptive Personality (SNAP) were tested for uniform DIF in a sample of Air Force recruits with groups defined by gender and ethnicity. Uniform DIF exists when an item is more easily endorsed for one group than the other, controlling for group mean differences on the variable under study. Results revealed significant DIF for many SNAP items and some effects were quite large. Differentially-functioning items can produce measurement bias and should be either deleted or modeled as if separate items were administered to different groups. Future research should aim to determine whether the DIF observed here holds for other samples.     

The Short Dark Triad (SD3): Adaptation and Psychometrics among At-Risk Male and Female Youths

The dark triad is a term used to describe a constellation of three socially harmful personality traits: Machiavellianism, psychopathy, and narcissism. The main aim of the present study was to examine the psychometric properties of the Short Dark Triad (SD3) scale, a brief measure of the dark triad, among a sample (N = 412) of male (n = 200) and female (n = 212) at-risk Portuguese youths. Confirmatory factor analysis revealed the three-factor structure of the SD3 obtained an adequate fit, and measurement invariance across gender was demonstrated, although two items per dimension had to be removed. The Portuguese version of the SD3 scale demonstrated satisfactory psychometric properties, specifically the properties of internal consistency, convergent validity, discriminant validity, and known-groups validity, which overall justifies its use among this population. Findings are discussed in terms of the use of the SD3 scale with male and female at-risk youths.     

Do Applicants and Incumbents Respond to Personality Items Similarly? A Comparison of Dominance and Ideal Point Response Models

This study used an ideal point response model to examine the extent to which applicants and incumbents differ when responding to personality items. It was hypothesized that applicants' responses would exhibit less folding at high trait levels than incumbents' responses. We used sample data from applicants (N=1,509) and incumbents (N=1,568) who completed the 16 Personality Questionnaire Select. Differential item (DIF) and test functioning (DTF) analyses were conducted using the generalized graded unfolding model, which is based on ideal point model assumptions. Out of the 90 items, 50 showed DIF; however, only 11 were in the hypothesized direction. DTF was significant for 3 of the 12 scales; 2 were in the hypothesized direction.     

Assessing Alexithymia: Psychometric Properties and Factorial Invariance of the 20-Item Toronto Alexithymia Scale in Nonclinical and Psychiatric Samples

The 20-item Toronto Alexithymia Scale (TAS-20) is a self-report questionnaire designed to measure the three components of alexithymia; difficulty identifying feelings in the self (DIF), difficulty describing feelings (DDF), and externally orientated thinking (EOT). We examined the scale’s psychometric properties in Australian nonclinical (N = 428) and psychiatric (N = 156) samples. In terms of factorial validity, confirmatory factor analyses found the traditional 3-factor correlated model (DIF, DDF, EOT) to be the best and most parsimonious solution, but it did not reach adequate levels of goodness-of-fit in either sample. Several EOT items loaded poorly on their intended factor, and a reverse-scored item method factor was present; the factor structure of the scale was invariant across both samples. A higher-order factor model (with a single higher-order factor) was slightly inferior to the correlated models, but still tenable. The total scale score and DIF and DDF subscales displayed sound internal consistency, but the EOT subscale did not. We conclude that the TAS-20 has, for the most part, adequate psychometric properties, though interpretation should focus only on the total scale score and DIF and DDF subscales; we recommend the EOT subscale score not be used. Implications for clinical use and future revision of the scale are discussed.     

经济法试题DIF的参数法检测研究

该研究基于项目反应理论的Samejima等级反应模型(GRM),在MULTILOG软件支持下,应用参数检测方法,对某年度全国性资格考试的某科目试卷中经济法部分的21个项目做了DIF检测分析。结果如下:存在性别DIF的项目一个,存在民族DIF的项目四个,存在工作性质DIF的项目一个。其中项目68在民族层面上表现为一致性DIF,项目64既存在民族DIF又存在工作性质DIF。通过对项目统计量、反应曲线的分析和专家的讨论,文章最后还分析了产生这些DIF的几个可能的原因。     

Differential Item Functioning on Antisocial Behavior Scale Items for Adolescents and Young Adults from Single-Parent and Two-Parent Families

We investigated measurement equivalence in two antisocial behavior scales (i.e., one scale for adolescents and a second scale for young adults) by examining differential item functioning (DIF) for respondents from single-parent (n = 109) and two-parent families (n = 447). Even though one item in the scale for adolescents and two items in the scale for young adults showed significant DIF, the two scales exhibited non-significant differential test functioning (DTF). Both uniform and nonuniform DIF were investigated and examples of each type were identified. Specifically, uniform DIF was exhibited in the adolescent scale whereas nonuniform DIF was shown in the young adult scale. Implications of DIF results for assessment of antisocial behavior, along with strengths and limitations of the study, are discussed.     

Examining the Relationship Between Gender DIF and Language Complexity in Mathematics Assessments

This study investigated whether the linguistic complexity of items leads to gender differential item functioning (DIF) on mathematics assessments. Two forms of a mathematics test were developed. The first form consisted of algebra items based on mathematical expressions, terms, and equations. In the second form, the same items were written as word problems without changing their contents and solutions. The test forms were given to a sample of 671 sixth-grade students from 10 middle schools in Turkey. The tests were administered to the students with a 4-week interval. Explanatory item response modeling and logistic regression approaches were used to examine gender DIF. Several word problems were flagged as having gender DIF in favor of female examinees, whereas mathematically expressed forms of the same items did not function differently across male and female examinees. The verbal content of word problems seems to influence the way males and females respond to items.     

Friendship competence in kindergarten and primary school children

Aim of this study was to confirm the increase of friendship competence and its multifactorial nature in kindergarten and primary school children and to verify gender differences, parenting and socioeconomic status influences on friendship concept. A semi-structured interview was administered in a natural context to 3–8 years-old children (N = 99; mean = 6.1 years; SD = 1.35). The coding provides five sub-categories: (1) friendship; (2) social perspective taking; (3) emotions understanding; (4) social interaction strategies; (5) aggressiveness. Three parental style questionnaires were administrated to parents. Results confirm the increasing of friendship competence according to age. No gender difference was found. Father's involvement in son's activities was inversely correlated with son's aggressivity.     

Being both – A European and a national citizen? Comparing young people’s identification with Europe and their home country across eight European countries*

Abstract

It is a well-established fact that forming a mature and coherent political identity is one developmental task in adolescence and young adulthood. However, given different degrees of commitment on the regional, national, and European level, the question remains whether young people’s identification varies among those spheres? Drawing on data from the European Catch-EyoU-project, it was the goal of this study to examine whether young people can be classified according to their identification toward their home country and Europe and how these types are associated with age, gender, country as well as political interest, tolerance, and political participation. The study is based on adolescents and young adults from the Czech Republic, Germany, Great Britain, Greece, Estonia, Italy, Portugal, and Sweden (N = 9339; Mage = 19.62; 59.1% female). Cluster analysis revealed five types of young people’s identification with country and Europe which showed significant associations between group membership and tolerance, political interest, and participation. The implications of distinguishing types of identification and their associations with political outcomes are discussed.