The influence of item order on intentional response distortion in the assessment of high potentials: Assessing pilot applicants

An experiment was conducted to investigate the effects of item order and questionnaire content on faking good or intentional response distortion. It was hypothesized that intentional response distortion would either increase towards the end of a long questionnaire, as learning effects might make it easier to adjust responses to a faking good schema, or decrease because applicants' will to distort responses is reduced if the questionnaire lasts long enough. Furthermore, it was hypothesized that certain types of questionnaire content are especially vulnerable to response distortion. Eighty‐four pre‐selected pilot applicants filled out a questionnaire consisting of 516 items including items from the NEO five factor inventory (NEO FFI), NEO personality inventory revised (NEO PI‐R) and business‐focused inventory of personality (BIP). The positions of the items were varied within the applicant sample to test if responses are affected by item order, and applicants' response behaviour was additionally compared to that of volunteers. Applicants reported significantly higher mean scores than volunteers, and results provide some evidence of decreased faking tendencies towards the end of the questionnaire. Furthermore, it could be demonstrated that lower variances or standard deviations in combination with appropriate (often higher) mean scores can serve as an indicator for faking tendencies in group comparisons, even if effects are not significant.     

Combining mixture distribution and multidimensional IRTree models for the measurement of extreme response styles

Personality constructs, attitudes and other non-cognitive variables are often measured using rating or Likert-type scales, which does not come without problems. Especially in low-stakes assessments, respondents may produce biased responses due to response styles (RS) that reduce the validity and comparability of the measurement. Detecting and correcting RS is not always straightforward because not all respondents show RS and the ones who do may not do so to the same extent or in the same direction. The present study proposes the combination of a multidimensional IRTree model with a mixture distribution item response theory model and illustrates the application of the approach using data from the Programme for the International Assessment of Adult Competencies (PIAAC). This joint approach allows for the differentiation between different latent classes of respondents who show different RS behaviours and respondents who show RS versus respondents who give (largely) unbiased responses. We illustrate the application of the approach by examining extreme RS and show how the resulting latent classes can be further examined using external variables and process data from computer-based assessments to develop a better understanding of response behaviour and RS.     

MMPI-A structural summary variables: prevalence and correlates in an adolescent inpatient psychiatric sample

This study examined the prevalence and correlates of Archer and Krishnamurthy's MMPI-A Structural Summary (SS) dimensions in a sample of 632 adolescent psychiatric inpatients through a series of correlational analyses. These analyses examined the relationship between factor dimensions and categorically defined dimension elevations and external criterion measures that included chart review data, therapist ratings, chart diagnoses, and cognitive test performance. The SS dimensions provided additional interpretive yield for some within-normal-limits profiles. An examination of the pattern of correlations revealed small to moderate relationships between all SS variables and external criterion measures.     

The Rorschach Ego Impairment Index: prediction of treatment outcome in a child psychiatric population

In this study, we investigated the treatment utility of the revision of Perry and Viglione's (1991) Rorschach Ego Impairment Index (EII-2) in a sample of 53 child psychiatric inpatients. Parent ratings of symptomatic functioning on the Devereux Scales of Mental Disorders (DSMD; Naglieri, LeBuffe, & Pfeiffer, 1994) were obtained at admission, 30 days postdischarge, and 120 days postdischarge. EII-2 scores correlated with initial symptom elevations on the Critical Pathology at admission. EII-2 scores did not predict short-term response to treatment. However, EII-2 scores demonstrated moderate correlations with long-term outcome and relapse. EII-2 was related to prediction of worsening of symptoms between 30-day and 120-day follow-up as measured by Reliable Change Index scores that were computed for the Externalizing, Internalizing, Critical Pathology, and Total DSMD scales.     

Posttraumatic Stress Disorder and Appetitive Aggression in Rwandan Genocide Perpetrators

The objectives of this study were to investigate rates of posttraumatic stress disorder (PTSD) and levels of appetitive aggression and potential risk factors for appetitive aggression in a sample of 200 Rwandan genocide perpetrators. Five percent of the perpetrators presented with PTSD, and high levels of appetitive aggression were common. High levels of appetitive aggression were associated with male gender, a high number of past committed offenses, and low levels of positive and elevated levels of negative religious coping. Considering the substantial extent of appetitive aggression, the reintegration of these individuals into the community should consider the inclusion of programs that restrain appetitive aggression and restore psychological functioning to facilitate a peaceful coexistence.     

Measuring Response Styles Across the Big Five: A Multiscale Extension of an Approach Using Multinomial Processing Trees

This study shows how to address the problem of trait-unrelated response styles (RS) in rating scales using multidimensional item response theory. The aim is to test and correct data for RS in order to provide fair assessments of personality. Expanding on an approach presented by Böckenholt (2012), observed rating data are decomposed into multiple response processes based on a multinomial processing tree. The data come from a questionnaire consisting of 50 items of the International Personality Item Pool measuring the Big Five dimensions administered to 2,026 U.S. students with a 5-point rating scale. It is shown that this approach can be used to test if RS exist in the data and that RS can be differentiated from trait-related responses. Although the extreme RS appear to be unidimensional after exclusion of only 1 item, a unidimensional measure for the midpoint RS is obtained only after exclusion of 10 items. Both RS measurements show high cross-scale correlations and item response theory-based (marginal) reliabilities. Cultural differences could be found in giving extreme responses. Moreover, it is shown how to score rating data to correct for RS after being proved to exist in the data.     

International physical activity questionnaire: reliability and validity of the Turkish version

Physical inactivity is a global problem which is related to many chronic health disorders. Physical activity scales which allow cross-cultural comparisons have been developed. The goal was to assess the reliability and validity of a Turkish version of the International Physical Activity Questionnaire (IPAQ). 1,097 university students (721 women, 376 men; ages 18-32) volunteered. Short and long forms of the IPAQ gave good agreement and comparable 1-wk. test-retest reliabilities. Caltrac accelerometer data were compared with IPAQ scores in 80 participants with good agreement for short and long forms. Turkish versions of the IPAQ short and long forms are reliable and valid in assessment of physical activity.