An Investigation of Interrater Reliability for the Rorschach Performance Assessment System (R–PAS) in a Nonpatient U.S. Sample

The Rorschach Performance Assessment System (R–PAS) aims to provide an evidence-based approach to administration, coding, and interpretation of the Rorschach Inkblot Method (RIM). R–PAS analyzes individualized communications given by respondents to each card to code a wide pool of possible variables. Due to the large number of possible codes that can be assigned to these responses, it is important to consider the concordance rates among different assessors. This study investigated interrater reliability for R–PAS protocols. Data were analyzed from a nonpatient convenience sample of 50 participants who were recruited through networking, local marketing, and advertising efforts from January 2013 through October 2014. Blind recoding was used and discrepancies between the initial and blind coders' ratings were analyzed for each variable with SPSS yielding percent agreement and intraclass correlation values. Data for Location, Space, Contents, Synthesis, Vague, Pairs, Form Quality, Populars, Determinants, and Cognitive and Thematic codes are presented. Rates of agreement for 1,168 responses were higher for more simplistic coding (e.g., Location), whereas agreement was lower for more complex codes (e.g., Cognitive and Thematic codes). Overall, concordance rates achieved good to excellent agreement. Results suggest R–PAS is an effective method with high interrater reliability supporting its empirical basis.     

Changes in the Rorschach and MMPI–2 After Electroconvulsive Therapy (ECT): A Collaborative Assessment Case Study

We used before-and-after testing with the Rorschach Inkblot Test (Exner, 1997/2003) and the Minnesota Multiphasic Personality Inventory–2 (Butcher et al., 2001 Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G. and Kaemmer, B. 2001. Minnesota Multiphasic Personality Inventory–2: Manual for administration, scoring, and interpretation, , rev. ed., Minneapolis: University of Minnesota Press.  [Google Scholar]) to assist a psychotherapy client—a survivor of child abuse suffering from depression accompanied by hallucinations—in evaluating a course of electroconvulsive therapy that she underwent. The results of both tests indicated positive changes. During the collaborative discussion of the test results, especially the changes seen on the Rorschach, a deeper understanding of her skeptical response to evidence of improvement came to light and helped to refocus the ongoing psychotherapy work.     

The Relevance of the Rorschach and Patient–Examiner Relationship in Treatment Planning and Outcome Assessment

In this era of evidence-based mental health care, traditional forms of depth-oriented psychotherapy and psychological assessment have been marginalized in graduate training in clinical psychology. As a counterpoint, this article presents the evaluation and treatment of an adolescent client, along with an outcome assessment, and illustrates ways that aspects of traditional psychological testing, including the Rorschach (Exner, 1986) and the patient–examiner relationship, can enhance psychodiagnosis and treatment planning. Additionally, this case illustrates ways that test data can illuminate the concept of underlying disturbance and its utility in diagnostic formulation, treatment planning, and outcome assessment.     

The Infant–Toddler Social and Emotional Assessment (ITSEA): Factor Structure, Reliability, and Validity

In this paper the refinement and psychometric properties of the Infant–Toddler Social and Emotional Assessment (ITSEA) are described. Results from a sociodemographically diverse birth cohort sample of 1,235 parents of children between the ages of 12 and 36 months are presented. Confirmatory factor analyses supported the hypothesized Internalizing, Externalizing, Regulatory, and Competence domains as well as the 17 individual scales that comprise the ITSEA. Findings for 3 additional indices useful in identifying significant psychopathology are presented. Subgroup analyses revealed structural invariance and expected mean level differences across both child sex and 6-month age bands. Child sex differences emerged for some problem and most competence scales, with boys rated as higher on Activity–Impulsivity and girls rated higher on Anxiety and most Competence scales. All competence scores increased across age groups. Problem behaviors showed a more mixed developmental pattern. Test–retest and interrater reliability were acceptable. Associations between the ITSEA and independent evaluator ratings and parental ratings of child behavior problems, temperament, and parental distress support the validity of the instrument.     

Reliability Generalization Study of the Yale–Brown Obsessive–Compulsive Scale for Children and Adolescents

The Yale–Brown Obsessive–Compulsive Scale for children and adolescents (CY–BOCS) is a frequently applied test to assess obsessive–compulsive symptoms. We conducted a reliability generalization meta-analysis on the CY–BOCS to estimate the average reliability, search for reliability moderators, and propose a predictive model that researchers and clinicians can use to estimate the expected reliability of the CY–BOCS scores. A total of 47 studies reporting a reliability coefficient with the data at hand were included in the meta-analysis. The results showed good reliability and a large variability associated to the standard deviation of total scores and sample size.     

The Test–Retest Reliability and Predictive Validity of a Battery of Newly Developed Occupational Performance Assessments

The Canadian Occupational Performance Measure was used as a tool to compare goals for intervention identified by seven clients living in a long-term residential program and diagnosed with schizophrenia, with their goals as identified by the occupational therapist. In-depth interviews were conducted in conjunction with the use of the Canadian Occupational Performance Measure. Data analysis revealed an overarching theme that described the clients' concerns as, “I want to accomplish goals outside of the residence program.” During the analysis, however, the data revealed that the occupational therapist primarily focused her attention on goals to be achieved within the residence program, emphasizing programming and symptom management as each client's priorities for intervention, rather than community involvement. The findings reveal how data from the Canadian Occupational Performance Measure was used to reveal client/therapist disconnect in goal setting and the need to continue to examine client-centered practices in mental health settings.     

Preschool Behavioral and Emotional Rating Scale (PreBERS): Test–Retest Reliability and Inter-Rater Reliability

The Preschool Behavioral and Emotional Rating Scale (PreBERS) is a standardized, norm-referenced instrument that assesses the emotional and behavioral strengths of preschool children. Two studies that investigated the test–retest and inter-rater reliability of the PreBERS are reported. In the first study, teachers rated preschool children (N = 96) on two occasions with 1 month between ratings. Reliability coefficients for the four subscales and total score of the PreBERS were all at or above 0.86. In the second study teachers and paraprofessionals rated the same preschool children (N = 88). All of the correlations were over 0.72. In both studies the magnitude of correlations were large indicating that the PreBERS is a stable measure across time and raters. Based on the data the PreBERS appears to be a psychometrically sound instrument appropriate for use with preschool children. Recommendations for use with preschool children as well as future research are discussed.     

The Assessment of Marital Adjustment with Muslim Populations: A Reliability Study of the Locke–Wallace Marital Adjustment Test

The Muslim population is growing rapidly throughout the world and a sizable population of 6–8 million Muslims is estimated in North America alone. This population deals with a vast array of issues, including marital adjustment. Nevertheless, the marriage and family literature lacks the research needed to facilitate therapeutic treatment with Muslim couples adequately. Marital adjustment assessments that are commonly utilized have been tested on predominantly Anglo-American or Caucasian couples. The present study is a preliminary investigation of the Locke–Wallace marital adjustment test’s (LWMAT) reliability when administered to married, Muslim-American people.     

Neuropsychological Behavioral Inhibition System (BIS) and Behavioral Approach System (BAS) Assessment: A Shortened Sensitivity to Punishment and Sensitivity to Reward Questionnaire Version (SPSRQ–20)

This research was designed to investigate the items and factor structure of the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ) proposed by Torrubia, Avila, Moltó, and Caseras (2001 Spielberger, C. D., Gorsuch, R. L. and Lushene, R. E. 1970. Manual for the State-Trait Anxiety Inventory., Palo Alto, CA: Consulting Psychologists Press.  [Google Scholar]), as a measure of the behavioral inhibition system and behavioral activation system in Gray's reinforcement sensitivity theory. Recent studies that analyzed this instrument by exploratory and confirmatory factor analysis suggest the need for structural refinement. The Spanish version of the SPSRQ was analyzed by exploratory and confirmatory procedures in calibration (n = 2,102) and validation (n = 746) independent samples. In addition, convergent and discriminant validity was evaluated with the Zuckerman–Kuhlman Personality Questionnaire (Zuckerman, Kuhlman, Teta, Joireman, &; Kraft, 1993 Torrubia, R. and Tobeña, A. 1984. A scale for the assessment of susceptibility to punishment as a measure of anxiety: Preliminary results. Personality and Individual Differences, 5: 371–375. [Crossref], [Web of Science ®] , [Google Scholar]), the Impulsiveness, Venturesomeness and Empathy Inventory (S. B. G. Eysenck, Pearson, Easting, &; Allsopp, 1985 Eysenck, S. B. G., Pearson, P. R., Easting, G. and Allsopp, F. J. 1985. Age norms for impulsiveness, venturesomeness and empathy in adults. Personality and Individual Differences, 6: 613–619. [Crossref], [Web of Science ®] , [Google Scholar]) the Neuroticism, Extraversion and Openness Five Factor Inventory (Costa &; McCrae, 1992 Costa, P. T. and McCrae, R. R. 1992. NEO–PI–R professional manual: Revised NEO Personality Inventory (NEO–PI–R) and NEO Five Factor Inventory (NEO–FFI), Odessa, FL: Psychological Assessment Resources.  [Google Scholar]), and the Barratt Impulsiveness Scales (Barratt, 1985 Ball, S. and Zuckerman, M. 1990. Sensation seeking, Eysenck's personality dimensions and reinforcement sensitivity in concept formation. Personality and Individual Differences, 11: 343–355. [Crossref], [Web of Science ®] , [Google Scholar]). Results showed the robustness of a 20-item structure of the SPSRQ, with satisfactory fit adjustment, validity, and reliability. The findings are discussed in terms of the better functioning and sound psychometric properties of the SPSRQ 20-item version for Gray's personality theory.     

The Association of Externalizing Behavior and Parent–Child Relationships: An Intergenerational Study

We investigated the influence of the child’s behavior on the quality of the mutual parent–child attachment relationships across three generations. We did so using a prospective longitudinal study which spanned 20 years from adolescence through adulthood. Study participants completed in-class questionnaires as students in the East Harlem area of New York City at the first wave and provided follow-up data at 4 additional points in time. 390 participants were included in these analyses; 59% female, 45% African American, and 55% Puerto Rican. Using structural equation modeling, we determined that externalizing behavior in the child was negatively related to the mutual parent–child attachment relationship for two generations of children. We also found continuity in externalizing behavior for the participant over time and from the participant to his/her child. Additionally, we found continuity in the quality of the mutual attachment relationship from the participant’s relationship with his/her parents to the participant’s relationship with his/her child. Finally, the mutual attachment relationship of the participant with his/her parents had a negative association with the participant’s externalizing behavior in adulthood. Based on these results, we propose that family interventions should focus on the role of the child’s externalizing behavior in the context of the parent–child attachment relationship. Furthermore, we suggest that prevention programs should address externalizing behavior as early as possible, as the effects of externalizing behavior in adolescence can persist into adulthood and extend to the next generation.     

The Interference of Introversion–Extraversion and Depressive Symptomatology with Reasoning Performance: A Behavioural Study

The objective of this study was to investigate the link between the Eysenck Personality Questionnaire (EPQ) scores and depressive symptomatology with reasoning performance induced by a task including valid and invalid Aristotelian syllogisms. The EPQ and the Zung Depressive Scale (ZDS) were completed by 48 healthy subjects (27 male, 21 female) aged 33.5 ± 9.0 years. Additionally, the subjects engaged into two reasoning tasks (valid vs. invalid syllogisms). Analysis showed that the judgment of invalid syllogisms is a more difficult task than of valid judgments (65.1% vs. 74.6% of correct judgments respectively, p < 0.01). In both conditions, the subjects’ degree of confidence is significantly higher when they make a correct judgment than when they make an incorrect judgment (83.8 ± 11.2 vs. 75.3 ± 17.3, p < 0.01). Subjects with extraversion as measured by EPQ and high sexual desire as rated by the relative ZDS subscale are more prone to make incorrect judgments in the valid syllogisms, while, at the same time, they are more confident in their responses. The effects of extraversion/introversion and sexual desire on the outcome measures of the valid condition are not commutative but additive. These findings indicate that extraversion/introversion and sexual desire variations may have a detrimental effect in the reasoning performance.     

Assessing the Quality of the Parent–Child Relationship: Validity and Reliability of the Child–Parent Relationship Test (ChiP-C)

The ChiP-C is a clinically oriented questionnaire for assessing the quality of the child-parent relationship according to the child’s subjective appraisal. The ChiP-C is based on family systems theory and a cumulative vulnerability model. The questionnaire consists of 36 items representing three resource scales, five risk scales, and one additional scale. This article presents the theoretical framework and main psychometric properties of the ChiP-C. A school-based sample of 1,377 youth (ages 10–20; M = 14.4) and a clinic-referred consecutive sample of 197 patients (ages 10–18, M = 14.0) were surveyed. Construct validity was determined by confirmatory factor analyses. The mean of the internal consistencies was 0.79. Systematic correlations between the ChiP-C scales and the German EMBU confirmed the convergent and discriminant validity of the ChiP-C. Moreover, all ChiP-C scales were shown to be significantly correlated with psychopathological symptoms as measured by parent and youth questionnaires. The ChiP-C can be considered an economical screening instrument for a reliable and valid assessment of strengths and disturbances of the child-parent relationship according to the child’s subjective appraisal.     

The Operational Development and Empirical Testing of the Terrorist Radicalization Assessment Protocol (TRAP–18)

The Terrorist Radicalization Assessment Protocol (TRAP–18) is a structured professional judgment instrument for threat assessment of the individual terrorist. It is a rationally derived theoretical model comprising eight proximal warning behaviors and 10 distal characteristics. Empirical research on the TRAP–18 is reviewed, including both nomothetic and idiographic studies of individual terrorists in both the United States and Europe. Mean interrater reliability is 0.895 (Cohen's kappa), ranging from 0.69 to 1.0. Evidence of criterion validity has been demonstrated, including usefulness of the instrument across various extremist ideologies (jihadism, ethnic nationalism, and single-issue), and its ability to discriminate between thwarted and successful attackers. The instrument appears to advance the domain recommendations of Monahan (2012, 2016) for the risk assessment of the individual terrorist. The TRAP–18 is further discussed as a threat assessment instrument for mental health clinicians. The limitations of the current research provide direction for further studies to assess its reliability and construct, discriminant, and predictive validity.     

Clinical Utility of the MMPI–2 Restructured Clinical (RC) Scales in Therapeutic Assessment: A Case Study

Summary: In a recent paper, Haan and Livson reported sex differences between male and female psychologists in their evaluations of adult men and adult women. Their conclusions have implication for the validity of clinical, assessments and were interpreted in terms of stereotypic sex rote perceptions. However, their statistical analysis was in fundamental error. When the data they employed were reanalyzed, no reliable sex differences between men and women psychologists were found, a finding in accord with a number of previous investigations of this problem.     

An Examination of the Relationship Between the Work–School Interface,Job Satisfaction,and Job Performance

Purpose

This study provides a comprehensive examination of how the work–school interface relates to work outcomes such as task performance and job satisfaction. Additionally, this study builds upon past research by examining a range of work- and school-related resources and demands that collectively influence the work–school interface.

Design/Methodology/Approach

Data were obtained from 170 working undergraduate students at multiple time points over the course of a semester, as well as from participants’ supervisors at the organizations in which the students work.

Findings

The strongest antecedent of job satisfaction, interpersonal facilitation, and job performance was work–school facilitation. Demands in one role create pressures in the other. Contrary to expectations, job demands positively related to work–school facilitation, while school demands positively related to school–work facilitation.

Implications

For practitioners, this study highlights the need to better understand the interplay between school and work roles for employees at a time when continuing education is emphasized. Employers benefit from the performance gains and positive attitudinal shifts that stem from experiences of facilitation between roles. From a theoretical perspective, this study reveals a unique pattern of results that adds to our understanding of the dynamics involved in the integrated work–school routines of working students.

Originality/Value

This is one of the first studies to investigate the relationships between four bi-directional forms of the work–school interface and subsequent multi-source assessments of organizational outcomes. As such, it offers an examination of how conflict and facilitation from both the work and school domains relate to work outcomes.

     

A Serbian Version of Modified and Revised Experiences in Close Relationships Scale (SM–ECR–R)

We present details about the validation of the Serbian version of the Experiences in Close Relationships–Revised questionnaire modified to measure attachment in close relationships in general (SM–ECR–R). Its psychometric features were examined with 2 samples of students (N = 719 and N = 91) and 1 group of employed adults (N = 259). The results obtained in the student sample were equivalent to those obtained in validation studies worldwide, whereas in the more heterogeneous sample of employed adults, internal consistency of both avoidance and anxiety was lower and their intercorrelation was higher. Test–retest reliability was satisfactory, and relations with measures of attachment, empathy, and personality structure were meaningful. The results support the SM–ECR–R as a reliable and valid research instrument, but its internal structure and consistency might vary in different samples, depending on age, education, gender, and culture.     

Gene–Environment Interaction of the Oxytocin Receptor Gene Polymorphism (rs53576) and Unresolved Attachment Status Predict Depersonalization Symptoms: An Exploratory Study

Depersonalization (DP), or feelings of detachment from one’s self or one’s surroundings (i.e., derealization, DR), is considered a maladaptive stress response, frequently occurring in anxiety disorders, depression or as a primary disorder. However, the pathogenesis of DP/DR symptoms is little understood. The present study aimed to elucidate the influence of unresolved attachment status and the oxytocin receptor gene (OXTR) rs53576 polymorphism on DP/DR symptoms. The study sample consisted of 84 women, including 43 depressed patients and 41 control subjects, aged 19–52. DP/DR symptoms were measured with the Cambridge Depersonalization Scale; unresolved attachment status was assessed with the Adult Attachment Interview. OXTR rs53576 genotypes were obtained from blood samples. We found a highly significant gene–environment interaction: Individuals with unresolved attachment status were significantly more depersonalized when they carried the GG-allele than A-allele carriers than not unresolved subjects. There was no statistically significant main influence of OXTR genotypes or unresolved attachment status on DP/DR symptoms. We suggest that the GG-allele and unresolved attachment status might be considered as risk factors in the etiology of DP/DR symptoms. Replication is needed in larger samples including male subjects.     

The Impact of Exposure to Internet-Based Information About the Rorschach and the MMPI–2 on Psychiatric Outpatients’ Ability to Simulate Mentally Healthy Test Performance

To examine the impact of Internet-based information about how to simulate being mentally healthy on the Rorschach (Exner, 2003) and the MMPI–2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989), 87 psychiatric outpatients completed the tests under 4 conditions: uncoached and Internet-coached outpatients under faking healthy instructions (faking patients and Internet-faking patients) and patients and nonpatients under standard instructions (standard patients and standard nonpatients). On the Rorschach, faking patients and Internet-faking patients did not manage to portray healthy test performance and, like standard patients, revealed a significantly greater number of perceptual and cognitive disturbances than standard nonpatients. Faking patients scored in the psychopathological direction on most variables. Internet-faking patients produced constricted protocols with significantly higher F% (57%) and lower use of provoking and aggressive contents than the other groups. On the MMPI–2, faking patients and Internet-faking patients were able to conceal symptoms and, like standard nonpatients, scored in the normal range on the clinical scales. The validity scale L successfully detected the faking patients and the Internet-faking patients, whereas the F scale only distinguished the Internet-faking patients and K only the faking patients. We conclude that Internet-based information could threaten test validity.     

Internal Validity and Reliability of Kolb’s Learning Style Inventory Version 3 (1999)

This study explores the internal validity and reliability of Kolb’s revised Learning Style Inventory (LSI-2A and LSI-3) in a sample of 221 graduate and undergraduate business students. Research on the LSI is also reviewed and the implications of conducting factor analysis using ipsative data are explored. Experiential Learning Theory is presented and the concept of learning styles explained. This study largely supports prior research supporting the internal reliability of scales. Principle Component Analysis provides evidence for a 2 factor structure as hypothesized by Kolb.