Toward a construct validation of the Rorschach

The debate over the validity of the Rorschach has been lengthy but unresolved. Major reasons for the lack of consensus and conclusion are the absence of agreement about, how validation research should be conducted and the failure to identify appropriate criteria for subsequent evaluation. A construct validation model for the Rorschach is presented, with guidelines for proper implementation. The difficulties in establishing the optimal relationship between theory, research design, and clinical practice arc discussed. Recommendations for a resolution of these difficulties are presented.     

Adolescent personality: a five-factor model construct validation

The purpose of this study was to investigate convergent and discriminant validity of the five-factor model of adolescent personality in a school setting using three different raters (methods): self-ratings, peer ratings, and teacher ratings. The authors investigated validity through a multitrait-multimethod matrix and a confirmatory factor analysis correlated trait, uncorrelated method model. With the exception of Emotional Stability, each analysis demonstrated similar patterns and together provided support for the convergent and discriminant validity of the five-factor model structure of adolescent personality. However, among the three raters, self-ratings of personality provided a comparatively weaker method for assessing adolescent personality. The influences of agreement between self and other raters are discussed in relation to contrast, perceiver, and target effects; expert observer effects; the degree of acquaintanceship; and the effect of the social context.     

Operationalizing relational turbulence theory: Measurement and construct validation

This study assessed measures operationalizing concepts in relational turbulence theory (Solomon, Knobloch, Theiss, & McLaren, 2016). Studies of relational turbulence in marriage have used measures developed in research on dating couples; therefore, one goal was evaluating these variables in a general population sample of married individuals (N = 1,469). A second goal addressed problems in measures of relational uncertainty by assessing alternative scales. Third, associations between relational turbulence theory variables and measures of cognitive, emotional, and communicative phenomena were estimated. Fourth, the distinctiveness of relational turbulence measures relative to measures of other relational qualities was assessed. The conclusions advance new, Likert relational uncertainty scales and highlight the validity of relational turbulence constructs as distinctive predictors of cognitions, emotions, and communication.     

The family of origin scale: A construct validation study

Data from 69 women and 63 men along with ratings from a panel of expert judges were used to assess the construct validity of the Family Of Origin Scale as a measure of family health. Loevinger's conception of construct validity, focusing on the substantive, structural, and external components of validity, was employed to organize the research procedures followed and the data analytic techniques used. Results showed that the instrument appears to be a useful measure of a warmth-coldness affect dimension in the family of origin, but the multi-dimensional structure of the test, as a measure of family-of-origin health, could not be validated. Suggestions for use, score interpretation, and further development are discussed.     

Witness self‐efficacy: Development and validation of the construct

Despite the application of Self‐Efficacy Theory (Bandura, 1977 , 2000 ) to many areas of psychology, there is a lack of research on self‐efficacy in the ability to testify in court. The present study fills this gap by incrementally developing the construct of Witness Self‐Efficacy and establishing its psychometric properties. Study I features exploratory and confirmatory factor analyses yielding a two‐factor Witness Self‐Efficacy Scale (WSES). The two components are Poise and Communication Style. Study II uses a second data collection to show that both WSES domains possess convergent, divergent, and predictive validity relations consistent with those expected using an SET framework. Notably, WSES components predicted perceptions of witness credibility and sentencing outcomes above and beyond witness extraversion, general self‐efficacy, and general self‐confidence. Implications for SET and witness preparation training are discussed. Copyright © 2010 John Wiley & Sons, Ltd.     

Assessing dimensions of competency to stand trial: construct validation of the ECST-R

Four decades of forensic research have left unanswered a fundamental issue regarding the best conceptualization of competency to stand trial vis-à-vis the Dusky standard. The current study investigated three competing models (discrete abilities, domains, and cognitive complexity) on combined data (N = 411) from six forensic and correctional samples. Using the Evaluation of Competency to Stand Trial-Revised (ECST-R), items representative of the Dusky prongs were used to test the three models via maximum-likelihood confirmatory factor analyses (CFA). Of the three, only the discrete abilities model evidenced a good fit, indicating that competency to stand trial should consider separately each defendant's factual understanding of the proceedings, rational understanding of the proceedings, and ability to consult with counsel. ECST-R competency scales, based on the current CFA, have excellent alphas (.83 to .89) and interrater reliabilities (.97 to .98).     

Chronic self-destructiveness: Conceptualization,measurement, and initial validation of the construct

Individual differences in various behaviors suggest that those who are primarily motivated by current emotional factors are more likely than those motivated by more distant cognitive considerations to engage in acts that are ultimately self-destructive. To assess and explore these behavioral differences, 12 samples of undergraduate subjects, totaling 864 (527 females, 337 males), a group of 15 businesswomen, and 111 male VA patients were used to develop a measure of this construct in a series of reliability and construct validity studies. By means of internal-consistency item analyses, two cross-validated 52-item measures of chronic self-destructiveness were constructed for males and females. Reliability was established with respect to internal consistency (alpha coefficients range from .73 to .97) and temporal consistency over a 1-month period (test-retest correlations range from .90 to .98). There is a slight drop in chronic self-destructiveness scores across age groups. Test scores were found to be positively related to external locus of control, negatively related to Type A coronary-prone behavior, and unrelated to either social desirability response set or need for achievement. Individuals high in chronic self-destructiveness, compared to those with low scores, are more likely to be in treatment for drug or alcohol abuse, to report having cheated in courses, to have had traffic violations, to report having gone through a rebellious stage in adolescence, and to postpone obtaining a medical test for cancer. Chronic self-destructiveness appears to be a personality dimension that affects behavior across a wide range of ages and situations.We wish to thank John Wapner for his assistance in obtaining data in the clinical sample.     

Measuring adult attachment: a construct validation of two self-report instruments

This study reports the Swedish construct validation of two translated attachment style scales. The factor structure of the attachment construct was investigated via exploratory and confirmatory factor analyses of attachment scores from 515 students of a Swedish university. Results supported the expected two-factor solution, but found a three-factor solution to be a viable alternative. In addition, the attachment scales were compared with the Big Five personality inventory (NEO-PI), using a sample of 87 Swedish students, and found to have expected correlation to this scale.     

A construct validation study of the Human Figure Drawing Test

To assess whether the Human Figure Drawing Test provides an assessment of nonverbal cognitive maturity, correlations for 31 youngsters who ranged in age from 6-0 to 10-10 on the Human Figure Drawing Test and the Verbal, Performance, and Full Scale IQs of the Wechsler Intelligence Scale for Children--Revised (WISC--R) were examined. Significant correlations were observed for each of the scales, but the value of .69 for drawings and WISC--R Performance IQs was significant, suggesting the assessment that these tests are largely nonverbal. Implications for the role of language were posited.     

Unconscious symmetrical inferences: A role of consciousness in event integration

Explicit and implicit learning have been attributed to different learning processes that create different types of knowledge structures. Consistent with that claim, our study provides evidence that people integrate stimulus events differently when consciously aware versus unaware of the relationship between the events. In a first, acquisition phase participants sorted words into two categories (A and B), which were fully predicted by task-irrelevant primes-the labels of two other, semantically unrelated categories (C and D). In a second, test phase participants performed a lexical decision task, in which all word stimuli stemmed from the previous prime categories (C and D) and the (now nonpredictive) primes were the labels of the previous target categories (A and B). Reliable priming effects in the second phase demonstrated that bidirectional associations between the respective categories had been formed in the acquisition phase (A<-->C and B<-->D), but these effects were found only in participants that were unaware of the relationship between the categories! We suggest that unconscious, implicit learning of event relationships results in the rather unsophisticated integration (i.e., bidirectional association) of the underlying event representations, whereas explicit learning takes the meaning of the order of the events into account, and thus creates unidirectional associations.     

A cross-order integration hypothesis for the neural correlate of consciousness

One major problem many hypotheses regarding the neural correlate of consciousness (NCC), face is what we might call "the why question": why would this particular neural feature, rather than another, correlate with consciousness? The purpose of the present paper is to develop an NCC hypothesis that answers this question. The proposed hypothesis is inspired by the cross-order integration (COI) theory of consciousness, according to which consciousness arises from the functional integration of a first-order representation of an external stimulus and a second-order representation of that first-order representation. The proposal comes in two steps. The first step concerns the "general shape" of the NCC and can be directly derived from COI theory. The second step is a concrete hypothesis that can be arrived at by combining the general shape with empirical considerations.     

Facets of private and public self‐consciousness: construct and discriminant validity

The construct and discriminant validity of proposed facets of private self‐consciousness (Self‐Reflectiveness and Internal State Awareness) and public self‐consciousness (Style Consciousness and Appearance Consciousness) was examined in two studies. In study 1 an exploratory factor analysis of 367 subjects' responses to a translated version of the Self‐Consciousness Scale (SCS) of Fenigstein, Scheir, and Buss confirmed the existence of two factors of private and public self‐consciousness. Confirmatory factor analysis of 199 university students' responses to the SCS confirmed the results from study 1. A two‐dimensional model of private and public self‐consciousness respectively represented a significant improvement in fit to data over single‐factor models. Further, the two facets of private and public self‐consciousness were related differently to measures representing different aspects of adjustment/maladjustment. Copyright © 2002 John Wiley & Sons, Ltd.     

On the dimensionality of organizational justice: a construct validation of a measure.

This study explores the dimensionality of organizational justice and provides evidence of construct validity for a new justice measure. Items for this measure were generated by strictly following the seminal works in the justice literature. The measure was then validated in 2 separate studies. Study 1 occurred in a university setting, and Study 2 occurred in a field setting using employees in an automobile parts manufacturing company. Confirmatory factor analyses supported a 4-factor structure to the measure, with distributive, procedural, interpersonal, and informational justice as distinct dimensions. This solution fit the data significantly better than a 2- or 3-factor solution using larger interactional or procedural dimensions. Structural equation modeling also demonstrated predictive validity for the justice dimensions on important outcomes, including leader evaluation, rule compliance, commitment, and helping behavior.     

Presence and search for meaning in sport: Initial construct validation

According to Frankl (1959), the will to meaning is a fundamental human motive. Perceiving life as meaningful is associated with a number of sources and positive outcomes. Similar findings emerged when looking at domain-specific meaning, such as work. Surprisingly, sport-specific meaning is yet to be empirically investigated or measured. Therefore, the purpose of this two-study project was to examine the psychometric properties of the Meaning in Sport Questionnaire (MSQ), a sport-specific meaning measure. Survey responses (n = 329) from Study 1 were used to assess factorial validity and measurement invariance for the MSQ. Results from Study 2 with a different sample (n = 402) supported initial convergent validity for the two subscales of presence and search for meaning in sport. The MSQ is a new measure that can be used to investigate the extent to which athletes perceive their sport to be meaningful and search for such meaning.     

A depressive symptom scale for the California Psychological Inventory: construct validation of the CPI-D

To facilitate life span research on depressive symptomatology, a depressive symptom scale for the California Psychological Inventory (CPI) is needed. The authors constructed such a scale (the CPI-D) and compared its psychometric properties with 2 widely used self-report depression scales: the Beck Depression Inventory and the Center for Epidemiological Studies Depression Scale. Construct validity of the CPI-D was examined in 3 studies. Study 1 established content validity, classifying CPI-D items into Diagnostic and Statistical Manual of Mental Disorders-Fourth Edition depressive symptoms. Study 2 used 3 large samples to gather evidence for reliability and validity: correlational analyses demonstrated alpha reliability and convergent and discriminant validity; factor analysis provided evidence for discriminant validity with anxiety; and regression analyses demonstrated comparative validity with existing standard PI scales. Study 3 used clinician ratings of depression and anxiety as criteria for external validity.     

Two theories of consciousness: Semantic pointer competition vs. information integration

Consciousness results from three mechanisms: representation by firing patterns in neural populations, binding of representations into more complex representations called semantic pointers, and competition among semantic pointers to capture the most important aspects of an organism’s current state. We contrast the semantic pointer competition (SPC) theory of consciousness with the hypothesis that consciousness is the capacity of a system to integrate information (IIT). We describe computer simulations to show that SPC surpasses IIT in providing better explanations of key aspects of consciousness: qualitative features, onset and cessation, shifts in experiences, differences in kinds across different organisms, unity and diversity, and storage and retrieval.     

A construct validation of the Objective-Analytic Test Battery (OATB)

The scales of Cattell's Objective–Analytic Test Battery (OATB) and the factors derived from the factor analysis of the subtests of the OATB were located with respect to a wide range of ability and personality variables, including the 16PF and Cattell's Comprehensive Ability Battery. The expected relationships between the OATB scales and the personality measures did not emerge. However, it was found that many of the OATB scales were highly correlated with ability factors. It is concluded that in Britain, and in its present form, the OATB is not a viable instrument for measuring personality traits.     

Role of consciousness in temporal integration of semantic information

Previous studies found that word meaning can be processed unconsciously. Yet it remains unknown whether temporally segregated words can be integrated into a holistic meaningful phrase without consciousness. The first four experiments were designed to examine this by sequentially presenting the first three words of Chinese four-word idioms as prime to one eye and dynamic Mondrians to the other (i.e., the continuous flash suppression paradigm; CFS). An unmasked target word followed the three masked words in a lexical decision task. Results from such invisible (CFS) condition were compared with the visible condition where the preceding words were superimposed on the Mondrians and presented to both eyes. Lower performance in behavioral experiments and larger N400 event-related potentials (ERP) component for incongruent- than congruent-ending words were found in the visible condition. However, no such congruency effect was found in the invisible condition, even with enhanced statistical power and top-down attention, and with several potential confounding factors (contrast-dependent processing, long interval, no conscious training) excluded. Experiment 5 demonstrated that familiarity of word orientation without temporal integration can be processed unconsciously, excluding the possibility of general insensitivity of our paradigm. The overall result pattern therefore suggests that consciousness plays an important role in semantic temporal integration in the conditions we tested.