Difference scores: A caveat illustrated with neuropsychological measures

Relationships among preferred minus non-preferred hand difference scores from four neuropsychological sensorimotor tests were evaluated in Community (N= 121), Prison Inmate (N = 350), and Psychiatric Inpatient (N = 398) samples. Across the three samples, the average absolute off-diagonal correlations among the four difference scores ranged from .07 to .13, and the squared multiple correlations (used to predict any difference score from the other three) did not exceed .07. Based on the determinant of the correlation matrix (i.e., |R|), the null hypothesis of complete independence was rejected in only the Prison Inmate sample (p < .001), however, departure from the null hypothesis was negligible (i.e., |R| = .94, expected value under the null = .98). Preferred/non-preferred hand ratio scores were very highly correlated with the difference scores and consequently analyses of the ratio scores yielded results that were comparable to those obtained for the difference scores. Results indicate that the four difference scores or four ratio scores measure little in common and therefore cannot corroborate each other. In general, it would be prudent to exercise considerable caution when using difference scores or ratio scores obtained from non-independent measures, either singly or in combination.     

The acquisition of bimanual coordination is mediated by anisotropic coupling between the hands

The present study was designed to test two predictions from the coupled oscillator model of multifrequency coordination. First, it was predicted that multifrequency tasks that match the inherent manual asymmetry (i.e., the preferred hand assigned to the faster tempo) would be easier to learn than tasks that do not match the inherent dynamics (i.e., the non-preferred hand assigned to the faster tempo). Second, in the latter case acquisition of the multifrequency coordination would involve a reorganisation of the coupling dynamics such that the faster hand would exert a greater influence on the slower hand than vice versa. Sixteen right-handed volunteers received extensive training on a 2:1 coordination pattern involving a bimanual forearm pronation-supination task. Participants were randomly assigned to one of two groups: 1L:2R in which the preferred right hand performed the higher frequency, or 2L:1R in which the non-preferred left hand performed the higher frequency. The dynamic stability of the patterns was assessed by the ability of participants to maintain the coordination pattern as movement frequency was increased. Changes in the directional coupling between the hands was assessed by transition pathways and lead-lag relationship evident in a 1:1 anti-phase frequency-scaled coordination task performed prior to and following three practice sessions of the 2:1 task. The predicted differential stability between the multifrequency patterns was evident in the initial acquisition sessions but by the end of training the two patterns evidenced equivalent stability. Unexpectedly, for both groups the fast hand displayed greater variability in amplitude and movement frequency than the slow hand perhaps reflecting anchoring afforded to the slow hand by synchronising movement endpoints with the auditory pacing metronome. Analysis of pre- to post-training changes to the coupling dynamics in the 1:1 anti-phase task support the hypothesis that acquisition of the 2L:1R pattern involved reorganisation of the inherent dynamics.     

A comparison of mean partialing and dual-hypothesis testing to evaluate stereotype effects when assessing profile similarity

Assessing profile similarity is an important task in research and clinical practice, but conclusions about profile similarity may be confounded by stereotype effects that create artificially similar profiles. In this article, we review the impact of stereotype effects on profile similarity and a conventional approach to addressing this confound (i.e., mean partialing). We argue that a dual-hypothesis testing approach distinguishing the no-effect null hypothesis (i.e., is the observed similarity different from zero?) from the chance-effect null hypothesis (i.e., is the observed similarity different from chance given the distribution of profile elements?) can provide a more nuanced understanding of profile similarity. To compare results from these 2 perspectives, we analyzed data from 2 samples using within-persons correlations as indexes of similar profile shapes. Results indicated that a dual-hypothesis testing approach led to more conservative conclusions about profile similarity (i.e., fewer Type 1 errors) than mean partialing and may be especially valuable when dealing with moderate-sized stereotype effects. Both approaches led to identical conclusions when stereotype effects were largest. Conclusions emphasize the relative merits and limitations of the dual-hypothesis testing approach as well as potential future applications in the personality assessment domain.     

Defining reactivity: how several methodological decisions can affect conclusions about emotional reactivity in psychopathology

There are many important methodological decisions that need to be made when examining emotional reactivity in psychopathology. In the present study, we examined the effects of two such decisions in an investigation of emotional reactivity in depression: (1) which (if any) comparison condition to employ; and (2) how to define change. Depressed (N = 69) and control (N = 37) participants viewed emotion-inducing film clips while subjective and facial responses were measured. Emotional reactivity was defined using no comparison condition (i.e., raw scores), baseline comparison condition (i.e., no stimulus presented), and neutral comparison condition (i.e., neutral stimulus presented). Change in emotional reactivity was assessed using four analytic approaches: difference scores, percentage change, residualised change, and ANCOVA. Results differed among the three comparison conditions and among several of the analytic approaches. Overall, our investigation suggests that choosing a comparison condition and the definition of change can significantly influence the presence of group differences in emotional reactivity. Recommendations for studies of emotional reactivity in psychopathology are discussed.     

Examining the utility of the PCL:SV as a screening measure using competing factor models of psychopathy

The correspondence between the Hare Psychopathy Checklist: Screening Version (PCL:SV; S. D. Hart, D. N. Cox, & R. D. Hare, 1995) and the Hare Psychopathy Checklist-Revised (PCL-R; R. D. Hare, 1991, 2003) was examined in forensic (N = 175) and correctional (N = 188) samples. Intermeasure correlations for Total scores (.95 forensic, .94 correctional) and the original 2-factor, D. J. Cooke and C. Michie's (2001) 3-factor, and R. D. Hare's (2003) 4-facet models (range = .87-.95) were high. Area under the curve values for the PCL:SV were .98 in both samples (cutoff = PCL-R Total score of 25). The PCL:SV performed well as a screen, maximizing false positive relative to false negative errors. Close correlations for prediction of violent recidivism in the correctional sample were obtained for the PCL-R (.42) and PCL:SV (.37). Results indicate the robust relation between the measures is maintained whether they are completed on the basis of file review only or file plus interview and whether the same or different raters score the measures.     

MORE ON THE STRUCTURE OF MALE ROLE NORMS

This study assessed the structure of a widely used measure of masculinity ideology, the Male Role Norms Scale (Thompson & Pleck, 1986), using data from four samples of male college students (total N= 656) at two large, public universities (one Midwestern, one Eastern-Central). Exploratory factor analysis suggested a four-factor model best fit the data in the exploratory sample (sample 1; N = 210). The four factors were Status/ Rationality, Antifemininity, Tough Image, and Violent Toughness. A series of confirmatory factor analyses on a validation sample (samples 2, 3, and 4; N = 446), tested four models based on theory (i.e., Brannon, 1976) and previous research (i.e., Thompson & Pleck, 1986). Results from Study 1, our exploratory analysis, indicated that the four-factor model derived from the exploratory sample in Study 1 provided the best fit for the validation sample data of all models tested and also provided a good fit in absolute terms, according to several model-data fit indices. Implications for the assessment of masculinity ideology and suggestions for future research are discussed.     

Between facets and domains: 10 aspects of the Big Five

Factor analyses of 75 facet scales from 2 major Big Five inventories, in the Eugene-Springfield community sample (N=481), produced a 2-factor solution for the 15 facets in each domain. These findings indicate the existence of 2 distinct (but correlated) aspects within each of the Big Five, representing an intermediate level of personality structure between facets and domains. The authors characterized these factors in detail at the item level by correlating factor scores with the International Personality Item Pool (L. R. Goldberg, 1999). These correlations allowed the construction of a 100-item measure of the 10 factors (the Big Five Aspect Scales [BFAS]), which was validated in a 2nd sample (N=480). Finally, the authors examined the correlations of the 10 factors with scores derived from 10 genetic factors that a previous study identified underlying the shared variance among the Revised NEO Personality Inventory facets (K. L. Jang et al., 2002). The correspondence was strong enough to suggest that the 10 aspects of the Big Five may have distinct biological substrates.     

Attention to novelty, fear-anxiety, and age: their effects on conduct problems

The authors investigated the effects of attention to novelty, fear-anxiety, and age on 3 measures of conduct problems. They found several main and interaction effects. The results indicated the presence of the hypothesized 3-way interaction for 2 dependent measures (i.e., conduct problem, socialized aggression); the 3rd dependent measure (i.e., conduct disorder) approached significance (p = .07). Participants who were older, had low attention to novelty, and high fear-anxiety generally had the highest conduct-problem scores among 8 comparison groups. Older students with high attention to novelty and low fear-anxiety had significantly lower conduct-problem scores that were unremarkable. The findings are congruent with J. Gray's (1987) theory of behavioral activation and inhibition, and the results support R. C. Eaves' (1993) integrated theory of human behavior, which postulates that the level of attention to novelty, fear-anxiety, and age interact to produce individuals with conduct problems.     

Racial/ethnic differences in the criterion-related validity of cognitive ability tests: a qualitative and quantitative review

The correlation between cognitive ability test scores and performance was separately meta-analyzed for Asian, Black, Hispanic, and White racial/ethnic subgroups. Compared to the average White observed correlation ( = .33, N = 903,779), average correlations were lower for Black samples ( = .24, N = 112,194) and Hispanic samples ( = .30, N = 51,205) and approximately equal for Asian samples ( = .33, N = 80,705). Despite some moderating effects (e.g., type of performance criterion, decade of data collection, job complexity), validity favored White over Black and Hispanic test takers in almost all conditions that included a sizable number of studies. Black-White validity comparisons were possible both across and within the 3 broad domains that use cognitive ability tests for high-stakes selection and placement: civilian employment, educational admissions, and the military. The trend of lower Black validity was repeated in each domain; however, average Black-White validity differences were largest in military studies and smallest in educational and employment studies. Further investigation of the reasons for these validity differences is warranted.     

Semantic response consistency and protocol validity in structured personality assessment: the case of the NEO-PI-R

In this study we tested the hypothesis that groups of NEO Personality Inventory-Revised (NEO-PI-R; Costa & McCrae, 1992a) protocols identified as potentially invalid by an inconsistency scale (INC; Schinka, Kinder, & Kremer, 1997) would show reduced reliability and validity according to a series of psychometric tests. Data were obtained from 2 undergraduate student samples, a self-report group (n = 132) who provided NEO-PI-R self-ratings on 2 occasions separated by a 7- to 14-day interval and an informant group (n = 109) who provided ratings of well-known friends or relatives on 2 occasions separated by a 6 month interval. INC scores from the Time 1 protocols were used to divide these samples into low, moderate, and elevated inconsistency groups. In both samples, these 3 groups showed equivalent levels of reliability and validity as measured by: contingency coefficients for the 20 INC item responses across occasions; test-retest intraclass correlations of NEO-PI-R domain scores; convergent correlations with Goldberg's (1992) Bipolar Adjective Scale scores; and discriminant correlations between the 5 NEO-PI-R domain scores. The similarity of results across self-report and informant assessment contexts provides additional evidence that semantic consistency approaches to assessing protocol validity may overestimate the prevalence of random or careless response behavior in standard administration conditions. Several theories are discussed that accommodate the existence of valid inconsistency in structured personality assessment.     

Measuring everyday adaptation after imprisonment: The post-release living inventory for ex-prisoners (PORLI-ex)

BackgroundThe number of ex-prisoners worldwide has constantly been increasing in recent years. Currently, little is known about post-release daily adaptation, not to mention valid and reliable instruments for post-release daily routines pertinent to mental health.ObjectiveThis study aims to develop and validate a self-report instrument, hereafter referred to as Post Release Living Inventory for Ex-prisoners (PORLI-ex).MethodsThree separate samples of ex-prisoners were recruited to complete an online survey (N=1,277, age range=17–89 years, 53.2% male, 72% white).ResultsThe final model evidenced acceptable goodness-of-fit and consisted of 45 items on nine dimensions, which loaded on three second-order factors: Consolidation (three dimensions; e.g., Institutional Routines), Replacement (two dimensions; e.g., Maladaptive Behaviors), and Addition (four dimensions; e.g., Socializing with Ex-prisoner Friends) (α=.695–.915). Convergent validity was demonstrated in the positive correlations with IADL, SOLI, MLQ, GSE-6, and MSPSS. Discriminant validity was demonstrated in the weak correlations with the LEC-5 and perceived social and personal cost of punishment. Criterion-related validity was demonstrated in the correlations with psychiatric symptoms and crime-related outcomes and incremental validity in the correlations with these measures independent of the scores on IADL, SOLI, MLQ, GSE-6, and MSPSS.ConclusionThis study calls for more resources on fostering psychological strengths and resilience through regularizing basic daily life experiences on top of traditional interventions for risk management among the ex-prisoners.     

An experimental analysis of dynamic hypotheses about cognitive abilities and achievement from childhood to early adulthood

This study examined the dynamics of cognitive abilities and academic achievement from childhood to early adulthood. Predictions about time-dependent "coupling" relations between cognition and achievement based on R. B. Cattell's (1971, 1987) investment hypothesis were evaluated using linear dynamic models applied to longitudinal data (N=672). Contrary to Cattell's hypothesis, a first set of findings indicated that fluid and crystallized abilities, as defined by the Woodcock-Johnson Psycho-Educational Battery-Revised (WJ-R; R. W. Woodcock & M. B. Johnson, 1989-1990), were not dynamically coupled with each other over time. A second set of findings provided support for the original predictions and indicated that fluid ability was a leading indicator of changes in achievement measures (i.e., quantitative ability and general academic knowledge). The findings of this study suggest that the dynamics of cognitive abilities and academic achievement follow a more complex pattern than that specified by Cattell's investment hypothesis.     

Validation of the Suicide Resilience Inventory-25 (SRI-25) in adolescent psychiatric inpatient samples

Resilience has been associated with a markedly decreased chance for risky behaviors following a trauma or other negative life event. This study examined the factor structure and psychometric properties of a self-report measure of resilience, the Suicide Resilience Inventory-25 (SRI-25; Osman et al., 2004 ), among psychiatric inpatient adolescents. In Study 1, we conducted confirmatory factor analysis to provide additional empirical support for the structure and invariance of the 3-factor model of the SRI-25 in youth samples, ages 14 to 17 years (N = 152 boys, 220 girls). Scale reliability analyses provided good evidence for internal consistency reliability of scores on the SRI-25 total and scales. In Study 2 (N = 30 boys, 40 girls), we presented data in support for the concurrent validity (i.e., known groups) of scores on the SRI-25. Additionally, we identified potential correlates for the SRI-25 total scale scores.     

Measuring gratitude in youth: assessing the psychometric properties of adult gratitude scales in children and adolescents

Before the developmental trajectory, outcomes, and related interventions of gratitude can be accurately and confidently studied among the youth, researchers must ensure that they have psychometrically sound measures of gratitude that are suitable for this population. Thus, considering that no known scales were specifically designed to measure gratitude in youth, this study aimed to answer an important question: Are the existing gratitude scales used with adults valid for use with youth? The present study is an empirical investigation, based on a large youth sample (N = 1,405) with ages ranging from 10 to 19 years old, of the psychometric properties of scores of the Gratitude Questionnaire-6 (GQ-6; M. E. McCullough, R. A. Emmons, & J.-A. Tsang, 2002), the Gratitude Adjective Checklist (GAC; M. E. McCullough, R. A. Emmons, & J.-A. Tsang, 2002), and the Gratitude Resentment and Appreciation Test (GRAT)-short form (M. Thomas & P. Watkins, 2003). Single-group and multiple-group confirmatory factor analyses indicated that the factor structures of these gratitude scales resemble those found with adults and were invariant across age groups. Scores of all three gratitude scales revealed acceptable internal consistency estimates (i.e., >.70) across age groups. Results showed that whereas scores of all three gratitude scales were positively correlated with each other for 14- to 19-year-olds, GRAT-short form scores tended to display relatively low correlations with scores of the other two measures for younger children (10-13 years old). Furthermore, the nomological network analysis showed that scores of all three gratitude scales were positively correlated with positive affect and life satisfaction scores across the age groups. The relationships with negative affect and depression scores, however, seemed dependent on the child's age. Pending results from subsequent research recommendations for researchers interested in studying gratitude in youth are offered.     

Gender Differences in the Dimensionality of Social Support1

Although theoretical frameworks have been developed and research has been conducted in the area of social support, little attention has been given to the influence of gender on the dimensionality of social support. In addition, much of the research on social support has been conducted solely with student samples. In the present study, two samples (students, N = 304, and working adults, N = 301) completed a social support questionnaire. The survey instrument measured four types of social support (appraisal, instrumental, informational, and emotional) from four different sources (supervisor, coworker, spouse, and friends). For the student sample, women reported higher levels of social support than men on most dimensions (i.e., 11 of 16 dimensions), with 5 yielding statistically significant differences. For the sample of working adults, men reported higher levels of social support on most of the dimensions (i.e., 10 of 16), with 5 representing statistically significant differences. Differences in results between the two samples are discussed.     

Sample size and correlational inference

In 4 studies, the authors examined the hypothesis that the structure of the informational environment makes small samples more informative than large ones for drawing inferences about population correlations. The specific purpose of the studies was to test predictions arising from the signal detection simulations of R. B. Anderson, M. E. Doherty, N. D. Berg, and J. C. Friedrich (2005). The results of a simulation study in the present article confirmed and extended previous theoretical claims (R. B. Anderson et al., 2005) that in a yes/no correlation detection task, small-sample advantages should occur but should be restricted to particular decision conditions. In 3 behavioral studies, participants viewed larger or smaller samples of data pairs and judged whether each sample had been drawn from a population characterized by a zero correlation or from one characterized by a greater-than-zero correlation. Consistent with traditional statistical theory, accuracy tended to be greater for larger than for smaller samples, though there was a small-sample advantage in 1 experimental condition. The results are discussed in relation to alternative theoretical and behavioral paradigms such as those of Y. Kareev (e.g., 2005) and K. Fiedler and Y. Kareev (2006).     

Continuity and change in personality traits from adolescence to midlife: a 25-year longitudinal study comparing representative and adjudicated men

In the first study, a hierarchical structure of personality traits was identified using data from a longitudinal study tracing two samples of men from adolescence to midlife (i.e., a representative sample of the general population and a sample of individuals adjudicated during their adolescence). The second study examined structural, rank-order, and mean-level continuity. Partial structural continuity was demonstrated through confirmatory factor analysis. Regarding rank-order continuity, the correlations were stronger as age increased, particularly for the adjudicated men. For mean-level continuity, the adjudicated men displayed higher scores from adolescence to midlife for nearly every personality trait related to Disinhibition and Negative Emotionality. Significant decreases were observed in these traits for both samples, supporting the hypothesis of a normative psychological maturation. Although both samples showed this maturation, the adjudicated men displayed a lower rate of change during adolescence and early adulthood. The two samples did not differ in Extraversion and this trait remained more stable, particularly for adjudicated men.     

Relationships between critical thinking and attitudes toward women's roles in society

This exploratory study is the first examination of the relationships between critical thinking--as measured by subscales on the Watson-Glaser Critical Thinking Appraisal Form S (WGCTA Form S; G. B. Watson & E. M. Glaser, 1994)-and attitudes toward women's roles in society--as measured by subscales on the Attitudes Toward Women Scale (AWS: J. T. Spence & R. L. Helmreich, 1972). The authors hypothesized that greater critical thinking skills would be associated with more liberal attitudes toward women's roles in society. Results from a sample of 90 nursing and management undergraduates supported the hypothesis. There were moderate correlations between scores from the WGCTA Form S Inference (.24 to .37) and Deduction (.19 to .26) subtests and scores from the AWS Freedom and Independence; Marital Relationships and Obligation; and Vocational, Educational, and Intellectual Roles subscales. These findings suggest that further research with larger samples and cross-cultural samples is warranted.     

The Relation Between Anxiety Sensitivity and Attachment Style in Adolescence and Early Adulthood

Given the accumulating evidence for a role of anxiety sensitivity in the etiology of panic, it is important to understand the developmental origins of anxiety sensitivity. To this end, this study examined the relation between attachment beliefs and anxiety sensitivity in a sample of high school students (n = 203; mean age 15.7 years) and university students (n = 324; mean age 21.7 years). The Experiences in Close Relationships (ECR; K. Brennan, C. Clark, &; P. Shaver, 1998) was used to assess attachment beliefs and to classify participants into attachment groups. The Anxiety Sensitivity Index (ASI; R. A. Peterson &; S. Reiss, 1987) was used to assess participants' levels of anxiety sensitivity. Results supported the hypothesis that individuals with insecure attachment, specifically those classified as preoccupied and fearful (i.e., those with a negative model of self), had significantly higher anxiety sensitivity scores than securely attached individuals in both the high school and college samples.