Development and Psychometric Integrity of a Measure of Ideational Behavior

Although creativity is an important part of cognitive, social, and emotional activity, high-quality creativity assessments are lacking. This article describes the rationale for and development of a measure of creative ideation. The scale is based on the belief that ideas can be treated as the products of original, divergent, and creative thinking-a claim J. P. Guilford (1967) made years ago. Guilford himself assessed ideation with tests of divergent thinking, although through the years scores from these tests have only moderate predictive validity. This may be because previous research has relied on inappropriate criteria. For this reason, the Runco Ideational Behavior Scale (RIBS) was developed. It can be used as a criterion of creative ideation. Most items describe actual behaviors (i.e., overt actions and activities) that clearly reflect an individual's use of, appreciation of, and skill with ideas. Results obtained using both exploratory and confirmatory factor analysis are reported in this article. These suggest the presence of 1 or 2 latent factors within the scale. Based on the theoretical underpinnings of the scale, a 1-factor solution was judged to be more interpretable than a 2-factor solution. Analyses also supported the discriminant validity of the RIBS.     

Convergent,Discriminant, and Incremental Validities of Person–Environment Fit Scale for Creativity in Predicting Innovative Behavior

This study examined the validity of a 14-item two-factor person–environment fit scale for creativity (PEFSC) to measure the personal and environmental components of creativity. A sample of 2,475 participants completed the PEFSC for evaluating the factor structure. For convergent, discriminant, and incremental validities, a subsample (N = 362) completed the creative self-efficacy scale, support for innovation subscale of the team climate inventory, and innovative behavior measure. Results indicated the two-factor correlated model showed a better goodness of fit than the one-factor model. Measurement invariance of PEFSC was observed across different genders and educational groups. Internal consistency reliabilities were satisfactory (α  ≥  .87). The personal dimension indicated stronger associations with creative self-efficacy than with support for innovation, whereas the environmental dimension was related more closely to support for innovation than to creative self-efficacy. Incremental validity was confirmed by significant and additional explanations from PEFSC in predicting innovative behavior. These results consolidated the application of person–environment fit theoretical framework in creativity research.     

中国人整体性思维特征的情境评估法及其应用

创设了新的中国人思维特征的情境评估方法, 初步应用于整体性思维特征与创造力倾向关系的研究并对其信效度进行了检验。新评估法选取体现典型文化意境和中国人思维特征的成语谜语作为材料, 利用虚拟现实技术构建形与意、情境与语境相互转换的成语谜语文化园, 记录被试游览时即景说出的成语建立成语库, 并编码所录成语的思维特征类型以作为被试的整体性思维测量指标。基于测试数据的信效度分析表明整体性思维成语测试系统信效度表现良好。整体性思维与创造力倾向的相关分析表明, 整体性思维与创造力倾向中的好奇性显著负相关。研究首次证实了利用虚拟现实技术来重建传统文化情境以实现对中国人思维特征的情境评估的可行性, 提示基于虚拟现实技术的情境评估法在未来心理学相关研究中的应用价值。     

Measuring the phenomenology of autobiographical memory: A short form of the Memory Experiences Questionnaire

The Memory Experiences Questionnaire (MEQ) is a theoretically driven and empirically validated 63-item self-report scale designed to measure 10 phenomenological qualities of autobiographical memories: Vividness, Coherence, Accessibility, Time Perspective, Sensory Details, Visual Perspective, Emotional Intensity, Sharing, Distancing and Valence. To develop a short form of the MEQ to use when time is limited, participants from two samples (N = 719; N = 352) retrieved autobiographical memories, rated the phenomenological experience of each memory and completed several scales measuring psychological distress. For each MEQ dimension, the number of items was reduced by one-half based on item content and item-total correlations. Each short-form scale had acceptable internal consistency (median alpha = .79), and, similar to the long-form version of the scales, the new short scales correlated with psychological distress in theoretically meaningful ways. The new short form of the MEQ has similar psychometric proprieties as the original long form and can be used when time is limited.     

Measuring the Creative Process: A Psychometric Examination of Creative Ideation and Grit

Within the investment theory of creativity (Sternberg & Lubart, 1996), creativity is defined as a 2-part process of buying low by investing in unusual ideas and then selling high by convincing others of the value or usefulness of these new ideas. This process requires both creative ideation and perseverance. The purpose of this research was to examine the psychometric properties of instrumentation proposed to assess the 2 underlying constructs in this definition: the creative ideational behavior required to buy low and the persevering behavior required to sell high. In particular, psychometric properties of a creativity ideation measure, the Runco Ideational Behavior Scale (RIBS Scale: Runco, Plucker, & Lim, 2001) and a perseverance measure, the Grit Scale (Duckworth, Peterson, Matthews, & Kelly, 2007) were examined in this study. Two samples of undergraduate students (N = 187; N = 817) completed a survey including these two scales and demographic information. Factor analyses were performed on the RIBS and Grit Scales. The RIBS Scale was found to have a 2-factor structure and 2 proposed new subscales. The Grit Scale’s previously reported 2-factor structure was confirmed.     

Test length and validity revisited

Results from three different subject samples extend earlier findings that lengthening a scale beyond some point can actually weaken its validity. A near-optimal algorithm selected the most valid aggregate of items from a common pool. Findings were then cross validated in a second sample. From this procedure emerged fairly short scales with acceptable cross validities, but only if the item pool had been prescreened for content saturation. Under these circumstances, even extremely short scales of two to four items each, which had survived double cross validation, suffered hardly any loss of cross validity. In a third sample they outperformed standard scales eight times as long. © 1997 John Wiley & Sons, Ltd.     

Reliability and validity of the Multiple Affect Adjective Check List - Revised

A recent factor analysis of the Multiple Affect Adjective Check List (MAACL) changed the Anxiety, Depression, and Hostility scales from bipolar to unipolar scales and added two new scales: Positive Affect and Sensation Seeking. Internal reliability of the MAACL-R scales, computed for normal and patient samples, was adequate for state and trait forms except for Sensation Seeking. Test-retest reliability in college students was higher for the trait form with retest intervals of from 2 to 8 weeks than for the state form with retest intervals of from 2 to 5 days. The pattern of correlations among self-, peer, and counselor ratings and the MAACL-R scales for normal and patient samples indicates improved discriminant validity and equally good convergent validity as the old scales. The use of standard scores that are indexed to the number of items checked reduced scale intercorrelations by controlling the acquiescence set.The financial support of the Weldon Springs Endowment Fund, University of Missouri at Kansas City, toward the completion of this research project is gratefully acknowledged.     

Development of short and very short forms of the Children's Behavior Questionnaire

Using data from 468 parents and taking into account internal consistency, breadth of item content, within-scale factor analysis, and patterns of missing data, we developed short (94 items, 15 scales) and very short (36 items, 3 broad scales) forms of the Children's Behavior Questionnaire (CBQ; Rothbart, Ahadi, & Hershey, 1994; Rothbart, Ahadi, Hershey, & Fisher, 2001), a well-established parent-report measure of temperament for children aged 3 to 8 years. We subsequently evaluated the forms with data from 1,189 participants. In mid/high-income and White samples, the CBQ short and very short forms demonstrated both satisfactory internal consistency and criterion validity, and exhibited longitudinal stability and cross-informant agreement comparable to that of the standard CBQ. Internal consistency was somewhat lower among African American and low-income samples for some scales. Very short form scales demonstrated acceptable internal consistency for all samples, and confirmatory factor analyses indicated marginal fit of the very short form items to a three-factor model.     

Examination of the reliability and validity of the personality assessment inventory

The reliability, discriminant validity, and construct validity of the Personality Assessment Inventory (PAI) — a multidimensional self-report measure of abnormal personality traits — were examined within the Australian context. Subjects included 151 normals, 30 alcoholics, and 30 schizophrenic patients. A subsample of 70 nonpsychiatric adults responded to the PAI items twice over a test-retest interval of 28 days. The resulting median retest coefficient was 0.7, indicating less than optimal stability. The median alpha (KR₂₁) coefficient was 0.8, suggesting somewhat narrow measurement scales. A significant multivariate main effect was obtained across groups after the effects of age and gender were removed. Multiple comparisons for each of the PAI scales revealed significant differences between the respective groups, as discussed. A higher-order scale factoring did not strongly support the purported PAI structure. In reanalyses of the correlation matrices included in the Professional Manual, the purported PAI factor structure was unable to be replicated for the standardization clinical sample (N=1246), and a confirmatory factor analysis using the normative (validation) correlational data (N=1000) revealed poor fit indices, raising further concerns about construct validity.     

An examination of the structural, discriminant, nomological, and incremental predictive validity of the MSCEIT© V2.0

We examined the structural, discriminant, nomological, and incremental predictive validity of a behavioral measure of emotional intelligence, using data from two undergraduate student samples. Covariance structure modeling indicated that the eight subscales of the MSCEIT© V2.0 were best modeled with a solution consisting of three first-order factors, and supported the existence of one higher-order factor of overall emotional intelligence. Multi-group confirmatory factor analyses indicated that the higher-order factor had discriminant validity from personality and conformity. Contrary to prediction, the higher-order factor was more highly correlated to social desirability than to general mental ability or long term affect. Finally, hierarchical regression results indicated that overall emotional intelligence did not predict incremental variance in either GPA or life satisfaction.     

Development and Assessment of Short and Very Short Forms of the Infant Behavior Questionnaire–Revised

Using data from parents of 761 infants from 6 independent samples, short (91 items, 14 scales) and very short (37 items, 3 broad scales) forms of the Infant Behavior Questionnaire–Revised (IBQ–R), a well-established caregiver report measure of temperament for infants aged 3 to 12 months, were developed. The forms were subsequently evaluated with data from 1,619 participants from 11 samples. Over 90% of Cronbach's alphas and part–whole correlations calculated for the short and very short form scales were greater than.70. Interparent agreement was nearly identical to that obtained with standard IBQ–R scales, averaging.41 and ranging from.06 to.76. Longitudinal stability over multiple time spans, and estimated retest reliability of the short form scales, were highly similar to those of standard forms, with estimated retest reliability averaging.72 and ranging from.54 to.93. Convergent and predictive validity of select short form scales were comparable to, but slightly lower, than those observed for standard IBQ–R scales. Recommendations for the use of the standard, short, and very short scales are discussed.     

A Short Measure of the Revised Reinforcement Sensitivity Theory – RSQ17

The need for a research and practical tool, such as a short, reliable, and valid personality assessment test, suggests researchers to create shortened versions of original instruments. Reinforcement sensitivity questionnaire (RSQ) was created in line with some basic premises of revised Reinforcement sensitivity theory, which proposes three motivational and emotional systems: Behavioral inhibition system (BIS), responsible for scanning environment for potential threats, Behavioral activation system (BAS), responsible for aproaching behavior, and the Fight/Flight/Freeze system (FFFS), responsible for behavior in the present threat. RSQ comprises five scales: BIS, BAS, Fight, Flight, and Freeze. The aim of this study was to develop a short version of RSQ, which would be beneficial to both research and practical purposes. Item response theory analyses were used for item selection. The study comprised two samples of participants, whereby Sample 1 (N = 837, 34.6% male, aged 18 – 82, M = 31.63, SD = 13.54) served as the derivation sample, while Sample 2 (818 participants, 43.6% male, 18?75 years, M = 29.65, SD = 12.52) served as validation sample. Factorial validity of the short RSQ was examined on both Sample 1 and Sample 2. Convergent and divergent validity of the short RSQ was examined using RST-PQ, Jackson-5, BIS/BAS scales, and Big Five Inventory. The results point to satisfactory internal consistency, factorial validity, and construct validity of the short RSQ, suggesting that it is an adequate measure for research settings or other contexts which require the use of short personality questionnaires.     

Creativity versus conscientiousness: which is a better predictor of student performance?

This paper examines the extent to which the incremental validity of creative thinking (over and above personality) in the prediction of academic performance may be a function of assessment methods. British university students (N = 307) completed the Alternate Uses Test and Big Five personality inventory at the beginning of the first academic year. Students' academic performance was assessed throughout a 4‐year period via written exams, continuous assessment (tutored seminars) and a supervised dissertation in the final year. Creative thinking was more related to final dissertation marks than to exam and continuous assessment performance (which were associated with Conscientiousness, rather than creative thinking). A follow‐up questionnaire on preferences for different assessment methods revealed that creative thinking was positively related to preference for viva voce (oral) exams, group projects and final dissertation, but negatively associated with preferences for multiple‐choice and essay‐type exams, as well as continuous assessment. Implications are discussed with regard to educational settings, in particular assessment methods. Copyright © 2005 John Wiley & Sons, Ltd.     

Psychometric properties of the mobility inventory for agoraphobia: convergent, discriminant, and criterion-related validity

Aims of this study were (a) to summarize the psychometric literature on the Mobility Inventory for Agoraphobia (MIA), (b) to examine the convergent and discriminant validity of the MIA's Avoidance Alone and Avoidance Accompanied rating scales relative to clinical severity ratings of anxiety disorders from the Anxiety Disorders Interview Schedule (ADIS), and (c) to establish a cutoff score indicative of interviewers’ diagnosis of agoraphobia for the Avoidance Alone scale. A meta-analytic synthesis of 10 published studies yielded positive evidence for internal consistency and convergent and discriminant validity of the scales. Participants in the present study were 129 people with a diagnosis of panic disorder. Internal consistency was excellent for this sample, α = .95 for AAC and .96 for AAL. When the MIA scales were correlated with interviewer ratings, evidence for convergent and discriminant validity for AAL was strong (convergent r with agoraphobia severity ratings = .63 vs. discriminant rs of .10–.29 for other anxiety disorders) and more modest but still positive for AAC (.54 vs. .01–.37). Receiver operating curve analysis indicated that the optimal operating point for AAL as an indicator of ADIS agoraphobia diagnosis was 1.61, which yielded sensitivity of .87 and specificity of .73.     

Measuring the validity and psychometric properties of a short form of the Hypomanic Personality Scale

The Hypomanic Personality Scale (HPS) is used to investigate hypomanic traits and risk for bipolar spectrum disorders; however, the length of the HPS (48 items) may be prohibitive for clinical research and screening purposes. Meads and Bentall (2008) developed a promising 20-item version of the HPS; however, the psychometric properties and validity of the short form have not been thoroughly examined. The present study investigated the construct validity and psychometric properties of the short HPS. A sample of 2713 non-clinically ascertained young adults was used to assess psychometric properties of the short form relative to the original scale. Two non-overlapping subsamples (n = 522; n = 145) were used to investigate the validity of the short HPS using personality and temperament questionnaires and clinical interviews of bipolar psychopathology and diagnoses. The short and original HPS generally had comparable correlations with measures of temperament, personality, impulsivity, borderline personality, grandiosity, psychosocial functioning, and alcohol use, and comparably predicted DSM bipolar and bipolar spectrum diagnoses. Overall, the short HPS was found to be both reliable and valid. However, the short HPS tended to be more strongly correlated with pathological components of hypomanic personality and less strongly correlated with exuberant and potentially adaptive aspects of the construct.     

True or False? Keying Direction and Acquiescence Influence the Validity of Socio-Emotional Skills Items in Predicting High School Achievement

What type of items, keyed positively or negatively, makes social-emotional skill or personality scales more valid? The present study examines the different criterion validities of true- and false-keyed items, before and after correction for acquiescence. The sample included 12,987 children and adolescents from 425 schools of the State of São Paulo Brazil (ages 11–18 attending grades 6–12). They answered a computerized 162-item questionnaire measuring 18 facets grouped into five broad domains of social-emotional skills, i.e.: Open-mindedness (O), Conscientious Self-Management (C), Engaging with others (E), Amity (A), and Negative-Emotion Regulation (N). All facet scales were fully balanced (3 true-keyed and 3 false-keyed items per facet). Criterion validity coefficients of scales composed of only true-keyed items versus only false-keyed items were compared. The criterion measure was a standardized achievement test of language and math ability. We found that coefficients were almost as twice as big for false-keyed items’ scales than for true-keyed items’ scales. After correcting for acquiescence coefficients became more similar. Acquiescence suppresses the criterion validity of unbalanced scales composed of true-keyed items. We conclude that balanced scales with pairs of true and false keyed items make a better scale in terms of internal structural and predictive validity.     

Validity of the SDS-17 measure of social desirability in the American context

In Germany, Stober et al. (1999, 2001) presented evidence for the validity of the SDS-17, a new measure of social desirability bias. In the current investigation, three experiments (n = 800) assessed the SDS-17’s validity in the US environment. In all conditions SDS-17 scores correlated highly with Marlowe–Crowne scores. In Study 1, a group administration of a paper and pencil booklet, SDS-17 scores of 327 college students were higher under Fake Good than Standard conditions, and both were higher than scores in the Honest condition. Study 2, an online survey of a demographically diverse adult sample (n = 257), showed that the increase in SDS-17 scores under Fake Good conditions occurs also in a Web survey and that SDS-17 scores were unrelated to one’s demographic profile. Study 3, a group administration to 216 college students, revealed again that scores under Fake Good were higher than those under Standard administration and that SDS-17 scores correlated more highly with the Impression Management than with the Self-Deception subscales of the BIDR. The SDS-17 appeared valid for the US environment as a measure of socially desirable responding. The evidence, however, encourages its further assessment as an index of social desirability bias per se.     

青少年心理韧性量表的编制和效度验证

心理韧性（resilience）是积极心理学的热点课题。虽然国外已有很多测量工具,但在中国群体中的适用性未得到支持。基于心理韧性的过程模型,通过访谈法开发适合我国青少年群体的心理韧性测量工具。通过访谈25名经历过较大负性生活事件而又适应良好的中学生,编制出100个题目,在283名青少年中初测,通过项目鉴别度分析和探索性因素分析,保留了27个题目,包含目标专注、情绪控制、积极认知、家庭支持和人际协助五个因子,α均大于0.7。复测样本包含420名青少年,验证性因素分析支持了量表的结构效度,二阶因素分析发现前3个因子属于个人力,后2个因子属于支持力。以其他心理韧性量表（RS）和中学生生存质量为关联效标,皮尔逊相关分别为0.53和0.49,支持了量表的外部效度。文章最后讨论了我国青少年心理韧性结构的文化意义及量表的应用范围     

Evaluation of Two New Scales Assessing Driving Anger: The Driving Anger Expression Inventory and the Driver's Angry Thoughts Questionnaire

This study assessed the validity of the Driving Anger Expression Inventory (DAX) and Driver's Angry Thoughts Questionnaire (DATQ). Scales within the DAX and DATQ appeared to assess separate, correlated constructs. Aggressive forms of thinking and anger expression correlated positively with each other, trait driving anger, aggressive and risky behavior, some crash-related conditions, general trait anger, and general forms of anger expression. Positive, constructive forms of thinking and anger expression correlated positively with each other, but minimally or negatively with other variables. Specific aggressive forms of thinking and anger expression formed stronger links with each other than other forms of expression, supporting the discriminant validity of the DATQ and DAX. Hierarchical regressions with DATQ and DAX scales entered after other variables showed that they added explained variance above and beyond other measures, supporting the discriminant and incremental validity of these scales. It was concluded that the DAX and DATQ have utility for researchers and clinicians interested in angry drivers.