Innovation in multidisciplinary teams: The moderating role of transformational leadership in the relationship between professional heterogeneity and shared mental models

Research on the effectiveness of multidisciplinary teams has been equivocal. In an attempt to understand when a team’s professional heterogeneity (PH) is positively related to innovation (INN), we proposed an integrative model in which shared mental models (SMMs) are theorized as a mechanism to leverage INN in highly multidisciplinary teams. In addition, we claim that transformational leadership (TL), which is usually regarded as a factor contributing to team effectiveness, will attenuate the effect of teams’ PH on team SMM. In a field study of 55 R&D teams in Israel, we found that SMMs mediated the relationship between PH and INN, and that TL moderated the relationship between PH and Team SMM. We discuss the theoretical and practical implication of these findings.     

Assessing Workplace Emotional Intelligence: Development and Validation of an Ability-based Measure

Existing measures of Emotional Intelligence (EI), defined as the ability to perceive, understand, and manage emotions for productive purposes, have displayed limitations in predicting workplace outcomes, likely in part because they do not target this context. Such considerations led to the development of an ability EI measure with work-related scenarios in which respondents infer the likely emotions (perception) and combinations of emotion (understanding) that would occur to protagonists while rating the effectiveness of ways of responding (management). Study 1 (n = 290 undergraduates) used item-total correlations to select scenarios from a larger pool and Study 2 (n = 578) reduced the measure—termed the NEAT—to 30 scenarios on the basis of structural equation modeling. Study 3 (n = 96) then showed that the NEAT had expected correlations with personality and cognitive ability and Study 4 (n = 85) demonstrated convergent validity with other ability EI measures. Last, study 5 (n = 91) established that the NEAT had predictive validity with respect to job satisfaction, job stress, and job performance. The findings affirm the importance of EI in the workplace in the context of a valid new instrument for assessing relevant skills.     

The Validation of a Provider-Reported Fidelity Measure for the Transdiagnostic Sleep and Circadian Intervention in a Community Mental Health Setting

Monitoring treatment fidelity is essential to check if patients receive adequate doses of treatment and to enhance our theoretical understanding of how psychosocial treatments work. Developing valid and efficient measures to assess fidelity is a priority for dissemination and implementation efforts. The present study reports on the psychometric properties of the Provider-Rated TranS-C Checklist—a provider-reported fidelity measure for the Transdiagnostic Sleep and Circadian Intervention (TranS-C). Adults with severe mental illness (SMI; N = 101) seeking treatment in a community mental health setting received eight sessions of TranS-C. Therapists completed the Provider-Rated TranS-C Checklist at the end of each treatment session (N = 808) to indicate which modules they delivered during that session. To assess convergent validity, independent raters scored modules delivered from audio recordings of a subset of sessions (n = 257) for the modules delivered using the Independent-Rater TranS-C Checklist. Using exploratory factor analysis, a unidimensional scale composed of TranS-C’s modules was identified. Provider-Rated TranS-C Checklist scores were positively associated with the Independent-Rater TranS-C Checklist scores demonstrating convergent validity. Results indicate that the Provider-Rated TranS-C Checklist yields reliable and valid scores of providers’ delivery of TranS-C.     

Investigating linear and interactive effects of shared mental models on safety and efficiency in a field setting

Linkages between 2 types of shared mental models (SMMs)--that is, positional-goal interdependencies and cue-strategy associations--and effectiveness in an air traffic control environment were investigated. Two types of SMMs were expected to contribute uniquely, as well as interact, to predict tower safety and efficiency. Using SMM data from 306 air traffic controllers, and corresponding archival efficiency and safety measures for 47 airports, the authors found no significant linear relationships between SMMs and either outcome measure. However, the 2 SMMs interacted with one another to predict both outcomes. Results are discussed in terms of the importance of measuring multiple types of SMMs, the examination of complex relationships, and the importance of indexing decisions.     

Converging on quality: Examining multiple measures of teaching effectiveness

The present study explores the convergent and predictive validity for several widely used measures of teaching quality from the Measures of Effective Teaching Project (Bill and Melinda Gates Foundation, 2009-2011). Specifically, the Classroom Assessment Scoring System (CLASS; Pianta, Hamre, & Mintz, 2012), the Framework for Teaching (FFT; Danielson Group, 2013), and the Tripod Student Perceptions Scale (Tripod; Ferguson, 2008) were examined. Correlations among measures were assessed by developmental level and content area (elementary mathematics N = 70; elementary English language arts N = 101; middle school mathematics N = 291, middle school English language arts N = 280). Both average scores and score variability (i.e., coefficient of variation) for the CLASS, FFT, and Tripod were used to predict value-added models (VAM), a high-stakes measure of students' academic growth. For elementary mathematics and ELA, findings indicated the CLASS and FFT exhibited moderate convergent validity while divergent validity was found between the Tripod and the CLASS and FFT. Across content areas in middle school grades, the CLASS, FFT, and Tripod exhibited moderate to high-moderate convergent validity. Average student and observer scores were positively related to VAM scores, whereas variability in scores demonstrated negative relations to VAM scores. Implications of findings for teacher evaluation and professional development are discussed.     

Construct validity of the Profile of Mood States — Adolescents for use with adults

Objectives: To extend the validation of the Profile of Mood States-Adolescents (POMS-A: J. Sports Sci. 17 (1999) 861–872) from adolescent to adult populations.Design: A strategy of assessing the invariance of the POMS-A factor structure among disparate samples and of testing relationships with concurrent measures was used.Methods: The POMS-A was administered to 2549 participants from four samples: adult athletes prior to competition (n=621), adult student athletes in a classroom (n=656), adolescent athletes prior to competition (n=676), and adolescent students in a classroom (n=596). A subset of 382 adult student athletes was used to test the criterion validity of the POMS-A.Results: Confirmatory factor analysis provided support for the factorial validity of a 24-item, six-factor model using both independent and multi-sample analyses. Relationships between POMS-A scores and previously validated measures, that were consistent with theoretical predictions, supported criterion validity.Conclusion: Evidence was found in support of the psychometric integrity of the POMS-A when extended from adolescent to adult populations.     

Measuring Prosociality: The Development of a Prosocial Behavioral Intentions Scale

Prosociality is a critical issue in behavioral research. In this investigation, we developed a measure of prosocial behavioral intentions. Qualitative responses from two surveys (n = 465) and items from existing measures were used to generate a list of prosocial behaviors in which people might intend to engage. We factor analyzed responses to these items (n = 319) and retained the most common and representative items. The new measure demonstrated adequate internal consistency (n = 247, 147; α = .81, .83); convergent validity with past prosocial behavior (r = .51, .43), moral identity (r = .50, .55), and materialism (r = –.30, –.20). The instrument also predicted prosocial behavior while controlling for a prior measure of prosocial intentions, Exp(B) = 1.99, Wald = 10.59, p = .001, thereby demonstrating incremental predictive validity. This 4-item scale could be used across contexts to advance the study of prosociality.     

The Social Behavior Scale for Preschool Children: Factorial Structure and Concurrent Validity

The aims of the present study were to examine the factor validity of a new social behavior assessment - the Social Behavior Scale (SBS) - using exploratory (sample 1, n = 169) and confirmatory (sample 2, n = 127) factor analysis, and to test factor invariance across gender in a sample of Italian preschoolers. The concurrent validity of the SBS was examined with measures of peer nominations and observed interactions (sample 3, n = 277). Findings confirmed the three-factor structure of the SBS: Emotional Competence, Social Engagement and Aggressiveness. Multigroup analysis provided evidence of factor invariance across gender. Concerning concurrent validity, results confirmed a great association between teacher-rating SBS and the other concurrent measures.     

The reward probability index: design and validation of a scale measuring access to environmental reward

Behavioral models of depression implicate decreased response-contingent positive reinforcement (RCPR) as critical toward the development and maintenance of depression (Lewinsohn, 1974). Given the absence of a psychometrically sound self-report measure of RCPR, the Reward Probability Index (RPI) was developed to measure access to environmental reward and to approximate actual RCPR. In Study 1 (n = 269), exploratory factor analysis supported a 20-item two-factor model (Reward Probability, Environmental Suppressors) with strong internal consistency (α = .90). In Study 2 (n = 281), confirmatory factor analysis supported this two-factor structure and convergent validity was established through strong correlations between the RPI and measures of activity, avoidance, reinforcement, and depression (r = .65 to .81). Discriminant validity was supported via smaller correlations between the RPI and measures of social support and somatic anxiety (r = – .29 to – .40). Two-week test–retest reliability was strong (r = .69). In Study 3 (n = 33), controlling for depression symptoms, hierarchical regression supported the incremental validity of the RPI in predicting daily diary reports of environmental reward. The RPI represents a parsimonious, reliable, and valid measure that may facilitate understanding of the etiology of depression and its relationship to overt behaviors.     

Can a Single Measure Estimate Protocol Adherence for Two Psychosocial Treatments for Youth Anxiety Delivered in Community Mental Health Settings?

Treatment adherence measurement can be time and resource-intensive in clinical trials, so the ability to measure protocol adherence for two distinct treatment programs with a single measure may benefit the field. The present study sought to determine if the Therapy Process Observational Coding System – Revised Strategies Scale (TPOCS-RS) could assess protocol adherence to two youth treatment programs. Treatment sessions (N = 796) from 55 youth (M age = 9.89 years, SD = 1.71; range 7–15 years; 55.0% White; 46.0% female) with primary anxiety problems treatment by 39 clinicians (M age = 40.54 years, SD = 9.56; 50.0% White; 80.0% female) were independently scored by coders using observational treatment adherence and alliance measures. The youth received one of three treatments: (a) Standard (i.e., cognitive-behavioral treatment program), (b) Modular (i.e., a program with cognitive-behavioral and parent training components), or (c) Usual Care. Consultants filled out a self-report measure of protocol adherence within the Standard and Modular conditions. Interrater reliability, ICC(2,2) for the various items for the full sample ranged from .17 to .92 (M ICC = .67; SD = .17). Scores from a TPOCS-RS subscale that mapped onto the specific content of the treatment protocols used in the Standard and Modular conditions evidenced convergent validity with the consultant-report adherence measure and discriminant validity with the alliance measure. The model-specific TPOCS-RS subscales also discriminated between the Standard and Modular treatments and Usual Care. This study provides initial evidence that (a) the TPOCS-RS has utility in estimating protocol adherence in different treatment programs and (b) support the score validity of the self-report consultation records.     

Combined Medication and CBT for Generalized Anxiety Disorder With African American Participants: Reliability and Validity of Assessments and Preliminary Outcomes

Using data from a study of combined cognitive behavioral therapy (CBT) and venlafaxine XR in the treatment of generalized anxiety disorder (GAD), the current article examines the reliability and convergent validity of scales, and preliminary outcomes, for African American compared with European American patients. Internal consistency and short-term stability coefficients for African Americans (n = 42) were adequate and similar or higher compared with those found for European Americans (n = 164) for standard scales used in GAD treatment research. Correlations among outcome measures among African Americans were in general not significantly different for African Americans compared with European Americans. A subset of patients with DSM-IV–diagnosed GAD (n = 24 African Americans; n = 52 European Americans) were randomly selected to be offered the option of adding 12 sessions of CBT to venlafaxine XR treatment. Of those offered CBT, 33.3% (n = 8) of the African Americans and 32.6% (n = 17) of the European Americans accepted and attended at least one CBT treatment session. The outcomes for African Americans receiving combined treatment were not significantly different from European Americans receiving combined treatment on primary or secondary efficacy measures.     

复杂任务中共享心智模型间的缓冲作用

共享心智模型（SMM）指队员对于团队的共享心理表征。复杂任务下高的一致性难以获得且易造成小集体意识,SMM的作用在于相互间的调节及共享信念对低一致性的调节作用。为了验证这些假设对9名不同行业创业者进行访谈,对访谈材料进行内容分析得到心智模型关键概念,经过概化理论分析后得到了4个SMM：任务、队友、团队协作以及团队精神。使用心智模型问卷在ERP模拟实验中测量31个团队的绩效和SMM一致性。结果发现团队协作模型一致性是预测绩效的有力指标;团队构成不影响各个SMM一致性;任务模型一致性正向缓冲了团队协作模型一致性对绩效的作用;团队精神模型一致性正向缓冲了团队协作模型一致性对绩效的作用。研究提示SMM对冲突的引导及增进团队成员相互理解方面的作用。     

Motivational Climate and Achievement Goals at the Situational Level of Generality

Based on the rule of compatibility, according to which motivational climate scales should capture both the objective environment and whether it activates particular goals, a measure is presented assessing achievement goals and climate perceptions in physical education at a particular point of time. In Study 1, students completed the questionnaires following an experimental manipulation where eight classes had task-involving drills (n = 185 students), eight classes had ego-involving drills (n = 174 students) and nine classes (n = 221) served as the control group. Study 2 was an intervention consisting of nine consecutive physical education lessons. Students in the intervention group (n = 174) pursued mastery goals and control group students (n = 181) participated in typical classes. Questionnaires were completed prior to the intervention and every third lesson. The structure of the model consisting of four achievement goals (mastery, performance approach, performance avoidance, and social approval) and four perceptions of teachers' emphasis on these goals was satisfactory and superior to the structure of all alternative models. Factor correlation results and the relationship of the current scales with intrinsic-extrinsic motivation and amotivation provided evidence of convergent and divergent validity for the measures. Results from multi-sample confirmatory factor analyses supported the invariance of factor loadings across samples and the invariance of covariances for the goals construct. In both studies, the differences that emerged between groups provided additional support to the construct validity of the present scales. Practitioners interested in the effects of teaching and coaching on motivational climate and achievement goal adoption could acquire useful feedback using these scales.     

The Effects of Warnings and Speeding on Scale Scores and Convergent Validity of Conscientiousness

We examined the effects of warnings and speeding on scale scores and convergent validity of a measure of Conscientiousness in a faking context (N = 329). A completely crossed 2 × 2 experimental design was used in which instructions (no warning or a warning) and speeding (with or without a time limit) were manipulated. No statistically significant effects on scale scores or convergent validity were evidenced for speeding. Warning participants did decrease Conscientiousness scores by almost 1 standard deviation (d = .91). Warnings also moderated the relationship between self- and observer-ratings of Conscientiousness such that the relationship between self- and observer-ratings was statistically significant and positive in the warned conditions (r _partial = .29, p < .01, n = 136), but this same relationship was statistically nonsignificant (r _partial = ?.14, p > .05, n = 148) in the unwarned conditions.     

Conforming to Masculine Norms: Evidence for Validity among Adult Men and Women

Assessment of masculinity as an ideological belief system (MI) has become increasingly popular. Validation of MI measures and subsequent research has relied heavily on undergraduate samples. In the present study, convergent and divergent validity of the Conformity to Masculine Norms Inventory (Mahalik et al., Psychology of Men and Masculinity, 4: 3–25, 2003) were examined among a convenience sample of 688 male and female adults who were divided into four groups (undergraduates, younger adults, middle-aged adults, older adults). Across groups, convergent validity was suggested by consistent relations with sexism, and divergent validity was suggested by consistent nonsignificant relations with masculine attributes. Results suggest that generalizations among male groups can be made with caution and that generalizations to women may be appropriate when the focal constructs are unrelated to women or femininity.     

Experiential Avoidance: An Examination of the Construct Validity of the AAQ-II and MEAQ

Experiential avoidance (also referred to as acceptance or psychological flexibility) is a core construct of third-wave behavior therapies. It is the tendency to avoid uncomfortable thoughts or feelings, even when doing so has negative long-term consequences. In order for developments in experiential avoidance and third-wave behavior therapies to continue, it is imperative to examine the construct validity of the most widely used measures of this construct, the Acceptance and Action Questionnaire–II (AAQ-II) and the Multidimensional Experiential Avoidance Questionnaire (MEAQ). In Amazon’s Mechanical Turk (N = 1,052) and college (N = 364) samples, we evaluated the construct validity of these measures. The AAQ-II demonstrated suboptimal patterns of convergent and discriminant validity with measures of neuroticism/negative affect (Big Five Inventory, Big Five Aspects Scale, Positive and Negative Affect Schedule), the MEAQ, and mindfulness (Five Factor Mindfulness Questionnaire). In contrast, the MEAQ demonstrated optimal convergent and discriminant validity. Factor analyses at the scale, subscale, and item levels demonstrated that the AAQ-II loads with indicators of neuroticism/negative affect and not with other constructs at the core of third-wave behavior therapies. In contrast, the MEAQ loads on factors with mindfulness or forms its own factors. These findings suggest the AAQ-II functions as a measure of neuroticism/negative affect, whereas the MEAQ functions as an indicator of experiential avoidance. These findings have substantial implications for research on experiential avoidance and third-wave behavior therapies. Therefore, in order to improve the theory, research, and practice of third-wave behavior therapies, we recommend using the MEAQ to assess experiential avoidance.     

Autism spectrum conditions among children and adolescents: A new profiling tool

There is considerable debate about the sociocognitive features of autism spectrum conditions (ASC), and a tool for profiling the sociocognitive profiles of children and adolescents with ASC is needed. The aim of this research was to evaluate the psychometric properties of a new questionnaire—The Australian Scale for Autism Spectrum Conditions (ASASC). Three hundred twenty‐two parents of children on the ASC spectrum, including autistic disorder (n = 76), Asperger's disorder (n = 188), and pervasive developmental disorder not otherwise specified (n = 21), and a clinical group of children with subclinical ASC features and no ASC diagnosis (n = 37). Measures include an initial scale measuring eight potential dimensions of ASC, a related screening tool for autism, and two previously validated social skills questionnaires. The questionnaires were administered online. The ASASC was factor‐analysed, internal and test–retest reliabilities (for a randomly selected 84 parents) were calculated, and preliminary tests of convergent and divergent validity were conducted. The resulting measure (44 items) contained five coherent and reliable dimensions: understand and express emotion, fact orientation, sensory sensitivity, social communication, and rigidity. The questionnaire had good test–retest reliability and convergent/divergent validity. The ASASC enables profiles of ASC symptomatology that should be useful in adjusting interventions to individual needs.     

An IRT analysis of motive questionnaires: The Unified Motive Scales

Multiple inventories claiming to assess the same explicit motive (achievement, power, or affiliation) show only mediocre convergent validity. In three studies (N = 1685) the structure, nomological net, and content coverage of multiple existing motive scales was investigated with exploratory factor analyses. The analyses revealed four approach factors (achievement, power, affiliation, and intimacy) and a general avoidance factor with a facet structure. New scales (the Unified Motive Scales; UMS) were developed using IRT, reflecting these underlying dimensions. In comparison to existing questionnaires, the UMS have the highest measurement precision and provide short (six-item) and ultra-short (three-item) scales. In a fourth study (N = 96), the UMS demonstrated incremental validity over existing motive scales with respect to several outcome criteria.     

Psychometric properties of the Conners-3 and Conners Early Childhood Indexes in a Spanish school population

Ba#ckground/Obje#ctive: To examine the psychometric properties of the Conners 3 ADHD Index (Conners 3 AI) and the Conners Early Children Global Index (Conners ECGI) parents’ form (PF) and teachers’ form (TF) in Spanish schoolers. Method: Two-phase cross-sectional study. In the first phase, information was gathered from teachers (n = 1,796) and parents (n = 882) of 4-5 and 10-11 year-old children. In the second phase (n = 196), children at risk of ADHD and controls were individually assessed. Results: The results confirmed the two-factor structure of the Conners 3 ADHD Index, which contains hyperactive-impulsive and inattentive symptoms, and the two-factor structure of the Conners ECGI PF, consisting of emotional lability and restless-impulsive symptoms. In contrast with the original version, the Conners ECGI TF presented an additional inattentive factor. Moderate-to-high rates of evidence of convergent validity with Child Behavior Checklist and Kiddie-Schedule for Affective Disorders & Schizophrenia, and evidence of external validity (academic achievement) were found. Scores were significantly higher in boys than in girls, for both indexes. Raw scores corresponding to clinical T-scores were higher than the original version. Conclusions: The Conners indexes may be considered reliable and valid instruments for detecting ADHD symptoms in Spanish populations.     

Assessing the Rising Emphasis on Muscularity for Women: Psychometric Properties of the Brazilian Version of the Female Muscularity Scale

The female appearance ideal has undergone considerable changes in recent years, resulting in increases in drive for muscularity among Brazilian women. The Female Muscularity Scale (FMS) was developed to assess muscularity concerns among U.S. women and was shown to be a promising measure of muscularity-related attitudes and behaviors. The present studies aimed to translate and culturally adapt the FMS to Brazilian Portuguese and to explore its factorial structure among Brazilian women (Study 1: n = 202, M_age = 24.40, SD = 5.03) and to confirm the factor structure as well as evaluate convergent and divergent validity and reliability of the FMS for young adult Brazilian women (Study 2: n = 382, M_age = 22.71, SD = 4.32). Exploratory factor analysis revealed a two-factor structure (Attitudes and Behaviors subscales), each comprising five items. Confirmatory factor analysis upheld the original two-factor structure with good fit indices. The full scale and its subscales presented convergent validity through associations with measures of body dissatisfaction, drive for muscularity, body-ideal internalization, body checking and avoidance behaviors, disordered eating, and exercise engagement. Evidence of divergent validity was obtained in relation to self-esteem and depressive symptoms. The Brazilian version of FMS also presented adequate values for internal consistency and 2-week test-retest reliability. These findings support the Brazilian version of the FMS as a useful tool for investigating muscularity-related aspects of body image and body change behaviors that are increasingly a source of concern for women.