Eight issues in studying organizational constructs: Tackling a complex problem

Much of the industrial/organizational psychology research literature involves abstractions called constructs. Frequently, new constructs are proposed and measures are developed, revised, and evaluated in studies for modeling or predicting organizational criteria. There are many hazards in these studies that lead to incorrect conclusions and decisions. This is especially applicable to the introduction and use of new constructs. We discuss several methodological issues that affect the interpretation of results from theoretical and applied studies and provide examples where construct confusion occurred due to failure to use best practices. A paradigm is proposed to increase the efficacy of studies regardless of which model of constructs has been chosen. Consideration is given to sample characteristics, range restriction, reliability of scores, criterion development, identifying latent sources of variance, content validity, comparing regression equations, and defining the nomological network.     

Toward quality criteria for collective judgments

While most organizational and social decision making is done in a group or collective mode, there are few guides or evaluative criteria for judging when a high-quality outcome has been reached. Most past studies of group decision making have been conducted in laboratories using student subjects and factual problems with correct answers as means for judging outcome quality. Such proxies are rough approximations at best of real-world conditions where value differences can be intense and problems have no correct or best answer. Drawing upon the existing literature, evaluative criteria are proposed including process, content, and outcome concerns. An instrument based upon these criteria is then applied retrospectively to six cases of ad hoc collective decision making. Using dimensional analyses, a set of more detailed evaluative factors is derived from actual participant responses. The results provide some insights into the nature of high-quality collective judgments as well as the most effective procedures for their achievement.     

The incremental validity of psychological testing and assessment: conceptual, methodological, and statistical issues

There has been insufficient effort in most areas of applied psychology to evaluate incremental validity. To further this kind of validity research, the authors examined applicable research designs, including those to assess the incremental validity of test instruments, of test-informed clinical inferences, and of newly developed measures. The authors also considered key statistical and measurement issues that can influence incremental validity findings, including the entry order of predictor variables, how to interpret the size of a validity increment, and possible artifactual effects in the criteria selected for incremental validity research. The authors concluded by suggesting steps for building a cumulative research base concerning incremental validity and by describing challenges associated with applying nomothetic research findings to individual clinical cases.     

Innovation in HIV prevention: organizational and intervention characteristics affecting program adoption

A multiple case study design was used to explore the organizational characteristics of community-based organizations that provide HIV prevention programs and the criteria these organizations employ when judging the merits of externally-developed HIV prevention programs. In-depth interviews were conducted with organizational representatives of 38 randomly-selected HIV prevention providers throughout Illinois. Results indicated that there were three main types of adopting organizations: adopters of entire programs, adopters of program components and practices, and adopters of common ideas. These three types of organizations were distinguished by their level of organizational commitment to HIV prevention, organizational resources, and level of organizational maturity. Narrative data from the interviews are used to describe the dimensions that underlie the organizations' program adoption criteria. The criteria of merit used by these organizations to evaluate prevention programs provide partial empirical support for existing theories of technology transfer. Implications for designing and disseminating HIV prevention programs are discussed.     

组织健康：概念、特征及维度

组织面临空前激烈的挑战和压力,长期以来被忽视的组织健康正在受到国内外学者和企业界人士的关注和重视。作者对国内外已有研究成果进行了梳理,结合时代背景界定了组织健康的概念,总结了组织健康具有环境适应性、自我调节性、学习创新性、持续成长性和组织、员工与社会健康并存性等特征,并列举了现有研究的维度划分类型。目前学界对组织健康的研究尚处于探索阶段,组织健康的内涵、维度及其测量等基础性问题的解决是进一步开展组织健康前因后果研究的前提,在此基础上,才能为促进组织健康提供可靠有效的管理建     

Computer methods and ecological validity in reading research

Computer-based procedures for obtaining word-by-word reading times are evaluated in terms of criteria for basic research and for ecologically valid research. Ecological validity can sometimes compromise experimental designs that should control extraneous variables or separate confounded factors. Two reading paradigms that were developed for basic research on linguistic coding mechanisms are also shown to meet many of the criteria for ecological validity.     

Assessing interpersonal functioning: Views from within and without

In order to better integrate research on personality pathology, interpersonal problems, and social skills, we applied the traditional methods of these three research strands (questionnaires, interviews, and interpersonal role-plays) to the same sample. Participants who attributed higher levels of interpersonal problems to themselves in general were also more critical of their own role-play performances, but these impressions were not mirrored by observer-ratings. Self-observer agreement in judging overall role-play performance was essentially zero. Interviewer-ratings of personality pathology had incremental validity over self-ratings in predicting observer-rated role-play performance. Self-reports of interpersonal functioning leave relevant behavioral variance untapped and thus should be complemented by other sources of information.     

Social comparison processes in an organizational context: New directions

The goal of this article is to frame some new directions to social comparison research in organizational settings. Four themes are developed. First, we examine the role of organizational variables in shaping the basic sub processes in social comparison, such as the selection of referents. The second theme focuses on the meaning of level of analysis in social comparison processes. The third theme develops how time can enhance our understanding of social comparison. Lastly, we explore some methodological issues inherent in the three prior themes.     

权力感的无意识启动:方法研究*

情境性启动法是对权力感进行内隐社会认知研究的重要方法。本研究首先对权力情境性启动的两种启动方法(概念启动和定势启动)进行介绍,接着通过两个实验对两种启动方法在中文背景下的适用性和有效性进行了验证,认为中文材料的概念启动和定势启动是适用和有效的,可以作为国内权力社会认知研究中启动权力的方法。最后对权力概念启动和定势启动的研究范式、方法差异和内在机制进行了讨论。     

工作场所文明行为：从内隐的自我提升到外显的组织优化

工作场所文明行为是一种在组织文化下, 基于社会和组织角色义务的, 传达礼貌和尊重的主动性行为, 是一种向内要求自我控制, 向外主张尊重传达的行为, 它对于个体自身性格的塑造、组织中人际关系的改善以及文明氛围的培养都具有积极意义。在员工-员工、领导-下属、员工-顾客等关系中, 工作场所文明行为发挥着增进同事情谊、促进合作、增强领导力、建立信任、提升绩效等作用。未来的研究应该进一步厘清工作场所文明行为与不文明行为的关系, 运用动态视角研究它们发生、发展和被感知的机制, 以及这两种行为能否相互转化等问题。     

The analytic hierarchy process: An effective tool for a strategic decision of a multidisciplinary research center

The external orientation of academic research centers has a high impact on their internal organization. A multidisciplinary research center of the University of Groningen in the Netherlands is concerned with a strategic, organizational decision impelled by a shift in its external orientation. This decision implies a choice for either an organizational structure based on disciplines or an organizational structure based on the fields of application of research. Due to diverging opinions concerning the desirability of each alternative, a multicriteria decisionmaking approach has been applied. Saaty’s Analytic Hierarchy Process (AHP) has been used to facilitate joint decisionmaking processes by evoking consistent logical foundations and consensus formations. Strategic management has used a forward AHP model to determine the future research activities of this center based on its external orientation. Subsequently, two comparable decisionmaking groups have used a backward AHP model to choose the most appropriate organizational structure, based on criteria for scientific research. Feedback procedures have reduced disagreements and have led to a clear decision for a structure based on application fields of research.     

Introduction to the Special Issue on the Role of Personality Assessment in Consulting to Organizations

This special issue aims to advance the integration of personality assessment across applied contexts. Personality assessment is an integral part of clinical and organizational case conceptualizations, intervention planning, and change efforts. Yet, as the present historical account will illustrate, the literatures in relation to personality assessment have developed rather independently. The articles in this special issue highlight the importance of organizational personality assessment as relates to how (a) academics vs. practitioners look at standards for test selection (Furnham), (b) the intended use of tests (selection vs. employee development) impacts the criteria used to establish assessment tool validity (Moyle & Hackston), (c) personality models developed in social and personality psychology can be applied in organizational contexts (Shorey & Chaffin), (d) assessments are modified to more accurately assess operational definitions of constructs (Belwalker & Tobacyk), (e) perception and knowledge about personality of others can be assessed as an ability (Mayer, Lortie, Panter & Caruso), and (f) performance-based techniques can be used in organizational personality assessment to curtail faking and socially desirable responding (Harms, Krasikova & Luthans). The present introduction highlights the important contributions of these articles, individually and as a body, in advancing the integration and application of personality assessment in organizational contexts.     

Orthogonal rotation algorithms

The quartimax and varimax algorithms for orthogonal rotation attempt to maximize particular simplicity criteria by a sequence of two-factor rotations. Derivations of these algorithms have been fairly complex. A simple general theory for obtaining two factor at a time algorithms for any polynomial simplicity criteria satisfying a natural symmetry condition is presented. It is shown that the degree of any symmetric criterion must be a multiple of four. A basic fourth degree algorithm, which is applicable to all symmetric fourth degree criteria, is derived and applied using a variety of criteria. When used with the quartimax and varimax criteria the algorithm is mathematically identical to the standard algorithms for these criteria. A basic eighth degree algorithm is also obtained and applied using a variety of eighth degree criteria. In general the problem of writing a basic algorithm for all symmetric criteria of any specified degree reduces to the problem of maximizing a trigonometric polynomial of degree one-fourth that of the criteria.This research was supported by the Bell Telephone Laboratories, Murray Hill, New Jersey and NIH Grant FR-3.     

Beyond Rational Order: Shifting the Meaning of Trust in Organizational Research

Trust is a key term in social sciences and organizational research. Trust as well is a term that originates from and speaks to our human relational experience. The first part of the paper explores trust as it is interpreted within contemporary sociology and organizational research, and systematically questions five basic assumptions underlying the interpretation of trust in organizational research. The last part of the paper reviews selected phenomenological methodological studies of trust in work life situations, in a quest for how experiential trust can emerge and be studied in professional organizations. We suggest looking for the “in-betweens” or spaces of possibilities within organizational structures, roles and tasks for emerging, experiential trust.     

Criterion-related validity of the three-factor model of psychopathy: personality, behavior, and adaptive functioning

The Psychopathy Checklist-Revised (PCL-R) has been conceptualized as indexing two distinct but correlated factors. Previous research has established that these factors demonstrate distinct patterns of relations with external criteria. However, more recent findings suggest that the PCL-R psychopathy construct may encompass three distinguishable factors, reflecting affective, interpersonal, and behavioral symptoms. Here, we evaluated the validity of this newer three-factor model of the PCL-R factors with reference to external criteria from the domains of personality, antisocial behavior; and adaptive functioning in a sample of 310 incarcerated offenders. The interpersonal factor was related to social dominance, low stress reactivity, and higher adaptive functioning; the affective factor was correlated with low social closeness and violent offending; and the behavioral factor was associated with negative emotionality, disinhibition, reactive aggression, and poor adaptive functioning. These findings provide support for the convergent and discriminant validity of these psychopathy facets.     

社会困境问题的理论架构与实验研究

社会困境是指个体理性导致集体非理性这样的情境。社会困境研究的推进要求一个新的框架来理解已有理论, 这一框架将这些理论区分为宏观、中观和微观三个层面。实验研究依据这些不同层面的理论, 以实验游戏为工具来探讨人们在面临社会困境时做出选择的心理机制及其影响因素, 从而对社会困境问题发展出相应的问题解决路径。理论的发展、实验任务本身的改进以及研究的外在效度预示了通过实验方法来研究社会困境问题有着广阔的前景。     

A critical evaluation of the use of interpretative phenomenological analysis (IPA) in health psychology

With the burgeoning use of qualitative methods in health research, criteria for judging their value become increasingly necessary. Interpretative phenomenological analysis (IPA) is a distinctive approach to conducting qualitative research being used with increasing frequency in published studies. A systematic literature review was undertaken to identify published papers in the area of health psychology employing IPA. A total of 52 articles are reviewed here in terms of the following: methods of data collection, sampling, assessing wider applicability of research and adherence to the theoretical foundations and procedures of IPA. IPA seems applicable and useful in a wide variety of research topics. The lack of attention sometimes afforded to the interpretative facet of the approach is discussed.     

Rate it again: Using the wisdom of many to improve performance evaluations

Much research shows that judgmental estimation could be improved by combining estimates from independent judges as well as within judges. These results have been obtained mostly with judgments about matters of fact, that is, for which there are objective truth criteria. In the present research, we extend these findings to performance evaluations. In a controlled field study, expert judges provided evaluations of a large number of essays written by college applicants taking college entrance tests. The judges were asked to evaluate each essay twice—on two occasions, a week apart. This design allowed us to assess the benefits of two methods of combining evaluations: within rater and across raters. Accuracy gains were obtained with both methods. Although the within‐rater combinations yielded fewer gains than the across‐rater ones, they were still appreciable in comparison with the across rater ones. Our findings extend the class of judgments to which the “wisdom of many” could be applied. These findings are potentially applicable to performance evaluations in social, educational, and employment settings.     

Social Networking Websites,Personality Ratings,and the Organizational Context: More Than Meets the Eye?1

We examined the psychometric properties of the Big Five personality traits assessed through social networking profiles in 2 studies consisting of 274 and 244 social networking website (SNW) users. First, SNW ratings demonstrated sufficient interrater reliability and internal consistency. Second, ratings via SNWs demonstrated convergent validity with self‐ratings of the Big Five traits. Third, SNW ratings correlated with job performance, hirability, and academic performance criteria; and the magnitude of these correlations was generally larger than for self‐ratings. Finally, SNW ratings accounted for significant variance in the criterion measures beyond self‐ratings of personality and cognitive ability. We suggest that SNWs may provide useful information for potential use in organizational research and practice, taking into consideration various legal and ethical issues.