Do overall dimension ratings from assessment centres show external construct-related validity?

ABSTRACT

There have been repeated calls for an external construct validation approach to advance our understanding of the construct-related validity of assessment centre dimension ratings beyond existing internal construct-related validity findings. Following an external construct validation approach, we examined whether linking assessment centre overall dimension ratings to ratings of the same dimensions that stem from sources external to the assessment centre provides evidence for construct-related validity of assessment centre ratings. We used data from one laboratory assessment centre sample and two field samples. External ratings of the same dimensions stemmed from assessees, assessees’ supervisors, and customers. Results converged across all three samples and showed that different dimension-same source correlations within the assessment centres were larger than same dimension-different source correlations. Moreover, confirmatory factor analyses revealed source factors but no dimension factors in the latent factor structure of overall dimension ratings from the assessment centre and from external sources. Hence, consistent results across the three samples provide no support that assessment centre overall dimension ratings and ratings of the same dimensions from other sources can be attributed to dimension factors. This questions arguments that assessment centre overall dimension ratings should have construct-related validity.     

From Autocracy to Empowerment: Teams with Shared Leadership Perceive their Coaches to be Better Leaders

Sports coaches often fear that empowering the players in their team would undermine their own leadership status. To investigate the legitimacy of this perception, we mapped the leadership structure within 64 sports teams (N = 840). The results highlight that the perceived leadership quality of the coaches is positively related to the density of their team's leadership networks (i.e., the average leadership qualities of all players). This finding held for task, motivational, social, and external leadership. The best coaches are thus the ones who adopt a shared leadership approach and who strengthen the leadership quality of their players.

Lay Summary

Sports coaches often feel that empowering the players in their teams undermines their own leadership status. This study investigates the legitimacy of this perception within 64 sports teams. Our findings provide evidence for the opposite view; by creating and developing leaders in their teams, coaches are perceived as better leaders themselves.     

Measurement Equivalence of Paper-and-Pencil and Internet Organisational Surveys: A Large Scale Examination in 16 Countries

In multinational surveys, mixed‐mode administration modes (e.g. combining Internet and paper‐and‐pencil administration) are increasingly used. To date, no studies have investigated whether measurement equivalence exists between Internet data collection and data collection using the conventional paper‐and‐pencil method in organisational surveys which include a large number of countries. This paper examined the measurement equivalence of a truly global organisational survey across Internet and paper‐and‐pencil survey administrations. Data from an organisational survey in 16 countries (N = 52,461) across the globe were used to assess the measurement equivalence of an organisational climate measure within each country in which the survey was administered. The empirical data provided strong indications which support the measurement equivalence of the multi‐item survey instrument across Internet and paper‐and‐pencil surveys in virtually all countries in which the survey was conducted. These findings suggest that merging data obtained through Internet and paper‐and‐pencil data administration in a particular country is legitimate as no evidence was found for differential effects across both modes of data collection. Dans les enquêtes internationales, les modalités d’administration mixtes, c’est‐à‐dire combinant les solution Internet et papier‐crayon, sont de plus en plus utilisées. Jusqu’à présent, on ignore si le recueil de données par Internet est méthodologiquement équivalent au recueil traditionnel sur papier dans les enquêtes organisationnelles qui couvrent un grand nombre de pays. Dans cet article, on analyse l’analogie des mesures d’une enquête organisationnelle véritablement universelle utilisant à la fois une administration Internet et papier‐crayon. Des données provenant de seize pays (N = 52,461) répartis sur l’ensemble de la planète ont été exploitées pour évaluer l’équivalence méthodologique d’une mesure du climat organisationnel dans chacun de ces pays. Les résultats empiriques sont en faveur de l’équivalence méthodologique de l’ensemble des items pour les recueils Internet et papier‐crayon dans pratiquement tous les pays retenus pour l’enquête. Ces résultats montrent qu’il est légitime de traiter ensemble les données obtenues par Internet et par papier‐crayon dans un même pays puisque rien ne nous permet d’affirmer l’existence d’un effet différentiel dû aux deux modes d’administration.     

Revisiting scene primes for object locations

Sanocki and Epstein (1997) provided evidence that an immediate prior experience of a scene, as a prime, can induce representations of its spatial layout, facilitating the subsequent spatial processing of objects in the target scene. In their experiments, observers responded to target scenes by indicating which of two critical objects was closer in the pictorial space. Reaction times to target scenes that were preceded by same-scene primes without the critical objects were faster than reaction times to target scenes that were preceded by different scene or control primes (geometrical figures). By manipulating the nature of the prime and the interval between prime and target, and by cueing the position of the critical objects, we obtain evidence that the facilitating effect of the same-scene primes can also be explained by the sudden appearance of the critical objects in the target scene. In same-scene conditions, the critical objects cause a local onset, whereas in different-scene and control conditions the entire target scene causes a global onset. As a result, the local onset in the same-scene condition produces a shift of attention towards the critical objects, resulting in faster processing of the critical objects.     

Will Bootstrap Clustering Resuscitate Repertory Grid Assessment of Cognitive Complexity? Convergence with Integrative and Dialogical Complexity Suggests It Could

This article is concerned with an introduction and examination of a new cognitive complexity index derived from repertory grid data. Our approach follows Heckmann's and Bell’s introduction of bootstrap clustering of grid data. In order to examine the validity of the new index, we reanalyze data from an older study. The reanalysis showed that the new index correlated significantly with other independent complexity indices: integrative complexity and dialogical complexity. The directions of correlations were in accordance with complexity theories that underlie the indices. These findings support the validity of the cognitive complexity index based on bootstrap clustering.