The Psychometric Properties of 360 Degree Feedback: An Empirical Study and a Cautionary Tale

Amongst the purported advantages of multi-rater feedback systems is their greater accuracy and objectivity. It is argued here that these benefits may be more imagined than real, and that there is no reason to believe such systems will avoid many of the rating errors and distortions found in traditional top-down appraisal. The first study reported in this paper investigates the psychometric soundness and concurrent validity of a pilot 360 degree feedback scheme operated by a multi-national oil company. The second study describes how analysis of the data provided by the first study was used to re-design the rating form, and demonstrates the resulting improvement achieved in the psychometric properties of the 360 degree scheme. It also examined some of the variables that influence rater’s assessment of the target managers. The conclusion is drawn that unless such feedback systems — irrespective of whether they are used for development or for appraisal — are constructed and evaluated along the lines associated with psychometric tests, they may produce assessments that are seriously misleading.     

Effects of presentation rate and individual differences in short-term memory capacity on an indirect measure of serial learning

In three experiments, we studied the relation between degree of implicit learning and two aspects of short-term memory: (l) the activation level of the to-be-learned information, and (2) individual differences in short-term memory capacity. In all the experiments, we used the Nissen and Bullemer (1987) serial reaction time paradigm or a modification thereof. The effects of activation level were assessed by experimentally manipulating the rate of presentation. Individual differences in short-term memory capacity were assessed via traditional span measures. The experiments demonstrated that the rate of presentation reliably affected an indirect measure of learning (i.e., response time) under both incidental and intentional task instructions and under both single-task and dual-task conditions. Short-term memory span was reliably related to the indirect measure of learning only in some experimental conditions. The findings represent important constraints for models of implicit serial learning and are discussed within a general framework for understanding implicit learning and memory.     

Body image and exercise: A study of relationships and comparisons between physically active men and women

A group of physically active women (n=112) and men (n=88) of a broad range of ages were compared on a number of variables related to body image, weight and diet concerns, and degree of exercise participation. Interrelationships between these measures were also examined. Results indicated that men and women were equally dissatisfied with their current weight. Although most women wanted to lose weight, the men were evenly divided between those who wanted to lose and those who wanted to gain. Women, however, were more dissatisfied with their bodies and placed greater importance on their appearance as an influence on their feelings of well-being. Although there were no sex differences in degree of physical activity, women were more likely than men to exercise to try and lose weight. Of interest was the finding that age was not related to body focus or body dissatisfaction for either sex. For women and older men, the degree to which they exercised was not associated with any of the body image variables. A very different pattern of relationships was found for young men. Greater body satisfaction was associated with increases in exercise participation and with increased body focus, a variable that was also associated with increased levels of exercise. The profile of results is considered in the context of social influences such as health promotion and sex roles — factors that have likely affected current attitudes to physical appearance and physical attractiveness among both sexes.     

Combining whole-school and targeted programs for the reduction of bullying victimization: A randomized,effectiveness trial

Despite the extensive evaluation of school-based interventions for bullying, victimization remains a significant problem in schools. Bullying victimization is significantly predicted by contextual (school-related) factors. As a consequence whole-school programs have been commonly used to prevent and reduce bullying victimization. Evidence also points to individual risk factors (such as emotional distress) in predicting victimization, yet programs to prevent bullying victimization by changing these individual risks are far less developed. Few studies have approximated “real-world” implementation conditions in their trials. The current effectiveness trial evaluated the combination of a whole-school program designed to prevent bullying perpetration and victimization together with a targeted intervention for at-risk students, teaching them individual and dyadic strategies to reduce their anxiety and manage victimization, allowing schools some latitude to implement programs as they typically would. Students from Grades 3 and 4 (N = 8,732) across 135 schools were randomly assigned to one of four conditions: combined intervention; whole-school intervention only; individual intervention only; and care as usual. Victimization decreased significantly and similarly across all four conditions at 12 and 24 months following baseline. Similar reductions and failure to discriminate conditions were found on other key constructs: anxiety; bullying perpetration; and depression. Possible reasons for the failure to demonstrate victimization prevention differences and lessons learned from this large, effectiveness trial are considered.     

Children's understanding of habitual behaviour

Research into the development of Theory of Mind (ToM) has shown how children from a very early age infer other people's goals. However, human behaviour is sometimes driven not by plans to achieve goals, but by habits, which are formed over long periods of reinforcement. Habitual and goal‐directed behaviours are often aligned with one another but can diverge when the optimal behavioural policy changes without being directly reinforced (thus specifically hobbling the habitual learning strategy). Unlike the flexibility of goal‐directed behaviour, rigid habits can cause agents to persist in behaviour that is no longer adaptive. In the current study, all children predict agents will tend to behave consistently with their goals, but between the ages of 5 and 10, children showed an increasing understanding of how habits can cause agents to persistently take suboptimal actions. These findings stand out from the typical way the development of social reasoning is examined, which instead focuses on children's increasing appreciation of how others' beliefs or expectations affect how they will act in service of their goals. The current findings show that children also learn that under certain circumstances, people's actions are suboptimal despite potentially ‘knowing better.’     

What's in a name: what analyst and patient call each other

Awkward moments often arise between patient and analyst involving the question, "What do we call each other?" The manner in which the dyad address each other contains material central to the patient's inner life. Names, like dreams, deserve a privileged status as providing a royal road into the paradoxical analytic relationship and the unconscious conflicts that feed it. Whether an analyst addresses the patient formally, informally, or not at all, awareness of the issues surrounding names is important.     

A Danish version of the Sensation Seeking Scale and its relation to a broad spectrum of behavioral and psychological characteristics

The primary purpose of the present study was to evaluate the internal consistency and construct validity of the Danish translation of Zuckerman's Sensation Seeking Scale (SSS). The secondary aim was to extend the range of psychological variables and behaviors that have been related to sensation seeking. The sample consisted of 691 subjects (363 males and 328 females) with a mean age of 31.7 years. The internal consistency of the scales was evaluated by coefficient alpha and intercorrelations among the five scales derived from the SSS were computed. Information on other variables was collected through standardized tests as well as questionnaires and interviews developed especially for this study. The results showed that the Danish SSS is a psychometrically sound instrument and revealed the relationship between sensation seeking and a broad spectrum of psychological traits and behaviors: socioeconomic status, academic achievement, intelligence, personality, smoking, alcohol and drug use, sexuality, driving and public transportation violations, and leisure time activities. Thus, this study confirmed and expanded the findings of many previous studies, while the results supported the validity of the Danish SSS and corroborated the usefulness of the concept of sensation seeking.     

Familial Handedness and Access to Words, Meaning, and Syntax during Sentence Comprehension

We compared right-handed familial dextral (FS-) and familial sinistral (FS+) participants who were aged either 10-13 years (children) or 18-23 years (adults). In word probe and associative probe tasks, FS+ adults responded faster than all other groups and FS+ children responded more slowly than all other groups. In the word probe task, only the FS- adults showed a significant effect of the serial position of the target word. We interpret these differences to support an analysis-by-synthesis model of comprehension in which individuals who differ in familial handedness and age emphasize different linguistic representations during comprehension. In general, FS+ individuals focus on words and meaning, while FS- individuals focus on syntactic representations. In FS+ individuals, age-related experiences with language produce a shift in responding from compositional meaning to words and their associations. In FS- individuals, age-related experiences with language produce a shift toward responding based more on detailed syntactic representations, including the serial order of words and possibly the structural roles of clauses.