A validation study of Belbin's team roles

The Belbin team role preferences of the members of 55 teams were assessed by three independent methods: (1) Cattell's 16PF (Form 5) personality questionnaire, (2) video observation of a business simulation exercise and subsequent analysis with a Belbin behavioural checklist, and (3) Saville and Holdsworth's Occupational Personality Questionnaire. The 338 participants were drawn in approximately equal measure from managerial and non-managerial levels from equal numbers of manufacturing and public service organizations. A multitrait-multimethod correlation matrix derived from the data collected from the participants was employed to evaluate the convergent and discriminant validities of the Belbin team roles. Application of the Campbell and Fiske criteria to the matrix did not produce clear support for discriminant validity. Application of a correlated uniqueness model in a confirmatory factor analysis showed the Belbin team role model to be overparameterized and to lack both convergent and discriminant validity. Further modelling revealed that the Belbin team roles fit easily into a “Big Five” five-factor personality framework.     

Revised Space Fortress: A validation study

We describe briefly the redevelopment of Space Fortress (SF), a research tool widely used to study training of complex tasks involving both cognitive and motor skills, to be executed on currentgeneration systems with significantly extended capabilities, and then compare the performance of human participants on an original PC version of Space Fortress (SF) with the revised Space Fortress (RSF). Participants trained on SF or RSF for 10 sets of eight 3-min practice trials and two 3-min test trials. They then took tests involving retention, resistance to secondary task interference, and transfer to a different control system. They then switched from SF to RSF or from RSF to SF for 2 sets of final tests and completed rating scales comparing RSF and SF. Slight differences were predicted on the basis of a scoring error in the original version of SF used and on slightly more precise joystick control in RSF. The predictions were supported. The SF group started better but did worse when they transferred to RSF. Despite the disadvantage of having to be cautious in generalizing from RSF to SF, we conclude that RSF has many advantages, which include accommodating new PC hardware and new training techniques. A monograph that presents the methodology used in creating RSF, details on its performance and validation, and directions on how to download free copies of the system may be downloaded from www .psychonomic.org/archive/.     

A validation study of goal orientations and self-efficacy scales

The aim of the current study was to investigate the validity and reliability of goal orientation and self-efficacy scales. The scales were administered to 264 university students (154 from engineering departments, 110 from business administration). Two samples were used. In the first sample, the original factor model was tested with confirmatory factor analysis. In the second sample, the Turkish versions of the scales were factor analyzed. Principal components analysis resulted in three components for the Goal Orientation scale: Learning goal orientation, Performance-prove goal orientation, and Performance-avoid goal orientation. The Self-efficacy scale had one factor as expected. Cronbach's alpha coefficients were satisfactory. The results did not fully support the use of current Turkish versions of the scales. Results of the studies are discussed along with the strengths and limitations of the study and suggestions for further development of the scales.     

Automated analysis of the WISC-R: A validation study

This study evaluated and automated analysis system for the WISC-R Reports generated by psychological examiners and by a comoputer program were rated by a random sample of National Association of School Psychologists menbers using a rating scale developed for this study. The results indicated significantly higher ratings for the automated analysis on an overall item and on items addressing Verbal-Performance discrepancies, relative weaknesses, and relative lack of irresponsible interpretation. These results support cautious use of the automated reports and validation in current practice.     

The Karolinska Directed Emotional Faces: A validation study

Although affective facial pictures are widely used in emotion research, standardised affective stimuli sets are rather scarce, and the existing sets have several limitations. We therefore conducted a validation study of 490 pictures of human facial expressions from the Karolinska Directed Emotional Faces database (KDEF). Pictures were evaluated on emotional content and were rated on an intensity and arousal scale. Results indicate that the database contains a valid set of affective facial pictures. Hit rates, intensity, and arousal of the 20 best KDEF pictures for each basic emotion are provided in an appendix.     

Spatial memory in rats: A cross validation study

Two experiments were performed to investigate whether two measures of spatial memory, working memory (WM) and reference memory (RM), can be generalized over learning situations. In the first experiment, outbred WU rats were used; in the second four inbred strains. In both experiments rats were given 50 training trials in both a holeboard and a high-sided radial maze: 4 out of 16 holes and 4 out of 8 arms were baited. The number of WM (revisits to baited holes/arms) and RM (visits and revisits to never baited holes/arms) errors were calculated for 5 blocks of 10 trials; odd-even reliabilities were determined for the last 20 trials and were shown to be satisfactory for both measures in both types of apparatus. Error-decrements were analyzed by trend components. For both WM and RM, simple and canonical correlations were determined between means and significant trends in maze and holeboard as a test for construct validity; in both experiments r's and R_c's were very low. It was concluded that the concepts WM and RM are not validly generalizable over tests.     

A neuropsychiatric developmental model of serial homicidal behavior

Serial sexual homicide has been the object of intensive study from forensic psychiatric, criminological, developmental, and sociological perspectives. In contradistinction to these approaches, neuropsychiatric concepts and methods have received relatively little attention in this area. In this article we adopt a neuropsychiatric developmental perspective and undertake a review of the psychiatric literature on violence and autism spectrum disorders. Our analysis of this literature suggests the presence of an association between autism spectrum psychopathology and serial homicidal behavior. Recommendations for further research to help clarify the nature of this association are briefly discussed.     

The family of origin scale: A construct validation study

Data from 69 women and 63 men along with ratings from a panel of expert judges were used to assess the construct validity of the Family Of Origin Scale as a measure of family health. Loevinger's conception of construct validity, focusing on the substantive, structural, and external components of validity, was employed to organize the research procedures followed and the data analytic techniques used. Results showed that the instrument appears to be a useful measure of a warmth-coldness affect dimension in the family of origin, but the multi-dimensional structure of the test, as a measure of family-of-origin health, could not be validated. Suggestions for use, score interpretation, and further development are discussed.     

A construct validation study of the Human Figure Drawing Test

To assess whether the Human Figure Drawing Test provides an assessment of nonverbal cognitive maturity, correlations for 31 youngsters who ranged in age from 6-0 to 10-10 on the Human Figure Drawing Test and the Verbal, Performance, and Full Scale IQs of the Wechsler Intelligence Scale for Children--Revised (WISC--R) were examined. Significant correlations were observed for each of the scales, but the value of .69 for drawings and WISC--R Performance IQs was significant, suggesting the assessment that these tests are largely nonverbal. Implications for the role of language were posited.     

A validation study of driving errors using a driving simulator

BackgroundDriving simulators have become an important research tool in road safety. They provide a safer environment to test driving performance and have the capacity to manipulate and control situations that are not possible on-road.AimTo validate a laboratory-based driving simulator in measuring on-road driving performance by type and mean driving errors.MethodsParticipants were instructed to drive a selected route on-road. The same route was programmed in the driving simulator using the UC/Win-road software. All participants completed a background questionnaire. On-road driving behaviours of participants and driving behaviours in the simulator were assessed by an occupational therapist and two trained researchers using an assessment form. Interclass correlations were calculated to assess the inter-rater agreement between the researchers on driving behaviours. Paired t-tests were used to assess differences in driving performance between the simulator and on-road assessments.ResultsA convenience sample of 47 drivers aged 18–69 years who held a current Western Australian class C licence (passenger vehicle) were recruited into the study. The mean age was 34.80 years (SD: 13.21) with twenty-six males (55.32%) and 21 females (44.68%) completing the study. There was no statistical difference between the on-road assessment and the driving simulator for mirror checking, left, right and forward observations, speed at intersections, maintaining speed, obeying traffic lights and stop signs.ConclusionThe preliminary results provide early support for the relative validity of the driving simulator which may be used for a variety of road safety outcomes with reduced risk of harm to participants.     

A further validation of the bem sex role inventory: A multitrait-multimethod study

The present study used a multitrait-multimethod technique [D.T. Campbell and D. W. Fiske (1959) “Convergent and Discriminant Validation by the Multitrait-Multimethod Matrix,” Psychological Bulletin, 56, 81–105] to examine Bem's [(1974) “The Measurement of Psychological Androgyny,” Journal of Consulting and Clinical Psychology, 42, 152–162] use of an instrumental-expressive dichotomy to conceptualize the Masculinity and Femininity scales of the Bem Sex Role Inventory as statistically orthogonal constructs. Results indicate that while perhaps reliable, masculinity and femininity lack clear convergent and discriminant validity. Therefore, Bem's contention that masculinity and femininity are orthogonal constructs is questioned. Results are discussed in light of trait- vs. method-driven research.     

Colorado Learning Difficulties Questionnaire: validation of a parent-report screening measure

This study evaluated the internal structure and convergent and discriminant evidence for the Colorado Learning Difficulties Questionnaire (CLDQ), a 20-item parent-report rating scale that was developed to provide a brief screening measure for learning difficulties. CLDQ ratings were obtained from parents of children in 2 large community samples and 2 samples from clinics that specialize in the assessment of learning disabilities and related disorders (total N = 8,004). Exploratory and confirmatory factor analyses revealed 5 correlated but separable dimensions that were labeled reading, math, social cognition, social anxiety, and spatial difficulties. Results revealed strong convergent and discriminant evidence for the CLDQ Reading scale, suggesting that this scale may provide a useful method to screen for reading difficulties in both research studies and clinical settings. Results are also promising for the other 4 CLDQ scales, but additional research is needed to refine each of these measures.