Construct Validity of the Relationship Profile Test: Correlates of Overdependence,Detachment, and Healthy Dependency in Low Income Urban Women Seeking Medical Services

Four categories of paintings (N = 200), done by schizophrenic patients, art students, and education students were rated by judges (N = 13) as to whether the painter was schizophrenic or normal. There was significant agreement in correctly identifying paintings, but the percent correct, greater than chance, was only 9.99%. Judges did best on paintings with “human content.” Intelligence scores were related to correct identification of two paintings, while art experience related to proportion was judged schizophrenic for all four paintings. Stepwise regression analysis suggested that intelligence scores were artifactually related to painting scores but art experience was not.     

A measure of time perspective with the TAT and some issues of reliability

In an effort to duplicate high interrater reliability coefficients reported in the use of Epley and Ricks' (1963) time orientation scoring system with the Thematic Apperception Test (TAT), two pairs of judges and two different training procedures were employed. Reliability coefficients considerably lower than those quoted by other researchers were found. One method of using the system was to have judges discuss scoring differences during training and at various times during a research project until perfect agreement was reached. When used as an adjunct with periodic assessment' of reliability as judges scored a large number of stories, reliability coefficients within a range acceptable for research purposes were obtained. This procedure is presented with correlational evidence for the presence of the time factor that the scoring system purports to measure.     

Judging complex movement performances for excellence: A principal components analysis-based technique applied to competitive diving

Athletes rely on subjective assessment of complex movements from coaches and judges to improve their motor skills. In some sports, such as diving, snowboard half pipe, gymnastics, and figure skating, subjective scoring forms the basis for competition. It is currently unclear whether this scoring process can be mathematically modeled; doing so could provide insight into what motor skill is. Principal components analysis has been proposed as a motion analysis method for identifying fundamental units of coordination. We used PCA to analyze movement quality of dives taken from USA Diving’s 2009 World Team Selection Camp, first identifying eigenpostures associated with dives, and then using the eigenpostures and their temporal weighting coefficients, as well as elements commonly assumed to affect scoring – gross body path, splash area, and board tip motion – to identify eigendives. Within this eigendive space we predicted actual judges’ scores using linear regression. This technique rated dives with accuracy comparable to the human judges. The temporal weighting of the eigenpostures, body center path, splash area, and board tip motion affected the score, but not the eigenpostures themselves. These results illustrate that (1) subjective scoring in a competitive diving event can be mathematically modeled; (2) the elements commonly assumed to affect dive scoring actually do affect scoring (3) skill in elite diving is more associated with the gross body path and the effect of the movement on the board and water than the units of coordination that PCA extracts, which might reflect the high level of technique these divers had achieved. We also illustrate how eigendives can be used to produce dive animations that an observer can distort continuously from poor to excellent, which is a novel approach to performance visualization.     

The effects of self-monitoring on the expressive display of masculinity-femininity

Do self-monitoring processes influence (1) the correspondence between assessed personality and expressive masculinity-femininity, and (2) the cross-channel consistency (face, body, voice) of expressive masculinity-femininity? To answer these questions, 36 male and 36 females completed the Bem Sex-Role Inventory (BSRI) and Snyder's Self-Monitoring Scale, and then were videotaped as teachers. Five groups of naive judges rated these stimulus subjects on expressive masculinity-femininity, basing their respective ratings on: video pictures and voices, just pictures, just faces, just bodies, or just voices. A sixth group of judges rated subjects on physical attractiveness. The results indicated that judged physical attractiveness was significantly correlated with judged masculinity-femininity, with men being judged more masculine and females more feminine the more attractive they were. BSRI femininity correlated strongly with judged masculinity-femininity, and BSRI masculinity, less so. Finally, self-monitoring did prove to moderate the correspondence between personality and expressive behavior, and the cross-channel consistency of masculinity-femininity cues: however, these moderating effects were different for males and females.     

Power and Personality Perception in Real‐Life Hierarchical Relationships

The present study examined how Big Five personality ratings of the same target individuals differ as a function of the power relation between the target and the judge. Our targets were 37 employees with leadership duties from two large organizations. The targets' subordinates (N = 352), peers (N = 186), and superiors (N = 62) constituted our groups of judges. The targets and judges also provided self‐reports of personality. Subordinate judges showed higher consensus but not higher self‐other agreement than peer or superior judges. Furthermore, the targets were judged as more extraverted, more emotionally stable, less agreeable, and less open to experience by their subordinates than by their superiors. The results suggest that (i) observer consensus, but not self‐other agreement or assumed similarity varies as a function of real‐life power; (ii) the effects of power on mean trait scores are mostly congruent with the previously observed effects of power on behaviour and on stereotypes. Copyright © 2012 John Wiley & Sons, Ltd.     

Expertise Shapes Multimodal Imagery for Wine

Although taste and smell seem hard to imagine, some people nevertheless report vivid imagery in these sensory modalities. We investigate whether experts are better able to imagine smells and tastes because they have learned the ability, or whether they are better imaginers in the first place, and so become experts. To test this, we first compared a group of wine experts to yoked novices using a battery of questionnaires. We show for the first time that experts report greater vividness of wine imagery, with no difference in vividness across sensory modalities. In contrast, novices had more vivid color imagery than taste or odor imagery for wines. Experts and novices did not differ on other vividness of imagery measures, suggesting a domain-specific effect of expertise. Critically, in a second study, we followed a group of students commencing a wine course and a group of matched control participants. Students and controls did not differ before the course, but after the wine course students reported more vivid wine imagery. We provide evidence that expertise improves imagery, exemplifying the extent of plasticity of cognition underlying the chemical senses.     

Immediate recognition memory for wine

We describe a preliminary investigation concerning the short-term recognition memory function for gustatory stimuli (wines). In Experiment 1A, 24 non-expert wine drinkers completed a yes/no recognition task for 3-wine sequences. For the raw recognition scores, the serial position function comprised both primacy and recency. Recency did not, however, achieve significance for the d′ scores. In Experiment 1B, 24 participants completed the same yes/no recognition task for 3-visual matrix sequences. In contrast to Experiment 1A, the serial position function comprised recency and an absence of primacy. We argue that the presence of primacy for the wine sequences cannot be interpreted via a verbal labelling strategy, nor can it be interpreted via proactive interference from the first wine in the list on subsequent list items. The result suggests qualitative differences in the memory processing for gustatory and non-verbal visual stimuli.     

A validity scale sign calling for caution in the interpretation of MMPIs among psychiatric inpatients

Three expert MMPI judges classified 100 psychiatric inpatients as psychotic or non-psychotic on the basis of their MMPIs. Validity scale data, as well as clinical scale scores, were included for 50 of the profiles, while the validity scale scores were withheld from the judges for the remaining 50 profiles. Within each of the above two groups, half had a "positive" validity scale sign (a defensive validity scale configuration defined as L or K greater than or equal to 70, or both greater than or equal to 60) and half had a negative validity scale sign, indicating a lack of defensiveness. Using actual diagnosis as the external criterion, results indicated that the majority of defensive psychotic patients produced clinical scale configurations which appeared nonpsychotic to the judges. Conversely, the majority of nondefensive nonpsychotics produced psychotic-appearing clinical scale configurations. These two types of test misses suggest that K corrections on MMPI scales relating to psychosis are not optimal for psychiatric inpatients. Guidelines were developed for interpreting defensive profiles.     

Some Characteristics of the Good Judge of Personality

Summary

Although ratings of subjects and judgments of personality from photographs may, on the average, be highly inaccurate, yet there exist considerable individual differences in the “intuitive” abilities of different judges or raters. Twenty measures of ability to judge personality were obtained for 48 judges, together with a number of measures of intellectual, social-asocial, and artistic tendencies. An extreme absence of consistency was found between the judging tests; the accuracy depends not only on the subject who is judged, but also on the content of the judgment and on the conditions under which the judgment is given. However, the personalities of the good and bad judges manifested fairly uniform characteristics. Good judges of self are more intelligent and possess more sense of humor than the average. Good judges of friends and associates are less socially inclined and less intelligent, but more artistic than good self-judges. Good judges of strangers are distinctly more artistic and intelligent than the average, and, under certain conditions, more asocial.     

Stability of the Millon Adolescent Personality Inventory in an incarcerated delinquent population

Clinical use of the Millon Adolescent Personality Inventory (MAPI) depends on computerized interpretation of the pattern of scale score elevations in the profile beyond certain cutoff scores rather than the elevations of single scales. There has been no reported work on the stability of the scale scores or the stability of the 2-point codes in a delinquent population. The MAPI was administered to 46 incarcerated male juvenile delinquents and was readministered after a period of 2 to 4 weeks. The test-retest correlations of the base-rate scale scores ranged from .33 to .89 with a mean of .74, which compare favorably to Millon's (1982) standardization sample. However, only 41% of the 2-point codes were judged to be congruent between administrations. The poor congruence of the 2-point codes across administrations raises doubts about interpretive statements based on these codes.     

Stability of the Million Adolescent Personality Inventory in an Incarcerated Delinquent Population

Clinical use of the Millon Adolescent Personality Inventory (MAPI) depends on computerized interpretation of the pattern of scale score elevations in the profile beyond certain cutoff scores rather than the elevations of single scales. There has been no reported work on the stability of the scale scores or the stability of the 2-point codes in a delinquent population. The MAPI was administered to 46 incarcerated male juvenile delinquents and was readministered after a period of 2 to 4 weeks. The test-retest correlations of the base-rate scale scores ranged from .33 to .89 with a mean of .74, which compare favorably to Millon's (1982) standardization sample. However, only 41% of the 2-point codes were judged to be congruent between administrations. The poor congruence of the 2-point codes across administrations raises doubts about interpretive statements based on these codes.     

A comparison of administration procedures for the Rey-Osterrieth Complex Figure: flowcharts versus pen switching

The Rey-Osterrieth Complex Figure (ROCF) is commonly used to assess visuospatial skills, visuoconstruction, visual memory, and executive functioning. Two different methods are traditionally used to record the order in which the figure is drawn: the flowchart method and the pen-switching method. Although it has been suggested that pen switching may interfere with performance, to date no research has been conducted to assess whether ROCF performance significantly differs due to administration method. As part of routine neuropsychological evaluation, 100 inpatients and outpatients were randomly assigned to either method. Using the Boston Qualitative Scoring System and the traditional 36-point scoring method, the authors unexpectedly found that the pen-switching group generally performed better than the flowchart group, and productions drawn with pen switching were also significantly faster to score.     

The criminal and personality profile of patients with schizophrenia and comorbid psychopathic traits

Sixty-one male forensic patients who met the DSM-IV criteria for schizophrenia were categorised into high and low psychopathic trait groups using the Psychopathy Checklist: Screening Version. The groups were compared on their criminal history, symptom profile, personality style, risk scores and subsequent institutional violence. Patients with high scores on the PCL:SV had a greater number of previous convictions and were more likely to have a family history of criminality. The high psychopathy-scoring group had higher levels of Positive and Negative Syndrome Scale grandiose and hostile symptomatology, and higher scores on trait impulsivity and aggression. They also had a more coercive, less compliant interpersonal style than the low-psychopathy scoring group. The high-psychopathy scoring group were more likely to be involved in institutional aggression and had higher levels of risk for violence. Patients with schizophrenia and high levels of comorbid psychopathy have a distinctive interpersonal style that may contribute to their greater risk of disruptive institutional behaviour.     

The Many Meanings of Religiousness: A Policy-Capturing Approach

ABSTRACT This article reports the results of two policy-capturing studies that investigated individual differences in the meaning of religiousness. Policy capturing requires judges to respond to a large number of hypothetical scenarios or profiles that differ along a number of potentially relevant cues or attributes. Multiple regression analyses are then conducted to ascertain which cues are influencing each judge's responses. For both studies, 100 profiles were developed describing hypothetical individuals who differed on 10 cues thought to influence perceptions of religiousness (e.g., church attendance, doctrinal orthodoxy), and judges rated each profile on a 9-point religiousness scale. Judges in Study 1 were 27 Roman Catholic and Protestant college students. Policy-capturing analyses identified clear individual differences in the cues that afifected judgments of religiousness, and in the self-insight of the students into their personal policies. To test whether these findings reflected the youth or religious maturity of the sample, the study was replicated with a sample of 22 Catholic and Protestant clergy. Similar results were found in Study 2. In both samples, individual policy capturing did a significantly better job of predicting judgments of religiousness than did self-described policies or policies created by averaging across judges. Together these findings underscore the diversity of religious meanings and the need for further idiographic investigations in the psychology of religion.     

Sex differences in spatial ability and spatial activities

Explanations of sex-related differences in spatial ability emphasizing the role of sex-differentiated experience have not been supported by direct measurement of spatial activities during adolescence, the period when these differences seem to increase. The present research involved development of a scale to measure the spatial experience of adolescents and adults. In Study 1, a list, as complete as possible of adolescent activities was compiled and given to undergraduate judges for ratings of involvement of spatial skills and sex-typing. Judges also indicated whether they had participated in each activity. Activities considered spatial by 75% or more of the judges were used to develop a spatial experience questionnaire. Judgments of the spatial nature of tasks were positively correlated with judged masculinity and with greater male than female participation. In Study 2, participation in spatial activities by undergraduates was correlated with spatial ability as measured by the Differential Aptitude Test. The activity questionnaire should prove useful in studying the development of spatial ability in adolescents and adults.     

Minimizing gender differences in children's interest assessment: Development of the Inventory of Children's Activities-3 (ICA-3)

The focus of this study was on revising the Inventory of Children's Activities–Revised (ICA-R; Tracey & Ward, 1998) to enhance its psychometric properties while minimizing gender differences in scale scores. The original 30 ICA-R items and an additional 30 items were administered to 70,280 fifth-eighth grades students. The original scoring was compared to a revised scoring method based solely on the empirically best items and a scoring method balancing empirical scoring with minimizing gender differences. All three item sets (original, empirical, and combined empirical/gender balancing) resulted in strong internal consistency estimates and adequate fit to the circular structure, yet the combined empirical/gender method had much lower gender differences especially for the scales measuring Investigative and Social interests. The implications of using the revised scale with children is discussed.     

On the consistency of individual classification using short scales

Short tests containing at most 15 items are used in clinical and health psychology, medicine, and psychiatry for making decisions about patients. Because short tests have large measurement error, the authors ask whether they are reliable enough for classifying patients into a treatment and a nontreatment group. For a given certainty level, proportions of correct classifications were computed for varying test length, cut-scores, item scoring, and choices of item parameters. Short tests were found to classify at most 50% of a group consistently. Results were much better for tests containing 20 or 40 items. Small differences were found between dichotomous and polytomous (5 ordered scores) items. It is recommended that short tests for high-stakes decision making be used in combination with other information so as to increase reliability and classification consistency.     

METHODOLOGICAL AND PSYCHOMETRIC ISSUES IN SETTING CUTOFF SCORES USING THE ANGOFF METHOD

The present study examined several psychometric issues relevant to the use of a favored technique (the Angoff method) used to set standards in criterion referenced testing. The research was conducted within a setting which allowed (a) confident identification of expert and non-expert judges, and (b) estimation of "true" scores for items judged so that accuracy of judgments in addition to reliability could be examined. Results suggested that expertise of judges does make a difference in producing more accurate and reliable data, underscoring the importance of using true subject matter experts (SMEs) in the judgment process. A rater analysis technique (rater-total correlations) was illustrated, which might prove useful in improving the quality of data obtained using the Angoff method, particularly when there is some question regarding the internal consistency of ratings and expertise of some of the raters. Finally, a rater accuracy adjustment/calibration technique was examined and proved to be a potentially useful method to maximize accuracy of a standard derived using the Angoff method in settings where archival normative test data can be obtained. Other methods that could potentially be used to improve Angoff data were discussed.