The effects of base rates and individuating information on judgments about another person

Past research suggests that in judging a person's category membership, people largely ignore the population frequency of membership in the category (base rates) in favor of individuating information about the particular person. This study tested the hypothesis that base rates will be utilized to the extent that the usefulness of the individuating information for diagnosing category membership is diminished. Subjects were given problems in which both base rates of membership in each of two categories and individuating information about a target person were presented. Then, in each case, they were asked to assess the probability that the target person belonged to each category. In three sets of problems, the diagnostic usefulness of the individuating information (personality characteristics) was diminished by including individuating information that was either inconsistent or irrelevant, or by increasing the similarity of the two alternative membership categories. In a fourth set of problems, the individualistic information included consistent, relevant personal characteristics and the membership categories were dissimilar. As expected, base rates were used in each of the first three sets of problems but were ignored in the fourth set. The results were interpreted in terms of informational factors that induce a shift away from a habitual, spontaneous reliance on a source of information (e.g., personality traits) for which one has well-developed rules (e.g., intuitive personality theories), and toward a more controlled, deliberate mode of thinking wherein other sources of information (e.g., base rates) are attended to and incorporated into judgment through less frequently used rules (e.g., sampling rules).     

Reinforcement and attraction specifying the effects of affective states

A multiplicative effect of magnitude and proportion of positive reinforcements on attraction and self-rated feelings was examined. Subjects (N = 270) rated their attraction toward persons associated with one of three reinforcement magnitudes (personality similarity, attitude similarity, and personal evaluations) and one of six proportions of positive reinforcements (.00, .20, .40, .60, .80, and 1.00). Results indicated that the slope of the linear attraction function increased and the Y-intercept decreased with increasing magnitude of reinforcement (p < .05). A similar interaction effect was found on the feelings of the subjects (N = 90) in another experiment. The results were interpreted as added support for Byrne's reinforcement-affect model of interpersonal attraction.     

Employment Interview Reliability: New meta‐analytic estimates by structure and format

This study sought to provide an update on evidence regarding the interrater reliability of employment interviews. Using a final dataset of 125 coefficients with a total sample size of 32,428, our results highlight the importance of taking all three sources of measurement error (random response, transient, and conspect) into account. For instance, the mean interrater reliability was considerably higher for panel interviews than for separate interviews conducted by different interviewers (.74 vs. .44). A strong implication of our findings is that interview professionals should not base perceptions of the psychometric properties of their interview process on interrater estimates that do not include all three sources. A number of directions for future research were identified, including the influence of cues in medium structure panel interviews (e.g., changes in tone or pitch) and the lower than expected reliability for highly structured interviews conducted separately by different interviewers.     

Acceptance of Structured Diagnostic Interviews for Mental Disorders in Clinical Practice and Research Settings

The objective of this study was to investigate the acceptance of structured diagnostic interviews in clinical practice, as well as research, settings. Using the Diagnostisches Interview bei Psychischen Störungen (the modified and extended German version of the Anxiety Disorders Interview Schedule for DSM-IV), 10 certified interviewers conducted 183 structured interviews in different inpatient, outpatient, and research settings in Switzerland and Germany. After each interview, patients and interviewers filled out a questionnaire asking for their evaluation of the interview. Patients' and interviewers' reactions to the interview were highly positive. On a scale measuring overall satisfaction with the interview (0 = not at all satisfied, 100 = totally satisfied) the mean patient rating was 86.55 (SD = 13.18), and the mean interviewer rating was 85.82 (SD = 12.84). The procedure used by the interviewer was rated by 142 (78.5%) patients as being helpful, and 176 (96.7%) rated the relationship as being positive. Less than 16% of the interviews were described as exhausting by the patients and interviewers. A majority of the interviewers (92.6%) indicated that during the interview they could respond adequately to the patient. The results of this study indicate that structured diagnostic interviews are highly accepted by interviewers and patients in a variety of settings. These findings, together with the existing evidence of the reliability and validity of structured interviews, should encourage their use in the diagnostic process, in outpatient and inpatient clinical settings as well as in research studies.     

Learning categories at different hierarchical levels: a comparison of category learning models

Three formal models of category learning, the rational model (Anderson, 1990), the configural-cue model (Gluck & Bower, 1988a), and ALCOVE (Kruschke, 1992), were evaluated on their ability to account for differential learning of hierarchically structured categories. An experiment using a theoretically challenging category structure developed by Lassaline, Wisniewski, and Medin (1992) is reported. Subjects learned one of two different category structures. For one structure, diagnostic information was present along a single dimension (1-D). For the other structure, diagnostic information was distributed across four dimensions (4-D). Subjects learned these categories at a general or at a specific level of abstraction. For the 1-D structure, specific-level categories were learned more rapidly than general-level categories. For the 4-D structure, the opposite result was observed. These results proved highly diagnostic for evaluating the models—although ALCOVE provided a good account of the observed results, the rational model and the configural-cue model did not.     

Assessing personality disorders using a systematic clinical interview: evaluation of an alternative to structured interviews

The aim of this study was to assess interrater reliability and provide initial data bearing on the validity of a method of assessing personality disorders (PDs) that does not presume that patients can accurately self-report personality pathology. In a sample of 24 outpatients, two clinician-judges independently applied the Shedler-Westen Assessment Procedure-200 (SWAP-200; Westen & Shedler, 1999a, 2000), a 200-item Q-sort procedure for assessing personality pathology, to data from the Clinical Diagnostic Interview (Westen, 2002), a systematic clinical interview that mirrors and standardizes methods used by experienced clinicians to diagnose personality. In 16 of the 24 cases, the treating clinician also independently described the patient using the SWAP-200 Q-sort, based on longitudinal knowledge of the patient over the course of treatment, blind to the interview data. Interrater reliability was uniformly high, with median correlations between interviewers at r > .80. Interviewer-treating clinician correlations were also high, with median convergent validity coefficients at r > .80. Diagnostic overlap (discriminant validity) was moderate for dimensional DSM-IV diagnoses, reflecting extensive comorbidity among disorders, but minimal for empirically derived diagnoses identified in prior research. Treating clinicians' dimensional PD diagnoses using this method also strongly predicted interviewer-rated measures of adaptive functioning. The findings provide preliminary support for the reliability and validity of an alternative to structured interviews for diagnosing personality pathology, and suggest that the way to improve validity of personality diagnosis may not be to minimize clinical inference but to quantify it using psychometric instruments.     

A counterintuitive hypothesis about employment interview validity and some supporting evidence

This study found mixed support for the hypothesis that the difference in criterion-related validity between unstructured and structured employment interviews is due solely to the greater reliability of structured interviews. Using data from prior meta-analyses, this hypothesis was tested in 4 data sets by using standard psychometric procedures to remove the effects of measurement error in interview scores from correlations with rated job performance and training performance. In the 1st data set. support was found for this hypothesis. However, in a 2nd data set structured interviews had higher true score correlations with performance ratings, and in 2 other data sets unstructured interviews had higher true score correlations. We also found that averaging across 3 to 4 independent unstructured interviews provides the same level of validity for predicting job performance as a structured interview administered by a single interviewer. Practical and theoretical implications are discussed.     

不同类别学习方式的对比研究

55名被试被随机分配到两个组,分别通过分类学习与推理学习来学习两个类别,之后,两组被试对新的测试项目进行典型性评定,考察类别学习方式对类别表征的影响。研究结果表明,分类学习者仅仅依据项目的诊断性程度来评定,而推理学习者主要依据项目的典型性程度来评定。所以,诊断性信息在分类学习者的类别表征中占有重要位置,典型性信息在推理学习者的类别表征中占有重要位置,即分类学习与推理学习导致的类别表征不同。     

Exploring the determinants of the graded structure of vocal emotion expressions

We examined what determines the typicality, or graded structure, of vocal emotion expressions. Separate groups of judges rated acted and spontaneous expressions of anger, fear, and joy with regard to their typicality and three main determinants of the graded structure of categories: category members' similarity to the central tendency of their category (CT); category members' frequency of instantiation, i.e., how often they are encountered as category members (FI); and category members' similarity to ideals associated with the goals served by its category, i.e., suitability to express particular emotions. Partial correlations and multiple regression analysis revealed that similarity to ideals, rather than CT or FI, explained most variance in judged typicality. Results thus suggest that vocal emotion expressions constitute ideal-based goal-derived categories, rather than taxonomic categories based on CT and FI. This could explain how prototypical expressions can be acoustically distinct and highly recognisable but occur relatively rarely in everyday speech.     

Hiring bias and the disabled interviewee: Effects of manipulating work history and disability information of the disabled job applicant

Ninety MBA students were randomly assigned to one of six experimental conditions in a 3(levels of disability) × 2(levels of employment history) design. Levels of disability (Physical, Psychiatric, and No Disability) and levels of employment history (Good and Poor) were manipulated by giving the subjects bogus information on a job application form prior to hearing a taped job interview. Subjects then rated the quality of the interview and stated the probability that they would hire the interviewee. Evaluations of the interview and hiring probabilities were different between the experimental groups. Implications and suggestions for future research are discussed.     

The Construct Validity of the Bioenergetic–Analytic Character Typology: A Multi-Method Investigation of a Humanistic Approach to Personality

The construct validity of the five bioenergetic–analytic character types was explored through a multitrait multi-method approach. Twenty-five college students had full-body photographs and Thematic Apperception Test (TAT) data rated using this typology, and these were compared to psychometric data, including from the Adjective Check List (ACL). The photographic ratings by two bioenergetic experts correlated significantly across all 5 types, evidencing satisfactory inter-rater reliability, but ratings on the TAT and ACL did not show adequate reliability and a comparison of the photographic ratings with the psychometrics did not evidence validity for the typology. The importance of developing multi-method approaches for holistic research across different domains within humanistic psychology, such as mind (psychological self-report) and body (photographic ratings) based methods, is emphasized.     

Age- and task-related differences in the use of category-size information for the retrieval of categorized items

Both the accuracy of category-size information and its use during the retrieval of categorized materials were investigated among kindergarten (5-year-old) and third-grade (8-year-old) children. Subjects were asked for free recall of a 34-item, categorized list wherein eight categories contained varying numbers of items. Subjects recalled items under either limited-time or unlimited-time conditions. Additionally, subjects were tested under one of three instructions: they were provided with the size of each category (Informed group), they were asked to estimate the size of each category (Estimation group), or they were given standard free recall instructions. Analysis of both the amount recalled and intercategory pause times indicated that third-graders' use of category size information was spontaneous, while kindergartners used the size information only when explicitly provided with it or asked for size estimates. Also, kindergartners' estimates of category size were much more in error than those of third-graders, although both groups erred on the side of underestimation. Importantly, when recall time limitations made the use of exhaustive category search less appropriate, third-graders were more apt to modify their search strategies.     

多面Rasch模型在结构化面试中的应用

使用项目反应理论中的多面Rasch模型,对66名考生在结构化面试中的成绩进行分析,剔除了由于评委等具体测量情境因素引入的误差对原始分数的影响,得到考生的能力估计值以及个体水平的评分者一致性信息。对基于考生能力估计值和考生面试分得到的决策结果进行比较,发现测量误差的确对决策造成影响,对个别考生的影响甚至相当巨大。进一步使用Facets偏差分析以及评委宽严程度的Facets分析追踪误差源。结果表明,将来自不同面试组的被试进行面试原始成绩的直接比较,评委的自身一致性和评委彼此之间在宽严程度上的差异均将导致误差。研究表明,采用Facets的考生能力估计值作为决策的依据将提高选拔的有效性。同时,Facets分析得到的考生个体层次的评分者一致性指标,以及评委与考生的偏差分析等研究结果还可以为面试误差来源的定位提供详细的诊断信息     

Developmental trends in children’s typicality judgments

Category typicality norms from 12 natural language categories are presented for kindergarten, third-grade, sixth-grade, and college students. Subjects first selected examples of familiar word concepts and rated them on a 3-point scale in terms of category typicality. Age differences in the percentage of items included as category members were found primarily for the less typical items, with inclusion rates varying as a function of both age and typicality level. The absolute level of typicality judgments increased with age, although correlations between the children’s and college students’ ratings were generally significant for all three children’s groups, with average correlations increasing somewhat with age. It was suggested that the rating data would be useful to developmental investigators interested in children’s processing of category information.     

Psychometric Properties of a Structured Behavioral Interview to Hire Private Security Personnel

This paper reports on a study about the reliability and validity of a structured behavioral interview to assess private security personnel. Reliability was estimated using interrater coefficients. Two independent interviewers were used to rate each interviewee. Results show a reliability coefficient of .81 (N = 43) and .89 with Spearman-Brown correction for two raters. Validity was estimated using a content validation approach. This strategy was suggested by Lawshe (1975) to estimate the content validity of selection tests. So far, only two studies carried out by Schmitt and Ostroff (1986) and Carrier et al. (1990) have used Lawshe's strategy in the structured behavioral interview case. The interview consisted of seven questions and each was rated by 11 experts in the job. Results show a significant content validity ratio (CVR) for majority of the questions in the interview and a content validity index (CVI) of .89. Implications of these findings for the practice of the structured behavioral interview are discussed and future research is suggested.     

Influence of physical and semantic information in a categorisation task of fragmented forms.

Two experiments were carried out to investigate the influence of structural and semantic information in the categorisation of visual forms. In experiment 1 the stimuli were pairs of 'well structured' or 'poorly structured' fragmented forms differing in structural properties including convexity, collinearity, and closure of the elements, and in their 'nameability'. The influence of structural and semantic information was tested by means of a task involving the presentation to both visual hemifields separately of stimuli having within-category physical similarity. For well structured forms, subjects were asked to judge if two sequentially presented forms belonged to the same semantic category. For poorly structured forms, subjects were required to decide if two stimuli belonged to the same previously learnt category of forms. For the two types of stimuli, one category was composed of physically similar items, and the other was composed of physically dissimilar items. The results show a marked advantage for the category composed of physically similar forms when the stimuli are well structured but no differences between the two categories when the stimuli are poorly structured. This suggests a facilitation in the computation of global shape information for forms having collinear and closed elements. The only effect of semantic information was a tendency towards a right visual field advantage for same-category pairs of well structured forms. The pattern of results for well structured fragmented forms (experiment 1) and forms in which fragments had been joined in order to complete the contour (experiment 2) were similar, suggesting that structured incomplete forms can be processed in the same way as forms having a continuous contour. Hypotheses about the organisational processes of forms are proposed in the discussion.     

Kindergarten children's use of category membership

Kindergarten children (N = 70) learned to order 12 photographically presented objects. The objects were well known and either unrelated or categorizable into two, three, four, or six well-known categories. Free recall was assessed. Results indicated that the children used category membership both to learn and to recall the items. However, they processed the list composed of six pairs of items at least as efficiently as lists composed of fewer but larger groups of items (including a list indexed as easiest through previous adult performance).