Selecting the most informative items in the IIP scales for personality disorders: an application of item response theory.

The first goal of the present analyses was to shorten the five scales (Pilkonis, P. A., Kim, Y., Proietti, J. M., & Barkham, M. [1996]. Journal of Personality Disorders, 10, 355-369) for personality disorders (PDs) developed from the Inventory of Interpersonal Problems (IIP), thereby increasing their attractiveness for screening purposes. The second goal was to illustrate, for more general purposes, the utility of item response theory (IRT) for such scale refinement. IRT analyses were performed using data collected from six different samples (N = 1149) at five sites and a two-parameter (2P) graded model designed for multiple response items like those on the IIP. The five most informative items from each scale were identified, based on the magnitude of item discrimination parameters and the range and elevation of individual item information functions. Preliminary analyses of the reliability and validity of the short forms of the scales (totaling 25 items) supported their value as alternatives to the longer forms (consisting of 47 items), although definitive tests of their psychometric properties await crossvalidation in independent samples. Analyses of the quality receiver operating characteristics (QROC) of the long and short forms showed that both versions can be useful in predicting the presence versus absence of any PD diagnosis arrived at by using either a "best estimate" clinical consensus method or a structured Axis II interview.     

Effects of constrained choice on memory: The extension of the multiple-cue hypothesis to the self-choice effect

The self-choice effect is the phenomenon whereby self-chosen items are remembered better than experimenter-assigned items. This study examined whether the effect occurs when the choice is constrained by cuing, and whether the effect also occurs for unchosen items. In the experiment, 33 participants chose (choice condition) or were assigned (force condition) a target from three alternatives that were followed by a cue sentence as a criterion for the choice. Cue sentences corresponded to any of the three alternatives (free cuing) or to only one (constrained cuing). Participants then engaged in free recall of targets and subsequent recognition of all alternatives (chosen and unchosen items). Memory performance was enhanced by choice regardless of the constraints, but was also enhanced for unchosen items. These results indicate that "free choice" is not always critical for the self-choice effect, and that multiple cuing involving unchosen items is a plausible account for the retention advantage of choice procedures.     

Toward a Shortened Measure of Adaptive Selling

This study investigates the psychometric properties of the adaptive selling scale (ADAPTS) developed by Spiro and Weitz (1990). A multiple industry sample of 1042 salespeople is employed, which provides the ability to more fully explore the dimensions of adaptive selling within a diverse cross-section of sales situations. An assessment utilizing confirmatory factor analysis suggests a shortened version of the scale consisting of five items that represent four of the facets originally proposed by Spiro and Weitz (1990). Based on its psychometric properties and measurement efficiency for business applications, this scale (labeled ADAPTS-SV, for shortened version) is recommended for future applications where appropriate.     

Psychometric characteristics of the Italian Clinical Depression Questionnaire using a 5-point rating scale with undergraduates

The aim was to investigate the psychometric properties of a proposed experimental version of the 1979 Italian adaptation of the Clinical Depression Questionnaire (Krug & Laughlin, 1976). This version is composed of an increased number of choice alternatives (5 instead of 3), tested with 240 Italian undergraduates. An exploratory item-factor analysis yielded one factor, which accounted for 28.2% of the variance. Analysis of the relationship between this version and an experimental one in 2002 of the 1979 Italian edition of the Anxiety Scale Questionnaire showed the corrective factor was not effective in increasing the discriminative power of the questionnaire for anxiety.     

Item placement on a personality measure: effects on faking behavior and test measurement properties

Although personality tests are widely used to select applicants for a variety of jobs, there is concern that such measures are fakable. One procedure used to minimize faking has been to disguise the true intent of personality tests by randomizing items such that items measuring similar constructs are dispersed throughout the test. In this study, we examined if item placement does influence the fakability and psychometric properties of a personality measure. Study participants responded to 1 of 2 formats (random vs. grouped items) of a personality test honestly and also under instructions to fake or to behave like an applicant. Results indicate that the grouped item placement format was more fakable for the Neuroticism and Conscientiousness scales. The test with items randomly placed fit the data better within the honest and applicant conditions. These findings demonstrate that the issue of item placement should be seriously considered before administering personality measures because different item presentations may affect the incidence of faking and the psychometric properties of the measure.     

Using Invariance to Examine Cheating in Unproctored Ability Tests

Despite their widespread use in personnel selection, there is concern that cheating could undermine the validity of unproctored Internet‐based tests. This study examined the presence of cheating in a speeded ability test used for personnel selection. The same test was administered to applicants in either proctored or unproctored conditions. Item response theory differential functioning analyses were used to evaluate the equivalence of the psychometric properties of test items across proctored and unproctored conditions. A few items displayed different psychometric properties, and the nature of these differences was not uniform. Theta scores were not reflective of widespread cheating among unproctored examinees. Thus, results were not consistent with what would be expected if cheating on unproctored tests was pervasive.     

Letters to the President

The Defense Mechanism Inventory and the Blacky Defense Preference Inventory were developed to measure the relative intensity of specific ego defense mechanisms and share similar theoretical underpinnings and psychometric properties. In this study, however, only two significant correlations were found among 25 comparisons between the respective defense mechanism scales of these two assessment devices, Several hypotheses are advanced to account for the incongruity between these two multiple choice personality tests.     

选项具有诊断信息的多选题认知诊断测验编制

编制选项具有诊断信息的多选题是提高多选题认知诊断测验诊断效果的有效方法.研究从认知诊断的目标出发,根据认知诊断测验质量的评价标准,结合多选题的特点,探讨选项具有诊断信息的多选题认知诊断测验编制的原则.同时,结合多选题的特点和多选题采用称名计分方式的需要,对编制选项具有诊断信息的多选题提出两点要求.根据多选题认知诊断测验编制的原则和要求,给出具有可操作性的多选题认知诊断测验编制的步骤.模拟研究结果表明：根据所提出的原则和要求编制的多选题认知诊断测验具有较好的诊断效果,说明这些原则和要求合理、可行.由于这些原则、要求和步骤具有较强的可操作性,因此它对于编制多选题认知诊断测验具有一定的指导意义.     

The optimal number of alternatives at a choice point with travel time considered

The problem of optimal design is considered for tasks that can be represented as n choice points with a_i alternatives per choice point. Examples are mazes or multiple choice tests. Some fixed time t′ elapses between choice points, say traveling from one to the other or reading a question, and additional time t is spent considering each alternative at the choice point. For fixed total time, the goal is to find the optimum number of choice points and the optimum number of alternatives at each choice point. In general, the longer the time spent between choice points, the greater the optimum number of alternatives at each point.     

Generating items during testing: Psychometric issues and models

On-line item generation is becoming increasingly feasible for many cognitive tests. Item generation seemingly conflicts with the well established principle of measuring persons from items with known psychometric properties. This paper examines psychometric principles and models required for measurement from on-line item generation. Three psychometric issues are elaborated for item generation. First, design principles to generate items are considered. A cognitive design system approach is elaborated and then illustrated with an application to a test of abstract reasoning. Second, psychometric models for calibrating generating principles, rather than specific items, are required. Existing item response theory (IRT) models are reviewed and a new IRT model that includes the impact on item discrimination, as well as difficulty, is developed. Third, the impact of item parameter uncertainty on person estimates is considered. Results from both fixed content and adaptive testing are presented.This article is based on the Presidential Address Susan E. Embretson gave on June 26, 1999 at the 1999 Annual Meeting of the Psychometric Society held at the University of Kansas in Lawrence, Kansas. —Editor     

内隐联系测验的修正——简式内隐联系测验

简式内隐联系测验(Brief Implicit Association Test,BIAT),是对内隐联系测验(Implicit Association Test,IAT)(也称为内隐联想测验)的修正,它由两部分联合任务组成,使用传统IAT中的两类别的属性材料和两类别的概念材料以及与IAT相同的联接-反应对。在设计BIAT时,焦点类别的选定对其测量效果有着至关重要的影响,Sriram和Greenwald的研究已经初步证明BIAT方法可以成功运用于测量内隐态度,认同和刻板印象。本文回顾了内隐联系测验发展过程中的各种变式,着重介绍了简式内隐联系测验,结合Sriram的应用对其进行综合评价并建议在今后的研究中对此方法进行验证。     

消费者独特性需求量表的研究

本研究目的是修订消费者独特性需求量表（CNFU）的中文版。研究对两个样本共计918名被试进行了问卷测量。项目分析显示,31个题目均符合心理测量学要求。验证性因素分析表明,26个题目的中文版量表符合原量表的三因素（即标新立异、非大众化和避免雷同）模型。量表的重测信度、内部一致性和分半信度均在0．85以上。量表具有较好的汇聚和区分效度,非学生样本得分显著高于学生样本。本文对量表今后的研究和应用进行了探讨。     

The simplest complete model of choice response time: linear ballistic accumulation

We propose a linear ballistic accumulator (LBA) model of decision making and reaction time. The LBA is simpler than other models of choice response time, with independent accumulators that race towards a common response threshold. Activity in the accumulators increases in a linear and deterministic manner. The simplicity of the model allows complete analytic solutions for choices between any number of alternatives. These solutions (and freely-available computer code) make the model easy to apply to both binary and multiple choice situations. Using data from five previously published experiments, we demonstrate that the LBA model successfully accommodates empirical phenomena from binary and multiple choice tasks that have proven difficult for other theoretical accounts. Our results are encouraging in a field beset by the tradeoff between complexity and completeness.     

心理健康素质测评系统·中国成年人心理弹性量表的编制

编制适用于我国成年人使用的心理弹性量表。通过对心理弹性研究的文献分析,将心理弹性定义为能够帮助个体从逆境、灾难、丧失或威胁等重大应激事件所造成的心理创伤中恢复过来的心理特质。在确立内控性,注重问题解决的应对风格,乐观性,接受和运用社会支持的人格倾向性,接纳性5个维度后,编写与之对应的50个项目。通过对420名大学生被试的测试进行项目筛选后,形成由30个项目组成的正式量表。通过对285名成年被试和457名大学生被试的实测,考察量表的心理测量学指标。结果表明,心理弹性量表具有较高的内部一致性信度和重测信度,也     

An adolescent version of the Michigan Alcoholism Screening Test

Item content of the Michigan Alcoholism Screening Test (MAST) was modified to make it more appropriate for young persons. The resulting test was found to have lower internal consistency than the adult MAST, but the elimination of five items with comparatively poor psychometric properties yielded an acceptable alpha coefficient of .73. A unitary factor model for the adolescent MAST was not confirmed; indeed, the revised test appeared to be factorially complex. Recommendations for further revisions are discussed.     

The depressive personality disorder inventory and current depressive symptoms: implications for the assessment of depressive personality

The Depressive Personality Disorder Inventory (DPDI; Huprich, Margrett, Barthelemy, & Fine, 1996; see Appendix) was created to assess Depressive Personality Disorder in clinical and nonclinical samples. Since its creation, the DPDI has been used in multiple studies, and the psychometric properties of the measure have generally supported its reliability, convergent validity, and construct validity; however, evidence for the measure's discriminant validity has been mixed. Specifically, the DPDI tends to correlate highly with measures of current depressive symptoms, which limits its efficacy in differentiating current depressive symptoms from a depressive personality structure. A principal components analysis of 362 individuals who completed both the DPDI and Beck Depression Inventory (BDI-II; Beck, Steer, & Brown, 1996) found that 49% of the variance was accounted for in two components. Seven items from the DPDI loaded more strongly on the first component composed of many BDI-II items. These items were removed in order to create a measure believed to assess DPD without the confounding influence of current depressive symptomology. Principal components analysis of the revised measure yielded three components, accounting for 46% of the variance. The revised DPDI was used to calculate convergent, discriminant, and construct validity coefficients from measures used in former studies. Virtually no improvement in the validity coefficients was observed. It is concluded that assessing DPD via self-report is limited in its utility.     

2008 Revision of the Chinese Code of Ethical Use of Psychological Tests and Its Implementation Status

In response to the rapidly increasing application and abuse of psychological tests in China, the Psychometrics Division of the Chinese Psychological Society published the 2008 revisions of the Chinese Code of Ethical Use of Psychological Tests. We investigated the implementation status of the code 2½ years after its promulgation. Sample included 284 psychological professionals and psychology graduate students. The average accuracy rate for the appropriate use of psychological tests was 67.1% (range = 25.5–97.5%), with 10 items having accuracy rates below 45%. Participants remained uncertain about the clients' rights to information about the purpose, psychometric properties, and scores of the tests. The most frequent violations involved “using psychological tests without psychometric information for entertainment purposes” and “using SCL-90 to measure mental health of normal people.”     

Factor analyses of two 'attitude toward gender role' questionnaire

Two questionnaires which purport to assess attitudes toward gender role, the Maferr Inventory of Feminine Values and the Sex Stereotype Questionnaire, were submitted to a factor analysis. While each analysis of the five response set items yielded interpretable factors with unequivocal item scores, the obtained factors are not consistent with the a priori assignment of items to "groupings" suggested by the manuals for these instruments. The implications of using questionnaires with questionable psychometric properties is discussed.     

Exploring the structure of Zuckerman's Sensation Seeking Scale, Form V in a Spanish sample

The psychometric properties of the original version of the Sensation Seeking Scale (Form V) were analyzed in a sample of 1,006 Spanish university students. The total sample was randomly split into two halves. Exploratory factor analyses were conducted on the calibration sample (n=504), whereas confirmatory factor analysis procedures were performed on the validation sample (n=502). As previous studies have suggested, exploratory factor structure indicated that several items load on a different factor or have loadings lower than .30. Those problems were surpassed when the best five items per factor were factor analyzed again. The confirmatory factor analyses showed that a 4-factor simple structure model gave a clearly imperfect fit. A model of 20 items (5 items per factor) gave a better fit, although with similar problems regarding the low reliabilities of the Experience Seeking and Boredom Susceptibility subscales. The need for improvement of the four-factor structure is discussed.     

If dancers ate their shoes: Inductive reasoning with factual and counterfactual premises

This experiment addressed the effect of precue information, which may be either familiar or novel, and either relevant or irrelevant, on the solution of inductive reasoning problems. Sixty undergraduate students each completed 216 verbal inductive reasoning problems and five psychometric ability tests. The reasoning problems were equally divided among analogies, classifications, and series completions, with half of each kind of item presented in a standard, uncued format, and half presented with a precue. With respect to internal validation, it was found that for analogies and classifications, subjects take longer to process irrelevant than relevant information if the precue is familiar, but they take longer to process relevant than irrelevant information if the precue is novel. For series completions, this relation does not hold; rather, both novelty and irrelevance add time to the processing of information, with the time for irrelevance greater than that for novelty. The utility of precues for different tasks was explored, and it was found that familiar relevant precues facilitated solution of the more difficult kinds of items (classifications and series completions), but hampered solution of the easier, more automatically solved items (analogies). With respect to external validation, it was found that the nonentrenched induction tasks overlapped with psychometric tests in terms of abilities measured, that the abilities measured were fluid rather than crystallized, and that the precued (more nonentrenched) items were better measures of fluid abilities than were the uncued items.