最大信息量法在CCSPC评分中应用的效度证据

采用基于最大信息量法的多维项目反应理论模型估计计算机模拟心理咨询病例系统（CCSPC）的合成分数及四个模块分数,并收集效标效度证据、成长变化效度证据和内容效度证据,结果表明：五个指标与心理咨询师考试三级技能成绩的相关均达到显著,且高于其与三级理论成绩的相关;所有指标得分均随着心理学学历升高而升高;多数指标分数随心理学本科年级提高而提高;获得心理咨询师资格认证的被试在CCSPC上有更高的得分.     

Latent variables should remain as such: Evidence from a Monte Carlo study

Use of subject scores as manifest variables to assess the relationship between latent variables produces attenuated estimates. This has been demonstrated for raw scores from classical test theory (CTT) and factor scores derived from factor analysis. Conclusions on scores have not been sufficiently extended to item response theory (IRT) theta estimates, which are still recommended for estimation of relationships between latent variables. This is because IRT estimates appear to have preferable properties compared to CTT, while structural equation modeling (SEM) is often advised as an alternative to scores for estimation of the relationship between latent variables. The present research evaluates the consequences of using subject scores as manifest variables in regression models to test the relationship between latent variables. Raw scores and three methods for obtaining theta estimates were used and compared to latent variable SEM modeling. A Monte Carlo study was designed by manipulating sample size, number of items, type of test, and magnitude of the correlation between latent variables. Results show that, despite the advantage of IRT models in other areas, estimates of the relationship between latent variables are always more accurate when SEM models are used. Recommendations are offered for applied researchers.     

Putting the “IRT” in “Dirty”: Item response theory analyses of the Dark Triad Dirty Dozen—An efficient measure of narcissism,psychopathy, and Machiavellianism

The Dark Triad Dirty Dozen is a new, concise personality inventory designed to measure individual differences in narcissism, psychopathy, and Machiavellianism in sub-clinical populations. To date, the psychometric work on this measure has used classical test theory to assess its validity, reliability, and structure. In two independent samples (N = 1014), we provide the first analyses of this measure using item response theory. In both samples, the Dark Triad Dirty Dozen efficiently recovered information and showed some evidence of differential scale functioning by sex, with a lower endorsement threshold for men compared to women. Results shed new light on the measurement of these “dark” personality traits.     

Item grouping and item randomization in personality measurement

This paper describes a study examining the impact of item order in personality measurement on reliability, measurement equivalence and scale-level correlations. A large sample of university students completed one of three forms of the International Personality Item Pool version of the Big Five personality inventory: items sorted at random, items sorted by factor, and items cycled through factors. Results showed that the underlying measurement model and the internal consistency of the IPIP-Big Five scale was unaffected by differences in item order. Also, most of the scale-level correlations among factors were not significantly different across forms. Implications for the administration of tests and interpretation of test scores are discussed, and future research directions are offered.     

A methodological note on ordered Q-Sort ratings

Patterns of ratings using the Q-Sort method and the Likert-type method are compared. Ordering effects are found in Q-Sort ratings that are not present in Likert-type ratings. Specifically, item order is related to both item variance and item placement, such that items appearing near the end of the Q-Sort have less variance and more central placement. This finding is verified across three measures in several datasets spanning nearly 20 years of research. Such item order effects appear to attenuate average absolute relationships (covariances and correlations) between items appearing near the end of the Q-Sort and other measures. Randomization of items may be (in some situations) a viable course of action to minimize these effects at a sample level.     

Sensitivity of the Informant Questionnaire on Cognitive Decline: An Application of Item Response Theory

ABSTRACT

The Informant Questionnaire on Cognitive Decline (IQCODE) is a formal informant report instrument, originally developed by Jorm and Jacomb (1989 Jorm, A. F. and Jacomb, P. A. 1989. The Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE): Socio-demographic correlates, reliability, validity and some norms. Psychological Medicine, 19(4): 1015–1022. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Psychological Medicine, 19(4), 1015). The goal of the present study was to evaluate the range of cognitive decline in which the IQCODE is most sensitive, using item response theory (IRT). Existing data (N = 740) from a sample of community-dwelling older adults was used for this purpose. A 2-parameter model estimating item difficulty and discrimination fit the data best. Additionally, the IQCODE provided the most psychometric information in the range of ?0.5 < θ < 1.5, with peak information obtained at approximately θ = 0.4. Based on individuals' latent score (θ) estimates, items on the IQCODE are adequate for use as a screening tool for dementia. Results of the item calibration may be useful for targeted assessment needs, such as the development of short forms.     

Hebb repetition effects in visual memory: The roles of verbal rehearsal and distinctiveness

A version of the Hebb repetition task was used with faces to explore the generality of the effect in a nonverbal domain. In the baseline condition, a series of upright faces was presented, and participants were asked to reconstruct the original order. Performance in this condition was compared to another in which the same stimuli were accompanied by concurrent verbal rehearsal to examine whether Hebb learning is dependent on verbal processing. Baseline performance was also compared to a condition in which the same faces were presented inverted. This comparison was used to determine the importance in Hebb learning of being able to visually distinguish between the list items. The results produced classic serial position curves that were equivalent over conditions with Hebb repetition effects being in evidence only for upright faces and verbal suppression as having no effect. These findings are interpreted as posing a challenge to current models derived from verbal-domain data.     

Time-limited effects of emotional arousal on item and source memory

Two experiments investigated the time-limited effects of emotional arousal on consolidation of item and source memory. In Experiment 1, participants memorized words (items) and the corresponding speakers (sources) and then took an immediate free recall test. Then they watched a neutral, positive, or negative video 5, 35, or 50?min after learning, and 24 hours later they took surprise memory tests. Experiment 2 was similar to Experiment 1 except that (a) a reality monitoring task was used; (b) elicitation delays of 5, 30, and 45?min were used; and (c) delayed memory tests were given 60?min after learning. Both experiments showed that, regardless of elicitation delay, emotional arousal did not enhance item recall memory. Second, both experiments showed that negative arousal enhanced delayed item recognition memory only at the medium elicitation delay, but not in the shorter or longer delays. Positive arousal enhanced performance only in Experiment 1. Third, regardless of elicitation delay, emotional arousal had little effect on source memory. These findings have implications for theories of emotion and memory, suggesting that emotion effects are contingent upon the nature of the memory task and elicitation delay.     

The fan effect influences face recognition but does not moderate the own-age bias

ABSTRACT

The fan effect shows that memory is superior for information associated with few contexts relative to information associated with many contexts. The current study examined the fan effect within face recognition. Participants studied faces in which eye regions were associated with only one face (low-fan) or several faces (high-fan). Additionally, we examined whether featural fan might moderate in-group biases (i.e. in-group faces are better remembered than out-group faces). To this end, we manipulated occupation status (Experiment 1) and age (Experiment 2) of studied faces, and presented high- and low-fan faces. Results showed that low-fan faces were better remembered than high-fan faces. We did not detect an in-group bias as a function of occupation status, but there was a robust own-age bias. Fan type did not moderate the own-age bias, however. Although face recognition is sensitive to featural fan, the effect does not appear to differentially impact the own-age bias..     

Accounting for Parcel-Allocation Variability in Practice: Combining Sources of Uncertainty and Choosing the Number of Allocations

Item parceling remains widely used under conditions that can lead to parcel-allocation variability in results. Hence, researchers may be interested in quantifying and accounting for parcel-allocation variability within sample. To do so in practice, three key issues need to be addressed. First, how can we combine sources of uncertainty arising from sampling variability and parcel-allocation variability when drawing inferences about parameters in structural equation models? Second, on what basis can we choose the number of repeated item-to-parcel allocations within sample? Third, how can we diagnose and report proportions of total variability per estimate arising due to parcel-allocation variability versus sampling variability? This article addresses these three methodological issues. Developments are illustrated using simulated and empirical examples, and software for implementing them is provided.