Irrational Beliefs in Employees with an Adjustment,a Depressive,or an Anxiety Disorder: a Prospective Cohort Study

It remains unclear if patients with different types of common mental disorders, such as adjustment, anxiety and depressive disorders, have the same irrational ideas. The aim of this prospective cohort study (n = 190) is to investigate differences in level and type of irrational beliefs among these groups and to examine whether a change in irrational beliefs is related to symptom recovery. Irrational beliefs (IBI) and symptoms were measured at four points in time: at baseline, after 3, 6 and 12 months. Results showed that diagnostic groups differed in their level of irrational beliefs and this effect remained over time. Highest levels of irrationality were observed in the double diagnosis group, followed by the anxiety disorder group and the depression group. Participants with adjustment disorders showed the lowest levels of irrationality, comparable to a community sample. We did not find differences in the type of irrational beliefs between diagnostic groups. The level of irrationality declined over time for all diagnostic groups. No differences in decrease were observed between diagnostic groups. The magnitude and direction of change in irrational beliefs were related to the magnitude of recovery of depressive, anxiety and stress symptoms over time. These results support the application of general cognitive interventions, especially for patients with a depressive or an anxiety disorder.     

Evaluating the Psychometric and Measurement Characteristics of a Measure of Sexual Orientation Harassment

We use classical test theory (CTT) and item response theory (IRT) methodologies to examine the psychometric and measurement properties of an instrument designed to assess sexual orientation harassment among military personnel (N?=?71,989). CTT analyses indicated that items were unidimensional and exhibited adequate levels of reliability. IRT analyses demonstrated that the items functioned similarly and exhibited appropriate levels of item discrimination. However, the analyses also suggested that the sensitivity of the items may be limited. Differential test functioning analyses provided evidence of the measurement equivalence of the instrument across male and female respondents. The findings provide support for the psychometric properties and measurement equivalence of the instrument for measuring sexual orientation harassment among male and female military personnel. We discuss the implications of our findings for future research on sexual orientation harassment in the workplace.     

A Note on Stochastic Ordering of the Latent Trait Using the Sum of Polytomous Item Scores

In contrast to dichotomous item response theory (IRT) models, most well-known polytomous IRT models do not imply stochastic ordering of the latent trait by the total test score (SOL). This has been thought to make the ordering of respondents on the latent trait using the total test score questionable and throws doubt on the justifiability of using nonparametric polytomous IRT models for ordinal measurement. We show that a broad class of polytomous IRT models has a weaker form of SOL, denoted weak SOL, and argue that weak SOL justifies ordering respondents on the latent trait using the total test score and, therefore, the use of nonparametric polytomous IRT models for ordinal measurement.     

The curiosity and exploration inventory-II: Development, factor structure, and psychometrics

Given curiosity’s fundamental role in motivation, learning, and well-being, we sought to refine the measurement of trait curiosity with an improved version of the Curiosity and Exploration Inventory (CEI; [Kashdan, T. B., Rose, P., & Fincham, F. D. (2004). Curiosity and exploration: Facilitating positive subjective experiences and personal growth opportunities. Journal of Personality Assessment, 82, 291–305]). A preliminary pool of 36 items was administered to 311 undergraduate students, who also completed measures of emotion, emotion regulation, personality, and well-being. Factor analyses indicated a two-factor model—motivation to seek out knowledge and new experiences (Stretching; five items) and a willingness to embrace the novel, uncertain, and unpredictable nature of everyday life (Embracing; five items). In two additional samples (ns = 150 and 119), we cross-validated this factor structure and provided initial evidence for construct validity. This includes positive correlations with personal growth, openness to experience, autonomy, purpose in life, self-acceptance, psychological flexibility, positive affect, and positive social relations, among others. Applying item response theory (IRT) to these samples (n = 578), we showed that the items have good discrimination and a desirable breadth of difficulty. The item information functions and test information function were centered near zero, indicating that the scale assesses the mid-range of the latent curiosity trait most reliably. The findings thus far provide good evidence for the psychometric properties of the 10-item CEI-II.     

项目反应理论中模型-资料拟合检验常用统计量

项目反应理论(IRT)模型依据项目与被试的特征预测被试的作答表现, 是常用的心理测量模型。但IRT的有效运用依赖于所选用IRT模型与实际数据资料相符合的程度(即模型?资料拟合度, goodness of fit)。只有当所采用IRT分析模型与实际数据资料拟合较好时, IRT的优点和功能才能真正发挥出来(Orlando & Thissen, 2000)。而当所采用IRT模型与资料不拟合或选择了错误的模型, 则会导致如参数估计、测验等值及项目功能差异分析等具有较大误差(Kang, Cohen & Sung, 2009), 给实际工作带来不良影响。因此, 在使用IRT分析时, 应首先充分考察及检验所选用模型与实际数据是否相匹配/相拟合(McKinley & Mills, 1985)。IRT领域中常用模型?资料拟合检验统计量可从项目拟合、测验拟合两个角度进行阐述并比较, 这是心理、教育测量领域的重要主题, 也是测验分析过程中较易忽视的环节, 目前还未见此类公开发表的文章。未来的研究可以在各统计量的实证比较研究以及在认知诊断领域的拓展方面有所发展。     

A goodness of fit test for the rasch model

The Rasch model is an item analysis model with logistic item characteristic curves of equal slope,i.e. with constant item discriminating powers. The proposed goodness of fit test is based on a comparison between difficulties estimated from different scoregroups and over-all estimates. Based on the within scoregroup estimates and the over-all estimates of item difficulties a conditional likelihood ratio is formed. It is shown that—2 times the logarithm of this ratio isx ²-distributed when the Rasch model is true. The power of the proposed goodness of fit test is discussed for alternative models with logistic item characteristic curves, but unequal discriminating items from a scholastic aptitude test.     

The Accuracy of the Life Orientation Test–Revised (LOT–R) in Measuring Dispositional Optimism: Evidence From Item Response Theory Analyses

The accuracy of the Life Orientation Test–Revised (LOT–R) in measuring dispositional optimism was investigated applying item response theory (IRT). The study was conducted on a sample of 484 university students (62% males, M age = 22.79 years, SD = 5.63). After testing the 1-factor structure of the scale, IRT was applied to evaluate the functioning of the LOT–R along the pessimism–optimism continuum. Item parameter estimates and the test information function showed that each item and the global scale satisfactorily measured the latent trait. Referring to the IRT estimated trait levels, the validity of the LOT–R was studied examining the relationships between dispositional optimism and psychological well-being, sense of mastery, and sense of coherence. Overall findings based on IRT analyses provide evidence of the accuracy of the LOT–R and suggest possible modifications of the scale to improve the assessment of dispositional optimism.     

A simplified version of the maximum information per time unit method in computerized adaptive testing

In this article, we propose a simplified version of the maximum information per time unit method (MIT; Fan, Wang, Chang, & Douglas, Journal of Educational and Behavioral Statistics 37: 655–670, 2012), or MIT-S, for computerized adaptive testing. Unlike the original MIT method, the proposed MIT-S method does not require fitting a response time model to the individual-level response time data. It is also computationally efficient. The performance of the MIT-S method was compared against that of the maximum information (MI) method in terms of measurement precision, testing time saving, and item pool usage under various item response theory (IRT) models. The results indicated that when the underlying IRT model is the two- or three-parameter logistic model, the MIT-S method maintains measurement precision and saves testing time. It performs similarly to the MI method in exposure control; both result in highly skewed item exposure distributions, due to heavy reliance on the highly discriminating items. If the underlying model is the one-parameter logistic (1PL) model, the MIT-S method maintains the measurement precision and saves a considerable amount of testing time. However, its heavy reliance on time-saving items leads to a highly skewed item exposure distribution. This weakness can be ameliorated by using randomesque exposure control, which successfully balances the item pool usage. Overall, the MIT-S method with randomesque exposure control is recommended for achieving better testing efficiency while maintaining measurement precision and balanced item pool usage when the underlying IRT model is 1PL.     

Psychometric Properties of the Wisconsin Schizotypy Scales in an Undergraduate Sample: Classical Test Theory,Item Response Theory,and Differential Item Functioning

The Wisconsin Schizotypy Scales are widely used for assessing schizotypy in nonclinical and clinical samples. However, they were developed using classical test theory (CTT) and have not had their psychometric properties examined with more sophisticated measurement models. The present study employed item response theory (IRT) as well as traditional CTT to examine psychometric properties of four of the schizotypy scales on the item and scale level, using a large sample of undergraduate students (n = 6,137). In addition, we investigated differential item functioning (DIF) for sex and ethnicity. The analyses revealed many strengths of the four scales, but some items had low discrimination values and many items had high DIF. The results offer useful guidance for applied users and for future development of these scales.     

Items bundles

An item bundle is a small group of multiple choice items that share a common reading passage or graph, or a small group of matching items that share distractors. Item bundles are easily identified by paging through a copy of a test. Bundled items may violate the latent conditional independence assumption of unidimensional item response theory (IRT), but such a violation would not typically suggest the existence of a new fundamental human ability to read one specific reading passage or to interpret one specific graph. It is important, therefore, to have theoretical concepts and empirical checks that distinguish between, on the one hand, anticipated violations of latent conditional independence within item bundles, and, on the other hand, violations that cannot be attributed to idiosyncratic features of test format and instead suggest departures from unidimensionalty. To this end, two theorems on unidimensional IRT are extended to describe observable item response distributions when there is conditional independencebetween but not necessarilywithin item bundles.The author is grateful to Ivo Molenaar and the referees for many helpful suggestions, and to D. Thayer for assistance with computing.     

Stability of the Positive Mood Effect on Creativity When Task Switching,Practice Effect,and Test Item Differences are Taken into Consideration

Although experimentally induced positive mood can generally last for 20 min and the induced mood is conducive to creative performance, it is still unclear whether the facilitation effect is stable during these 20 min. Two studies were conducted to examine this issue while controlling for the impacts of task switching, practice effect, and test item differences. In Study 1, participants (N = 42) were randomly assigned to positive, negative, and neutral mood conditions. After watching a short video clip, participants answered four items of the Alternate Uses Test (AUT) in 20 min, with 5 min allotted for each item. Creative performance during each 5‐min period was scored in terms of fluency and flexibility. Separate repeated‐measures analyses of variances on these creativity scores showed that positive mood consistently enhanced performance over 20 min. Study 2 further eliminated the effects of test item differences and test order. Participants (N = 131) underwent the same mood induction procedure and answered the same four items of the AUT, except that these items were presented in four different sequences in accordance with the Latin square design. Consistent with the findings in Study 1, Study 2 showed that the facilitation effect of positive mood lasted for 20 min when the interference of task switching, practice effect, and test item differences were minimized. This finding not only sheds light on the debate regarding the stability of experimentally induced positive mood effect, but also contributes to the body of empirical evidence that future studies may use to examine the positive mood effect over a relatively long period of time.     

Psychopathy in adolescent female offenders: an item response theory analysis of the psychopathy checklist: youth version

The present study examined the applicability of the PCL:YV items to a sample of detained adolescent girls. Item response theory (IRT) was used to analyze test and item functioning of the PCL:YV. Examination of IRT trace lines indicated that the items most discriminating of the underlying construct of psychopathy included "callousness and a lack of empathy", "conning and manipulation", and "a grandiose sense of self-worth". Results from the analyses also demonstrated that the items least discriminating in this sample, or least useful for identifying psychopathy, included "poor anger control", "shallow affect", or engaging in a "serious violation of conditional release". Consistent with previous research (Cooke & Michie, 1997; Hare, 2003), interpersonal and affective components of psychopathy provided more information than behavioral features. Moreover, although previous research has also found affective features to provide the most information in past studies, it was interpersonal features of psychopathy in this case, followed by affective features, that provided greater levels of information. Implications of these results are discussed.     

Latent variables underlying the memory beliefs of Chartered Clinical Psychologists,Hypnotherapists and undergraduate students

In courts in the United Kingdom, understanding of memory phenomena is often assumed to be a matter of common sense. To test this assumption 337 UK respondents, consisting of 125 Chartered Clinical Psychologists, 88 individuals who advertised their services as Hypnotherapists (HTs) in a classified directory, the Yellow Pages^TM, and 124 first year undergraduate psychology students, completed a questionnaire that assessed their knowledge of 10 memory phenomena about which there is a broad scientific consensus. HTs’ responses were the most inconsistent with the scientific consensus, scoring lowest on six of these ten items. Principal Components Analysis indicated two latent variables – reflecting beliefs about memory quality and malleability – underlying respondents’ responses. In addition, respondents were asked to rate their own knowledge of the academic memory literature in general. There was no significant relationship between participants’ self reported knowledge and their actual knowledge (as measured by their responses to the 10-item questionnaire). There was evidence of beliefs among the HTs that could give rise to some concern (e.g., that early memories from the first year of life are accurately stored and are retrievable).     

Item Response Theory Analyses of the Parent and Teacher Ratings of the DSM-IV ADHD Rating Scale

The graded response model (GRM), which is based on item response theory (IRT), was used to evaluate the psychometric properties of the inattention and hyperactivity/impulsivity symptoms in an ADHD rating scale. To accomplish this, parents and teachers completed the DSM-IV ADHD Rating Scale (DARS; Gomez et al., Journal of Child Psychology and Psychiatry, 40, 265–274, 1999) for a group of 1,475 primary school-aged children. The results for the discrimination parameters showed that all symptoms for both groups of respondents were generally good for discriminating their respective latent traits. For virtually all symptoms, their threshold values showed moderate to large increases in the level of the latent trait at each subsequent response dichotomy, with the symptoms being especially good at representing the appropriate traits from mean to moderately high trait levels. The item information function values for most symptoms indicated reasonable reliability from, approximately, the mean trait levels to moderately high trait levels. These findings indicate good psychometric properties for the parent and teacher ratings of the DARS. The implications of the findings for the use of the DARS and other similar scales are discussed.     

A Psychometric Analysis of the Trait Emotional Intelligence Questionnaire–Short Form (TEIQue–SF) Using Item Response Theory

Trait emotional intelligence refers to a constellation of emotional self-perceptions located at the lower levels of personality hierarchies. In 2 studies, we sought to examine the psychometric properties of the Trait Emotional Intelligence Questionnaire–Short Form (TEIQue–SF; Petrides, 2009) using item response theory (IRT). Study 1 (N= 1,119, 455 men) showed that most items had good discrimination and threshold parameters and high item information values. At the global level, the TEIQue–SF showed very good precision across most of the latent trait range. Study 2 (N= 866, 432 men) used similar IRT techniques in a new sample based on the latest version of the TEIQue–SF (version 1.50). Results replicated Study 1, with the instrument showing good psychometric properties at the item and global level. Overall, the 2 studies suggest the TEIQue-SF can be recommended when a rapid assessment of trait emotional intelligence is required.     

The Missing Data Assumptions of the NEAT Design and their Implications for Test Equating

The Non-Equivalent groups with Anchor Test (NEAT) design involves missing data that are missing by design. Three nonlinear observed score equating methods used with a NEAT design are the frequency estimation equipercentile equating (FEEE), the chain equipercentile equating (CEE), and the item-response-theory observed-score-equating (IRT OSE). These three methods each make different assumptions about the missing data in the NEAT design. The FEEE method assumes that the conditional distribution of the test score given the anchor test score is the same in the two examinee groups. The CEE method assumes that the equipercentile functions equating the test score to the anchor test score are the same in the two examinee groups. The IRT OSE method assumes that the IRT model employed fits the data adequately, and the items in the tests and the anchor test do not exhibit differential item functioning across the two examinee groups. This paper first describes the missing data assumptions of the three equating methods. Then it describes how the missing data in the NEAT design can be filled in a manner that is coherent with the assumptions made by each of these equating methods. Implications on equating are also discussed.     

Are You Looking at Me,or Am I? Anger,Aggression, Shame and Self-worth in Violent Individuals

Conclusions about the relationship between anger and violence have been drawn from research that largely uses non-clinically angry, non-violent participants. The present study assessed cognitive correlates of anger by comparing mentally disordered violent offenders (n = 22) and violent prisoners (n = 22) in their irrational beliefs, self-esteem, internalised shame, and the experience and expression of anger. Findings showed there to be no significant difference between the two groups on all of the scales used. Low self-worth, high shame and self-downing irrational beliefs were found across the whole population. Cluster analysis revealed two distinct clusters with anger as the main factor separating them. One cluster could be categorised as anger disordered and had significantly higher shame, lower self-worth and more self- and other-downing irrational beliefs than the second cluster where levels of unhealthy anger were lower. It was concluded that high levels of unhealthy anger may serve as an attempt to protect against shame and low self-worth.     

Cultural Influences in the Aetiological Beliefs of Saudi Arabian Primary Care Patients About Their Symptoms: The Association of Religious and Psychological Beliefs

Objective To develop a self-report questionnaire to measure the beliefs of Arabic primary care patients about the causes of their physical symptoms; to use this to quantify the beliefs of patients consulting their general practitioners (GPs) in Saudi Arabia; and to test whether patients with psychological problems differ from others in their beliefs, particularly religious and supernatural beliefs. Methods Consecutive patients (N = 224) completed a specially developed aetiological beliefs’ questionnaire. Patients were divided into two groups (cases and non-cases of emotional disorder) according to the GHQ-12. Results Religious and supernatural aspects of culture colour patients’ symptom beliefs: that their symptoms were a test or punishment from Allah’ was the most common belief. Even in non-cases, around half the patients also endorsed nerves and stress as a cause of their physical symptoms. Cases were more likely than non-cases to endorse items related to both religious and psychological factors. Conclusion There is no support for the view that Saudi Arabian patients explain symptoms supernaturally as a way of denying psychological factors. GPs and health professionals in Saudi primary care need to understand what patients believe to be the cause of their problems and to appreciate that religious and psychological beliefs are both very common. GPs should address psychological beliefs and concerns even with those patients who present physical symptoms.