Item response theory analyses of the Delis-Kaplan Executive Function System card sorting subtest

In the current study, we examined the dimensionality of the 16-item Card Sorting subtest of the Delis-Kaplan Executive Functioning System assessment in a sample of 264 native English-speaking children between the ages of 9 and 15 years. We also tested for measurement invariance for these items across age and gender groups using item response theory (IRT). Results of the exploratory factor analysis indicated that a two-factor model that distinguished between verbal and perceptual items provided the best fit to the data. Although the items demonstrated measurement invariance across age groups, measurement invariance was violated for gender groups, with two items demonstrating differential item functioning for males and females. Multigroup analysis using all 16 items indicated that the items were more effective for individuals whose IRT scale scores were relatively high. A single-group explanatory IRT model using 14 non-differential item functioning items showed that for perceptual ability, females scored higher than males and that scores increased with age for both males and females; for verbal ability, the observed increase in scores across age differed for males and females. The implications of these findings are discussed.     

Same face,same place,different memory: manner of presentation modulates the associative deficit in older adults

One of the more severe and consequential memory impairments experienced by older adults is the loss of the ability to form and remember associations. Although the associative deficit is often assumed to be unitary, memory episodes may contain different types of associations (e.g., item–item, item–context). Research in younger adults suggests that these different association types may involve different neural mechanisms. This raises the possibility that different association types are not equally affected by aging. In order to investigate this, the current study directly compared memory across item–item and item–context associations in younger and older adults by manipulating the manner of presentation of the associations. Results indicate that the associative deficit in aging is not uniform and that aging has a greater impact on item–context compared to item–item associations. The results have implications for theories of associative memory, age-related cognitive decline, and the functional organization of the medial temporal lobe in aging.     

你和上司合拍吗?组织中的上下级匹配

上下级匹配, 作为影响领导-下属良性互动的关键因素, 近几年逐渐成为组织管理研究中的前沿话题。上下级匹配是指领导和下属在心理或行为特征方面的契合度, 包括一致性匹配和互补性匹配两种类型, 其测量方式也涉及直接测量与间接测量。从现有文献来看, 研究者主要考察了领导-下属在人格特质、社会认知、心理状态、工作行为和关系因素等方面的匹配效应, 涉及心理过程和互动过程两大中介机制, 个体因素和情境因素两大调节机制。未来研究可以关注传统性、面子意识等本土心理特征的匹配效应, 或者对现有的中介、调节机制进行拓展。     

Item Parameter Drift in Context Questionnaires from International Large-Scale Assessments

The purpose of the current study was to examine the impact of item parameter drift (IPD) occurring in context questionnaires from an international large-scale assessment and determine the most appropriate way to address IPD. Focusing on the context of psychometric and educational research where scores from context questionnaires composed of polytomous items were employed for the classification of examinees, the current research investigated the impacts of IPD on the estimation of questionnaire scores and classification accuracy with five manipulated factors: the length of a questionnaire, the proportion of items exhibiting IPD, the direction and magnitude of IPD, and three decisions about IPD. The results indicated that the impact of IPD occurring in a short context questionnaire on the accuracy of score estimation and classification of examinees was substantial. The accuracy in classification considerably decreased especially at the lowest and highest categories of a trait. Unlike the recommendation from literature in educational testing, the current study demonstrated that keeping items exhibiting IPD and removing them only for transformation were appropriate when IPD occurred in relatively short context questionnaires. Using 2011 TIMSS data from Iran, an applied example demonstrated the application of provided guidance in making appropriate decisions about IPD.     

Reliability and validity of the Basic Depression Questionnaire

Background/ObjectiveDepressive disorders have a high prevalence around the world. They present a great comorbidity with other disorders like anxiety, thereby making a differential diagnosis very difficult. The Basic Depression Questionnaire was designed to palliate this issue by isolating specific depression symptoms. Our aim is to study the reliability, factorial structure, and differential item functioning of this questionnaire. Method: The sample consisted of 1,397 adults without psychological problems (M_age = 29.76, SD = 11.25, 64.78% women) who completed the CBD. Results: We observed that none of the items presented differential functioning. A monofactorial structure was established. In this model a good fit was obtained by confirmatory factor analysis and a strict invariance by sex. The ordinal alpha was used to check the reliability and it fetched an index of .95. Conclusions: The Basic Depression Questionnaire has adequate psychometric properties. The absence of differential item functioning and the invariance by sex are guarantees of an adequate use to diagnose depression for men and women. So, its clinical use can help to differentiate between the specific diagnoses for depressive disorders and anxiety disorders.     

How identity related goals moderate the role of attributes in product evaluation

This research examines how identity related goals influence product evaluation. It is proposed that products are evaluated based on an attribute level to fulfill an identity related goal. Further, the positive relationship between an attribute level and product evaluation is strengthened by goal activation (the degree to which a goal occupies a consumer's thinking) and goal‐product fit (the extent to which consumers think a product is related to a particular goal). Results of three experimental studies support the above propositions. The research makes contributions in that it identifies two moderators, that is, goal activation and goal‐product fit, in the relationship between attributes ability and product evaluation. First, identity‐related goals are higher order and likely to have higher priority for consumers. However, results in this paper show that it still needs to be activated before it can exert an influence on attribute importance. Specifically, when an identity related goal (e.g., one supportive of the fair trade goal) is activated, it takes over a lower‐order goal (e.g., seek for a good taste or a good priced coffee in this case). As goal activation increases, relevant attributes become more important, and the positive relationship between an attribute level and product evaluation strengthens. Second, this paper introduces a new construct of goal‐product fit into identity‐related goals and product evaluation literature. The results of study three suggest that when goal‐product fit becomes stronger, the relevant attribute that can fulfill the goal becomes more important in the overall product evaluation.     

心理与教育测验中反应时模型应用的优势与举例

基于计算机形式的测验使得收集作答反应时信息成为可能,这些信息的有效利用对心理与教育测验的理论研究和实际应用产生了重大影响。首先,归纳并总结了测验中使用反应时信息的五大优势。其次,分别介绍了4种不同取向下较典型的反应时模型与模型特征,并分别进行评价。再次,较系统地梳理了反应时模型在实践中的应用,使读者了解反应时信息在测验中所发挥的作用。最后,探讨了未来将反应时应用于心理与教育测量领域的几个研究方向。     

Dark and bright sides of thriving – school burnout and engagement in the Finnish context

School burnout is defined as exhaustion, cynicism and inadequacy as a student, and engagement can be conceptualized as study-related vigor, absorption and dedication. School burnout is increasing, particularly among students on an academic track, while at the end of elementary school almost half of the students no longer find school meaningful. School burnout and engagement were investigated by applying the demand-resource and stage-environment models. The results show that high school demands lead to burnout, while personal and school resources lead to school engagement. Burnout from school-context can also spillover to later depression, drop out and internet addiction, and engagement to overall satisfaction with life and success in educational pathways. In line with the stage-environment fit theory, educational transitions play a role in changes in school burnout trajectories. Adoption of a person-oriented approach revealed several different burnout-engagement profiles, including a profile in which students are at the same time both exhausted and engaged. The social context of peers, immigrant status, parents and teachers also play an important role in engagement and burnout.     

Developing new online calibration methods for multidimensional computerized adaptive testing

Multidimensional computerized adaptive testing (MCAT) has received increasing attention over the past few years in educational measurement. Like all other formats of CAT, item replenishment is an essential part of MCAT for its item bank maintenance and management, which governs retiring overexposed or obsolete items over time and replacing them with new ones. Moreover, calibration precision of the new items will directly affect the estimation accuracy of examinees’ ability vectors. In unidimensional CAT (UCAT) and cognitive diagnostic CAT, online calibration techniques have been developed to effectively calibrate new items. However, there has been very little discussion of online calibration in MCAT in the literature. Thus, this paper proposes new online calibration methods for MCAT based upon some popular methods used in UCAT. Three representative methods, Method A, the ‘one EM cycle’ method and the ‘multiple EM cycles’ method, are generalized to MCAT. Three simulation studies were conducted to compare the three new methods by manipulating three factors (test length, item bank design, and level of correlation between coordinate dimensions). The results showed that all the new methods were able to recover the item parameters accurately, and the adaptive online calibration designs showed some improvements compared to the random design under most conditions.