Rater Model Using Signal Detection Theory for Latent Differential Rater Functioning

Differential rater functioning (DRF) occurs when raters show evidence of exercising differential severity or leniency when scoring examinees within different subgroups. Previous studies of DRF have examined rater bias using manifest variables (e.g., use of covariates) to determine the subgroups. These manifest variables include gender and the ethnicity of the examinee. For example, a rater may score males more severely. Ideally, each rater’s severity should be invariant across subgroups. This study examines DRF in the context of latent subgroups that classify possible sources of DRF based on raters’ scoring behavior rather than manifest factors. An extension of the latent class signal detection theory (LC-SDT) model for identifying DRF is proposed and examined using real-world data and simulations. Results from real-world data show that the signal detection approach leads to an effective method to identify latent DRF. Simulations with varying sample sizes and conditions of rater precision were shown to recover parameters at an adequate level, supporting its use to identify latent DRF in large-scale data. These findings suggest that the DRF extension of the LC-SDT can be a useful model to examine characteristics of raters and add information that can aid rater training.     

Political Attitudes and the Processing of Misinformation Corrections

Misinformation often continues to influence people’s memory and inferential reasoning after it has been retracted; this is known as the continued influence effect (CIE). Previous research investigating the role of attitude‐based motivated reasoning in this context has found conflicting results: Some studies have found that worldview can have a strong impact on the magnitude of the CIE, such that retractions are less effective if the misinformation is congruent with a person’s relevant attitudes, in which case the retractions can even backfire. Other studies have failed to find evidence for an effect of attitudes on the processing of misinformation corrections. The present study used political misinformation—specifically fictional scenarios involving misconduct by politicians from left‐wing and right‐wing parties—and tested participants identifying with those political parties. Results showed that in this type of scenario, partisan attitudes have an impact on the processing of retractions, in particular (1) if the misinformation relates to a general assertion rather than just a specific singular event and (2) if the misinformation is congruent with a conservative partisanship.     

The Moderating Effect of Cognitive Flexibility in the Relationship Between Work Stress and Psychological Symptoms in Korean Air Force Pilots

Stress is closely associated with not only physical illness but also with indices of psychological maladjustment. However, such negative mental health outcomes may vary depending on the individual’s cognitive style, or perception of stress. Air force pilots are particularly vulnerable to experience a high degree of stress as they are required to conduct missions while simultaneously monitoring for safety in complex and uncertain flight situations. It can thus be posited that appropriate use of cognitive stress management strategies is one of the crucial competency requirements for pilots. As such, the present study examined the effects of stress on psychological symptoms of Korean Air Force pilots and further investigated the moderating role of cognitive flexibility in this relationship. A total of 192 air force pilots participated in the present study. The results indicated that degree of stress was positively correlated with indices of psychological maladjustment, while cognitive flexibility was negatively associated with psychological symptoms. Furthermore, cognitive flexibility demonstrated a significant moderating effect on the relationship between stress and psychological symptoms. Such results suggest that cognitive flexibility may serve as a protective factor in the potential effects of stress on psychological adjustment. Implications and suggestions for future research are discussed.     

Chaos,danger, and maternal parenting in families: Links with adolescent adjustment in low‐ and middle‐income countries

The current longitudinal study is the first comparative investigation across low‐ and middle‐income countries (LMICs) to test the hypothesis that harsher and less affectionate maternal parenting (child age 14 years, on average) statistically mediates the prediction from prior household chaos and neighborhood danger (at 13 years) to subsequent adolescent maladjustment (externalizing, internalizing, and school performance problems at 15 years). The sample included 511 urban families in six LMICs: China, Colombia, Jordan, Kenya, the Philippines, and Thailand. Multigroup structural equation modeling showed consistent associations between chaos, danger, affectionate and harsh parenting, and adolescent adjustment problems. There was some support for the hypothesis, with nearly all countries showing a modest indirect effect of maternal hostility (but not affection) for adolescent externalizing, internalizing, and scholastic problems. Results provide further evidence that chaotic home and dangerous neighborhood environments increase risk for adolescent maladjustment in LMIC contexts, via harsher maternal parenting.     

A Phenomenological Investigation: Microaggressions and Counselors-in-Training

Counselor educators are charged with the responsibility of assisting counselors–in–training to gain knowledge about injustice and inequity in society. Individuals experience oppression and privilege in different ways depending on their identities of marginalized or majority status. This study examined microaggressions using written and photographic journals from 24 counselors–in–training through the lens of phenomenology. Participants identified four overarching themes in describing their experiences with microaggressions: denial, dismay, awareness, and action. Implications for training and future research are discussed.     

Developing new online calibration methods for multidimensional computerized adaptive testing

Multidimensional computerized adaptive testing (MCAT) has received increasing attention over the past few years in educational measurement. Like all other formats of CAT, item replenishment is an essential part of MCAT for its item bank maintenance and management, which governs retiring overexposed or obsolete items over time and replacing them with new ones. Moreover, calibration precision of the new items will directly affect the estimation accuracy of examinees’ ability vectors. In unidimensional CAT (UCAT) and cognitive diagnostic CAT, online calibration techniques have been developed to effectively calibrate new items. However, there has been very little discussion of online calibration in MCAT in the literature. Thus, this paper proposes new online calibration methods for MCAT based upon some popular methods used in UCAT. Three representative methods, Method A, the ‘one EM cycle’ method and the ‘multiple EM cycles’ method, are generalized to MCAT. Three simulation studies were conducted to compare the three new methods by manipulating three factors (test length, item bank design, and level of correlation between coordinate dimensions). The results showed that all the new methods were able to recover the item parameters accurately, and the adaptive online calibration designs showed some improvements compared to the random design under most conditions.     

The Long-Term Effectiveness of the Family Check-up on Peer Preference: Parent-Child Interaction and Child Effortful Control as Sequential Mediators

We examined the longitudinal effects of the Family Check-Up (FCU) intervention beginning in toddlerhood on children’s peer preference at school-age. Specifically, a sequential mediational model was proposed in which the FCU was hypothesized to promote peer preference (i.e., higher acceptance and lower rejection by peers) in middle childhood through its positive effects on parent-child interaction and child effortful control in early childhood. Participants were 731 low-income families (49 % female). Qualities of parent-child interaction were observed during structured activities at 2 to 5 years, child effortful control was assessed using behavioral tasks at 5 years, and peer acceptance and rejection were rated by teachers at 7.5 to 10.5 years. Results indicated that the FCU indirectly predicted peer preference by sequentially improving parent-child interaction and child effortful control. The findings are discussed with respect to implications for understanding mechanisms by which early parenting-focused programs may enhance child functioning across time and context.     

The Relationship between Online Game Experience and Multitasking Ability in a Virtual Environment

Online game playing has become popular entertainment, yet its relationship with individuals' multitasking ability was inconsistent. Types of online game genre so far have not been compared and may be associated with multitasking abilities. This study proposed to explore the relationships between types of online game playing and multitasking ability, using Edinburgh Virtual Errands Test (EVET). One hundred and sixteen participants playing different online game genres, including multiplayer online battle arena (MOBA), other online game playing, and no‐online game playing were compared. Each participant was required to fill in Chen's Internet Addiction Scale and the Internet Usage Questionnaire and perform EVET and working memory tests. The results showed a positive correlation between multitasking ability and working memory. In addition, a positive association was found between MOBA‐type gaming and multitasking abilities measured by EVET. In conclusion, MOBA‐type gaming compared with other game playing is associated with better multitasking abilities in a virtual environment.Copyright © 2017 John Wiley & Sons, Ltd.