Predictor content matters for knowledge testing: Evidence supporting content validation

Organizations often rely on the match between job requirements and test content to justify test use. This practice has been questioned on the grounds that content validation has little relevance to criterion-related validation due to positive manifold among predictors. We analyze two large databases to assess the implications of test content for (a) test interchangeability and (b) criterion-related validity. Analyses of 15 knowledge tests administered (N = 80,394) as part of Project Talent demonstrate that test content is related to predictor interchangeability. Analyses of SAT and Advanced Placement test data compare correlations among predictors and criteria drawn from matched and unmatched content domains. We conclude that test-criterion content match is likely to result in stronger criterion-related validity.     

Age Moderates the Mediational Role of Empathy in the Association Between Gender and Forgiveness

Researchers have suggested that empathy may serve to explain, at least in part, the relationship between gender and forgiveness. Some findings in the literature have supported this claim, while other studies have not. Accounting for the variable of age might help to explain these inconsistencies, as age has been found to influence the expression of empathy across gender. As such, in the present study we examined whether age might exert a conditional indirect effect on the relationship between gender and forgiveness as mediated by empathy. Participants were recruited from the community (N?=?62) and on a college campus (N?=?94). Within the community sample the average age was 74.8, while on the college campus the average age was 20.7. Participants were given a survey packet that included the Heartland Forgiveness Scale and the Empathy Quotient Scale, among other instruments. A moderated-mediational analysis showed that while gender was related to empathy and empathy was associated with forgiveness, empathy served as a significant mediator only for those younger than 62 years of age. This finding suggests that empathy serves as an important mediator in the relationship between gender and forgiveness for adults aged 61 and younger, because younger women are more likely to respond empathetically to a transgressor as compared to younger men. Older women also tend to be more forgiving than older men, but in the present study empathy was not as important of a factor in explaining this relationship for individuals 62 years and older. These findings help to address the inconsistencies in the literature with regard to the relationships among gender, age, empathy, and forgiveness.     

Detecting Duplication in Students’ Research Data: A Method and Illustration

Research integrity is core to the mission of higher education. In undergraduate student samples, self-reported rates of data fabrication have been troublingly high. Despite this, no research has investigated undergraduate data fabrication in a more systematic manner. We applied duplication screening techniques to 18 data sets submitted by psychology honors students for assessment. Although we did not identify any completely duplicated cases, there were numerous partial duplicates. Rather than indicating fabrication, however, these partial duplicates are likely a consequence of poor measure selection, insufficient data screening, and/or participant characteristics. Implications for the teaching and supervision of honors students are discussed.     

Self‐Efficacy Among Adults in Substance Abuse Treatment: The Role of Religious Coping

In substance abuse treatment, general self‐efficacy and religiousness are factors that may support positive outcomes. The authors surveyed clients receiving substance abuse treatment (N = 121) and found that religious coping predicted general self‐efficacy scores. Clinical implications are discussed.     

Assessing the evidence for a cue-induced trade-off between capacity and precision in visual working memory using mixture modelling and Bayesian model comparison

There is considerable debate regarding the ability to trade mnemonic precision for capacity in working memory (WM), with some studies reporting evidence consistent with such a trade-off and others suggesting it may not be possible. The majority of studies addressing this question have utilized a standard approach to analysing continuous recall data in which individual-subject data from each experimental condition is fitted with a probabilistic model of choice. Estimated parameter values related to different aspects of WM (e.g., the capacity and precision of stored items) are then compared using statistical tests to determine the presence of hypothesized differences between experimental conditions. However, recent research has suggested that the standard approach is flawed in several respects. In this study, we presented participants with behavioural pre-cues informing them about the upcoming number of to-be-remembered items (high- vs. low-load) with the goal of inducing a trade-off between capacity and precision. The data were then analysed using the standard analytical approach and a more rigorous Bayesian model comparison (BMC) approach. The second approach involved generating a set of probabilistic models whose priors reflect different hypotheses regarding the effect of our key experimental manipulations on behaviour. Our results demonstrate that these two approaches can produce notably different results. More specifically, the standard analysis revealed that a high- versus a low-load cue resulted in higher capacity and lower precision parameter estimates, suggesting the presence of a trade-off between capacity and precision. However, the more rigorous BMC analysis revealed that it was very unlikely that participants employed a behavioural strategy in which they sacrificed mnemonic precision to achieve higher storage capacity. In light of these differences, we advocate for a more stringent approach to model selection and hypothesis testing in studies implementing mixture modelling.     

Hot executive function following moderate‐to‐late preterm birth: altered delay discounting at 4 years of age

Interest in monitoring long‐term neurodevelopmental outcomes of children born moderate‐to‐late preterm (32–36 weeks gestation) is increasing. Moderate‐to‐late preterm birth has a negative impact on academic achievement, which may relate to differential development of executive function (EF). Prior studies reporting deficits in EF in preterm children have almost exclusively assessed EF in affectively neutral contexts in high‐risk preterm children (< 32 weeks gestation). Disrupted function in motivational or emotionally charged contexts (hot EF) following preterm birth remains uninvestigated, despite evidence that preterm children show differential development of neural circuitry subserving hot EF, including reduced orbitofrontal cortex volume. The present study is the first to examine whether low‐risk, healthy children born moderate‐to‐late preterm exhibit impairments in the development of hot EF. Preterm children at age 4.5 years were less likely to choose larger, delayed rewards across all levels of reward magnitude on a delay discounting task using tangible rewards, but performed more similarly to their full‐term peers on a delay aversion task involving abstract rewards and on measures of cool EF. The relationship between gestational age at birth and selection of delayed rewards extended across the entire gestational age range of the sample (32–42 weeks), and remained significant after controlling for intelligence and processing speed. Results imply that there is not a finite cut‐off point at which children are spared from potential long‐term neurodevelopmental effects of PT birth. Further investigation of reward processing and hot EF in individuals with a history of PT birth is warranted given the susceptibility of prefrontal cortex development to early environmental variations.     

Motivation in a MOOC: a probabilistic analysis of online learners’ basic psychological needs

Self-determination theory (SDT) is one of the most well-known approaches to achievement motivation. However, the three basic psychological needs of SDT have not received equivalent attention in the literature: priority has been given to autonomy, followed by the need for competence, with research into relatedness lacking (Bachman and Stewart in Teach Psychol 38: 180–187, 2011. doi: 10.1177/0098628311411798). One new educational setting where relatedness may be particularly important is massive open online courses (MOOCs), which provide unprecedented opportunities for either relatedness or isolation. The purpose of the research was to use Bayesian networks (BN) to establish probabilistic relationships between learners’ basic psychological needs in the context of one MOOC. The majority (59 %) of participants (N = 1037; 50 % female and 50 % male) were under 45 (age range was 18–74 years). This sample represented approximately 88 regions and countries. Participants completed a revised Basic Student Needs Scale (Betoret and Artiga in Electron J Res Educ Psychol 9(2): 463–496, 2011). In order to reveal the best structural understanding of SDT within a MOOC learning environment, analysis of the data involved the development of a BN probabilistic model. The best fitting BN model included autonomy, competence, and relatedness—resulting in a probabilistic accuracy of 77.41 %. Analyses revealed participants with high autonomy had an 80.01 % probability of having a moderate level of competence. Relatedness was distinct from the autonomy and competence relationship. The strong inter-connections between autonomy and competence support existing research. The notion that relatedness may be a distinct need, at least in this context, was supported and warrants future research.     

Suicide risk assessment: Clinicians’ confidence in their professional judgment

Suicide risk assessment is a critical component of mental health practice for which the stakes are high and the outcomes uncertain. This research examines the consistency with which clinicians make determinations of suicide risk and factors influencing clinical confidence. Seventy-one social workers interviewed two standardized patients performing in scenarios depicting suicidal ideation, judged whether the patient required hospitalization, and completed standardized suicide risk assessment measures. Self-ratings and qualitative interviews explored participants’ confidence in their judgment of risk. Participants had highly divergent views regarding whether or not the risk of suicide was sufficiently high to require hospitalization. However, regardless of the ultimate decision reached, participants were equally confident when recommending either clinical course of action. The variation in risk assessment appraisals in this study, despite at times high rates of confidence in risk appraisals, speaks to the need for ongoing training, consultation, and increased decision support strategies.     

Altering attentional control settings causes persistent biases of visual attention

Attentional control settings have an important role in guiding visual behaviour. Previous work within cognitive psychology has found that the deployment of general attentional control settings can be modulated by training. However, research has not yet established whether long-term modifications of one particular type of attentional control setting can be induced. To address this, we investigated persistent alterations to feature search mode, also known as an attentional bias, towards an arbitrary stimulus in healthy participants. Subjects were biased towards the colour green by an information sheet. Attentional bias was assessed using a change detection task. After an interval of either 1 or 2 weeks, participants were then retested on the same change detection task, tested on a different change detection task where colour was irrelevant, or were biased towards an alternative colour. One experiment included trials in which the distractor stimuli (but never the target stimuli) were green. The key finding was that green stimuli in the second task attracted attention, despite this impairing task performance. Furthermore, inducing a second attentional bias did not override the initial bias toward green objects. The attentional bias also persisted for at least two weeks. It is argued that this persistent attentional bias is mediated by a chronic change to participants’ attentional control settings, which is aided by long-term representations involving contextual cueing. We speculate that similar changes to attentional control settings and continuous cueing may relate to attentional biases observed in psychopathologies. Targeting these biases may be a productive approach to treatment.