Exploring Differential Subgroup Functioning on SAT Writing Items: What Happens When English Is Not a Test Taker's Best Language?

The purpose of this study is to explore patterns in model-data fit related to subgroups of test takers from a large-scale writing assessment. Using data from the SAT, a calibration group was randomly selected to represent test takers who reported that English was their best language from the total population of test takers (N = 322,011). A reference scale for the items was constructed based on EBL responses. Response behaviors of test takers who reported that English was not their best language (ENBL) were examined in relationship to this reference scale. This study illustrates the use of differential subgroup analyses to identify patterns related to person misfit within subgroups, as well as subsets of items, that may affect the validity of writing scores for ENBL test takers. The methodology described here offers an approach that can be used to explore, understand, and improve the validity of scores obtained from ENBL test takers in large-scale writing assessments.     

Performance monitoring in obsessive–compulsive disorder: A temporo-spatial principal component analysis

Hyperactive performance monitoring is a robust finding in obsessive–compulsive disorder (OCD). Patients show increased amplitudes of the error-related negativity (ERN) and correct-related negativity (CRN). Recently, two temporo-spatial factors were shown to contribute to both ERPs in healthy individuals. In the present study, it was investigated whether the factor structure underlying ERN and CRN is similar in OCD and which factors differ between groups. A principal component analysis (PCA) was employed to investigate the temporo-spatial factor structure of ERN and CRN. Twenty-six OCD patients and 26 healthy controls conducted a flanker task. EEG data were analyzed as conventional ERP components and as factor scores derived from temporo-spatial PCA. ERP results showed expected increases in ERN and CRN amplitudes in OCD patients. For both groups, the PCA confirmed the assumed factor structure of a central and a fronto-parietal factor contributing to ERN and CRN. Factor scores of both factors were differently affected by response correctness in OCD. Alterations in factor scores indicate increased activity in both an outcome-independent monitoring process and an error-sensitive process, contributing to overactive performance monitoring in OCD.     

Child decision-making: On the burden of predecisional information search

In many decision situations, individuals must actively search information before they can make a satisfying choice. In such instances, individuals must be aware of the fact that not all information may be equally relevant for the choice at hand—thus, individuals should weight information by its respective relevance. We compared children’s and adult’s decision-making in a child-friendly decision game. For each decision, participants received information on the content of 3 piggy banks on an information-board. In Experiment 1, we manipulated the weight-structure by presenting decisions with similarly relevant or differently relevant information. Results suggested that 8- to 9-year-olds did not adapt their search to the weight-structure. In contrast, 10- to 12-year-olds did consider relevance weights. Still, 8- to 9-year-olds and 10- to 12-year-olds were unable to search for a good, adultlike information sample containing all relevant and no irrelevant information. Thus, children based their decisions on a biased information sample. In Experiment 2, we intensified the need to consider relevance weights by introducing a search constraint. In doing so, we replicated the deficits of 8- to 9-year-olds and found adultlike behavior in 11- to 12-year-olds. Our findings suggest that although children understand that relevance may vary, they are not immediately able to effectively consider relevance weights in their information search—which appears to be a skill that continues to develop throughout childhood. We discuss the resulting implications for understanding children as decision makers as well as the general ability to perform structured information search.     

The Influence of Rater Effects in Training Sets on the Psychometric Quality of Automated Scoring for Writing Assessments

Automated essay scoring engines (AESEs) are becoming increasingly popular as an efficient method for performance assessments in writing, including many language assessments that are used worldwide. Before they can be used operationally, AESEs must be “trained” using machine-learning techniques that incorporate human ratings. However, the quality of the human ratings used to train the AESEs is rarely examined. As a result, the impact of various rater effects (e.g., severity and centrality) on the quality of AESE-assigned scores is not known. In this study, we use data from a large-scale rater-mediated writing assessment to examine the impact of rater effects on the quality of AESE-assigned scores. Overall, the results suggest that if rater effects are present in the ratings used to train an AESE, the AESE scores may replicate these effects. Implications are discussed in terms of research and practice related to automated scoring.     

A Conservation of Resources Perspective on Negative Affect and Innovative Work Behaviour: the Role of Affect Activation and Mindfulness

The present study aimed to clarify the inconsistent relationship between negative affect and innovative work behaviour by taking into account the role of affect activation and mindfulness. Building on the conservation of resources theory, we hypothesized that low-activated negative affect can be associated with increased innovativeness, but only for employees with high levels of mindfulness. Conversely, high-activated negative affect is expected to have a positive, direct relationship with innovative work behaviour. Data were collected from two independent samples, namely 163 French Canadian and 101 Italian employees. Consistent with our predictions, multiple regression analysis results showed that low-activated negative affect was positively related to innovative behaviour only when mindfulness was high (vs. low), whereas high-activated negative affect was directly associated with higher innovativeness. Our findings challenge the assumption that low-activated negative affects are associated with undermined innovative behaviour, suggesting that these affective states can be related to increased innovativeness if employees are mindful. On the other hand, they support the view that high-activated negative affects provide the energizing potential for instigating innovative actions. This study is unique in examining mindfulness as a moderator that is capable of shaping the link between deactivating negative affect and employee innovativeness. As such, it answers recent calls for research on how mindfulness can contribute to workplace functioning. Moreover, this is the first study to take into account the role of activation level in the negative affect-innovative work behaviour relationship.     

Propositions,Meaning, and Names

The object of this paper is to sketch an approach to propositions, meaning, and names. The key ingredients are a Twin‐Earth‐inspired distinction between internal and external meaning, and a middle‐Wittgenstein‐inspired conception of internal meaning as role in language system. The focus here is not on working out all the details, but on outlining the approach and showing how it offers a promising solution to the problem of the meaning of proper names. This is a plea for a neglected way of thinking about these topics.     

Task switching and action sequencing

We investigated if task switching affects late response processes that occur after the selection of a response. Subjects performed a sequence of two responses. The first and second response were selected, and then executed in close succession. The interresponse interval (IRI) was taken as a measure of late response processes. The two responses could either belong to different tasks (task-switch condition), or to the same task that was performed twice (task-repetition condition). In all three experiments, the IRI was found to be longer in the task-switch condition than in the task-repetition condition, consistent with the idea that task switching affected late response processes. However, the effects of the manipulation of the stimulus-onset asynchrony revealed that the tendency to perform the two responses as a sequence was reduced in the task-switch condition relative to the task-repetition condition. Thus, the data do not provide unequivocal evidence for task switching affecting late response processes. The data show, however, that task switching affected action sequencing. Two actions that do not belong to the same task context are less likely to be performed as an action sequence. We suggest that task switching interacts with higher-order control processes that cannot be studied within the traditional task-switching paradigm.     

Structural properties of spatial representations in blind people: Scanning images constructed from haptic exploration or from locomotion in a 3-D audio virtual environment

When people scan mental images, their response times increase linearly with increases in the distance to be scanned, which is generally taken as reflecting the fact that their internal representations incorporate the metric properties of the corresponding objects. In view of this finding, we investigated the structural properties of spatial mental images created from nonvisual sources in three groups (blindfolded sighted, late blind, and congenitally blind). In Experiment 1, blindfolded sighted and late blind participants created metrically accurate spatial representations of a small-scale spatial configuration under both verbal and haptic learning conditions. In Experiment 2, late and congenitally blind participants generated accurate spatial mental images after both verbal and locomotor learning of a full-scale navigable space (created by an immersive audio virtual reality system), whereas blindfolded sighted participants were selectively impaired in their ability to generate precise spatial representations from locomotor experience. These results attest that in the context of a permanent lack of sight, encoding spatial information on the basis of the most reliable currently functional system (the sensorimotor system) is crucial for building a metrically accurate representation of a spatial environment. The results also highlight the potential of spatialized audio-rendering technology for exploring the spatial representations of visually impaired participants.     

Subjective well‐being in times of social change: Congruence of control strategies and perceived control

This paper investigates the association between perceptions of broader changes in the social‐ecological context and individuals’ subjective well‐being (SWB). Macro‐level societal changes such as globalization or demographic change give rise to new demands for individual functioning at work and/or in the family. Such new demands associated with social change are stressful and likely to be related to lower levels of SWB. Being active agents, individuals attempt to deal with social change and its increasing demands to protect their SWB. The present study investigates which kinds of control strategies are most effective in protecting one's SWB. Specifically, we predicted that control strategies of goal engagement will be most effective under conditions of perceived high control, and control strategies of goal disengagement will be most effective under conditions of perceived low control. In a large sample of 2537 German adults, work‐ and family‐related demands associated with social change were found to be negatively linked to SWB. Moreover and in line with the motivational theory of lifespan development, control strategies of goal engagement and disengagement were beneficial for SWB to the extent that they matched the perceived control of the demands associated with social change.