Examiner error in curriculum-based measurement of oral reading

Although curriculum based measures of oral reading (CBM-R) have strong technical adequacy, there is still a reason to believe that student performance may be influenced by factors of the testing situation, such as errors examiners make in administering and scoring the test. This study examined the construct-irrelevant variance introduced by examiners using a cross-classified multilevel model. We sought to determine the extent of variance in student CBM-R scores attributable to examiners and, if present, the extent to which it was moderated by students' grade level and English learner (EL) status. Fit indices indicated that a cross-classified random effects model (CCREM) best fits the data with measures nested within students, students nested within schools, and examiners crossing schools. Intraclass correlations of the CCREM revealed that roughly 16% of the variance in student CBM-R scores was associated between examiners. The remaining variance was associated with the measurement level, 3.59%; between students, 75.23%; and between schools, 5.21%. Results were moderated by grade level but not by EL status. The discussion addresses the implications of this error for low-stakes and high-stakes decisions about students, teacher evaluation systems, and hypothesis testing in reading intervention research.     

Comparing methods for measuring peak look duration: Are individual differences observed on screen-based tasks also found in more ecologically valid contexts?

Convergent research points to the importance of studying the ontogenesis of sustained attention during the early years of life, but little research hitherto has compared and contrasted different techniques available for measuring sustained attention. Here, we compare methods that have been used to assess one parameter of sustained attention, namely infants’ peak look duration to novel stimuli. Our focus was to assess whether individual differences in peak look duration are stable across different measurement techniques. In a single cohort of 42 typically developing 11-month-old infants we assessed peak look duration using six different measurement paradigms (four screen-based, two naturalistic). Zero-order correlations suggested that individual differences in peak look duration were stable across all four screen-based paradigms, but no correlations were found between peak look durations observed on the screen-based and the naturalistic paradigms. A factor analysis conducted on the dependent variable of peak look duration identified two factors. All four screen-based tasks loaded onto the first factor, but the two naturalistic tasks did not relate, and mapped onto a different factor. Our results question how individual differences observed on screen-based tasks manifest in more ecologically valid contexts.     

Sustained attention to spontaneous thumb sensations activates brain somatosensory and other proprioceptive areas

The present experiment was designed to test if sustained attention directed to the spontaneous sensations of the right or left thumb in the absence of any external stimuli is able to activate corresponding somatosensory brain areas. After verifying in 34 healthy volunteers that external touch stimuli to either thumb effectively activate brain contralateral somatosensory areas, and after subtracting attention mechanisms employed in both touch and spontaneous-sensation conditions, fMRI evidence was obtained that the primary somatosensory cortex (specifically left BA 3a/3b) becomes active when an individual is required to attend to the spontaneous sensations of either thumb in the absence of external stimuli. In addition, the left superior parietal cortex, anterior cingulate gyrus, insula, motor and premotor cortex, left dorsolateral prefrontal cortex, Broca’s area, and occipital cortices were activated. Moreover, attention to spontaneous-sensations revealed an increased connectivity between BA 3a/3b, superior frontal gyrus (BA 9) and anterior cingulate cortex (BA 32), probably allowing top-down activations of primary somatosensory cortex. We conclude that specific primary somatosensory areas in conjunction with other left parieto-frontal areas are involved in processing proprioceptive and interoceptive bodily information that underlies own body-representations and that these networks and cognitive functions can be modulated by top-down attentional processes.     

Disentangling the neural mechanisms involved in Hinduism- and Buddhism-related meditations

The most diffuse forms of meditation derive from Hinduism and Buddhism spiritual traditions. Different cognitive processes are set in place to reach these meditation states. According to an historical-philological hypothesis (Wynne, 2009) the two forms of meditation could be disentangled. While mindfulness is the focus of Buddhist meditation reached by focusing sustained attention on the body, on breathing and on the content of the thoughts, reaching an ineffable state of nothigness accompanied by a loss of sense of self and duality (Samadhi) is the main focus of Hinduism-inspired meditation. It is possible that these different practices activate separate brain networks. We tested this hypothesis by conducting an activation likelihood estimation (ALE) meta-analysis of functional magnetic resonance imaging (fMRI) studies. The network related to Buddhism-inspired meditation (16 experiments, 263 subjects, and 96 activation foci) included activations in some frontal lobe structures associated with executive attention, possibly confirming the fundamental role of mindfulness shared by many Buddhist meditations. By contrast, the network related to Hinduism-inspired meditation (8 experiments, 54 activation foci and 66 subjects) triggered a left lateralized network of areas including the postcentral gyrus, the superior parietal lobe, the hippocampus and the right middle cingulate cortex. The dissociation between anterior and posterior networks support the notion that different meditation styles and traditions are characterized by different patterns of neural activation.     

Working memory retrieval differences between medial temporal lobe epilepsy patients and controls: A three memory layer approach

Multi-store models of working memory (WM) have given way to more dynamic approaches that conceive WM as an activated subset of long-term memory (LTM). The resulting framework considers that memory representations are governed by a hierarchy of accessibility. The activated part of LTM holds representations in a heightened state of activation, some of which can reach a state of immediate accessibility according to task demands. Recent neuroimaging studies have studied the neural basis of retrieval information with different states of accessibility. It was found that the medial temporal lobe (MTL) was involved in retrieving information within immediate access store and outside this privileged zone. In the current study we further explored the contribution of MTL to WM retrieval by analyzing the consequences of MTL damage to this process considering the state of accessibility of memory representations. The performance of a group of epilepsy patients with left hippocampal sclerosis in a 12-item recognition task was compared with that of a healthy control group. We adopted an embedded model of WM that distinguishes three components: the activated LTM, the region of direct access, and a single-item focus of attention. Groups did not differ when retrieving information from single-item focus, but patients were less accurate retrieving information outside focal attention, either items from LTM or items expected to be in the WM range. Analyses focused on items held in the direct access buffer showed that consequences of MTL damage were modulated by the level of accessibility of memory representations, producing a reduced capacity.     

THE IMAGO DEI AS A WORK IN PROGRESS: A PERSPECTIVE FROM PALEOANTHROPOLOGY

This article considers the imago Dei from the perspective of paleoanthropology. We identify structural, functional, and relational elements of the imago Dei that emerged mosaically during human evolution. Humans are unique in their ability to relate to each other and to God, and in their membership of cultural communities where shared attention, the transmission of moral norms, and symbolic behavior are important elements. We discuss similarities between our approach and the concept of theosis adopted in the Eastern Orthodox Church.     

Exploring Differential Subgroup Functioning on SAT Writing Items: What Happens When English Is Not a Test Taker's Best Language?

The purpose of this study is to explore patterns in model-data fit related to subgroups of test takers from a large-scale writing assessment. Using data from the SAT, a calibration group was randomly selected to represent test takers who reported that English was their best language from the total population of test takers (N = 322,011). A reference scale for the items was constructed based on EBL responses. Response behaviors of test takers who reported that English was not their best language (ENBL) were examined in relationship to this reference scale. This study illustrates the use of differential subgroup analyses to identify patterns related to person misfit within subgroups, as well as subsets of items, that may affect the validity of writing scores for ENBL test takers. The methodology described here offers an approach that can be used to explore, understand, and improve the validity of scores obtained from ENBL test takers in large-scale writing assessments.     

Do goal cue and motor activity impact preschoolers’ working memory?

Preschoolers are well known for their poor working memory (WM) performance. This could result from goal neglect, which would hamper the setting of maintenance strategies. Previous studies have shown that preschoolers’ WM performance can be improved in game-like tasks, because they provide cues to support goal maintenance. However, in these studies, it was unclear what features of the task (either the main toy or the motor activity required by the game) provide efficient cues. The aim of the present study was to disentangle the two features to examine cue effects in 5- to 7-year-old children. No improvement of WM performance was observed when the toy was a potential goal cue, whereas the motor activity had a detrimental effect in all age groups. The latter effect could result from a distraction of attention from attention-based maintenance activities. Hence, preschoolers' poor WM performance would not be fundamentally due to goal neglect.     

Consequences of Ignoring Guessing Effects on Measurement Invariance Analysis

Pseudo-guessing parameters are present in item response theory applications for many educational assessments. When sample size is not sufficiently large, the guessing parameters may be ignored from the analysis. This study examines the impact of ignoring pseudo-guessing parameters on measurement invariance analysis, specifically, on item difficulty, item discrimination, and mean and variance of ability distribution. Results show that when non-zero guessing parameters are ignored from the measurement invariance analysis, item discrimination estimates tend to decrease particularly for more difficult items, and item difficulty estimates decrease unless the items are highly discriminating and difficult. As the guessing parameter increases, the size of the decrease in item discrimination and difficulty tends to increase, and the estimated mean and variance of ability distribution tend to be inaccurate. When two groups have heterogeneous ability distributions, ignoring the guessing parameter affects the reference group and the focal group differently. Implications of result findings are discussed.     

Effects of irrelevant object structure on early attention deployment

Event-related potential (ERP) studies have suggested that Gestalt principles or grouping factors in a visual scene modulate attention deployment in early visual processing. The present study examined the effects of an extrinsic grouping factor, region commonality, on early ERP spatial attention. Effects of sex were also explored, since the processing of task-irrelvant objects may differ between the sexes. Twenty-four participants were required to discriminate one side of rapidly-presented bilateral letters, and attention effects were indexed by hemispheric lateralization accroding to attended visual fields. In results, an early P1 attention effect (70–110 ms) increased when the letters were surrounded by an object, compared to the control stimulus without a complete object, and this result was more prominent in women than in men. The present study demonstrates that visual object and sex differences play a novel role at very early cortical stages of processing in attention deployment to a task-irrelevant visual structure.