Assessing Growth in a Diagnostic Classification Model Framework

A common assessment research design is the single-group pre-test/post-test design in which examinees are administered an assessment before instruction and then another assessment after instruction. In this type of study, the primary objective is to measure growth in examinees, individually and collectively. In an item response theory (IRT) framework, longitudinal IRT models can be used to assess growth in examinee ability over time. In a diagnostic classification model (DCM) framework, assessing growth translates to measuring changes in attribute mastery status over time, thereby providing a categorical, criterion-referenced interpretation of growth. This study introduces the Transition Diagnostic Classification Model (TDCM), which combines latent transition analysis with the log-linear cognitive diagnosis model to provide methodology for analyzing growth in a general DCM framework. Simulation study results indicate that the proposed model is flexible, provides accurate and reliable classifications, and is quite robust to violations to measurement invariance over time. The TDCM is used to analyze pre-test/post-test data from a diagnostic mathematics assessment.     

Strategies of semantic categorization in the cerebral hemispheres

Strategies of semantic categorization in intact cerebral hemispheres were studied in two experiments by presenting names of typical and atypical category instances to the left visual field (LVF) (right hemisphere) or to the right visual field (RVF) (left hemisphere). The results revealed that the typicality of instances had a large effect on categorization times in the LVF in both experiments, suggesting that the right hemisphere relies strongly on a holistic, similarity-based comparison strategy. In Experiment 1, the typicality effect was weaker in the RVF than in the LVF. In Experiment 2, a typicality effect in the RVF was observed for the "four-footed animal" category but not for the "bird" category. The hypothesis that the left hemisphere employs a strategy based on defining or necessary features is not supported by the observed typicality effect in the "four-footed animal" category. Instead, it is suggested that the left hemisphere may be able to categorize on the basis of prestored instance-category knowledge. When such knowledge is not available (e.g., as for four-footed animals), a similarity-based comparison strategy is employed by the left hemisphere.     

Bilingualism Is Associated with a Delayed Onset of Dementia but Not with a Lower Risk of Developing it: a Systematic Review with Meta-Analyses

Neuropsychology Review - Some studies have linked bilingualism with a later onset of dementia, Alzheimer’s disease (AD), and mild cognitive impairment (MCI). Not all studies have observed...     

Novice construction of chess memory

Novice acquisition of skilled recall of chess positions was studied in an experiment in which two novices studied a series of five hundred chess positions during a period of several months. They spent fifteen minutes to half an hour a day teaching themselves these positions. As a result their skill in recalling chess positions rose from sixteen percent to somewhere between forty to fifty percent. The learning curve proved to have a shape which indicates that in the beginning learning is very fast but after some 100-150 studied positions the speed of learning decreases substantially. A computer simulation was used to model the results and analyse alternative explanations. Two alternative ways of thinking were tested. In the first, chunk construction was assumed to be based on the neighbourhood of associated pieces. The second model assumed a frequency-based correlative association process. Although the learning curves of the two models are very similar in shape to those of the subjects, the frequency-based associative model gave a better explanation for the data. This is why it is natural to suggest that common co-occurrence in addition to easily recognizable chess-specific characteristics, like colour and type of pieces, guide associative processes during chess players' learning of chess-specific chunks.     

Combining Item Response Theory and Diagnostic Classification Models: A Psychometric Model for Scaling Ability and Diagnosing Misconceptions

Traditional testing procedures typically utilize unidimensional item response theory (IRT) models to provide a single, continuous estimate of a student’s overall ability. Advances in psychometrics have focused on measuring multiple dimensions of ability to provide more detailed feedback for students, teachers, and other stakeholders. Diagnostic classification models (DCMs) provide multidimensional feedback by using categorical latent variables that represent distinct skills underlying a test that students may or may not have mastered. The Scaling Individuals and Classifying Misconceptions (SICM) model is presented as a combination of a unidimensional IRT model and a DCM where the categorical latent variables represent misconceptions instead of skills. In addition to an estimate of ability along a latent continuum, the SICM model provides multidimensional, diagnostic feedback in the form of statistical estimates of probabilities that students have certain misconceptions. Through an empirical data analysis, we show how this additional feedback can be used by stakeholders to tailor instruction for students’ needs. We also provide results from a simulation study that demonstrate that the SICM MCMC estimation algorithm yields reasonably accurate estimates under large-scale testing conditions.     

Hierarchical Diagnostic Classification Models: A Family of Models for Estimating and Testing Attribute Hierarchies

Although latent attributes that follow a hierarchical structure are anticipated in many areas of educational and psychological assessment, current psychometric models are limited in their capacity to objectively evaluate the presence of such attribute hierarchies. This paper introduces the Hierarchical Diagnostic Classification Model (HDCM), which adapts the Log-linear Cognitive Diagnosis Model to cases where attribute hierarchies are present. The utility of the HDCM is demonstrated through simulation and by an empirical example. Simulation study results show the HDCM is efficiently estimated and can accurately test for the presence of an attribute hierarchy statistically, a feature not possible when using more commonly used DCMs. Empirically, the HDCM is used to test for the presence of a suspected attribute hierarchy in a test of English grammar, confirming the data is more adequately represented by hierarchical attribute structure when compared to a crossed, or nonhierarchical structure.     

Relationship between language switching experience and executive functions in bilinguals: an Internet-based study*

We examined the relationship between self-reported everyday language switching experience and the performance of early bilinguals in tasks measuring different executive functions. Our participants were Finnish–Swedish early bilinguals, aged 16–41 years (N?=?66, Experiment 1) and 18–69 years (N?=?111, Experiment 2). An earlier study using a sample from a similar population discovered a negative relationship between self-reported language switching and a mixing cost in error rates in a number–letter task. This finding was not replicated. Instead, we found that a higher rate of reported contextual language switching predicted larger switching cost reaction times in the number–letter task, and that a higher rate of reported unintended language switches predicted larger error rates in a spatial n-back task. We conclude that these results likely reflect individual differences in executive skills, and do not provide evidence for the hypothesis that language switching trains executive functions.     

Determinants of Human Fixed-Interval Performance Following Varied Exposure to Reinforcement Schedules

The Psychological Record - Undergraduates given accurate instructions pressed keys for token points under either a variety of reinforcement schedules (variety training) or under a single schedule....     

Central executive function in mild cognitive impairment: a PET activation study

Using positron emission tomography (PET), we explored the neural correlates of an executive function, dual tasking, in patients with amnestic mild cognitive impairment (aMCI) and in elderly controls. The experiment employed simple auditory and visual tasks that were presented both in isolation and simultaneously to create a task condition requiring enhanced attentional control. Behaviorally, both groups performed well, albeit the patients made more errors on the visual task. The PET analysis focused at prefrontal regions where group differences in task-related activation patterns were expected. During dual task performance, the patients showed attenuated activity in the left inferior frontal region when compared to the controls. This suggests abnormalities in the neural processes underlying attentional control in aMCI.     

Lexical access to inflected words as measured by lateralized visual lexical decision

In two lateralized visual lexical decision experiments conducted with normal subjects, we studied hemispheric performance in the recognition of case-inflected Finnish nouns. Previous research employing mainly locative cases has indicated that such noun forms undergo morphological decomposition. The present experiments extend this finding to syntactic cases by showing that nouns with partitive or genitive endings take longer to recognize and elicit more errors than otherwise comparable monomorphemic nominative singular nouns. Morpheme-based recognition of all case-inflected forms would be a particularly appropriate solution for mental lexicon in highly inflecting languages like Finnish: it saves storage space and enables fast recognition of inflected forms not encountered before. In real words, morphological structure did not interact with visual field. However, particularly demanding, morphologically decomposable nonwords elicited more errors in the left visual field/right hemisphere than did nondecomposable nonwords. Our results suggest that at least in Finnish, both hemispheres are capable of morpheme-based access, but this mechanism is more accurate in the left than in the right hemisphere. Received: 21 May 1997 / Accepted: 19 January 1998