Computerized adaptive testing: the capitalization on chance problem

This paper describes several simulation studies that examine the effects of capitalization on chance in the selection of items and the ability estimation in CAT, employing the 3-parameter logistic model. In order to generate different estimation errors for the item parameters, the calibration sample size was manipulated (N = 500, 1000 and 2000 subjects) as was the ratio of item bank size to test length (banks of 197 and 788 items, test lengths of 20 and 40 items), both in a CAT and in a random test. Results show that capitalization on chance is particularly serious in CAT, as revealed by the large positive bias found in the small sample calibration conditions. For broad ranges of theta, the overestimation of the precision (asymptotic Se) reaches levels of 40%, something that does not occur with the RMSE (theta). The problem is greater as the item bank size to test length ratio increases. Potential solutions were tested in a second study, where two exposure control methods were incorporated into the item selection algorithm. Some alternative solutions are discussed.     

Effects of delayed constructed-response identity matching on spelling of dictated words

We studied the effects of delayed constructed-response identity matching on spelling with 6 first graders with histories of school failure. After training, the children learned to spell words to dictation and their cursive writing improved. These results replicate studies showing that delayed constructed-response matching establishes spelling. For 2 children, spelling of generalization words--words formed by recombining the syllables of training words--also improved. These results extend studies that have shown recombinative generalization in reading and spelling.     

Flexible conceptual projection of time onto spatial frames of reference

Flexibility in conceptual projection constitutes one of the most challenging issues in the embodiment and conceptual metaphor literatures. We sketch a theoretical proposal that places the burden of the explanation on attentional dynamics in interaction with mental models in working memory that are constrained to be maximally coherent. A test of this theory is provided in the context of the conceptual projection of time onto the domain of space. Participants categorized words presented at different spatial locations (back–front, left–right) as referring to the past or to the future. Responses were faster when the irrelevant word location was congruent with the back–past, front–future metaphoric mapping. Moreover, when a new highly task-relevant spatial frame of reference was introduced, it changed the projection of past and future onto space in a way that was congruent with the new frame (past was now projected to left space and future to right space), as predicted by the theory. This study shows that there is substantial flexibility in conceptual projection and opens a venue to study metaphoric variation across tasks, individuals, and cultures as the result of attentional dynamics.     

Evaluation of violent behaviors in secondary school

School harassment, or bullying, is a term that for being so frequent already forms a part of our vocabulary. In the present work one presents a new instrument of evaluation of the violence that happens in the school centers. The Questionnaire of School Violence (CUVE) has been elaborated and, later, applied to a sample of 1637 teenagers of seven centers of Secondary Obligatory Education (public and compound). The CUVE evaluates in a trustworthy way five dimensions of the school violence: a) physical indirect violence on the part of the student body; b) verbal violence of the student body towards companions; c) physical direct violence between (among) pupils; d) verbal violence of the student body towards the professorship; and e) violence of the professorship towards the student body.     

Assessing heterogeneity in meta-analysis: Q statistic or I2 index?

In meta-analysis, the usual way of assessing whether a set of single studies is homogeneous is by means of the Q test. However, the Q test only informs meta-analysts about the presence versus the absence of heterogeneity, but it does not report on the extent of such heterogeneity. Recently, the I(2) index has been proposed to quantify the degree of heterogeneity in a meta-analysis. In this article, the performances of the Q test and the confidence interval around the I(2) index are compared by means of a Monte Carlo simulation. The results show the utility of the I(2) index as a complement to the Q test, although it has the same problems of power with a small number of studies.     

Desarrollo cognitivo-motivacional y rendimiento académico en segunda etapa de EGB y BUP

Resumen

En este trabajo se estudia el grado en que dos variables, una de tipo motivacional y otra de tipo cognitivo, permiten pronosticar el rendimiento académico. Una muestra de alumnos de segunda etapa de EGB y de BUP fue evaluada mediante el Test de Longeot, el cuestionario MAPE y un test de CI. Los resultados obtenidos muestran que el nivel de desarrollo cognitivo y el tipo de pautas motivacionales utilizadas por los sujetos explican un alto porcentaje de las diferencias individuales observadas en el rendimiento. El nivel de desarrollo cognitivo es la variable con mayor poder predictivo en EGB, mientras que en BUP este lugar lo ocupa la variable CI. La variable motivacional utilizada es un buen predictor en todos los grupos estudiados. Dependiendo del nivel de edad, las variables utilizadas permiten explicar entre un 60 y un 81 por ciento de la varianza del rendimiento.     

The Cross‐cultural Transportability of Situational Judgment Tests: How does a US‐based integrity situational judgment test fare in Spain?

Despite the globalization of HRM, there is a dearth of research on the potential use of contextualized selection instruments such as situational judgment tests (SJTs) in other countries than those where the selection instruments were originally developed. Therefore, two studies are conducted to examine the transportability of an integrity SJT that was originally developed in the United States to a Spanish context. Study 1 showed that most SJT scenarios (16 out of 19) that were developed in the United States were also considered realistic in a Spanish context. In Study 2, the item option endorsement patterns converged to the original scoring scheme, with the exception of two items. In addition, there were high correlations between the original US empirical scoring scheme and two empirical scoring schemes that were tailored to the Spanish context (i.e., mode consensus scoring and proportional consensus scoring). Finally, correlations between the SJT integrity scores and ratings on a self‐report integrity measure did not differ significantly from each other according to the type of scoring key (original US scoring vs. Spanish scoring keys). Overall, these results shed light on potential issues and solutions related to the cross‐cultural use of contextualized selection instruments such as SJTs.     

A learning rule that explains how rewards teach attention

Many theories propose that top-down attentional signals control processing in sensory cortices by modulating neural activity. But who controls the controller? Here we investigate how a biologically plausible neural reinforcement learning scheme can create higher order representations and top-down attentional signals. The learning scheme trains neural networks using two factors that gate Hebbian plasticity: (1) an attentional feedback signal from the response-selection stage to earlier processing levels; and (2) a globally available neuromodulator that encodes the reward prediction error. We demonstrate how the neural network learns to direct attention to one of two coloured stimuli that are arranged in a rank-order. Like monkeys trained on this task, the network develops units that are tuned to the rank-order of the colours and it generalizes this newly learned rule to previously unseen colour combinations. These results provide new insight into how individuals can learn to control attention as a function of reward contingency.     

Recombinative reading derived from pseudoword instruction in a miniature linguistic system

A miniature linguistic system was used to study acquisition of recombinative symbolic behavior. Three studies evaluated the teaching conditions of conditional discriminations with printed and spoken pseudowords that could potentially generate recombinative reading. Fifty-four college students across all studies learned to match 12 printed pseudowords to 12 spoken pseudowords. Some also matched pictures to the same spoken words. Each two-syllable pseudoword was formed by symbols from an arbitrarily created alphabet composed of four vowels and four consonants. Letters had univocal correspondence with phonemes. Recombinative receptive reading, comprehensive reading, and textual responding to pseudowords were periodically assessed. Experiment 1 (n = 20) showed that recombinative reading increased as the number of trained words composed of the same symbols increased. Experiment 2 (n = 14) showed that overtraining the same two words did not produce recombinative reading for most participants. Experiment 3 (n = 20), in which training with pictures was omitted, showed that elemental control by within-syllable units can develop even when the trained pseudowords are meaningless (not related to pictures). The present results support the utility of the miniature linguistic system methodology for identifying and controlling environmental determinants of rudimentary reading skills.