Consequences of Ignoring Guessing Effects on Measurement Invariance Analysis

Pseudo-guessing parameters are present in item response theory applications for many educational assessments. When sample size is not sufficiently large, the guessing parameters may be ignored from the analysis. This study examines the impact of ignoring pseudo-guessing parameters on measurement invariance analysis, specifically, on item difficulty, item discrimination, and mean and variance of ability distribution. Results show that when non-zero guessing parameters are ignored from the measurement invariance analysis, item discrimination estimates tend to decrease particularly for more difficult items, and item difficulty estimates decrease unless the items are highly discriminating and difficult. As the guessing parameter increases, the size of the decrease in item discrimination and difficulty tends to increase, and the estimated mean and variance of ability distribution tend to be inaccurate. When two groups have heterogeneous ability distributions, ignoring the guessing parameter affects the reference group and the focal group differently. Implications of result findings are discussed.     

5～9岁儿童在不同复杂性任务上类比推理的发展特点

采用经典的A:B:C:D范式,设计两类难度不同的图片任务,依据关系-表征复杂性模型从等级复杂性和水平复杂性角度分析任务难度.在此基础上,选取5～9岁115名儿童探讨两类任务上类比推理的特点和发展趋势.表明:(1)儿童类比推理呈现多样化特点,主要有:充分意义上掌握了类比推理、部分完成了类比推理、位置关系类比推理、不能类比推理和不确定情况类比推理,其中部分完成了类比推理是复杂任务上所特有的.(2)简单、复杂两类任务上,随着年龄增长,5-9岁儿童充分意义上掌握类比推理的人次比例不断上升,不能类比推理的人次比例不断下降.此外,复杂任务上,随年龄增长,部分完成类比任务的人次比例降低.结果表明,在简单任务上,前运算阶段儿童已具备了类比推理能力;但在复杂任务上,儿童到了具体运算阶段才具备类比推理能力.     

Assessing potential reinforcement-like effects of brief stimuli unrelated to food reinforcers

It is widely assumed that reinforcers are biologically relevant stimuli, or stimuli that have been associated with biologically relevant stimuli. However, brief, arbitrary stimuli have also been reported to have reinforcement-like effects, despite being unrelated to biologically relevant stimuli like food. The present study explored the potential reinforcement-like effects of brief stimuli across 5 experiments. In Experiments 1 through 4, pigeon subjects responded for food reinforcement and brief stimulus presentations in a 2-component multiple schedule. Neither baseline response rates nor resistance to change during disruption tests were systematically greater in a component with versus without brief stimulus presentations. Increasing the rate and duration of brief stimulus presentations in Experiment 4 did not reveal reinforcement-like effects when compared directly with food. In Experiment 5, pigeons chose between independent terminal links in a concurrent-chains procedure. Across conditions, varying the location, duration, and rate of brief stimulus presentations in the terminal links had no systematic effects on preference. In contrast, varying rates of food reinforcers resulted in large and reliable shifts in preference. Therefore, the present study found no systematic evidence that brief stimuli unrelated to food reliably increase response rates, resistance to change, or preference. These data demonstrate the value of systematic replication, and a behavioral momentum approach to assessing potential reinforcement-like effects.     

Complexity of interruptions: Evidence supporting a non-interruption-based theory

Interruptions are known to be pervasive and harmful for concentration. It is also known that many factors can influence their effect, such as the complexity of the interrupting task. Less, however, is known about the processes underlying the resumption of the primary task, especially if the interrupting task is complex. Many hypotheses have been proposed but, as yet, it has not been possible to distinguish between their various qualities. In the current study, we carried out two experiments in which we manipulated the complexity of the interrupting task (either simple or complex) and the time between the end of the interrupting task and the resumption of the primary task (i.e., a break). Results showed that complex interrupting tasks led to longer resumption lags (RL) when there was no break, as has already been shown many times. However, while RL after simple interrupting tasks did not change as the break before resumption lengthened up to 1,500 ms, those after complex interrupting tasks decreased. Moreover, after a break of 3,000 ms, RL were longer overall. These results can only support the hypothesis based on task-switching theories, but not hypotheses derived from interruption-based models. Our findings therefore provide empirical evidence in support of explanations of complexity effects and the implications for research and application are discussed.     

Investigating How Test-Takers Change Their Strategies to Handle Difficulty in Taking a Reading Comprehension Test: Implications for Score Validation

This article investigates how test-takers change their strategies to handle increased test difficulty. An adult sample reported their test-taking strategies immediately after completing the tasks in a reading test. Data were analyzed using structural equation modeling specifying a measurement-invariant, ability-moderated, latent transition analysis in Mplus (Muthén & Asparouhov, 2011). It was found that almost half of the test-takers (47%) changed their strategies when encountering increased task-difficulty. The changes were characterized by augmenting comprehending-meaning strategies with score-maximizing and test-wiseness strategies. Moreover, test-takers' ability was the driving influence that facilitated and/or buffered the changes. The test outcomes, when reviewed in light of adjusted test-taking strategies, demonstrated a form of process-based validity evidence.     

Temperament,coping, and involuntary stress responses in preadolescent children: the moderating role of achievement goal orientation

Background and objectives: Developmental theorists posit that temperament contributes to preadolescent’s stress response styles. Findings from empirical studies, however, have yielded mixed results, thus indicating a need to consider moderators of this relation. Utilizing an analytic framework guided by resiliency theory [Zimmerman, M. A. (2013). Resiliency theory: A strengths-based approach to research and practice for adolescent health. Health Education &; Behavior, 40, 381–383], this study examined achievement goal orientation as a moderator of the relation between temperament and stress response styles.

Methods: 96 preadolescent–parent dyads (M_age?=?10.30 years, range?=?9–12 years) participated in the study. Preadolescents reported on their achievement goal orientation, coping and involuntary stress responses (ISRs) styles and a parent reported on children’s temperament.

Results: Multiple regressions revealed that effortful control positively predicted preadolescent’s predominant use of engagement coping and negatively predicted predominance of ISRs, but only for children with a predominant mastery goal orientation. For preadolescents with a predominant performance goal orientation, effortful control negatively predicted the predominant use of engagement coping and positively predicted predominance of ISRs. Negative affectivity and its interaction with goal orientation did not predict coping or ISR styles.

Conclusions: Findings suggest that a predominant mastery goal orientation may function as a promotive factor by enhancing the contribution of effortful control to engagement coping styles and buffering against unmanaged reactivity.     

New Directions in the Cognitive-Behavioral Treatment of OCD: Theory,Research, and Practice

The beneficial effects of cognitive-behavioral interventions (particularly exposure and response prevention) for OCD are among the most consistent research findings in the mental health literature. Nevertheless, even after an adequate trial, many individuals experience residual symptoms, and others never receive adequate treatment due to limited access. These and other issues have prompted clinicians and researchers to search for ways to improve the conceptual and practical aspects of existing treatment approaches, as well as look for augmentation strategies. In the present article, we review a number of recent developments and new directions in the psychological treatment of OCD, including (a) the application of inhibitory learning approaches to exposure therapy, (b) the development of acceptance-based approaches, (c) involvement of caregivers (partners and parents) in treatment, (d) pharmacological cognitive enhancement of exposure therapy, and (e) the use of technology to disseminate effective treatment. We focus on both the conceptual/scientific and practical aspects of these topics so that clinicians and researchers alike can assess their relative merits and disadvantages.     

Cognitive diagnosis modelling incorporating item response times

To provide more refined diagnostic feedback with collateral information in item response times (RTs), this study proposed joint modelling of attributes and response speed using item responses and RTs simultaneously for cognitive diagnosis. For illustration, an extended deterministic input, noisy ‘and’ gate (DINA) model was proposed for joint modelling of responses and RTs. Model parameter estimation was explored using the Bayesian Markov chain Monte Carlo (MCMC) method. The PISA 2012 computer-based mathematics data were analysed first. These real data estimates were treated as true values in a subsequent simulation study. A follow-up simulation study with ideal testing conditions was conducted as well to further evaluate model parameter recovery. The results indicated that model parameters could be well recovered using the MCMC approach. Further, incorporating RTs into the DINA model would improve attribute and profile correct classification rates and result in more accurate and precise estimation of the model parameters.     

The basis of behavioral momentum in the nonlinearity of strength

The persistence of operant responding in the context of distractors and opposing forces is of central importance to the success of behavioral interventions. It has been successfully analyzed with Behavioral Momentum Theory. Key data from the research inspired by that theory are reanalyzed in terms of more molecular behavioral mechanisms: the demotivational effects of disruptors, and their differential impacts on the target response and other responses that interact with them. Behavioral momentum is regrounded as a nonlinear effect of motivation and reinforcement rate on response probability and persistence. When response probabilities are high, more energy is required to further increase or to decrease them than when they are low. Classic Behavioral Momentum Theory effects are reproduced with this account. Finally, it is shown how the new account involving motivation and competition is closely related to the metaphor of force and action that is at the core of Behavioral Momentum Theory.