Effects of Discontinue Rules on Psychometric Properties of Test Scores

This paper provides results on a form of adaptive testing that is used frequently in intelligence testing. In these tests, items are presented in order of increasing difficulty. The presentation of items is adaptive in the sense that a session is discontinued once a test taker produces a certain number of incorrect responses in sequence, with subsequent (not observed) responses commonly scored as wrong. The Stanford-Binet Intelligence Scales (SB5; Riverside Publishing Company, 2003) and the Kaufman Assessment Battery for Children (KABC-II; Kaufman and Kaufman, 2004), the Kaufman Adolescent and Adult Intelligence Test (Kaufman and Kaufman 2014) and the Universal Nonverbal Intelligence Test (2nd ed.) (Bracken and McCallum 2015) are some of the many examples using this rule. He and Wolfe (Educ Psychol Meas 72(5):808–826, 2012. https://doi.org/10.1177/0013164412441937) compared different ability estimation methods in a simulation study for this discontinue rule adaptation of test length. However, there has been no study, to our knowledge, of the underlying distributional properties based on analytic arguments drawing on probability theory, of what these authors call stochastic censoring of responses. The study results obtained by He and Wolfe (Educ Psychol Meas 72(5):808–826, 2012. https://doi.org/10.1177/0013164412441937) agree with results presented by DeAyala et al. (J Educ Meas 38:213–234, 2001) as well as Rose et al. (Modeling non-ignorable missing data with item response theory (IRT; ETS RR-10-11), Educational Testing Service, Princeton, 2010) and Rose et al. (Psychometrika 82:795–819, 2017. https://doi.org/10.1007/s11336-016-9544-7) in that ability estimates are biased most when scoring the not observed responses as wrong. This scoring is used operationally, so more research is needed in order to improve practice in this field. The paper extends existing research on adaptivity by discontinue rules in intelligence tests in multiple ways: First, an analytical study of the distributional properties of discontinue rule scored items is presented. Second, a simulation is presented that includes additional scoring rules and uses ability estimators that may be suitable to reduce bias for discontinue rule scored intelligence tests.

     

A performance comparison between the two language versions of the Affective Go/No‐Go test: A randomised crossover study

The purpose of this randomised crossover study is to validate the Korean version of the Affective Go/No‐go (AGN) test. The Korean words for the AGN test were selected after careful evaluation of emotional valences, word length and frequency. Fifteen Korean advanced learners of English were administered both Korean and English versions, yielding 30 data points. The performance of both language versions was compared for each of the AGN test parameters (response latency, commission error and omission error) using two‐way analysis of variance (ANOVA). Intraclass correlation coefficients (ICCs) were estimated to evaluate associations between the two versions. The ICCs were high for response latencies of all valences and commission errors of positive and neutral words, but not for that of negative words and omission errors of all valences. A similar pattern of test results, as revealed by the high ICCs and non‐significant interaction effects between language and word valence, suggests that the psychometric properties of the AGN test may be comparable over different language versions.     

Beyond Consent: Building Trusting Relationships With Diverse Populations in Precision Medicine Research

With the growth of precision medicine research on health data and biospecimens, research institutions will need to build and maintain long-term, trusting relationships with patient-participants. While trust is important for all research relationships, the longitudinal nature of precision medicine research raises particular challenges for facilitating trust when the specifics of future studies are unknown. Based on focus groups with racially and ethnically diverse patients, we describe several factors that influence patient trust and potential institutional approaches to building trustworthiness. Drawing on these findings, we suggest several considerations for research institutions seeking to cultivate long-term, trusting relationships with patients: (1) Address the role of history and experience on trust, (2) engage concerns about potential group harm, (3) address cultural values and communication barriers, and (4) integrate patient values and expectations into oversight and governance structures.     

Purchases of food in youth. Influence of price and income

One way to increase choice of healthy over unhealthy behaviors is to increase the cost of less healthy alternatives or reduce the cost of healthier alternatives. The influence of price on purchases of healthy and unhealthy foods was evaluated in two laboratory experiments. In Experiment 1, thirty-two 10- to 12-year-old youth were given $5.00 and allowed to purchase multiple portions of a healthy food (fruit or vegetable) and a less healthy food (higher-fat snack). The price of one type of food varied from $0.50 to $2.50, while the price of the other type was held at $1.00. Increasing the price of a type of food reduced purchases of that type of food, but did not lead to substitution with the alternative type of food. In Experiment 2, twenty 10- to 14-year-old youth were given $1.00, $3.00, and $5.00 to purchase healthy and unhealthy foods. The price of each food was raised and lowered by 25% and 50%. Raising the price of healthy or unhealthy foods resulted in decreased purchases of those foods, and income available interacted with price to predict the pattern of substitution of alternative foods. These results show the potential for controlled laboratory studies of price and food purchases, and show that the substitution of healthier for unhealthy food is related to available money.     

Influences of multiple spatial stimulus and response codes on orthogonal stimulus-response compatibility

When up-down stimuli are mapped to left-right responses, an up-right/down-left mapping advantage is found that is modified by response eccentricity and hand posture. These effects can be attributed to correspondence of asymmetric stimulus and response codes formed relative to multiple reference frames. We examined the influence of stimulus-set location on these orthogonal stimulus-response compatibility (SRC) effects. In Experiment 1, the stimulus set appeared in the upper or lower display positions. A spatial code for stimulus-set location was formed, producing Simon-type response eccentricity and hand posture effects, but this code had no influence on the coding of the relevant stimuli. In Experiment 2, the stimulus set appeared in the left, center, or right positions relative to the response location, which also varied, to dissociate the effects of response location, relative to the stimulus display and body midline. The former factor influenced the orthogonal SRC effect for both unimanual switch movements and bimanual keypresses, and the latter factor influenced the effect for only unimanual switch movements. Stimulus-set location causes orthogonal Simon-type effects when varied along the stimulus dimension and provides a referent for response coding when varied along the response dimension.     

Stimulus-set location does not affect orthogonal stimulus-response compatibility

In two-choice tasks for which stimuli and responses vary along orthogonal dimensions, one stimulus-response mapping typically yields better performance than another. For unimanual movement responses, the hand used to respond, hand posture (prone or supine), and response eccentricity influence this orthogonal stimulus-response compatibility (SRC) effect. All accounts of these phenomena attribute them to response-related processes. Two experiments examined whether manipulation of stimulus-set position along the dimension on which the stimuli varied influences orthogonal SRC in a manner similar to the way that response location does. The experiments differed in whether the stimulus dimension was vertical and the response dimension horizontal, or vice versa. In both experiments, an advantage of mapping up with right and down with left was evident for several response modes, and stimulus-set position had no influence on the orthogonal SRC effect. The lack of effect of stimulus-set position is in agreement with the emphasis that present accounts place on response-related processes. We favor a multiple asymmetric codes account, for which the present findings imply that the polarity of stimulus codes does not vary across task contexts although the polarity of response codes does.     

From car use reduction to ride-sharing: The relevance of moral and environmental identity

Car use contributes significantly to environmental pollution, leading people to rethink their transport habits. Previous studies on car use reduction relied on established theories related to values and self-regulation to examine this decision. In this paper, we offer an alternative approach and examine the intention to reduce car use through the prism of identity theory, and propose environmental and moral identities, together with environmental concern, as the main antecedents to the importance of car use reduction and intention to reduce car use. Further, we consider ride-sharing intention as an outcome of the decision to reduce car use. The proposed conceptual model is tested on a sample of consumers from the United Kingdom using an online consumer panel. The results offer partial support for the influence of moral identity, environmental identity, and environmental concern on the importance to reduce car use and intention. The links among the importance of and intention to reduce car use, along with ride-sharing intentions, are supported. Finally, managerial implications are discussed, and future research directions are suggested.     

Impaired cognitive control during reward pursuit and punishment avoidance

Motivation and Emotion - Two experiments were conducted to examine how cognitive control is modulated by response-contingent reward (Experiment 1) and response-contingent punishment (Experiment 2)....