Learning and transfer of calorie information

This study compared generating information about food to viewing and verbally producing that information for learning and transfer. Specifically, during training, a list of food items was shown, and some participants generated either real calories (Experiment 1) or fabricated prices (Experiment 2) associated with those foods with feedback provided (seeding), some viewed and read aloud values provided (viewing), and others read aloud the names of the items with no values provided (control). All participants were tested immediately and 1 week later on both old and new foods. In both experiments, the seeding and viewing conditions showed more learning than the control condition, and only the experimental conditions showed transfer of learning from old to new foods, with advantages found for seeding over viewing only in some cases. The results are discussed in terms of the seeding, testing, generation, and production effects, as well as their applications to health and policy.     

Psychometric properties and heritability of a new online test for musicality,the Swedish Musical Discrimination Test

We examine, in 6881 twin individuals, the psychometric properties of a new test (the Swedish Musical Discrimination Test, SMDT) that was developed to tap auditory discrimination of musical stimuli. The SMDT consists of three subtests measuring discrimination of melodies, rhythms, and single pitches, respectively. Mean test taking times for the subtests were 3.0–4.6 min. Reliability and internal consistency were good with Cronbach’s alpha values and Spearman–Brown split-half reliabilities between .79 and .89. Subtests correlated positively (r values .27–.41). Criterion validity was demonstrated in three ways: individuals that had played a musical instrument scored higher than individuals that had not (Cohen’s d .38–.63); individuals that had taken music lessons scored higher than individuals that had not (Cohen’s d .35–.60); finally, total hours of musical training and SMDT scores correlated (r values .14–.28) among those participants that had played an instrument. Lastly, twin modelling revealed moderate heritability estimates for the three sub-scales. We conclude that the SMDT has good psychometric characteristics, short test taking time, and may serve as a useful complement to existing tests of musical ability.     

Nicholas A. Vacc: A Legacy of Professional Leadership and Mentoring

For more than 20 years, Dr. Nicholas A. Vacc helped shape the counseling profession through his extensive involvement in accreditation, certification, and testing, as well as his research and scholarship. This article, based on a review of documents and interviews with his colleagues, former students, and family members, provides the only summary of Vacc's numerous accomplishments and describes his characteristics as a leader, a mentor, and a person.     

The Depression Anxiety and Stress Scales: Reference data from a large psychiatric outpatient sample

The published norms for the Depression Anxiety and Stress Scale (DASS) give results for clinical populations that largely fall in the severe to very severe categories. As a result, within this population, the ability to compare the comparative contributions of the underlying emotional components is reduced. The present study presents results from a large general psychiatric outpatient population and provides percentile norms with confidence intervals for both the original DASS and the shorter 21‐item form. It is noted that both forms have high validity but that the correlations between scales are higher than those reported in non‐clinical populations. There was little variation between sexes but some variation of results with age with both younger and older cohorts having lower scores except for the Stress scale where there were higher scores in the older group. There is some evidence of a ceiling effect in the Depression and Stress scales. It was noted that nearly a quarter of patient scores fell within the originally defined normal range suggesting that the DASS would not be a particularly sensitive instrument in its previously reported use as a screening instrument for psychiatric illness.     

Properties of hypothesis testing techniques and (Bayesian) model selection for exploration‐based and theory‐based (order‐restricted) hypotheses

In this paper, the performance of six types of techniques for comparisons of means is examined. These six emerge from the distinction between the method employed (hypothesis testing, model selection using information criteria, or Bayesian model selection) and the set of hypotheses that is investigated (a classical, exploration‐based set of hypotheses containing equality constraints on the means, or a theory‐based limited set of hypotheses with equality and/or order restrictions). A simulation study is conducted to examine the performance of these techniques. We demonstrate that, if one has specific, a priori specified hypotheses, confirmation (i.e., investigating theory‐based hypotheses) has advantages over exploration (i.e., examining all possible equality‐constrained hypotheses). Furthermore, examining reasonable order‐restricted hypotheses has more power to detect the true effect/non‐null hypothesis than evaluating only equality restrictions. Additionally, when investigating more than one theory‐based hypothesis, model selection is preferred over hypothesis testing. Because of the first two results, we further examine the techniques that are able to evaluate order restrictions in a confirmatory fashion by examining their performance when the homogeneity of variance assumption is violated. Results show that the techniques are robust to heterogeneity when the sample sizes are equal. When the sample sizes are unequal, the performance is affected by heterogeneity. The size and direction of the deviations from the baseline, where there is no heterogeneity, depend on the effect size (of the means) and on the trend in the group variances with respect to the ordering of the group sizes. Importantly, the deviations are less pronounced when the group variances and sizes exhibit the same trend (e.g., are both increasing with group number).     

Equivalence tests for comparing correlation and regression coefficients

Equivalence tests are an alternative to traditional difference‐based tests for demonstrating a lack of association between two variables. While there are several recent studies investigating equivalence tests for comparing means, little research has been conducted on equivalence methods for evaluating the equivalence or similarity of two correlation coefficients or two regression coefficients. The current project proposes novel tests for evaluating the equivalence of two regression or correlation coefficients derived from the two one‐sided tests (TOST) method (Schuirmann, 1987, J. Pharmacokinet. Biopharm, 15, 657) and an equivalence test by Anderson and Hauck (1983, Stat. Commun., 12, 2663). A simulation study was used to evaluate the performance of these tests and compare them with the common, yet inappropriate, method of assessing equivalence using non‐rejection of the null hypothesis in difference‐based tests. Results demonstrate that equivalence tests have more accurate probabilities of declaring equivalence than difference‐based tests. However, equivalence tests require large sample sizes to ensure adequate power. We recommend the Anderson–Hauck equivalence test over the TOST method for comparing correlation or regression coefficients.     

Transformative Theory in Social and Organizational Research

In social and organizational research, theory is conventionally used to explain social phenomena. However, theory may be transformative in the sense that in using and testing the theory in a practical domain, researchers may attempt to help practitioners transform and improve their social practices and institutions. This idea is illustrated by a research-and-development project in Denmark, headed by the author, which used transformative theory to design professional conferences that are more conducive to participant learning and involvement than is the conventional, lecture-based format. A number of learning techniques were derived from the theory and were tested as hypotheses: When implemented in thirty live conference experiments, did they contribute to learning, as specified by the theory? Used in this manner, transformative theory may supplement the aspirations motivating change agents by some of the well-known qualities of scientific research, including theoretical grounding, a coherent ontology, testable hypotheses, systematic evaluation, external validity, and theory–action consistency.     

Relationship between sustained,orientated, divided,and selective attention and simulated aviation performance: Training & pressure effects

The present study examined how different characteristics of visual attention are related to flying ability. Eighty participants completed one of four attentional tests designed to assess sustained attention (SUSTAIN), attentional orienting (ORIENT), divided attention (DIVIDE) or selective attention (SELECT). Median splits were used to create low and high groups. After completing training, participants executed simulated landings under conditions of high anxiety. For the DIVIDE test, there were significant group differences in: (i) landing ability after training and (ii) the effects of anxiety. The high DIVIDE group had lower root mean square (RMS) errors at the end of training and were less affected by anxiety as compared to the low DIVIDE group. For the ORIENT and SELECT tests, there were significant group effects for training but not for anxiety. The high groups for these tests displayed lower RMS errors following training. There were no group differences for the SUSTAIN test. The results suggest that a test of divided attention may be useful for operational assessment of pilots.     

On initial item selection in cognitive diagnostic computerized adaptive testing

There has recently been much interest in computerized adaptive testing (CAT) for cognitive diagnosis. While there exist various item selection criteria and different asymptotically optimal designs, these are mostly constructed based on the asymptotic theory assuming the test length goes to infinity. In practice, with limited test lengths, the desired asymptotic optimality may not always apply, and there are few studies in the literature concerning the optimal design of finite items. Related questions, such as how many items we need in order to be able to identify the attribute pattern of an examinee and what types of initial items provide the optimal classification results, are still open. This paper aims to answer these questions by providing non‐asymptotic theory of the optimal selection of initial items in cognitive diagnostic CAT. In particular, for the optimal design, we provide necessary and sufficient conditions for the Q ‐matrix structure of the initial items. The theoretical development is suitable for a general family of cognitive diagnostic models. The results not only provide a guideline for the design of optimal item selection procedures, but also may be applied to guide item bank construction.     

Discrepancy detection in the retrieval-enhanced suggestibility paradigm

Retrieval-enhanced suggestibility (RES) refers to the finding that immediately recalling the details of a witnessed event can increase susceptibility to later misinformation. In three experiments, we sought to gain a deeper understanding of the role that retrieval plays in the RES paradigm. Consistent with past research, initial testing did increase susceptibility to misinformation – but only for those who failed to detect discrepancies between the original event and the post-event misinformation. In all three experiments, subjects who retrospectively detected discrepancies in the post-event narratives were more resistant to misinformation than those who did not. In Experiments 2 and 3, having subjects concurrently assess the consistency of the misinformation narratives negated the RES effect. Interestingly, in Experiments 2 and 3, subjects who had retrieval practice and detected discrepancies were more likely to endorse misinformation than control subjects who detected discrepancies. These results call attention to limiting conditions of the RES effect and highlight the complex relationship between retrieval practice, discrepancy detection, and misinformation endorsement.