Optimal Item Calibration for Computerized Achievement Tests

Item calibration is a technique to estimate characteristics of questions (called items) for achievement tests. In computerized tests, item calibration is an important tool for maintaining, updating and developing new items for an item bank. To efficiently sample examinees with specific ability levels for this calibration, we use optimal design theory assuming that the probability to answer correctly follows an item response model. Locally optimal unrestricted designs have usually a few design points for ability. In practice, it is hard to sample examinees from a population with these specific ability levels due to unavailability or limited availability of examinees. To counter this problem, we use the concept of optimal restricted designs and show that this concept naturally fits to item calibration. We prove an equivalence theorem needed to verify optimality of a design. Locally optimal restricted designs provide intervals of ability levels for optimal calibration of an item. When assuming a two-parameter logistic model, several scenarios with D-optimal restricted designs are presented for calibration of a single item and simultaneous calibration of several items. These scenarios show that the naive way to sample examinees around unrestricted design points is not optimal.

     

The League

About painting, cybernetics, and shared purpose, this article is partly a story, in part a memoir, an adventure in cybernetics, happening 30 years ago, in snow, in the small Swiss city of St. Gallen. A conference of the American Society for Cybernetics meets there. It is 1987. The author, a painter, searching for a new understanding of painting, encounters a convergence of the art of painting and the art of cybernetics through principles of second-order cybernetics in Pask, von Foerster and Maturana, dissolved in Kathleen Forsythe’s poetry. The form, as well as the content of this article, reflects cybernetics.     

The language of lies: a preregistered direct replication of Suchotzki and Gamer (2018; Experiment 2)

Is lying in a different language easier or more difficult? The Emotional Distance and the Cognitive Load hypothesis give competing answers. Suchotzki and Gamer measured the time native German speakers needed to initiate honest and deceptive answers to German and English questions. Lie-truth differences in RTs were much smaller for the foreign compared to the native language. In our preregistered replication study in native Dutch speakers, we found that lie-truth differences in RTs were moderately smaller when participants were tested in English than when tested in Dutch. These findings indicate that people struggle with quickly retrieving the truth in another language, and that foreign language use may diminish lie-truth differences.     

The efficacy of structural ecosystems therapy with drug-abusing/dependent African American and Hispanic American adolescents.

Many family therapies for adolescent drug use include ecological interventions. The purpose of this randomized clinical trial was to establish whether ecological interventions contribute to the impact of family therapy above and beyond the contributions of family process-only interventions. A family-based ecological approach, structural ecosystems therapy (SET), was compared with family process-only condition (FAM) and community services control (CS). One hundred ninety substance-abusing or dependent African American and Hispanic adolescents were randomized to SET, FAM, or CS. Follow-up assessments were conducted at 3, 6, 12, and 18 months postrandomization. SET was significantly more efficacious than FAM and CS in reducing adolescent drug use. However, these improvements were limited to Hispanic adolescents. The study demonstrates the importance of investigating changes in adolescent drug use as a result of treatment condition across more than 1 racial/ethnic group.     

Young adult international adoptees' search for birth parents

This study examines international adoptees and factors associated with searching for birth parents. A total of 1,417 international adoptees in The Netherlands, aged 24 to 30 years, were divided into 4 groups: uninterested nonsearchers, interested nonsearchers, searchers, and reunited searchers. In total, 32% of adoptees had searched. Although the majority of searchers were well-adjusted, they had more problems--mainly internalizing problems--than uninterested nonsearchers. These problems, however, were not caused by the search itself. It is concluded that searching is the product of natural curiosity influenced by external factors such as the divorce of adoptive parents and the options for searching.     

No Regrets, or: Edith Piaf Revamps Decision Theory

I argue that standard decision theories, namely causal decision theory and evidential decision theory, both are unsatisfactory. I devise a new decision theory, from which, under certain conditions, standard game theory can be derived.

Modeling how, when, and what is learned in a simple fault-finding task

We have developed a process model that learns in multiple ways while finding faults in a simple control panel device. The model predicts human participants' learning through its own learning. The model's performance was systematically compared to human learning data, including the time course and specific sequence of learned behaviors. These comparisons show that the model accounts very well for measures such as problem-solving strategy, the relative difficulty of faults, and average fault-finding time. More important, because the model learns and transfers its learning across problems, it also accounts for the faster problem-solving times due to learning when examined across participants, across faults, and across the series of 20 trials on an individual participant basis. The model shows how learning while problem solving can lead to more recognition-based performance, and helps explain how the shape of the learning curve can arise through learning and be modified by differential transfer. Overall, the quality of the correspondence appears to have arisen from procedural, declarative, and episodic learning all taking place within individual problem-solving episodes.     

Production of non-canonical sentences in agrammatic aphasia: limits in representation or rule application?

The study reported here compares two linguistically informed hypotheses on agrammatic sentence production, the TPH [Friedmann, N., & Grodzinsky, Y. (1997). Tense and agreement in agrammatic production: Pruning the syntactic tree. Brain and Language, 56, 397-425.] and the DOP [Bastiaanse, R., & van Zonneveld, R. (2005). Sentence production with verbs of alternating transitivity in agrammatic Broca's aphasia. Journal of Neurolinguistics, 18, 59-66]. To explain impaired production of non-canonical sentences in agrammatism, the TPH basically relies on deleted or pruned clause structure positions in the left periphery, whereas the DOP appeals to limitations in the application of movement rules. Certain non-canonical sentences such as object-questions and object-relative clauses require the availability of nodes in the left periphery as well as movement to these nodes. In languages with relatively fixed word order such as English, the relevant test cases generally involve a coincidence of left periphery and movement, such that the predictions of the TPH and the DOP are identical although for different reasons. In languages with relatively free word order such as German, on the other hand, it is possible to devise specific tests of the different predictions due to the availability of scrambling. Scrambled object sentences, for example, do not involve the left periphery but do require application of movement in a domain below the left periphery. A study was conducted with German agrammatic subjects which elicited canonical sentences without object movement and non-canonical scrambled sentences with object movement. The results show that agrammatic speakers have a particular problem with the production of scrambled sentences. Further evidence reported in the study from spontaneous speech, elicitation of object relatives, questions and passives and with different agrammatic subjects confirms that non-canonical sentences are generally harder to produce for agrammatics. These findings provide evidence in favor of the DOP and it will be argued that a cross-modal explanation of agrammatic deficits is possible if two factors--movement and canonicity--are taken into consideration.