Collecting paired-comparison data with a sorting algorithm

Monte Carlo techniques were used to evaluate the performance of an on-line paired-comparisons data collection procedure that makes use of a common computer sorting algorithm. The results revealed that the sorting method can reduce the number of trials per subject substantially even when a considerable amount of random error is present. While a complete paired-comparisons design requires N(N?1)/2 trials (where N is the number of objects), the sorting procedure requires a theoretical minimum of N(log₂N) trials. The savings in the number of trials consequently increases with N. Furthermore, the negative effect of random error on the final ordering of the data from the sorting method is small and decreases with the number of stimuli. The data from a small empirical study reinforces the Monte Carlo observations. It is recommended that the sorting method be used in place of the complete paired-comparisons procedure whenever a substantial number of stimuli are included in the design.     

Pluralism unconstrained

The problem of constraining methodological pluralism is highlighted in a discussion of John Dupré's The Disorder of Things. Dupré requires limits on what are to count as legitimate scientific methodologies. Although Dupré recognises this requirement, he fails in his attempt to appropriately ground such limitations.     

Multidimensional scaling of hierarchical sorting data applied to facial expressions

A new algorithm for multidimensional scaling analysis of sorting data and hierarchical-sorting data is tested by applying it to facial expressions of emotion. We construct maps in “facial expression space” for two sets of still photographs: the I-FEEL series (expressions displayed spontaneously by infants and young children), and a subset of the Lightfoot series (posed expressions, all from one actress). The analysis avoids potential artefacts by fitting a map directly to the subject's judgments, rather than transforming the data into a matrix of estimated dissimilarities as an intermediate step. The results for both stimulus sets display an improvement in the extent to which they agree with existing maps. Some points emerge about the limitations of sorting data and the need for caution when interpreting MDS configurations derived from them.     

Measuring category intuitiveness in unconstrained categorization tasks

What makes a category seem natural or intuitive? In this paper, an unsupervised categorization task was employed to examine observer agreement concerning the categorization of nine different stimulus sets. The stimulus sets were designed to capture different intuitions about classification structure. The main empirical index of category intuitiveness was the frequency of the preferred classification, for different stimulus sets. With 169 participants, and a within participants design, with some stimulus sets the most frequent classification was produced over 50 times and with others not more than two or three times. The main empirical finding was that cluster tightness was more important in determining category intuitiveness, than cluster separation. The results were considered in relation to the following models of unsupervised categorization: DIVA, the rational model, the simplicity model, SUSTAIN, an Unsupervised version of the Generalized Context Model (UGCM), and a simple geometric model based on similarity. DIVA, the geometric approach, SUSTAIN, and the UGCM provided good, though not perfect, fits. Overall, the present work highlights several theoretical and practical issues regarding unsupervised categorization and reveals weaknesses in some of the corresponding formal models.     

An investigation of data collection methods for auditory stimuli: Paired comparisons versus a computer sorting task

Two experiments were performed to determine whether a computer sorting task could be used to collect data for auditory stimuli. Within each experiment, subjects were assigned to either a paired comparison task or a computer sorting task. For the first experiment, the stimuli were 18 graph representations constructed to vary on three parameters (shape, frequency, and amplitude). The stimuli for the second experiment were 30 sentences produced by actors portraying five emotions (anger, fear, happiness, sadness, and neutral). Multidimensional scaling solutions were produced and comparisons were made between the paired comparison and computer sorting task in each experiment. The results suggest that the computer sorting task is a viable alternative to the paired comparison task traditionally used for the investigation of the perception of auditory stimuli.     

Constrained versus unconstrained estimation in structural equation modeling

Recently, R. D. Stoel, F. G. Garre, C. Dolan, and G. van den Wittenboer (2006) reviewed approaches for obtaining reference mixture distributions for difference tests when a parameter is on the boundary. The authors of the present study argue that this methodology is incomplete without a discussion of when the mixtures are needed and show that they only become relevant when constrained difference tests are conducted. Because constrained difference tests can hide important model misspecification, a reliable way to assess global model fit under constrained estimation would be needed. Examination of the options for assessing model fit under constrained estimation reveals that no perfect solutions exist, although the conditional approach of releasing a degree of freedom for each active constraint appears to be the most methodologically sound one. The authors discuss pros and cons of constrained and unconstrained estimation and their implementation in 5 popular structural equation modeling packages and argue that unconstrained estimation is a simpler method that is also more informative about sources of misfit. In practice, researchers will have trouble conducting constrained difference tests appropriately, as this requires a commitment to ignore Heywood cases. Consequently, mixture distributions for difference tests are rarely appropriate.     

Strategies used for unconstrained direction change during walking

Full functional mobility requires adaptations, such as turning, to the basic straight locomotor pattern. The aim was to assess the mechanics of completing a complex turning manoeuvre. A full 3-dimensional kinematic and kinetic analysis of the ipsilateral limb was carried out during both straight gait and unconstrained turning through 90 degrees. 10 healthy university students participated. Analysis indicated that two distinctive substrategies of the spin turn-ipsilateral pivot and ipsilateral crossover-were employed. The ipsilateral pivot was the more dynamic turn and required two additional power phases at the ankle and hip to facilitate the pivot phase. The ipsilateral crossover uses a fall into the new direction. The spin turn is a more complex action than previously indicated.     

Effects of media violence on viewers' aggression in unconstrained social interaction

This article provides a meta-analytic review of the experimental effects of media violence on viewers' aggression in unstructured social interaction. In the reviewed experiments, children or adolescents were exposed to violent or control presentations and their postexposure behavior was coded for aggression during spontaneous social interaction. Exposure to media violence significantly enhanced viewers' aggressive behavior when the findings were aggregated across studies, but the effect was not uniform across investigations. Only suggestive evidence was obtained concerning moderators of the effect: Marginally stronger relations were obtained in those studies using a cross-section of the normal population of children (vs. emotionally disturbed children) and in those studies conducted in laboratory settings (vs. other contexts).     

Apparatus for auditory stimulus sorting

An apparatus that enables Ss to sort and rank auditory stimuli is described. It consists of an array of movable pushbuttons that may be connected to various stimulus generators.     

Value-driven attentional and oculomotor capture during goal-directed, unconstrained viewing

Covert shifts of attention precede and direct overt eye movements to stimuli that are task relevant or physically salient. A growing body of evidence suggests that the learned value of perceptual stimuli strongly influences their attentional priority. For example, previously rewarded but otherwise irrelevant and inconspicuous stimuli capture covert attention involuntarily. It is unknown, however, whether stimuli also draw eye movements involuntarily as a consequence of their reward history. Here, we show that previously rewarded but currently task-irrelevant stimuli capture both attention and the eyes. Value-driven oculomotor capture was observed during unconstrained viewing, when neither eye movements nor fixations were required, and was strongly related to individual differences in visual working memory capacity. The appearance of a reward-associated stimulus came to evoke pupil dilation over the course of training, which provides physiological evidence that the stimuli that elicit value-driven capture come to serve as reward-predictive cues. These findings reveal a close coupling of value-driven attentional capture and eye movements that has broad implications for theories of attention and reward learning.     

A template-matching pandemonium recognizes unconstrained handwritten characters with high accuracy

Psychological data suggest that internal representations such as mental images can be used as templates in visual pattern recognition. But computational studies suggest that traditional template matching is insufficient for high-accuracy recognition of real-life patterns such as handwritten characters. Here we explore a model for visual pattern recognition that combines a template-matching and a feature-analysis approach: Character classification is based on weighted evidence from a number of analyzers (demons), each of which computes the degree of match between the input character and a stored template (a copy of a previously presented character). The template-matching pandemonium was trained to recognize totally unconstrained handwritten digits. With a mean of 37 templates per type of digit, the system has attained a recognition rate of 95.3%, which falls short of human performance by only 2%–3%.