The Great Divide: Academic Versus Practitioner Criteria for Psychometric Test Choice

This article looks at the two very different worlds of academic personality psychologists and business (human resources) professionals who both use personality tests. It examines the decisions practitioners make when choosing to purchase and use psychometric tests in the workplace. It reviews the relatively few papers on practitioner’s knowledge of, attitudes toward, and beliefs about psychological tests. Data are then reported from a study looking at practitioners’ rank ordering of criteria they would use in choosing psychological tests. This is contrasted with typical academic concerns as expressed in the literature. The article shows some divide between academic personality psychology researchers and those who purchase and use these tests in applied settings.     

Sequential Choice in a Step-Level Public Goods Dilemma: The Effects of Criticality and Uncertainty

A social dilemma is a situation in which members of a group or organization are faced with a conflict between two choices: maximize personal interests (defection) or maximize collective interests (cooperation). It is generally more profitable to defect, but if all do so, all are worse off than if all choose to cooperate. Previous research indicate that criticality and uncertainty affect the likelihood of cooperation. The more a member perceives that her choice is critical (has a significant impact on the outcome), the greater the likelihood of cooperation; conversely, the greater the uncertainty about the outcome, the lower the likelihood of cooperation. A sequential social dilemma paradigm was developed to manipulate criticality and uncertainty systematically. Using college students as subjects, two experiments were conducted. In both experiments (based on four- and six-person groups), criticality interacted with uncertainty: When criticality was high, cooperation decreased with uncertainty; but when criticality was low, there was a slight increase of cooperation rates with uncertainty. Several hypotheses are proposed to explain these results.     

The experimenter module of the DSMAC (Dynamic Sequential MultiAttribute Choice) interface

The DSMAC (Dynamic Sequential MultiAttribute Choice) interface is a process-tracing methodology that permits a researcher to investigate subjects’ behaviors in an optional-stopping task. In such an environment, an individual decides after each piece of acquired information whether to make a choice between a pair of competing alternatives or to acquire additional information. DSMAC consists of two modules-an experimenter and a subject interface. The former allows the researcher to specify all of the relevant experimental parameters for a particular study, which is subsequently used as input by the latter. The bimodular nature of DSMAC significantly reduces the set-up time required for constructing novel stimuli for new experiments. DSMAC runs on a Macintosh computer. It is compatible with most Mactintosh models that use a system 7.0 (or higher) operating system. The source code was written in ThinkPascal 4.0.1.     

Stopping speech suppresses the task-irrelevant hand

Some situations require one to quickly stop an initiated response. Recent evidence suggests that rapid stopping engages a mechanism that has diffuse effects on the motor system. For example, stopping the hand dampens the excitability of the task-irrelevant leg. However, it is unclear whether this ‘global suppression’ could apply across wider motor modalities. Here we tested whether stopping speech leads to suppression of the task-irrelevant hand. We used Transcranial Magnetic Stimulation over the primary motor cortex with concurrent electromyography from the hand. We found that when speech was successfully stopped the motor evoked potential from the task-irrelevant hand was significantly reduced compared to when the participant failed to stop speaking, or responded on non stop signal trials, or compared to baseline. This shows that when speech is quickly stopped, there is a broad suppression across the motor system. This has implications for the neural basis of speech control and stuttering.     

Sequential dependencies in free-responding

Three pigeons pecked for food in an experiment in which reinforcements were arranged for responses terminating sequences of interresponse times. Each reinforced interresponse time belonged to a class extending either from 1.0 to 2.0 sec (class A) or from 3.0 to 4.5 sec (class B). Reinforcements were arranged by a single variable-interval schedule and a random device that assigned each reinforcement to one of four sequences of two successive interresponse times: AA, AB, BA, or BB. Throughout the experiment, half of the reinforcements were delivered for interresponse times in class A and half for those in class B. Over conditions, the interresponse time preceding a reinforced interresponse time always, half of the time, or never, belonged to class A. The duration of the interresponse time preceding a reinforced one had a pronounced effect on response patterning. It also had a pronounced effect on the overall response probability, which was highest, intermediate, and lowest, when the interresponse time preceding a reinforced interresponse time always, half of the time, or never, belonged to class A, respectively. In no case were successive interresponse times independent, so that overall response probability was not representative of momentary response probabilities.     

Sequential dependencies in driving

The effect of recent experience on current behavior has been studied extensively in simple laboratory tasks. We explore the nature of sequential effects in the more naturalistic setting of automobile driving. Driving is a safety-critical task in which delayed response times may have severe consequences. Using a realistic driving simulator, we find significant sequential effects in pedal-press response times that depend on the history of recent stimuli and responses. Response times are slowed up to 100 ms in particular cases, a delay that has dangerous practical consequences. Further, we observe a significant number of history-related pedal misapplications, which have recently been noted as a cause for concern in the automotive safety community. By anticipating these consequences of sequential context, driver assistance systems could mitigate the effects of performance degradations and thus critically improve driver safety.     

Stopping rule use during information search in design problems

Information search is critical in most decision-making tasks. An important aspect of information search is the stopping rule used by the decision maker to terminate information acquisition. Decision-making problems may be usefully decomposed into design problems and choice problems. The distinction is critical because the goals of stopping behavior in the two types of problems are quite different. In design problems, the focus is on the sufficiency of information obtained for problem structuring and generating alternatives, while choice problems focus on convergence toward a solution. While previous research has studied stopping behavior in choice problems, the present research is concerned with stopping rule use during information search in design problems. To build theory in this area, we conducted two experiments. In the first, we presented professional systems analysts with an information search problem in a systems development context and asked them to gather information for a proposed system. Protocols of the search sessions were analyzed, and stopping rules used and information gathered by the analysts were identified. Results indicated that the use of certain stopping rules resulted in greater quantity and quality of information gathered. Additionally, stopping rule use, rather than analyst experience, accounted for the quantity and quality of information elicited. Finally, stopping rule use differed between more experienced and less experienced analysts. To apply our findings about stopping rules from the first experiment, we performed a second experiment in which we investigated stopping rule use in a consumer information search task on the world wide web. Results indicated the use of the same stopping rules as in the first experiment, although in different proportions. Implications for information search theory and practice are discussed.     

Stopping rules for multi-category computerized classification testing

Computerized classification testing (CCT) aims to classify persons into one of two or more possible categories to make decisions such as mastery/non-mastery or meet most/meet all/exceed. A defining feature of CCT is its stopping criterion: the test terminates when there is enough confidence to make a decision. There is abundant research on CCT with a single cut-off, and two common stopping criteria are the sequential probability ratio test (SPRT) statistic and the generalized likelihood ratio statistic (GLR). However, there is a relative scarcity of research extending the SPRT to the multi-hypothesis case for when there is more than one cut-off. In this paper, we propose a new multi-category GLR (mGLR) statistic as well as a stochastically curtailed version of the CCT with three or more categories. A simulation study was conducted to show that the mGLR statistic outperformed the existing stopping rules by generating shorter average test length without sacrificing classification accuracy. Results also revealed that the stochastically curtailed mGLR successfully increased test efficiency in certain testing conditions.     

Sequential effects in dimensional contrast

Two experiments examined pigeons' response rates during short trials signaled by stimuli closely spaced along a wavelength continuum. In Experiment 1 separate halves of the continuum were correlated with different reinforcement schedules. In Experiment 2, the middle stimulus was accompanied by a lower probability of reinforcement than were the remaining wavelengths. Both procedures resulted in dimensional contrast “shoulders,” seen as relatively enhanced or depressed response rates in the presence of stimuli between the extreme of the continuum and the border separating the positive and negative stimuli. Sequential analyses addressed possible contributions of the following interactions: (a) local contrast, seen when rate during a given schedule depends on the schedule in the just-preceding trial; (b) modification of local contrast by the similarity of the signaling stimuli (P. Blough, 1983); and (c) schedule-independent rate contrast, seen when rate in a given trial depends on the rate controlled by the stimulus that accompanied the just-preceding trial (Malone & Rowe, 1981). Dimensional contrast functions were similar when isolated according to the schedule, to the similarity of the signaling stimulus, and to the response rate of the just-preceding trial. The interactions noted above do not appear to make important contributions to this effect.     

Sequential effects in number comparison

The modular framework of number processing (e.g., S. Dehaene & R. Akhavein, 1995) was applied to study sequential trial-to-trial effects in a number comparison task. In Experiment 1, numbers were always presented as digits. Responses were faster when the same number was repeated, but this effect was additive with the numerical distance effect. In Experiment 2, numbers were presented either as digits or as words. The authors found significant effects of repeating (a) the same physical stimulus, (b) the same number but in a different notation, and (c) the same notation but a different number. Again, all 3 effects were additive with the numerical distance effect. The authors' results provide strong evidence against accounts according to which, on stimulus repetition trials, the comparison stage is bypassed (as proposed by S. Dehaene, 1996), and the results clearly favor an early, precomparison locus of repetition effects.