Online psychophysics: reaction time effects in cognitive experiments

Using the Internet to acquire behavioral data is currently on the rise. However, very basic questions regarding the feasibility of online psychophysics are still open. Here, we aimed to replicate five well-known paradigms in experimental psychology (Stroop, Flanker, visual search, masked priming, attentional blink) in three settings (classical “lab”, “web-in-lab”, “web”) to account for possible changes in technology and environment. Lab and web-in-lab data were both acquired in an in-lab setting with lab using “Gold Standard” methods, while web-in-lab used web technology. This allowed for a direct comparison of potential differences in acquisition software. To account for additional environmental differences, the web technology experiments were published online to participate from home (setting web), thereby keeping the software and experimental design identical and only changing the environmental setting. Our main results are: First, we found an expected fixed additive timing offset when using web technology (M = 37 ms, SD = 8.14) and recording online (M = 87 ms, SD = 16.04) in comparison to lab data. Second, all task-specific effects were reproduced except for the priming paradigm, which couldn’t be replicated in any setting. Third, there were no differences in error rates, which are independent of the timing offset. This finding further supports the assumption of data equality over all settings. Fourth, we found that browser type might be influencing absolute reaction times. Together, these results contribute to the slowly but steadily growing literature that online psychophysics is a suitable complement – or even substitute – to lab data acquisition.     

Processing sets of letters for order: Evidence from reaction time experiments

In two experiments, subjects were required to impose different levels of organization on randomly ordered letters. In a between-subject design, the subject was to identify the letter in the set coming first in the alphabet or to reorganize the set into an alphabetic sequence. In a within-subject design, presentation of the letters was followed by an instruction to carry out the identification or reorganization task or to recite the letters in left-to-right order. Reaction time varied systematically with level of required organization, size of the presented set, and position and spacing of the letter set in the alphabet. The results are discussed in terms of two simple models.     

Crossed-uncrossed difference (CUD) on reaction time and movement time in three two-choice experiments

The present study addresses the robustness and the reliability of the crossed-uncrossed difference (CUD) on a reaction time (RT) and a movement time (MT) component of a prescribed unimanual response to lateralized stimuli. Experiment 1 demonstrated positive CUDs both when a visual warning signal (WS) and an auditory reaction signal (RS) appeared on corresponding and non-corresponding sides of the body. Experiment 2 showed effect of handedness on CUD calculated among right-handers and left-handers. Experiment 3 investigated CUDs through five successive days, indicating that CUDs became steady and reliable although practice affected both RT and MT. All experiments indicated CUD on RT and MT. In addition, Experiments 1 and 2 demonstrated hemispheric asymmetries in favour of an anatomical theory while Experiment 3 did not show any asymmetries and supports an S-R compatibility theory.     

ARTIST: A computer system for creating and running psychology experiments

A flexible computer system for research and teaching experiments in psychology is described. Special features of the system include (1) separate phases for the generation and running of experiments, (2) facilities to control presentation of stimuli according to any factorial design, and (3) different modes of operation depending on the prior knowledge of the users. The system is evaluated both in terms of the range of experiments that can be performed and in terms of the time and effort required to create new experiments or modify old ones. General principles for designing interactive systems are discussed in the light of experiences with this particular system.     

ACPE: A computerized system for running small-group decision-making experiments

Small groups are called upon to make important policy decisions under a wide variety of procedural constraints. ACPE is a flexible, computerized system for conducting small-group voting experiments. It permits researchers to examine the impact of electronic communication on group deliberation and choice. The system runs under a variety of different personal computer networks and is designed to permit the specification of voting rules, communication, and group sizes. The system also facilitates the study of group process by tracking all messages sent and votes taken. An experiment in which the system was used is briefly described.     

An inaccurate-timing filter for reaction time measurement by JAVA applets implementing Internet-based experiments

JAVA applets are not accurate enough to measure reaction time unless precautions are taken. A response-filtering technique is introduced that identifies inaccurate measurements by testing whether the client-side JAVA implementation produces false measurements of a time interval of known length during the measured reaction time. Reaction times that indicate such inaccuracy are discarded to increase the reliability of the remaining data. Three studies provide illustrative data on the effectiveness of the new technique, using 11 different computer systems. Study 1 showed differences in the accuracy of different clients and higher variability of the obtained means with applets than with native programs. Study 2 showed sharply increased variability when additional loads were imposed on the clients during reaction time measurement. The response-filtering technique diminishes this variability. Study 3 indicated more accurate measurement, with the new technique being able to reveal even smaller differences in difficult technical conditions.     

Measuring reaction time and controlling the video display in experiments on an IBM PC

The problems of using the IBM PC XT/AT or their clones in experiments are recognized because of the slow, inadequate and awkward timing procedures of these microcomputers. Some specific solutions to these problems are described, including a compiled BASIC approach using real time procedures accurate to 1 millisecond (although resolution to 1 microsecond can be achieved) and synchronization of the video display with the program. Programs are available from the authors on receipt of a 5 1/4 inch floppy disc or $10.     

Perceptual and motor components of performance in three different reaction time experiments

Three reaction time experiments were conducted to examine the effects of time of day, stimulus intensity, stimulus modality, and constant and variable foreperiod on the perceptual and motor components of performance. These variables are all supposed to generate changes in arousal level. All the independent variables affected the perceptual component, while the motor component was significantly influenced only by foreperiod and modality. The results are discussed in relation to aspects of dependency/independency of the perceptual and motor components of human performance in reaction time experiments.     

Speed-accuracy tradeoff functions in choice reaction time: Experimental designs and computational procedures

The existence of tradeoffs between speed and accuracy is an important interpretative problem in choice reaction time (RT) experiments. A recently suggested solution to this problem is the use of complete speed-accuracy tradeoff functions as the primary dependent variable in choice RT ,experiments instead of a single mean RT and error rate. This paper reviews and compares existing procedures for generating empirical speed-accuracy tradeoff, functions for use as dependent variables in choice RT experiments. Two major types of tradeoff function are identified, and their experimental designs and computational procedures are discussed and evaluated. Systematic disparities are demonstrated between the two tradeoff functions in both empirical and computer-simulated data. Although all existing procedures for generating speed-accuracy tradeoff functions involve empirically untested assumptions, one procedure requires less stringent assumptions and is less sensitive to sources of experimental and statistical error. This procedure involves plotting accuracy against RT over a set of experimental conditions in which subjects’ criteria for speed vs. accuracy are systematically varied.     

A random-walk model of accuracy and reaction time applied to three experiments on pigeon visual discrimination

A random-walk model of visual discrimination is described and applied to reaction time (RT) distributions from three discrete-trial experiments with pigeons. Experiment 1 was a two-choice hue discrimination task with multiple hues. Choice percentages changed with hue discriminability; RTs were shortest for the least and most discriminable stimuli. Experiments 2 and 3 used go/no-go hue discriminations. Blocks of sessions differed in reward probability associated with a variable red stimulus in Experiment 2 and with a constant green stimulus in Experiment 3. Changes in hue had a large effect on response percentage and a small effect on RT; changes in reward shifted RT distributions on the time axis. The "random-walk, pigeon" model applied to these data is closely related to Ratcliff's diffusion model (Ratcliff, 1978; Ratcliff & Rouder, 1998). Simulations showed that stimulus discriminability affected the speed with which evidence accumulated toward a response threshold, in line with comparable effects in human subjects. Reward probability affected bias, modeled as the amount of evidence needed to reach one threshold rather than the other. The effects of reward probability are novel, and their isolation from stimulus effects within the decision process can guide development of a broader model of discrimination.     

Object relocation: a program for setting up, running, and analyzing experiments on memory for object locations

Object Relocation is a computer program for Windows 95, with which experiments on spatial memory for object locations can be designed, run, and analyzed. Because of its clear graphical user interface, no long and complex command syntax is needed. Basically, a stimulus consists of a frame that contains a chosen number of locations (i.e., the actual spatial layout) to which objects can be assigned. When the experiment is run, these stimuli are presented to the subject for a variable period of time. Subsequently (either with or without a delay), the objects are presented in a row above the frame and have to be relocated to the correct positions. Finally, the raw data can be analyzed efficiently, using various error scores, and an SPSS-ready output file can be produced. Object Relocation is a very flexible program: New objects and positions can easily be added, and various options for presentation and relocation are present.     

Projects in experimental psychology: Software for several classical perception experiments

Projects in Experimental Psychology (Sorkin, 1997) is a Windows-based series of nine classical perception experiments. It is primarily designed for laboratory use in perception and related courses. The program is generally simple to use and exploits the “point-and-click” features of Windows quite well. It complements, rather than competes with, Levy and Ransdell’s (1998) Laboratory in Cognition and Perception, which is more suitable for courses in memory. Projects can be extremely useful in laboratory courses in perception and cognition, although the number and range of studies may presently be too limited to be the exclusive source of data in these courses. Although instructors proficient with experiment generators such as MEL (Schneider, 1998) or ERTS (Beringer, 1992) may opt to design their own experiments, this is an excellent alternative for those who lack the time or the background to do so.     

Loudness and reaction time: I

It is widely assumed, based on Chocholle’s (1940) research, that stimuli that appear equal in loudness will generate the same reaction times. In Experiment 1, we first obtained equal-loudness functions for five stimulus frequencies at four different intensity levels. It was found that equal loudness produced equal RT at 80 phons and 60 phons, but not at 40 phons and 20 phons. It is likely that Chocholle obtained equivalence between loudness and RT at all intensity levels because of relay-click transients in his RT signals. One main conclusion drawn from Experiment 1 is that signal detection (in reaction time) and stimulus discrimination (in loudness estimation) require different perceptual processes. In the second phase of this investigation, the RT-intensity functions from six different experiments were used to generate scales of auditory intensity. Our analyses indicate that when the nonsensory or “residual” component is removed from auditory RT measures, the remaining sensory-detection component is inversely related to sound pressure according to a power function whose exponent is about — 3. The absolute value of this exponent is the same as the .3 exponent for loudness when interval-scaling procedures are used, and is one-half the size of the .6 exponent which is commonly assumed for loudness scaling.     

Effects of electromyographic biofeedback on reaction time and movement time

The effects of electromyographic (EMG) biofeedback on reaction time (RT) and movement time (MT) were investigated utilizing 42 right-handed, male subjects from a university population. Subjects were randomly divided into three groups, a control group and two experimental groups. Both experimental groups were exposed to their EMG signals from their triceps brachii during the task, one experimental group received written information explaining the purpose of the EMG was to improve performance through biofeedback. Reaction times of the first block of 25 trials were significantly faster than those on the subsequent three blocks of trials for all groups. This provided evidence of learning. No other significant effects for reaction times were observed. Mean movement time for the EMG-only group was significantly slower than the means of either the Control group or EMG-Biofeedback group, with no difference between the latter two. The differences between experimental groups may have been related to alteration of strategy, anxiety, motivation.