Time-stamping computer events to report .1-msec accuracy of events in the Micro Experimental Laboratory

A critical problem in most real-time programming tasks is the verification that timing of the presented displays and recorded events occur at the expected times. It is often difficult for psychologists to verify critical timing because of the lack of costly specialized tools and technicians to measure events with millisecond accuracy. Algorithms utilized in a new Time Audit mechanism, added to the Micro Experimental Laboratory, are described. This new mechanism involves the recording and time stamping of all input and output events with 0.1-msec accuracy. This allows the experimenter to determine the initiation, duration, and termination of each event and also makes it possible to relate these events to the synchronization of the screen refresh cycle. A customized user interface provides a time log and event-tracing feature that enables nonprogrammers to determine the duration of command execution to the .1-msec level, allowing rapid, precise assessment of program execution. The resulting time log provides a detailed specification of the experimental events for debugging and a permanent record of the experimental procedure.     

Psychology Experiment Authoring Kit (PEAK): Formal usability testing of an easy-to-use method for creating computerized experiments

In academic courses in which one task for the students is to understand empirical methodology and the nature of scientific inquiry, the ability of students to create and implement their own experiments allows them to take intellectual ownership of, and greatly facilitates, the learning process. The Psychology Experiment Authoring Kit (PEAK) is a novel spreadsheet-based interface allowing students and researchers with rudimentary spreadsheet skills to create cognitive and cognitive neuroscience experiments in minutes. Students fill in a spreadsheet listing of independent variables and stimuli, insert columns that represent experimental objects such as slides (presenting text, pictures, and sounds) and feedback displays to create complete experiments, all within a single spreadsheet. The application then executes experiments with centisecond precision. Formal usability testing was done in two stages: (1) detailed coding of 10 individual subjects in one-on-one experimenter/subject videotaped sessions and (2) classroom testing of 64 undergraduates. In both individual and classroom testing, the students learned to effectively use PEAK within 2 h, and were able to create a lexical decision experiment in under 10 min. Findings from the individual testing in Stage 1 resulted in significant changes to documentation and training materials and identification of bugs to be corrected. Stage 2 testing identified additional bugs to be corrected and new features to be considered to facilitate student understanding of the experiment model. Such testing will improve the approach with each semester. The students were typically able to create their own projects in 2 h.     

PsychMate: Providing psychology majors the tools to do real experiments and learn empirical methods

PsychMate is a set of software tools for undergraduate psychology students to run, develop, and analyze computerized experiments. It includes 30 psychological experiments in the areas of perception, cognition, social psychology, human factors, and cognitive neuroscience. Students run experiments themselves and see basic results immediately. The automatic spreadsheet analysis forms allow them to aggregate data and create analyses, presentations, and Web pages with a single click. Students can use the Psychology Experiment Authoring Kit experiment editor to create their own experiments in minutes and run experiments with other students using Web-based experiment-management tools. The Brain-Tutor and BrainViewer applications teach brain anatomy and permit students to analyze fMRI brain imaging data from subjects who have performed the same memory experiments in which they participated. PsychMate has been used in 83 classes in which 1,533 students submitted 5,464 completed experiments with few (less than 1%) requests for help and a very positive rating of the research experience.