Validating a visual version of the metronome response task

The metronome response task (MRT)—a sustained-attention task that requires participants to produce a response in synchrony with an audible metronome—was recently developed to index response variability in the context of studies on mind wandering. In the present studies, we report on the development and validation of a visual version of the MRT (the visual metronome response task; vMRT), which uses the rhythmic presentation of visual, rather than auditory, stimuli. Participants completed the vMRT (Studies 1 and 2) and the original (auditory-based) MRT (Study 2) while also responding to intermittent thought probes asking them to report the depth of their mind wandering. The results showed that (1) individual differences in response variability during the vMRT are highly reliable; (2) prior to thought probes, response variability increases with increasing depth of mind wandering; (3) response variability is highly consistent between the vMRT and the original MRT; and (4) both response variability and depth of mind wandering increase with increasing time on task. Our results indicate that the original MRT findings are consistent across the visual and auditory modalities, and that the response variability measured in both tasks indexes a non-modality-specific tendency toward behavioral variability. The vMRT will be useful in the place of the MRT in experimental contexts in which researchers’ designs require a visual-based primary task.     

Validating a selection test,a predictive probability approach

The problem of inferring the validity of a selection test (x) as a predictor of some criterion (y) when completexy data are not available is investigated. The basic approach is to construct the predictive probability distribution of the unobservedy scores and then derive interval estimates of the least squares regression weights, the difference in averagey scores for selected and unselected cases, and the residual variance in predictingy fromx. Further, an approximation to the predictive distribution of the squared correlation betweenx andy in a future group is derived.     

A test of the Piagetian water-level task with Chinese students.

A sample of 486 children in Beijing, China, were tested on the water-level task (WLT; J. Piaget & B. Inhelder, 1948/1956). The participants were 256 boys and 230 girls from 4th, 5th, 6th, 8th, and 11th grades. Three levels of mastery of the WLT were found. Level 1 consisted of 4th and 5th graders, who averaged about 71% correct. Level 2 consisted of 6th and 8th graders, who averaged about 83% correct. Level 3 consisted of 11th graders, who averaged 97% correct. The results provide partial support for the Piagetian theory of age-related developmental differences in performance on the WLT. The findings depict an interactive relationship of maturation with culture and education in the development of the ability to solve the WLT.     

Prospective and retrospective effects in a virtual pointing task

Over two decades ago prospective and retrospective effects of posture selection in a sequential task were described for the first time. Since then, both effects have been reproduced in a number of reaching studies. We asked (1) whether retrospective effects would also be found in a sequential pointing task and (2) whether pro/retrospective effects of posture selection would transfer to the end-effector position in the absence of haptic feedback. To this end, we created a sequential, perceptual-motor task in a virtual environment. Participants had to point to a row of targets in the frontal plane in sequential order. In a control experiment, physical targets were placed at the same locations. Results showed that kinematic parameters were similar in the virtual and real environment. Retrospective effects of posture/position were found in neither environment, indicating that pointing movements require lower cognitive planning costs than reaching movements. Prospective effects of posture were found both in the virtual and real environment. Prospective effects of position, on the other hand, were present in the virtual but not in the real environment, indicating that the absence of haptic feedback may result in unconscious shifts of the end-effector position.     

Flying dreams stimulated by an immersive virtual reality task

Despite a high prevalence and broad interest in flying dreams, these exceptional experiences remain infrequent. Our study aimed to (1) induce flying dreams using a custom-built virtual reality (VR) flying task, (2) examine their phenomenological correlates and (3) investigate their relations to participant state and trait factors. 137 participants underwent VR-flying followed by a morning nap. They also completed home dream journals for 5 days before and 10 days after the VR exposure. VR-flying successfully increased the reporting of flying dreams during the laboratory nap and on the following morning compared to both baseline frequencies and a control cohort. Flying dreams were also changed qualitatively, exhibiting higher levels of Lucid-control and emotional intensity, after VR exposure. Factors such as prior dream-flying experiences and level of VR sensory immersion modulated flying dream induction. Findings are consistent with a new vection-based explanation of dream-flying and may facilitate development of dream flight-induction technologies.     

Behavior of college baseball players in a virtual batting task

A baseball batting simulation was used to investigate the information used to hit a baseball. Measures of spatial and temporal swing accuracy were used to test whether batters (a) use speed to estimate pitch height, (b) initiate a constant swing duration at a fixed time to contact, (c) are influenced by the history of previous pitches and pitch count, and (d) use rotation direction. Batters were experienced college players. Pitch speed variance led to predictable spatial errors, and spatial accuracy was worse than temporal accuracy. Swing duration was generally variable. The history of the previous 3 pitches and the pitch count had significant effects on accuracy, and performance improved when rotation cues were added. There were significant effects of expertise on hitting strategy.     

Evidence of separable spatial representations in a virtual navigation task

Three experiments investigated spatial orientation in a virtual navigation task. Subjects had to adjust a homing vector indicating their end position relative to the origin of the path. It was demonstrated that sparse visual flow was sufficient for accurate path integration. Moreover, subjects were found to prefer a distinct egocentric or allocentric reference frame to solve the task. "Turners" reacted as if they had taken on the new orientation during turns of the path by mentally rotating their sagittal axis (egocentric frame). "Nonturners," by contrast, tracked the new orientation without adopting it (allocentric frame). When instructed to use their nonpreferred reference frame, both groups displayed no decline in response accuracy relative to their preferred frame; even when presented with reaction formats based on either ego or allocentric coordinates, with format unpredictable on a trial, both groups responded highly accurately. These findings support the assumption of coexisting spatial representations during navigation.     

Testing the semantic differential as a model of task processes with the implicit association test

In this study, we examined the hypothesis that semantic judgment tasks share overlapping processes if they require processing on common dimensions but not if they require processing on orthogonal dimensions in semantic space (Osgood, Suci, & Tannenbaum, 1957). We tested the hypothesis with the implicit association test (IATl Greenwald, McGhee, & Schwartz, 1998) in three experiments. Consistent with the hypothesis, IAT effects (costs in reaction time because of incompatible response mapping between associated judgment tasks) occurred consistently when judgment tasks tapped into common semantic dimensions, whereas no IAT effect appeared when judgment tasks entailed processing on orthogonal semantic dimensions.     

A test of a neo-Piagetian model of the water-level task

A neo-Piagetian model (Pascual-Leone & Morra, 1991 Pascual-Leone, J. and Morra, S. 1991. “Horizontality of water level: A neo-Piagetian developmental review”. In Advances in child development and behavior, Edited by: Reese, H. W. Vol. 23, 231–276. San Diego, CA: Academic Press.  [Google Scholar]) of the Water-level task (WLT) predicts that WLT performance depends on three factors: physical knowledge, field independence, and M capacity. The latter is an attentional capacity construct defined in neo-Piagetian theories. The model predicts that a minimum M capacity is necessary for accurate performance on WLT items. It also predicts that M capacity mediates the relationship between field independence and physical knowledge on one side and WLT on the other. Tests of field independence and M capacity, a paper-and-pencil version of the WLT, and a set of questions on the liquid horizontality principle were administered to 337 participants, aged 5 to 13 years. Six predictions derived from the model were tested; all of them were supported by the data, with only one exception, namely, on items with sideways and capsized bottles the M capacity required for accurate performance was one unit lower than predicted. It is concluded that the results strongly support the model under consideration, but suggest an amendment to one of its details. Gender differences were also examined; a small but significant gender difference in the WLT remained when field independence, physical knowledge, and M capacity were controlled for.     

Comparing adaptive procedures for estimating the psychometric function for an auditory gap detection task

A subject’s sensitivity to a stimulus variation can be studied by estimating the psychometric function. Generally speaking, three parameters of the psychometric function are of interest: the performance threshold, the slope of the function, and the rate at which attention lapses occur. In the present study, three psychophysical procedures were used to estimate the three-parameter psychometric function for an auditory gap detection task. These were an up–down staircase (up–down) procedure, an entropy-based Bayesian (entropy) procedure, and an updated maximum-likelihood (UML) procedure. Data collected from four young, normal-hearing listeners showed that while all three procedures provided similar estimates of the threshold parameter, the up–down procedure performed slightly better in estimating the slope and lapse rate for 200 trials of data collection. When the lapse rate was increased by mixing in random responses for the three adaptive procedures, the larger lapse rate was especially detrimental to the efficiency of the up–down procedure, and the UML procedure provided better estimates of the threshold and slope than did the other two procedures.     

A critical test of the failure-to-engage theory of task switching

When people switch between two tasks, their performance on each is worse than when they perform that task in isolation. One theory of this “switch cost” is the failure-to-engage (FTE) theory, which posits that observed responses are a simple mixture of prepared and unprepared response strategies. The probability that participants use prepared processes can be manipulated experimentally (e.g., by changing preparation time). The FTE theory is a binary mixture model and therefore makes a strong prediction about the existence of fixed points in response time distributions. We found evidence contradicting this prediction, using data from 20 participants in a standard task-switching paradigm. In this article, we examine reasons for the failure of the FTE theory, and we demonstrate that a generalized version of FTE theory accommodates our data.     

Bridging the gap between theory and model: a reflection on the balance scale task

At first glance, the two lead articles in this issue share little except the balance scale task, yet we view them as complementary rather than unrelated or contradictory. Our Reflection focuses on the individual strengths of the two lead articles and, to a greater extent, the potential power of their combined perspectives. Our general approach is to allow psychological theory to suggest a model of performance that can both evaluate specific theoretical claims and reveal important features of the data that had been previously obscured using conventional statistical analyses. Our guiding principle is that model, theory, and data all should be connected.     

Working memory in wayfinding-a dual task experiment in a virtual city

This study examines the working memory systems involved in human wayfinding. In the learning phase, 24 participants learned two routes in a novel photorealistic virtual environment displayed on a 220° screen while they were disrupted by a visual, a spatial, a verbal, or—in a control group—no secondary task. In the following wayfinding phase, the participants had to find and to "virtually walk" the two routes again. During this wayfinding phase, a number of dependent measures were recorded. This research shows that encoding wayfinding knowledge interfered with the verbal and with the spatial secondary task. These interferences were even stronger than the interference of wayfinding knowledge with the visual secondary task. These findings are consistent with a dual-coding approach of wayfinding knowledge.     

Validating Internet research: A test of the psychometric equivalence of Internet and in-person samples

This study evaluated the psychometric equivalency of Web-based research. The Sexual Boredom Scale was presented via the World-Wide Web along with five additional scales used to validate it. A subset of 533 participants that matched a previously published sample (Watt & Ewing, 1996) on age, gender, and race was identified. An 8 × 8 correlation matrix from the matched Internet sample was compared via structural equation modeling with a similar 8 × 8 correlation matrix from the previously published study. The Internet and previously published samples were psychometrically equivalent. Co-efficient alpha values calculated on the matched Internet sample yielded reliability coefficients almost identical to those for the previously published sample. Factors such as computer administration and uncontrollable administration settings did not appear to affect the results. Demographic data indicated an overrepresentation of males by about 6% and Caucasians by about 13% relative to the U.S. Census (2000). A total of 2,230 participants were obtained in about 8 months without remuneration. These results suggest that data collection on the Web is (1) reliable, (2) valid, (3) reasonably representative, (4) cost effective, and (5) efficient.     

Teachers' task demands,students' test expectations,and actual test content

Background: Previous studies on instructional importance show that individual students and their teachers differ in the topics that they consider important in the context of an upcoming teacher‐made test. Aims: This study aimed to examine whether such differences between students' test expectations and teachers' intended task demands can be explained by the actual test content. Samples: Participants were history teachers (N=19) and their 11th‐grade students (N=388). Method: Teachers and students rated the importance of text sections that would be tested in the near future. By means of multilevel analysis, ratings were compared with the occurrence of sections in the tests. Results: Although teachers considered a majority of sections as important and tested only a minority of the sections, their tests still included sections rated as unimportant. The number of such discrepancies, however, was relatively small. Sections the teachers rated important had a much higher probability of being included in the test than sections rated unimportant. For students, a similar but lower degree of correspondence between ratings and test content was found. Interestingly, for sections that teachers considered important, students more often gave a higher rating when these sections appeared in the test than when they did not. The same holds for sections that teachers considered unimportant. Conclusions: For both teachers and students there is a limited correspondence between perceived task demands and test content. Furthermore, students' perceptions of task demands show a compensation for some of the differences between their teachers' intended task demands and the test demands.     

Validating Clusters with the Lower Bound for Sum-of-Squares Error

Given that a minor condition holds (e.g., the number of variables is greater than the number of clusters), a nontrivial lower bound for the sum-of-squares error criterion in K-means clustering is derived. By calculating the lower bound for several different situations, a method is developed to determine the adequacy of cluster solution based on the observed sum-of-squares error as compared to the minimum sum-of-squares error. The author was partially supported by the Office of Naval Research Grant #N00014-06-0106.     

Validating the Riverside Acculturation Stress Inventory with Asian Americans

An emerging body of empirical research highlights the impact of acculturative stress in the lives of culturally diverse populations. Therefore, to facilitate future research in this area, we conducted 3 studies to examine the psychometric properties of the Riverside Acculturation Stress Inventory (RASI; Benet-Martínez & Haritatos, 2005) and its 5 subscales in a total sample of 793 self-identified Asian American participants. The reliability and validity of RASI scores and the hypothesized 1-factor higher order model (with 1st-order factors Language Skills, Work Challenges, Intercultural Relations, Discrimination, and Cultural Isolation) of the RASI were examined in Study 1. The RASI higher order structure and score validity and reliability were examined across different generational groups in Study 2. The stability of RASI scores over a 3-week period was examined in Study 3. Overall, findings from these studies support the hypothesized structure of the RASI and indicate that this brief instrument provides reliable and valid acculturative stress scores. In addition, results suggest that RASI items are interpreted in an equivalent manner across different generations of Asian American individuals. Implications for research and assessment are discussed.