Beyond Dyadic Coordination: Multimodal Behavioral Irregularity in Triads Predicts Facets of Collaborative Problem Solving

We hypothesize that effective collaboration is facilitated when individuals and environmental components form a synergy where they work together and regulate one another to produce stable patterns of behavior, or regularity, as well as adaptively reorganize to form new behaviors, or irregularity. We tested this hypothesis in a study with 32 triads who collaboratively solved a challenging visual computer programming task for 20 min following an introductory warm‐up phase. Multidimensional recurrence quantification analysis was used to examine fine‐grained (i.e., every 10 s) collective patterns of regularity across team members' speech rate, body movement, and team interaction with the shared user interface. We found that teams exhibited significant patterns of regularity as compared to shuffled baselines, but there were no systematic trends in regularity across time. We also found that periods of regularity were associated with a reduction in overall behavior. Notably, the production of irregular behavior predicted expert‐coded metrics of collaborative activity, such as teams' ability to construct shared knowledge and effectively negotiate and coordinate execution of solutions, net of overall behavioral production and behavioral self‐similarity. Our findings support the theory that groups can interact to form interpersonal synergies and indicate that information about system‐level dynamics is a viable way to understand and predict effective collaborative processes.     

Infant visual responses to pattern: Which metric perdicts best?

Visual fixations were recorded in newborn, 4-, and 8-week old human infants as they scanned displays that varied along several dimensions. These displays were designed to evaluate four metrics that have been theorized to control infant visual preference: Contour length, size, number, and a new metric, CVAL, based on Contour Variability, Amount, and Location. This latter metric reflects characteristics of the visual system that other metrics ignore. Both contour length and CVAL separately accounted for approximately 95% of looking-duration variance, a much larger portion than the other metrics considered; however, CVAL accounted for more looking variance than contour length when the number of lines and contour length were deconfounded, and uniquely accommodated a large orientation effect. Finally, several predictions were confirmed about characteristics of visual scanning. Retinal structure and natural scanning dispositions should be considered in accounts of infants' reactions to visual stimuli.     

Seeing it both ways: Openness to experience and binocular rivalry suppression

Openness to experience is characterised by flexible and inclusive cognition. Here we investigated whether this extends to basic visual perception, such that open people combine information more flexibly, even at low-levels of perceptual processing. We used binocular rivalry, where the brain alternates between perceptual solutions and times where neither solution is fully suppressed, mixed percept. Study 1 showed that openness is positively associated with duration of mixed percept and ruled out the possibility of response bias. Study 2 showed that mixed percept increased following a positive mood induction particularly for open people. Overall, the results showed that openness is linked to differences in low-level visual perceptual experience. Further studies should investigate whether this may be driven by common neural processes.     

Tactile detection response task: Metrics for assessing drivers’ cognitive workload

The Tactile Detection Response Task (TDRT) has been used to assess the cognitive workload of driver distraction with response time and miss rate as metrics of cognitive workload. However, it is not clear which metric is more sensitive and whether sensitivity is maintained for visual tasks. The objective of this study was to assess the sensitivity of the TDRT to changes in cognitive workload and to examine whether the sensitivity depends on task modality. A driving simulator study was conducted with 24 participants. The study included restaurant selection tasks with three presentation modalities (auditory, visual, and hybrid) and two difficulty levels (low and high). The high difficulty level was designed to be more cognitively demanding than the low difficulty level. Mixed-effects models were applied to examine the TDRT metrics and task difficulty level. The model controlled for age group, gender, and included a random effect for participants. The high difficulty level of the auditory tasks significantly increased the likelihood of missing a TDRT stimulus. No statistically significant differences were observed for visual and hybrid tasks. TDRT response time was not significantly associated with the difficulty level, regardless of task modality. In this study, the binary outcome TDRT miss was thus considered a more sensitive metric of cognitive workload than TDRT response time. TDRT response time can still be used to measure cognitive workload when tasks are relatively easy and the TDRT miss rate is close to zero. In addition, the sensitivity of the TDRT miss diminished for tasks that involved a visual component. Researchers who use TDRT to measure the cognitive workload associated with visual tasks should be aware of this limitation.     

Computer programming for generating visual stimuli

Critical to vision research is the generation of visual displays with precise control over stimulus metrics. Generating stimuli often requires adapting commercial software or developing specialized software for specific research applications. In order to facilitate this process, we give here an overview that allows nonexpert users to generate and customize stimuli for vision research. We first give a review of relevant hardware and software considerations, to allow the selection of display hardware, operating system, programming language, and graphics packages most appropriate for specific research applications. We then describe the framework of a generic computer program that can be adapted for use with a broad range of experimental applications. Stimuli are generated in the context of trial events, allowing the display of text messages, the monitoring of subject responses and reaction times, and the inclusion of contingency algorithms. This approach allows direct control and management of computer-generated visual stimuli while utilizing the full capabilities of modern hardware and software systems. The flowchart and source code for the stimulus-generating program may be downloaded from www.psychonomic.org/archive.     

Long-distance feedback projections to area V1: Implications for multisensory integration,spatial awareness,and visual consciousness

It is generally agreed that information flow through the cortex is constrained by a hierarchical architecture. Recent experimental evidence suggests that projections descending the hierarchy and targeting the primary visual cortex (area V1) may play an essential role in perceptual processes. We have, therefore, reexamined feedback projections to area V1, using retrograde tracer injections in this area. In addition to well-known areas, quantification of labeling in higher cortical areas reveals a number of hitherto unknown long-distance feedback connections originating from auditory (A1), multisensory (STP) cortices, but also from a perirhinal area (36). These feedback projections from advanced cortical stations, a global feature shared by areas that belong to the ventral visual stream, could play an important role in early multisensory integration and spatial awareness and could provide the physical substrate for the involvement of area V1 in visual consciousness.     

Abstract Conceptual Feature Ratings Predict Gaze Within Written Word Arrays: Evidence From a Visual Wor(l)d Paradigm

The Abstract Conceptual Feature (ACF) framework predicts that word meaning is represented within a high‐dimensional semantic space bounded by weighted contributions of perceptual, affective, and encyclopedic information. The ACF, like latent semantic analysis, is amenable to distance metrics between any two words. We applied predictions of the ACF framework to abstract words using eyetracking via an adaptation of the classical “visual word paradigm” (VWP). Healthy adults (n = 20) selected the lexical item most related to a probe word in a 4‐item written word array comprising the target and three distractors. The relation between the probe and each of the four words was determined using the semantic distance metrics derived from ACF ratings. Eye movement data indicated that the word that was most semantically related to the probe received more and longer fixations relative to distractors. Importantly, in sets where participants did not provide an overt behavioral response, the fixation rates were nonetheless significantly higher for targets than distractors, closely resembling trials where an expected response was given. Furthermore, ACF ratings which are based on individual words predicted eye fixation metrics of probe‐target similarity at least as well as latent semantic analysis ratings which are based on word co‐occurrence. The results provide further validation of Euclidean distance metrics derived from ACF ratings as a measure of one facet of the semantic relatedness of abstract words and suggest that they represent a reasonable approximation of the organization of abstract conceptual space. The data are also compatible with the broad notion that multiple sources of information (not restricted to sensorimotor and emotion information) shape the organization of abstract concepts. While the adapted “VWP” is potentially a more metacognitive task than the classical visual world paradigm, we argue that it offers potential utility for studying abstract word comprehension.     

Top-down attentional modulation of spatial frequency processing in scene perception

Recent evidence suggests that spatial frequency (SF) processing of simple and complex visual patterns is flexible. The use of spatial scale in scene perception seems to be influenced by people's expectations. However as yet there is no direct evidence for top-down attentional effects on flexible scale use in scene perception. In two experiments we provide such evidence. We presented participants with low- and high-pass SF filtered scenes and cued their attention to the relevant scale. In Experiment 1 we subsequently presented them with hybrid scenes (both low- and high-pass scenes present). We observed that participants reported detecting the cued component of hybrids. To explore if this might be due to decision biases, in Experiment 2, we replaced hybrids with images containing meaningful scenes at uncued SFs and noise at the cued SFs (invalid cueing). We found that participants performed poorly on invalid cueing trials. These findings are consistent with top-down attentional modulation of early spatial frequency processing in scene perception.     

Inverse discrimination time as a perceptual distance for alphabetic characters

Reaction times to discriminate lower‐case letters were collected in an experiment. The inverse discrimination times were used to build metrics on the space of letters. These metrics were found to be significantly correlated with various well‐known letter confusability measures, and a meaningful dimensional analysis of the alphabet was performed. This methodology is mathematically well founded, it requires fewer data than common methods, and it appears to be highly sensitive to visual similarity between letters, which allows visual letter features to be effectively analysed.     

Strategic and automatic effects of visual working memory on attention in visual search

Previous research indicates that visual attention can be automatically captured by sensory inputs that match the contents of visual working memory. However, Woodman and Luck (2007) showed that information in working memory can be used flexibly as a template for either selection or rejection according to task demands. We report two experiments that extend their work. Participants performed a visual search task while maintaining items in visual working memory. Memory items were presented for either a short or long exposure duration immediately prior to the search task. Memory was tested by a change-detection task immediately afterwards. On a random half of trials items in memory matched either one distractor in the search task (Experiment 1) or three (Experiment 2). The main result was that matching distractors speeded or slowed target detection depending on whether memory items were presented for a long or short duration. These effects were more in evidence with three matching distractors than one. We conclude that the influence of visual working memory on visual search is indeed flexible but is not solely a function of task demands. Our results suggest that attentional capture by perceptual inputs matching information in visual working memory involves a fast automatic process that can be overridden by a slower top-down process of attentional avoidance.     

Action rules: why the visual control of reaching and grasping is not always influenced by perceptual illusions

It is generally accepted that vision first evolved for the distal control of movement and that perception or 'representational' vision emerged much later. Vision-for-action operates in real time and uses egocentric frames of reference and the real metrics of the world. Vision-for-perception can operate over longer time scales and is much more scene-based in its computations. These differences in the timing and metrics of the two systems have been examined in experiments that have looked at the way in which each system deals with visual illusions. Although controversial, the consensus is that actions such as grasping and reaching are often unaffected by high-level pictorial illusions, which by definition affect percetion. However, recent experiments have shown that, for actions to escape the effects of such illusions, they must be highly practiced actions, preferably with the right hand, and must be directed in real time at visible targets. This latter finding suggests that some of the critical components of the encapsulated (bottom-up) systems that mediate the visual control of skilled reaching and grasping movements are lateralised to the left hemisphere.     

A viewpoint-independent process for spatial reorientation

Reorientation tasks, in which disoriented participants attempt to relocate objects using different visual cues, have previously been understood to depend on representing aspects of the global organisation of the space, for example its major axis for judgements based on geometry. Careful analysis of the visual information available for these tasks shows that successful performance could be based on the much simpler process of storing a visual ‘snapshot’ at the target location, and subsequently moving in order to match it. We tested 4-8-year olds on a new spatial reorientation task that could not be solved based on information directly contained in any retinal projection that they had been exposed to, but required participants to infer how the space is structured. Only 6-8-year olds showed flexible recall from novel viewpoints. Five-year olds were able to recall locations given movement information or a unique proximal landmark, but without these they could not do so, even when they were not disoriented or when the landmark was a familiar object. These results indicate that early developing spatial abilities based on view matching and self motion are supplemented by a later-developing process that takes into account the structure of spatial layouts and so enables flexible recall from arbitrary viewpoints.     

Perception of heading without retinal optic flow

How do we determine where we are heading during visually controlled locomotion? Psychophysical research has shown that humans are quite good at judging their travel direction, or heading, from retinal optic flow. Here we show that retinal optic flow is sufficient, but not necessary, for determining heading. By using a purely cyclopean stimulus (random dot cinematogram), we demonstrate heading perception without retinal optic flow. We also show that heading judgments are equally accurate for the cyclopean stimulus and a conventional optic flow stimulus, when the two are matched for motion visibility. The human visual system thus demonstrates flexible, robust use of available visual cues for perceiving heading direction.     

Analytic flexibility in laboratory aggression paradigms: Relations with personality traits vary (slightly) by operationalization of aggression

Competitive reaction time tasks (CRTTs) have been used widely in social science research, but recent criticism has been directed at the flexible quantification strategies used with this methodology. A recent review suggests that over 150 different quantification strategies have been used in this literature, and there is evidence to suggest that different operationalizations can affect the results and interpretations of experiments using CRTTs. In the current investigation, we reanalyze data from four existing samples from two different sites (total N = 600) to examine how the relations between a range of personality traits and aggression vary based on how aggression is operationalized. Our results suggest that there is a modest degree of heterogeneity in effect size and direction for these relations, and that effect size and direction were most consistent for traits more generally related to lab aggression (e.g., psychopathy, low Five-Factor Model agreeableness). In addition, profile matching analyses suggest that different operationalizations yield empirical correlates that are quite similar to one another, even when quantifying absolute rather than relative similarity. These results were consistent across site, methodology, and type of sample, suggesting that these issues are likely generalizable across most labs using CRTTs. We conclude with suggestions for future directions, particularly emphasizing the need for adequately-powered samples, and for researchers to preregister a plan for how CRTT data will be analyzed.     

Comparing eye-tracking metrics of mental workload caused by NDRTs in semi-autonomous driving

The objective of this study was to verify the effectiveness of eye-tacking metrics in indicating driver’s mental workload in semi-autonomous driving when the driver is engaged in different non-driving related tasks (NDRTs). A driving simulator was developed for three scenarios (high-, medium-, and low-mental workload presented by SAE (Society of Automotive Engineers) Levels 0, 1, and 2) and three uni-modality secondary tasks. Thirty-six individuals participated in the driving simulation experiment. NASA-TLX (Task Load Index), secondary task performance, and eye-tracking metrics were used as indicators of mental workload. The subjective rating using the NASA-TLX showed a main effect of autonomous level on mental workload in both visual and auditory tasks. Correlation-matrix calculation and principal-component extraction indicated that pupil diameter change, number of saccades, saccade duration, fixation duration, and 3D gaze entropy were effective indicators of a driver’s mental workload in the visual and auditory multi-tasking situations of semi-autonomous driving. The accuracy of predicting the mental-workload level using the K-Nearest Neighbor (KNN) classifier was 88.9% with bootstrapped data. These results can be used to develop an adaptive multi-modal interface that issues efficient and safe takeover requests.     

Inhibition of return functions within but not across searches

Inhibition of return (IOR) facilitates visual search by discouraging the reinspection of recently processed items. We investigated whether IOR operates across two consecutive searches of the same display for different targets. In Experiment 1, we demonstrated that IOR is present within each of the two searches. In Experiment 2, we found no evidence for IOR across searches. In Experiment 3, we showed that IOR is present across the two searches when the first search is interrupted, suggesting that the completion of the search is what causes the resetting of IOR. We concluded that IOR is a partially flexible process that can be reset when the task completes, but not necessarily when it changes. When resetting occurs, this flexibility ensures that the inhibition of previously visited locations does not interfere with the new search.     

The interaction of attention and action: From seeing action to acting on perception

We discuss evidence indicating that human visual attention is strongly modulated by the potential of objects for action. The possibility of action between multiple objects enables the objects to be attended as a single group, and the fit between individual objects in a group and the action that can be performed influences responses to group members. In addition, having a goal state to perform a particular action affects the stimuli that are selected along with the features and area of space that is attended. These effects of action may reflect statistical learning between environmental cues that are linked by action and/or the coupling between perception and action systems in the brain. The data support the argument that visual selection is a flexible process that emerges as a need to prioritize objects for action.     

Visually guided facial actions in rhesus monkeys

We trained 2 monkeys to display facial actions in response to corresponding arbitrary visual cues. Each monkey executed the task successfully, and each displayed two different facial actions corresponding to either hand-sign or color cues. More than 90% of the responses were correct for each monkey. These results provide evidence that monkeys can execute facial actions in response to conditioned visual cues in the absence of social context. These data suggest that facial actions of monkeys are flexible enough for use in further laboratory investigations—for example, in studies on the neural mechanisms underlying the execution of actions.     

Statistical analysis of the bidirectional inconsistency of spelling and sound in French

Recent studies suggest that performance attendant on visual word perception is affected not only by the “traditional” feedforward inconsistency (spelling → phonology) but also by its feedback inconsistency (phonology → spelling). The present study presents a statistical analysis of the bidirectional inconsistency for all French monosyllabic words. We show that French is relatively consistent from spelling to phonology but highly inconsistent from phonology to spelling. Appendixes B and C list prior and conditional probabilities for all inconsistent mappings and thus provide a valuable tool for controlling, selecting, and constructing stimulus materials for psycholinguistic and neuropsychological research. Such large-scale statistical analyses about a language’s structure are crucial for developing metrics of inconsistency, generating hypotheses for cross-linguistic research, and building computational models of reading.