Exploring the effects of EEG signals on collision cases happening in the process of young drivers’ braking

Detecting mental states in drivers offers an opportunity to reduce accidents by triggering alerts and signaling the need for rest or renewed focus. Here we used electroencephalography (EEG) to measure brain signals in young drivers operating a driving simulator to detect mental states and predict accidents. We measured reaction times to unexpected hazardous events and correlated them with EEG signals measured from the frontal, parietal, and temporal cortices as well as the central sulcus (corresponding to motor cortex). We found that EEG signals in the relative beta (power in beta (13–30 Hz) relative to total power of the EEG (0.5–30 Hz)), alpha/delta, alpha/theta, beta/delta, beta/theta frequency bands were higher for collisions than successful collision avoidance, and that the key decision-making period is the 2nd second before braking. Importantly, a decision tree classifier trained on these neural signals predicted collision avoidance outcomes. Then based on random forest model, we extracted three critical neural signals (beta/delta_frontal, relative beta_parietal and relative beta_central Sulcus) to classify collision avoidance outcomes. Our findings suggest measuring EEG during driving may provide useful signals for enhancing driver safety.     

Balancing awareness: Vestibular signals modulate visual consciousness in the absence of awareness

The processing of visual and vestibular information is crucial for perceiving self-motion. Visual cues, such as optic flow, have been shown to induce and alter vestibular percepts, yet the role of vestibular information in shaping visual awareness remains unclear. Here we investigated if vestibular signals influence the access to awareness of invisible visual signals. Using natural vestibular stimulation (passive yaw rotations) on a vestibular self-motion platform, and optic flow masked through continuous flash suppression (CFS) we tested if congruent visual–vestibular information would break interocular suppression more rapidly than incongruent information. We found that when the unseen optic flow was congruent with the vestibular signals perceptual suppression as quantified with the CFS paradigm was broken more rapidly than when it was incongruent. We argue that vestibular signals impact the formation of visual awareness through enhanced access to awareness for congruent multisensory stimulation.     

Matching perceived depth from disparity and from velocity: Modeling and psychophysics

We asked observers to match in depth a disparity-only stimulus with a velocity-only stimulus. The observers’ responses revealed systematic biases: the two stimuli appeared to be matched in depth when they were produced by the projection of different distal depth extents. We discuss two alternative models of depth recovery that could account for these results. (1) Depth matches could be obtained by scaling the image signals by constants not specified by optical information, and (2) depth matches could be obtained by equating the stimuli in terms of their signal-to-noise ratios (see Domini & Caudek, 2009). We show that the systematic failures of shape constancy revealed by observers’ judgments are well accounted for by the hypothesis that the apparent depth of a stimulus is determined by the magnitude of the retinal signals relative to the uncertainty (i.e., internal noise) arising from the measurement of those signals.     

Is What You Feel What They See? Prominent and Subtle Identity Signaling in Intergroup Interactions

Individuals often signal group affiliations to others, and the display of such identity signals is frequently rather subtle. While prior work has focused on understanding an individual's choices of subtle versus prominent signals, in this work, we look at the downstream consequences of such choices. Specifically, we explore how the prominence of identity signals may affect one's behavior in intergroup interactions. Drawing from literature on processing fluency, we propose that the use of difficult to process (subtle) identity signals in intergroup interactions leads signalers to experience identity threat, lowering confidence in their identity and leading them to engage in behaviors to recover from this experience. Across three different identity domains (college affiliation, political affiliation, and brand loyalty), we show that when individuals use difficult to process identity signals, they derogate out‐group members in communication and behave less cooperatively in intergroup interactions. We find that these effects depend upon the observability of the signals by out‐group members and only occur for individuals who are highly identified with the in‐group. We also find that the effects are attenuated when behavior towards members of the out‐group is made public. Copyright © 2017 John Wiley & Sons, Ltd.     

How Positive and Negative Feedback Motivate Goal Pursuit

This article explores the feedback individuals give, seek, and respond to in the course of pursuing their goals. We propose that positive feedback motivates goal pursuit when it signals an increase in goal commitment, whereas negative feedback motivates goal pursuit when it signals insufficient goal progress. We review research suggesting that whether individuals are drawn to evaluate their level of commitment versus rate of progress determines the type of feedback (positive or negative) that best motivates them to pursue their goals. We then review research suggesting that these effects of feedback operate by inducing positive and negative general moods as well as specific emotions.     

Cross-modal integration of multimodal courtship signals in a wolf spider

Cross-modal integration, i.e., cognitive binding of information transmitted in more than one signal mode, is important in animal communication, especially in complex, noisy environments in which signals of many individuals may overlap. Males of the brush-legged wolf spider Schizocosa ocreata (Hentz) use multimodal communication (visual and vibratory signals) in courtship. Because females may be courted by multiple males at the same time, they must evaluate co-occurring male signals originating from separate locations. Moreover, due to environmental complexity, individual components of male signals may be occluded, altering detection of sensory modes by females. We used digital multimodal playback to investigate the effect of spatial and temporal disparity of visual and vibratory components of male courtship signals on female mate choice. Females were presented with male courtship signals with components that varied in spatial location or temporal synchrony. Females responded to spatially disparate signal components separated by ≥90° as though they were separate sources, but responded to disparate signals separated by ≤45° as though they originated from a single source. Responses were seen as evidence for cross-modal integration. Temporal disparity (asynchrony) in signal modes also affected female receptivity. Females responded more to male signals when visual and vibratory modes were in synchrony than either out-of-synch or interleaved/alternated. These findings are consistent with those seen in both humans and other vertebrates and provide insight into how animals overcome communication challenges inherent in a complex environment.     

Neural Computation and the Computational Theory of Cognition

We begin by distinguishing computationalism from a number of other theses that are sometimes conflated with it. We also distinguish between several important kinds of computation: computation in a generic sense, digital computation, and analog computation. Then, we defend a weak version of computationalism—neural processes are computations in the generic sense. After that, we reject on empirical grounds the common assimilation of neural computation to either analog or digital computation, concluding that neural computation is sui generis. Analog computation requires continuous signals; digital computation requires strings of digits. But current neuroscientific evidence indicates that typical neural signals, such as spike trains, are graded like continuous signals but are constituted by discrete functional elements (spikes); thus, typical neural signals are neither continuous signals nor strings of digits. It follows that neural computation is sui generis. Finally, we highlight three important consequences of a proper understanding of neural computation for the theory of cognition. First, understanding neural computation requires a specially designed mathematical theory (or theories) rather than the mathematical theories of analog or digital computation. Second, several popular views about neural computation turn out to be incorrect. Third, computational theories of cognition that rely on non‐neural notions of computation ought to be replaced or reinterpreted in terms of neural computation.     

The evolutionary origins of natural pedagogy: Rhesus monkeys show sustained attention following nonsocial cues versus social communicative signals

The natural pedagogy hypothesis proposes that human infants preferentially attend to communicative signals from others, facilitating rapid cultural learning. In this view, sensitivity to such signals is a uniquely human adaptation and as such nonhuman animals should not produce or utilize these communicative signals. We test these evolutionary predictions by examining sensitivity to communicative cues in 206 rhesus monkeys (Macaca mulatta) using an expectancy looking time task modeled on prior work with infants. Monkeys observed a human actor who either made eye contact and vocalized to the monkey (social cue), or waved a fruit in front of her face and produced a tapping sound (nonsocial cue). The actor then either looked at an object (referential look) or looked toward empty space (look away). We found that, unlike human infants in analogous situations, rhesus monkeys looked longer at events following nonsocial cues, regardless of the demonstrator's subsequent looking behavior. Moreover younger and older monkeys showed similar patterns of responses across development. These results provide support for the natural pedagogy hypothesis, while also highlighting evolutionary changes in human sensitivity to communicative signals.     

Computational heterogeneity in the human mesencephalic dopamine system

Recent evidence in animals has indicated that the mesencephalic dopamine system is heterogeneous anatomically, molecularly, and functionally, and it has been suggested that the dopamine system comprises distinct functional systems. Identifying and characterizing these systems in humans will have widespread ramifications for understanding drug addiction and mental health disorders. Model-based studies in humans have suggested an analogous computational heterogeneity, in which dopaminergic targets in striatum encode both experience-based learning signals and counterfactual learning signals that are based on hypothetical information. We used brainstem-tailored fMRI to identify mesencephalic sources of experiential and counterfactual learning signals. Participants completed a decision-making task based on investing in markets. This sequential investment task generated experience-based learning signals, in the form of temporal difference (TD) reward prediction errors, and counterfactual learning signals, in the form of “fictive errors.” Fictive errors are reinforcement learning signals based on hypothetical information about “what could have been.” An additional learning signal was constructed to be relatable to a motivational salience signal. Blood oxygenation level dependent responses in regions of substantia nigra (SN) and ventral tegmental area (VTA), where dopamine neurons are located, coded for TD and fictive errors, and additionally were related to the motivational salience signal. These results are highly consistent with animal electrophysiology and provide direct evidence that human SN and VTA heterogeneously handle important reward-harvesting computations.     

Models of recognition, repetition priming, and fluency: exploring a new framework

We present a new modeling framework for recognition memory and repetition priming based on signal detection theory. We use this framework to specify and test the predictions of 4 models: (a) a single-system (SS) model, in which one continuous memory signal drives recognition and priming; (b) a multiple-systems-1 (MS1) model, in which completely independent memory signals (such as explicit and implicit memory) drive recognition and priming; (c) a multiple-systems-2 (MS2) model, in which there are also 2 memory signals, but some degree of dependence is allowed between these 2 signals (and this model subsumes the SS and MS1 models as special cases); and (d) a dual-process signal detection (DPSD1) model, 1 possible extension of a dual-process theory of recognition (Yonelinas, 1994) to priming, in which a signal detection model is augmented by an independent recollection process. The predictions of the models are tested in a continuous-identification-with-recognition paradigm in both normal adults (Experiments 1-3) and amnesic individuals (using data from Conroy, Hopkins, & Squire, 2005). The SS model predicted numerous results in advance. These were not predicted by the MS1 model, though could be accommodated by the more flexible MS2 model. Importantly, measures of overall model fit favored the SS model over the others. These results illustrate a new, formal approach to testing theories of explicit and implicit memory.     

Haptic shape perception from force and position signals varies with exploratory movement direction and the exploring finger

We investigated how exploratory movement influences signal integration in active touch. Participants judged the amplitude of a bump specified by redundant signals: When a finger slides across a bump, the finger’s position follows the bump’s geometry (position signal); simultaneously, it is exposed to patterns of forces depending on the gradient of the bump (force signal). We varied amplitudes specified by force signals independently of amplitudes specified by position signals. Amplitude judgment was a weighted linear function of the amplitudes specified by both signals, under different exploratory conditions. The force signal’s contribution to the judgment was higher when the participants explored with the index finger, as opposed to the thumb, and when they explored along a tangential axis, as opposed to a radial one (pivot ≌ shoulder joint). Furthermore, for tangential, as compared with radial, axis exploration, amplitude judgments were larger (and more accurate), and amplitude discrimination was better. We attribute these exploration-induced differences to biases in estimating bump amplitude from force signals. Given the choice, the participants preferred tangential explorations with the index finger—a behavior that resulted in good discrimination performance. A role for an active explorer, as well as biases that depend on exploration, should be taken into account when signal integration models are extended to active touch.     

Effects of spatial and selective attention on basic multisensory integration

When participants respond to auditory and visual stimuli, responses to audiovisual stimuli are substantially faster than to unimodal stimuli (redundant signals effect, RSE). In such tasks, the RSE is usually higher than probability summation predicts, suggestive of specific integration mechanisms underlying the RSE. We investigated the role of spatial and selective attention on the RSE in audiovisual redundant signals tasks. In Experiment 1, stimuli were presented either centrally (narrow attentional focus) or at 1 of 3 unpredictable locations (wide focus). The RSE was accurately described by a coactivation model assuming linear superposition of modality-specific activation. Effects of spatial attention were explained by a shift of the evidence criterion. In Experiment 2, stimuli were presented at 3 locations; participants had to respond either to all signals regardless of location (simple response task) or to central stimuli only (selective attention task). The RSE was consistent with task-specific coactivation models; accumulation of evidence, however, differed between the 2 tasks.     

Locus of the redundant-signals effect in bimodal divided attention: a neurophysiological analysis.

We reanalyzed the data from the study of Lamarre, Busby, and Spidalieri (1983). In that study, the activity of single neurons in area 4 of the motor cortex was recorded during a bimodal detection task in which a monkey (Macaca mulatta) had to respond as quickly as possible to a visual or an auditory signal or to both (redundant trials). Manual responses on redundant trials were speeded by the presence of both signals, as is typically found. The times between signal onsets and the first changes in neuronal activity were also speeded by redundant signals, but there was no difference between redundant-signals and single-signal trials in the time between the change in neuronal activity and movement onset. These results suggest that late motor processes are not speeded by redundant signals in bimodal detection tasks.     

Auditory clicks distort perceived velocity but only when the system has to rely on extraretinal signals

Previous work has found that repetitive auditory stimulation (click trains) increases the subjective velocity of subsequently presented moving stimuli. We ask whether the effect of click trains is stronger for retinal velocity signals (produced when the target moves across the retina) or for extraretinal velocity signals (produced during smooth pursuit eye movements, when target motion across the retina is limited). In Experiment 1, participants viewed leftward or rightward moving single dot targets, travelling at speeds from 7.5 to 17.5 deg/s. They estimated velocity at the end of each trial. Prior presentation of auditory click trains increased estimated velocity, but only in the pursuit condition, where estimates were based on extraretinal velocity signals. Experiment 2 generalized this result to vertical motion. Experiment 3 found that the effect of clicks during pursuit disappeared when participants tracked across a visually textured background that provided strong local motion cues. Together these results suggest that auditory click trains selectively affect extraretinal velocity signals. This novel finding suggests that the cross-modal integration required for auditory click trains to influence subjective velocity operates at later stages of processing.     

Material properties determine how force and position signals combine in haptic shape perception

When integrating estimates from redundant sensory signals, humans seem to weight these estimates according to their reliabilities. In the present study, human observers used active touch to judge the curvature of a shape. The curvature was specified by positional and force signals: When a finger slides across a surface, the finger's position follows the surface geometry (position signal). At the same time, it is exposed to patterns of forces depending on the gradient of the surface (force signal; Robles-de-la-Torre, G., & Hayward, V. (2001). Force can overcome object geometry in the perception of shape through active touch. Nature, 412, 445-448). We show that variations in the surface's material properties (compliance, friction) influence the sensorily available position and force signals, as well as the noise associated with these signals. Along with this, material properties affect the weights given to the position and force signals for curvature judgements. Our findings are consistent with the notion of an observer who weights signal estimates according to their reliabilities. That is, signal weights shifted with the signal noise, which in the present case resulted from active exploration.     

Locus of the redundant-signals effect in bimodal divided attention: A neurophysiological analysis

We reanalyzed the data from the study of Lamarre, Busby, and Spidalieri (1983). In that study, the activity of single neurons in area 4 of the motor cortex was recorded during a bimodal detection task in which a monkey (Macaca mulatta)had to respond as quickly as possible to a visual or an auditory signal or to both (redundant trials). Manual responses on redundant trials were speeded by the presence of both signals, as is typically found. The times between signal onsets and the first changes in neuronal activity were also speeded by redundant signals, but there was no difference between redundant-signals and single-signal trials in the time between the change in neuronal activity and movement onset. These results suggest that late motor processes are not speeded by redundant signals in bimodal detection tasks.     

Fake hand in movement: Visual motion cues from the rubber hand are processed for kinesthesia

The feeling that a fake (e.g. rubber) hand belongs to a person's own body can be elicited by synchronously stroking the fake hand and the real hand, with the latter hidden from view. Here, we sought to determine whether visual motion signals from that incorporated rubber hand would provide relevant cues for sensing movement (i.e. kinesthesia). After 180 s of visuo-tactile synchronous or asynchronous stroking, the fake hand was moved along the lateral or the sagittal axis. After synchronous stroking, movement of the rubber hand induced illusory movement of the static (real) hand in the same direction; the illusion was slightly more frequent and more intense when the fake hand was moved along the sagittal axis. We therefore conclude that visual signals of motion originating from the rubber hand are integrated for kinesthesia by the central nervous system just as visual signals from the real hand are.     

Using spatial vibrotactile cues to direct visual attention in driving scenes

We report two experiments designed to investigate the potential use of vibrotactile warning signals to present spatial information to car drivers. Participants performed an attention-demanding rapid serial visual presentation (RSVP) monitoring task. Meanwhile, whenever they felt a vibrotactile stimulus presented on either their front or back, they had to check the front and the rearview mirror for the rapid approach of a car, and brake or accelerate accordingly. We investigated whether speeded responses to potential emergency driving situations could be facilitated by the presentation of spatially-predictive (80% valid; Experiment 1) or spatially-nonpredictive (50% valid; Experiment 2) vibrotactile cues. Participants responded significantly more rapidly following both spatially-predictive and spatially-nonpredictive vibrotactile cues from the same rather than the opposite direction as the critical driving events. These results highlight the potential utility of vibrotactile warning signals in automobile interface design for directing a driver’s visual attention to time-critical events or information.     

One-Year-Old Infants Appreciate the Referential Nature of Deictic Gestures and Words

ABSTRACT— One-year-old infants have a small receptive vocabulary and follow deictic gestures, but it is still debated whether they appreciate the referential nature of these signals. Demonstrating understanding of the complementary roles of symbolic (word) and indexical (pointing) reference provides evidence of referential interpretation of communicative signals. We presented 13-month-old infants with video sequences of an actress indicating the position of a hidden object while naming it. The infants looked longer when the named object was revealed not at the location indicated by the actress's gestures, but on the opposite side of the display. This finding suggests that infants expect that concurrently occurring communicative signals co-refer to the same object. Another group of infants, who were shown video sequences in which the naming and the deictic cues were provided concurrently but by two different people, displayed no evidence of expectation of co-reference. These findings suggest that a single communicative source, and not simply co-occurrence, is required for mapping the two signals onto each other. By 13 months of age, infants appreciate the referential nature of words and deictic gestures alike.