Individual reactions to a multisensory immersive virtual environment: the impact of a wind farm on individuals

The aim of this study was to assess the impact of a wind farm on individuals by means of an audio-visual methodology that tried to simulate biologically plausible individual-environment interactions. To disentangle the effects of auditory and visual components on cognitive performances and subjective evaluations, unimodal (Audio or Video) and bimodal (Audio + Video) approaches were compared. Participants were assigned to three experimental conditions that reproduced a wind farm by means of an immersive virtual reality system: bimodal condition, reproducing scenarios with both acoustic and visual stimuli; unimodal visual condition, with only visual stimuli; unimodal auditory condition, with only auditory stimuli. While immersed in the virtual scenarios, participants performed tasks assessing verbal fluency, short-term verbal memory, backward counting, and distance estimations (egocentric: how far is the turbine from you?; allocentric: how far is the turbine from the target?). Afterwards, participants reported their degree of visual and noise annoyance. The results revealed that the presence of a visual scenario as compared to the only availability of auditory stimuli may exert a negative effect on resource-demanding cognitive tasks but a positive effect on perceived noise annoyance. This supports the idea that humans perceive the environment holistically and that auditory and visual features are processed in close interaction.     

An in-situ examination of the timing of information pick-up for interception by cricket batsmen of different skill levels

ObjectivesCricket batting is performed under demanding constraints, which requires rapid and accurate decision making for successful achievement of the skill goal. To understand how batsmen negotiate these constraints, the capability of highly skilled and low skilled cricket batsmen to utilise visual information prior to and during sections of ball flight to strike balls delivered by fast bowlers was examined.MethodSix highly skilled and six low skilled batsmen faced different types of balls delivered by three fast bowlers. Batsmen wore vision occlusion spectacles and were required to strike delivered balls, while their vision of the bowler's delivery action and ball flight was selectively occluded. Three vision conditions were randomly designed that included temporal occlusion at: (i) a point prior to ball release (providing only advance information), (ii) a point prior to ball bounce (providing advance and ball flight information) and (iii) no occlusion (where all advance, ball flight and bounce information were visible). Foot movements made forward or backward were assessed as a measure of ball length judgement, while the quality of bat–ball contact was assessed as a measure of interception.ResultsResults demonstrated the superior capability of highly skilled batsmen to utilise information prior to ball release to judge short ball length. Expert batsmen were better able to utilise ball flight information prior to and post-bounce to attain a superior number of bat–ball contacts.ConclusionsFindings demonstrate that the mechanism of experts to deal with task constraints when attempting to intercept a delivered ball is their capability to pick-up visual information to judge ball landing position.     

Effects of retrieval practice and presentation modality on verbal learning: testing the limits of the testing effect

ABSTRACT

The testing effect refers to improved memory after retrieval practice and has been researched primarily with visual stimuli. In two experiments, we investigated whether the testing effect can be replicated when the to-be-learned information is presented auditorily, or visually?+?auditorily. Participants learned Swahili-English word pairs in one of three presentation modalities – visual, auditory, or visual?+?auditory. This was manipulated between-participants in Experiment 1 and within-participants in Experiment2. All participants studied the word pairs during three study trials. Half of participants practiced recalling the English translations in response to the Swahili cue word twice before the final test whereas the other half simply studied the word pairs twice more. Results indicated an improvement in final test performance in the repeated test condition, but only in the visual presentation modality (Experiments 1 and 2) and in the visual?+?auditory presentation modality (Experiment 2). This suggests that the benefits of practiced retrieval may be limited to information presented in a visual modality.     

Effect of visual-verbal load and spatial compatibility on stimulus response

This study examined the effects of visual-verbalload (as measured by a visually presented reading-memory task with three levels) on a visual/auditory stimulus-response task. The three levels of load were defined as follows: "No Load" meant no other stimuli were presented concurrently; "Free Load" meant that a letter (A, B, C, or D) appeared at the same time as the visual or auditory stimulus; and "Force Load" was the same as "Free Load," but the participants were also instructed to count how many times the letter A appeared. The stimulus-response task also had three levels: "irrelevant," "compatible," and "incompatible" spatial conditions. These required different key-pressing responses. The visual stimulus was a red ball presented either to the left or to the right of the display screen, and the auditory stimulus was a tone delivered from a position similar to that of the visual stimulus. Participants also processed an irrelevant stimulus. The results indicated that participants perceived auditory stimuli earlier than visual stimuli and reacted faster under stimulus-response compatible conditions. These results held even under a high visual-verbal load. These findings suggest the following guidelines for systems used in driving: an auditory source, appropriately compatible signal and manual-response positions, and a visually simplified background.     

媒体多任务的效用：听觉信息干扰和视听信息整合的实验证据

采用心理旋转范式和词汇判断范式,探讨媒体多任务经验不同者,在听觉信息干扰和视听信息整合情境下对图形一致性和真假词的判断表现。结果发现：(1)以判断图形一致性为实验任务,在无声和低音干扰条件下,低经验组的正确率均显著高于高经验组,两组的反应时差异均不显著;在高音干扰条件下,高经验组的反应时显著短于低经验组,正确率则没有显著差异。(2)以真假词判断为实验任务,对真词的判断,在三种听觉条件下,高经验组在语音匹配条件下的反应时最短,与低经验组无显著差异,但正确率显著高于低经验组,与另两种听觉条件没有显著差异;低经验组在语音匹配条件下的反应时显著长于另两种听觉条件,正确率则显著高于无声条件,与不匹配条件差异不显著。对假词的判断,低经验组在三种听觉条件下的反应时均显著短于高经验组,正确率与高经验组均无显著差异。研究表明,媒体多任务经验丰富者相比经验缺乏者受到任务无关的纯短高音干扰的影响要小一些,在需要视听通道语义整合的加工中具有一定的优势。     

Using perceptual home-training to improve anticipation skills of soccer goalkeepers

ObjectiveThis study aims to test the effectiveness of a perceptual training concerning the anticipatory skills of soccer goalkeepers, by assessing their performances while engaged in predicting the direction of penalty kicks.DesignForty-two skilled goalkeepers were randomly assigned to three training groups: Experimental, placebo, and control. All the groups were tested at the beginning of the experiment and re-tested after a period of eight weeks.MethodThe pre-test consisted of the presentation of temporally occluded videos of penalties recorded from the goalkeeper's perspective, and participants had to predict the direction of the ball. The experimental group practiced with an interactive home-training, based on video analogous to those of the test, with the addition of both positive and negative feedback. The placebo group viewed television footage of penalty kick shoot-outs. Participants of both groups were free to schedule their own training/placebo sessions. Finally, the control group did not receive any treatment.ResultsThe results demonstrated the effectiveness of the home-training protocol, evidencing significant accuracy improvements between pre-test and post-test only for the experimental group.ConclusionsThe outcomes indicate that skilled athletes can benefit from perceptual training, which was not investigated before among soccer goalkeepers. Indeed, all the previous training studies concerning soccer penalty predictions were run on participants with either recreational or no goalkeeping experience at all. Moreover, the present training protocol is innovative because learners can schedule training sessions on their own. Finally, its usability suggests numerous potential applications.     

The co-occurrence of multisensory competition and facilitation

Previous studies of multisensory integration have often stressed the beneficial effects that may arise when information concerning an event arrives via different sensory modalities at the same time, as, for example, exemplified by research on the redundant target effect (RTE). By contrast, studies of the Colavita visual dominance effect (e.g., [Colavita, F. B. (1974). Human sensory dominance. Perception & Psychophysics, 16, 409–412]) highlight the inhibitory consequences of the competition between signals presented simultaneously in different sensory modalities instead. Although both the RTE and the Colavita effect are thought to occur at early sensory levels and the stimulus conditions under which they are typically observed are very similar, the interplay between these two opposing behavioural phenomena (facilitation vs. competition) has yet to be addressed empirically. We hypothesized that the dissociation may reflect two of the fundamentally different ways in which humans can perceive concurrent auditory and visual stimuli. In Experiment 1, we demonstrated both multisensory facilitation (RTE) and the Colavita visual dominance effect using exactly the same audiovisual displays, by simply changing the task from a speeded detection task to a speeded modality discrimination task. Meanwhile, in Experiment 2, the participants exhibited multisensory facilitation when responding to visual targets and multisensory inhibition when responding to auditory targets while keeping the task constant. These results therefore indicate that both multisensory facilitation and inhibition can be demonstrated in reaction to the same bimodal event.     

Skill differences in visual anticipation of type of throw in team-handball penalties

ObjectivesVisual identification and anticipation of an opponent's action intentions is crucial for successful performance in interactive situations such as team-handball penalties. We conducted two experiments to examine experienced and novice team-handball goalkeepers' ability to predict the type of throw in handball penalties and to identify the observers' reliance on local versus globally distributed spatial cues.Design and methodsIn Experiment 1, following a 2 (Skill) × 5 (Temporal Occlusion Condition) factorial design participants were provided with videos of team-handball penalties where the amount of viewing time was varied. In Experiment 2, another sample of experienced and novice goalkeepers watched videos of spatially manipulated penalties where specific parts of the thrower's body or the ball were either removed or presented in isolation (2 [Skill] × 9 [Display Condition] factorial design).ResultsIn Experiment 1, experienced goalkeepers outperformed novices and both groups similarly improved their performances with later occlusion conditions. In Experiment 2, experienced goalkeepers were again superior to novices, and local cues (e.g., ball and hand) were sufficient for better than chance predictions in both groups. Moreover, experienced in contrast to novice goalkeepers (i) suffered from the removal of and (ii) benefited from the addition of distal (i.e., throwing arm and ball) as well as proximal (i.e., upper body) kinematic features.ConclusionsOur research is in line with previous findings on perceptual-cognitive expertise in sports and suggests that experienced team-handball goalkeepers rely on multiple, globally distributed cues when making anticipatory judgments.     

Representative design: Does the addition of a defender change the execution of a basketball shot?

ObjectiveThe aim of this study was to examine the influence of a defender on the performance of a motor skill from an invasion sport.DesignHighly skilled basketball players performed different variations of basketball shots using a randomised test schedule.MethodParticipants completed a total of 30 test trials comprising 6 trials of 5 different shot types in both defended and undefended conditions.ResultsThe presence of a defender led to significant changes in several behavioral measures including faster shot execution times, longer jump times, and an increase in the amount of time that the ball spent in the air as it travelled to the basket after being released from the shooter's hand. These behavioral changes were accompanied by an overall decline in shooting accuracy of over 20%. Defended shots also tended to elicit greater amounts of movement variability which, when interpreted in conjunction with the other findings, suggests that participants were attempting to adapt their movements to accommodate for the changing demands of the performance environment. Comparisons across different shot types revealed that the influence of the defender was generally context and task dependent.ConclusionsThe results have important implications for representative task design, and highlight how the manipulation of key information sources can have a marked effect upon behavioral responses.     

Neuroscientific evidence for defensive avoidance of fear appeals

Previous studies indicate that people respond defensively to threatening health information, especially when the information challenges self‐relevant goals. The authors investigated whether reduced acceptance of self‐relevant health risk information is already visible in early attention allocation processes. In two experimental studies, participants were watching high‐ and low‐threat health commercials, and at the same time had to pay attention to specific odd auditory stimuli in a sequence of frequent auditory stimuli (odd ball paradigm). The amount of attention allocation was measured by recording event‐related brain potentials (i.e., P300 ERPs) and reaction times. Smokers showed larger P300 amplitudes in response to the auditory targets while watching high‐threat instead of low‐threat anti‐smoking commercials. In contrast, non‐smokers showed smaller P300 amplitudes during watching high as opposed to low threat anti‐smoking commercials. In conclusion, the findings provide further neuroscientific support for the hypothesis that threatening health information causes more avoidance responses among those for whom the health threat is self‐relevant.     

Knowing when to respond: the role of visual information in conversational turn exchanges

When engaging in conversation, we efficiently go back and forth with our partner, organizing our contributions in reciprocal turn-taking behavior. Using multiple auditory and visual cues, we make online decisions about when it is the appropriate time to take our turn. In two experiments, we demonstrated, for the first time, that auditory and visual information serve complementary roles when making such turn-taking decisions. We presented clips of single utterances spoken by individuals engaged in conversations in audiovisual, auditory-only or visual-only modalities. These utterances occurred either right before a turn exchange (i.e., ‘Turn-Ends’) or right before the next sentence spoken by the same talker (i.e., ‘Turn-Continuations’). In Experiment 1, participants discriminated between Turn-Ends and Turn-Continuations in order to synchronize a button-press response to the moment the talker would stop speaking. We showed that participants were best at discriminating between Turn-Ends and Turn-Continuations in the audiovisual condition. However, in terms of response synchronization, participants were equally precise at timing their responses to a Turn-End in the audiovisual and auditory-only conditions, showing no advantage of visual information. In Experiment 2, we used a gating paradigm, where increasing segments of Turns-Ends and Turn-Continuations were presented, and participants predicted if a turn exchange would occur at the end of the sentence. We found an audiovisual advantage in detecting an upcoming turn early in the perception of a turn exchange. Together, these results suggest that visual information functions as an early signal indicating an upcoming turn exchange while auditory information is used to precisely time a response to the turn end.     

The use of positively-worded performance reminders to reduce warm-up decrement in the field hockey penalty shot

Abstract

The effect of performance reminders in reducing temporary posttest performance decrement, referred to as warm-up decrement (WUD), was examined. Advanced, male, held hockey players performed 21 baseline trials of the standard penalty shot and then rested for three 7-min periods, each of which was followed by 4 additional penalty shots. During the last 2 min of each rest period, control participants continued resting while participants in 2 other groups reviewed written checklists containing positively-worded (PR) performance reminders (e.g., “watch the ball”) or negatively-worded (NR) reminders (e.g., “don't rush the shot”). Diminished posttest performance accuracy and movement form (i.e., WUD) was found for the NR group and control group but not for the PR group. It was concluded that the review of positively-worded performance reminders may be an effective warming-up activity for certain types of discontinuous sport performance.     

Does visual experience influence the spatial distribution of auditory attention?

Sighted individuals are less accurate and slower to localize sounds coming from the peripheral space than sounds coming from the frontal space. This specific bias in favour of the frontal auditory space seems reduced in early blind individuals, who are particularly better than sighted individuals at localizing sounds coming from the peripheral space. Currently, it is not clear to what extent this bias in the auditory space is a general phenomenon or if it applies only to spatial processing (i.e. sound localization). In our approach we compared the performance of early blind participants with that of sighted subjects during a frequency discrimination task with sounds originating either from frontal or peripheral locations. Results showed that early blind participants discriminated faster than sighted subjects both peripheral and frontal sounds. In addition, sighted subjects were faster at discriminating frontal sounds than peripheral ones, whereas early blind participants showed equal discrimination speed for frontal and peripheral sounds. We conclude that the spatial bias observed in sighted subjects reflects an unbalance in the spatial distribution of auditory attention resources that is induced by visual experience.     

On-court position and handedness in visual anticipation of stroke direction in tennis

ObjectivesIn racket sports, players integrate information picked up from their opponent's kinematics and contextual cues like on-court position into shot outcome anticipation. In view of suggested difficulties with anticipating left-handed opponents' action intentions, here we examined whether an opponent's handedness interacts with position-dependency in visual anticipation.Design and methodFollowing a 2 (Group) x 2 (Handedness) x 2 (Position) x 3 (Temporal Occlusion) factorial design, 20 tennis players and 20 non-players predicted directional outcome of temporally manipulated point-light animations of identical left- and right-handed forehand groundstrokes performed near vs. far from the court's midline.ResultsTennis players' response selection was mostly affected by an opponent's on-court position, particularly at an early stage of a hitting movement. Opponents' handedness affected response selection similarly in both groups (i.e., bias towards down-the-line predictions against left-handed strokes occluded at racket-ball-contact), but it did not interact with on-court position.ConclusionsFindings highlight that on-court position, and opponents' handedness to some extent as well, appears relevant for skilled visual anticipation in tennis.     

Eliciting information and cues to deception using a model statement: Examining the effect of presentation modality

Forensic interviewing involves gathering information from a suspect or eyewitness. Administering a model statement during an interview results in greater information elicitation, which can enhance lie detection. Typically, a model statement is a highly detailed statement, on an unrelated topic to that of the interview. This study examined the effect of manipulating the modality of the MS, either by allowing participants to listen to (Audio‐MS), or read (Written‐MS) a model statement. A total of 162 (81 truth tellers, 81 liars) participants were randomly allocated to one of three interviewing conditions where they received either the Audio‐MS, Written‐MS, or No‐MS (control condition). Truth tellers honestly reported a “spy” mission, whereas liars performed a covert mission and lied about their activities. Results showed both model statements were equally more effective at eliciting information and facilitating lie detection, compared with a control condition. Theoretical and practical implications are discussed.     

Aiming at a far target under different viewing conditions: visual control in basketball jump shooting

Most research on visual search in aiming at far targets assumes preprogrammed motor control implying that relevant visual information is detected prior to the final shooting or throwing movements. Eye movement data indirectly support this claim for stationary tasks. Using the basketball jump shot as experimental task we investigated whether in dynamic tasks in which the target can be seen until ball release, continuous, instead of preprogrammed, motor control is possible. We tested this with the temporal occlusion paradigm: 10 expert shooters took shots under four viewing conditions, namely, no vision, full vision, early vision (vision occluded during the final +/-350 ms before ball release), and late vision (vision occluded until these final +/-350 ms). Late-vision shooting appeared to be as good as shooting with full vision while early-vision performance was severely impaired. The results imply that the final shooting movements were controlled by continuous detection and use of visual information until ball release. The data further suggest that visual and movement control of aiming at a far target develop in close correspondence with the style of execution.     

Audio-visual integration of emotional cues in song

We examined whether facial expressions of performers influence the emotional connotations of sung materials, and whether attention is implicated in audio-visual integration of affective cues. In Experiment 1, participants judged the emotional valence of audio-visual presentations of sung intervals. Performances were edited such that auditory and visual information conveyed congruent or incongruent affective connotations. In the single-task condition, participants judged the emotional connotation of sung intervals. In the dual-task condition, participants judged the emotional connotation of intervals while performing a secondary task. Judgements were influenced by melodic cues and facial expressions and the effects were undiminished by the secondary task. Experiment 2 involved identical conditions but participants were instructed to base judgements on auditory information alone. Again, facial expressions influenced judgements and the effect was undiminished by the secondary task. The results suggest that visual aspects of music performance are automatically and preattentively registered and integrated with auditory cues.     

How distraction affects pedestrian response: Evidence from behavior patterns and cortex oxyhemoglobin changes

ObjectivesDistracted walking is a major cause of pedestrian road traffic injuries, but little is known about how distraction affects pedestrian safety. The study was designed to explore how visual and auditory distraction might influence pedestrian safety.MethodsThree experiments were conducted to explore causal mechanisms from two theoretical perspectives, increased cognitive load from the distraction task and resource competition in the same sensory modality. Pedestrians’ behavior patterns and cortex oxyhemoglobin changes were recorded while they performed a series of dual tasks.ResultsFour primary results emerged: (a) participants responded more slowly to both visual and auditory stimuli in traffic, as well as walked more slowly, while talking on the phone or text messaging compared to when undistracted or listening to music; (b) when participants completed pedestrian response tasks while distracted with a high cognitive load, their response was significantly slower and poorer than when they carried out a lower cognitive load distraction task, (c) participants had higher levels of oxy-Hb change in cortices related to visual processing and executive function while distracted with a higher cognitive load; and (d) participants' responses to traffic lights were slower and resulted in a higher activation in prefrontal cortex and occipital areas when distracted by a visual distraction task compared to when distracted with an auditory task; similarly, brain activation increased significantly in temporal areas when participants responded to an auditory car horn task compared to when they responded to visual traffic lights.ConclusionsBoth distracting cognitive load demands and the type of distraction task significantly affect young adult pedestrian performance and threaten pedestrian safety. Pedestrian injury prevention efforts should consider the effects of the type of distracting task and its cognitive demands on pedestrian safety.     

Synchronization with competing visual and auditory rhythms: bouncing ball meets metronome

Synchronization of finger taps with periodically flashing visual stimuli is known to be much more variable than synchronization with an auditory metronome. When one of these rhythms is the synchronization target and the other serves as a distracter at various temporal offsets, strong auditory dominance is observed. However, it has recently been shown that visuomotor synchronization improves substantially with moving stimuli such as a continuously bouncing ball. The present study pitted a bouncing ball against an auditory metronome in a target–distracter synchronization paradigm, with the participants being auditory experts (musicians) and visual experts (video gamers and ball players). Synchronization was still less variable with auditory than with visual target stimuli in both groups. For musicians, auditory stimuli tended to be more distracting than visual stimuli, whereas the opposite was the case for the visual experts. Overall, there was no main effect of distracter modality. Thus, a distracting spatiotemporal visual rhythm can be as effective as a distracting auditory rhythm in its capacity to perturb synchronous movement, but its effectiveness also depends on modality-specific expertise.