Does visual expertise improve visual recognition memory?

In general, humans have impressive recognition memory for previously viewed pictures. Many people spend years becoming experts in highly specialized image sets. For example, cytologists are experts at searching micrographs filled with potentially cancerous cells and radiologists are expert at searching mammograms for indications of cancer. Do these experts develop robust visual long-term memory for their domain of expertise? If so, is this expertise specific to the trained image class, or do such experts possess generally superior visual memory? We tested recognition memory of cytologists, radiologists, and controls with no medical experience for three visual stimulus classes: isolated objects, scenes, and mammograms or micrographs. Experts were better than control observers at recognizing images from their domain, but their memory for those images was not particularly good (D’ ~ 1.0) and was much worse than memory for objects or scenes (D’ > 2.0). Furthermore, experts were not better at recognizing scenes or isolated objects than control observers.     

Expertise training with novel objects leads to left-lateralized facelike electrophysiological responses

Scalp event-related potentials (ERPs) in humans indicate that face and object processing differ approximately 170 ms following stimulus presentation, at the point of the N170 occipitotemporal component. The N170 is delayed and enhanced to inverted faces but not to inverted objects. We tested whether this inversion effect reflects early mechanisms exclusive to faces or whether it generalizes to other stimuli as a function of visual expertise. ERPs to upright and inverted faces and novel objects (Greebles) were recorded in 10 participants before and after 2 weeks of expertise training with Greebles. The N170 component was observed for both faces and Greebles. The results are consistent with previous reports in that the N170 was delayed and enhanced for inverted faces at recording sites in both hemispheres. For Greebles, the same effect of inversion was observed only for experts, primarily in the left hemisphere. These results suggest that the mechanisms underlying the electrophysiological face-inversion effect extend to visually homogeneous nonface object categories, at least in the left hemisphere, but only when such mechanisms are recruited by expertise.     

Learning to learn: From within-modality to cross-modality transfer during infancy

One critical aspect of learning is the ability to apply learned knowledge to new situations. This ability to transfer is often limited, and its development is not well understood. The current research investigated the development of transfer between 8 and 16 months of age. In Experiment 1, 8- and 16-month-olds (who were established to have a preference to the beginning of a visual sequence) were trained to attend to the end of a sequence. They were then tested on novel visual sequences. Results indicated transfer of learning, with both groups changing baseline preferences as a result of training. In Experiment 2, participants were trained to attend to the end of a visual sequence and were then tested on an auditory sequence. Unlike Experiment 1, only older participants exhibited transfer of learning by changing baseline preferences. These findings suggest that the generalization of learning becomes broader with development, with transfer across modalities developing later than transfer within a modality.     

The training and transfer of real-world perceptual expertise

A hallmark of perceptual expertise is that experts classify objects at a more specific, subordinate level of abstraction than novices. To what extent does subordinate-level learning contribute to the transfer of perceptual expertise to novel exemplars and novel categories? In this study, participants learned to classify 10 varieties of wading birds and 10 varieties of owls at either the subordinate, species (e.g., "great blue crown heron,"eastern screech owl") or the family ("wading bird,"owl") level of abstraction. During training, the amount of visual exposure was equated such that participants received an equal number of learning trials for wading birds and owls. Pre- and posttraining performance was measured in a same/different discrimination task in which participants judged whether pairs of bird stimuli belonged to the same or different species. Participants trained in species-level discrimination demonstrated greater transfer to novel exemplars and novel species categories than participants trained in family-level discrimination. These findings suggest that perceptual categorization, not perceptual exposure per se, is important for the development and generalization of visual expertise.     

基于视听双通道的音乐情绪加工机制及情绪类型和音乐经验的影响

为了探讨视听双通道下的音乐情绪加工机制及音乐情绪类型和音乐训练背景对加工机制的影响,本研究采用表达开心和悲伤的音乐表演视频为材料,比较音乐组被试和非音乐组被试在单听觉通道、单视觉通道和视听双通道三种情境下的情绪评定速度、正确率和强度。结果发现：1）视听双通道与单视觉通道差异显著,与单听觉通道差异不显著。2）非音乐组被试对悲伤的评定正确率高于音乐组被试,对开心的评定正确率低于音乐组被试。说明音乐情绪加工的视听双通道整合优势仅相对单视觉通道存在;非音乐组被试对视觉通道情绪信息的变化更敏感,音乐组被试更依赖音乐经验;可在音乐表演时加入协调的视觉通道情绪信息帮助没有音乐训练经验的听赏者。     

When seeing doesn't matter: assessing the after-effects of tactile distractor processing in the blind and the sighted

Negative priming (NP) refers to the finding that people's responses to probe targets previously presented as prime distractors are usually slower than to unrepeated stimuli. Intriguingly, the effect sizes of tactile NP were much larger than the effect sizes for visual NP. We analyzed whether the large tactile NP effect is just a side effect of the higher difficulty when processing tactile compared to visual stimuli. Thus, we analyzed tactile NP in a sample of blind participants and in a control sample of sighted participants. Although the blind participants handled the tactile stimuli with ease, we found no evidence that the size of the tactile NP effect diminished. In two control experiments with sighted participants, we varied the processing difficulty in the visual and tactile modality and found that both modality and processing difficulty had an effect on the size of NP. Taken together, our data show that the difficulty associated with processing tactile stimuli is only partially the reason for the unusual large tactile NP effect. These results suggest that non-spatial tactile distractors are processed and selected quite differently from visual distractors.     

基于视听双通道的音乐情绪冲突效应及优势通道研究

为探讨基于视听双通道的音乐情绪冲突效应、冲突情境下的优势加工通道和音乐经验对结果的影响,本研究采用音乐表演视频为材料,比较音乐组和非音乐组被试在一致型和不一致型视听双通道下的情绪评定速度、准确性及强度。结果发现:(1)一致型条件下的情绪评定更准确且更强烈;(2)不一致型条件下,被试更多以听觉通道的情绪线索为依据进行情绪类型评定;(3)非音乐组被试比音乐组被试更依赖视觉通道的情绪线索。结果表明:通道间情绪信息的不一致阻碍了音乐情绪加工; 听觉通道是音乐情绪冲突情境下的优势加工通道; 音乐经验降低了情绪冲突效应对音乐组被试的干扰。     

Experts see it all: configural effects in action observation

Biological motion perception is influenced by observers’ familiarity with the observed action. Here, we used classical dance as a means to investigate how visual and motor experience modulates perceptual mechanism for configural processing of actions. Although some ballet moves are performed by only one gender, male and female dancers train together and acquire visual knowledge of all ballet moves. Twenty-four expert ballet dancers (12 female) and matched non-expert participants viewed pairs of upright and inverted point light female and common dance movements. Visual discrimination between different exemplars of the same movement presented upright was significantly better in experts than controls, whilst no differences were found when the same stimuli were presented upside down. These results suggest expertise influences configural action processing. Within the expert group, effects were stronger for female participants than for males, whilst no differences were found between movement types. This observer gender effect could suggest an additional role for motor familiarity in action perception, over and above the visual experience. Our results are consistent with a specific motor contribution to configural processing of action.     

Synchronization with competing visual and auditory rhythms: bouncing ball meets metronome

Synchronization of finger taps with periodically flashing visual stimuli is known to be much more variable than synchronization with an auditory metronome. When one of these rhythms is the synchronization target and the other serves as a distracter at various temporal offsets, strong auditory dominance is observed. However, it has recently been shown that visuomotor synchronization improves substantially with moving stimuli such as a continuously bouncing ball. The present study pitted a bouncing ball against an auditory metronome in a target–distracter synchronization paradigm, with the participants being auditory experts (musicians) and visual experts (video gamers and ball players). Synchronization was still less variable with auditory than with visual target stimuli in both groups. For musicians, auditory stimuli tended to be more distracting than visual stimuli, whereas the opposite was the case for the visual experts. Overall, there was no main effect of distracter modality. Thus, a distracting spatiotemporal visual rhythm can be as effective as a distracting auditory rhythm in its capacity to perturb synchronous movement, but its effectiveness also depends on modality-specific expertise.     

Extensive occupational finger use delays age effects in tactileperception—an ERP study

Tactile expertise, resulting from extensive use of hands, has previously been shown to improve tactile perception in blind people and musicians and to be associated with changes in the central processing of tactile information. This study investigated whether expertise, due to precise and deliberate use of the fingers at work, relates to improved tactile perception and whether this expertise interacts with age. A tactile pattern and a frequency discrimination task were conducted while ERPs were measured in experts and nonexperts of two age groups within middle adulthood. Independently of age, accuracy was better in experts than in nonexperts in both tasks. Somatosensory N70 amplitudes were larger with increasing age and for experts than for nonexperts. P100 amplitudes were smaller in experts than in nonexperts in the frequency discrimination task. In the pattern discrimination task, P300 difference wave amplitude was reduced in experts and late middle-aged adults. In the frequency discrimination task, P300 was more equally distributed in late middle-aged adults. We conclude that extensive, dexterous manual work leads to acquisition of tactile expertise and that this expertise might delay, but not counteract, age effects on tactile perception. Comparable neurophysiological changes induced by age and expertise presumably have different underlying mechanisms. Enlarged somatosensory N70 amplitudes might result from reduced inhibition in older adults but from enhanced, specific excitability of the somatosensory cortex in experts. Regarding P300, smaller amplitudes might indicate fewer available resources in older adults and, by contrast, a reduced need to engage as much cognitive effort to the task in experts.     

The visual system supports online translation invariance for object identification

The ability to recognize the same image projected to different retinal locations is critical for visual object recognition in natural contexts. According to many theories, the translation invariance for objects extends only to trained retinal locations, so that a familiar object projected to a nontrained location should not be identified. In another approach, invariance is achieved “online,” such that learning to identify an object in one location immediately affords generalization to other locations. We trained participants to name novel objects at one retinal location using eyetracking technology and then tested their ability to name the same images presented at novel retinal locations. Across three experiments, we found robust generalization. These findings provide a strong constraint for theories of vision.     

The modality effect of ego depletion: Auditory task modality reduces ego depletion

An initial act of self‐control that impairs subsequent acts of self‐control is called ego depletion. The ego depletion phenomenon has been observed consistently. The modality effect refers to the effect of the presentation modality on the processing of stimuli. The modality effect was also robustly found in a large body of research. However, no study to date has examined the modality effects of ego depletion. This issue was addressed in the current study. In Experiment 1, after all participants completed a handgrip task, one group's participants completed a visual attention regulation task and the other group's participants completed an auditory attention regulation task, and then all participants again completed a handgrip task. The ego depletion phenomenon was observed in both the visual and the auditory attention regulation task. Moreover, participants who completed the visual task performed worse on the handgrip task than participants who completed the auditory task, which indicated that there was high ego depletion in the visual task condition. In Experiment 2, participants completed an initial task that either did or did not deplete self‐control resources, and then they completed a second visual or auditory attention control task. The results indicated that depleted participants performed better on the auditory attention control task than the visual attention control task. These findings suggest that altering task modality may reduce ego depletion.     

The role of consolidation for perceptual learning in temporal discrimination within and across modalities

Training people on temporal discrimination can substantially improve performance in the trained modality but also in untrained modalities. A pretest–training–posttest design was used to investigate whether consolidation plays a crucial role for training effects within the trained modality and its transfer to another modality. In the pretest, both auditory and visual discrimination performance was assessed. In the training phase, participants performed only the auditory task. After a consolidation interval of either 5 min or 24 h, participants were again tested in both the auditory and visual tasks. Irrespective of the consolidation interval, performance improved from the pretest to the posttest in both modalities. Most importantly, the training effect for the trained auditory modality was independent of the consolidation interval whereas the transfer effect to the visual modality was larger after 24 h than after 5 min. This finding shows that transfer effects benefit from extended consolidation.     

The effects of interference on recognition of haptic pictures in blindfolded sighted participants: the modality of representation of haptic information

Haptic picture recognition was tested in 36 undergraduate students to determine whether haptic representations are visual or multi-modal. Participants explored target haptic pictures and were asked to recognize the target from three alternatives. Each participant completed eight control and eight interference trials in visual, lexical and tactile recognition modalities. For interference, participants were assigned to either an articulatory suppression (repeat "the" at a constant rate) or a visual interference (watch a visual display) condition, to prevent recoding into a verbal or visual code. The results showed that accuracy was higher at control compared to interference trials and for tactile compared to lexical recognition. Additionally, lexical and tactile recognition decreased with articulatory suppression whereas only tactile recognition decreased with visual interference. These findings suggest that haptic pictures may be represented by coordinating visual and verbal codes.     

Dynamics of expertise level: Coordination in handstand

The aim of the present study was to investigate the effect of expertise on coordination patterns. We thus tested the coordination dynamics of two groups: experts in the handstand also having high expertise in gymnastics and experts in the handstand but only intermediate expertise in gymnastics. All participants were instructed to track a target with their ankles while maintaining the handstand. The target moved on the anterior-posterior axis according to three frequency conditions: 0.2, 0.4 and 0.6 Hz. The results showed that the suprapostural task was performed better by the group with high gymnastics expertise. Moreover, the spontaneous coordination was specific to the level of gymnastics expertise. We concluded that (i) the dynamics of coordination progress with the overall level of expertise in a sport discipline, independently of the mastery of a single skill, (ii) persistence and change are seen in related movement properties, and (iii) high expertise offers greater adaptability relative to the task.     

Congruency effects between auditory and tactile motion: Extending the phenomenon of cross-modal dynamic capture

Behavioral studies of multisensory integration in motion perception have focused on the particular case of visual and auditory signals. Here, we addressed a new case: audition and touch. In Experiment 1, we tested the effects of an apparent motion stream presented in an irrelevant modality (audition or touch) on the perception of apparent motion streams in the other modality (touch or audition, respectively). We found significant congruency effects (lower performance when the direction of motion in the irrelevant modality was incongruent with the direction of the target) for the two possible modality combinations. This congruency effect was asymmetrical, with tactile motion distractors having a stronger influence on auditory motion perception than vice versa. In Experiment 2, we used auditory motion targets and tactile motion distractors while participants adopted one of two possible postures: arms uncrossed or arms crossed. The effects of tactile motion on auditory motion judgments were replicated in the arms-uncrossed posture, but they dissipated in the arms-crossed posture. The implications of these results are discussed in light of current findings regarding the representation of tactile and auditory space.     

Crossmodal change blindness between vision and touch

Change blindness is the name given to people's inability to detect changes introduced between two consecutively-presented scenes when they are separated by a distractor that masks the transients that are typically associated with change. Change blindness has been reported within vision, audition, and touch, but has never before been investigated when successive patterns are presented to different sensory modalities. In the study reported here, we investigated change detection performance when the two to-be-compared stimulus patterns were presented in the same sensory modality (i.e., both visual or both tactile) and when one stimulus pattern was tactile while the other was presented visually or vice versa. The two to-be-compared patterns were presented consecutively, separated by an empty interval, or else separated by a masked interval. In the latter case, the masked interval could either be tactile or visual. The first experiment investigated visual-tactile and tactile-visual change detection performance. The results showed that in the absence of masking, participants detected changes in position accurately, despite the fact that the two to-be-compared displays were presented in different sensory modalities. Furthermore, when a mask was presented between the two to-be-compared displays, crossmodal change blindness was elicited no matter whether the mask was visual or tactile. The results of two further experiments showed that performance was better overall in the unimodal (visual or tactile) conditions than in the crossmodal conditions. These results suggest that certain of the processes underlying change blindness are multisensory in nature. We discuss these findings in relation to recent claims regarding the crossmodal nature of spatial attention.     

Gender recognition depends on type of movement and motor skill. Analyzing and perceiving biological motion in musical and nonmusical tasks

Gender recognition in point-light displays was investigated with regard to body morphology cues and motion cues of human motion performed with different levels of technical skill. Gestures of male and female orchestral conductors were recorded with a motion capture system while they conducted excerpts from a Mendelssohn string symphony to musicians. Point-light displays of conductors were presented to observers under the following conditions: visual-only, auditory-only, audiovisual, and two non-conducting conditions (walking and static images). Observers distinguished between male and female conductors in gait and static images, but not in visual-only and auditory-only conducting conditions. Across all conductors, gender recognition for audiovisual stimuli was better than chance, yet significantly less reliable than for gait. Separate analyses for two groups of conductors indicated an expertise effect in that novice conductors' gender was perceived above chance level for visual-only and audiovisual conducting, while skilled conducting gestures of experts did not afford gender-specific cues. In these conditions, participants may have ignored the body morphology cues that led to correct judgments for static images. Results point to a response bias such that conductors were more often judged to be male. Thus judgment accuracy depended both on the conductors' level of expertise as well as on the observers' concepts, suggesting that perceivable differences between men and women may diminish for highly trained movements of experienced individuals.     

The effect of vertical and horizontal symmetry on memory for tactile patterns in late blind individuals

Visual stimuli that exhibit vertical symmetry are easier to remember than stimuli symmetric along other axes, an advantage that extends to the haptic modality as well. Critically, the vertical symmetry memory advantage has not been found in early blind individuals, despite their overall superior memory, as compared with sighted individuals, and the presence of an overall advantage for identifying symmetric over asymmetric patterns. The absence of the vertical axis memory advantage in the early blind may depend on their total lack of visual experience or on the effect of prolonged visual deprivation. To disentangle this issue, in this study, we measured the ability of late blind individuals to remember tactile spatial patterns that were either vertically or horizontally symmetric or asymmetric. Late blind participants showed better memory performance for symmetric patterns. An additional advantage for the vertical axis of symmetry over the horizontal one was reported, but only for patterns presented in the frontal plane. In the horizontal plane, no difference was observed between vertical and horizontal symmetric patterns, due to the latter being recalled particularly well. These results are discussed in terms of the influence of the spatial reference frame adopted during exploration. Overall, our data suggest that prior visual experience is sufficient to drive the vertical symmetry memory advantage, at least when an external reference frame based on geocentric cues (i.e., gravity) is adopted.     

Cross-modal attention modulates tactile subitizing but not tactile numerosity estimation

Debate remains about whether the same attentional mechanism subserves subitizing (with number of items less than or equal to 4) and numerosity estimation (with number of items equal to or larger than 5), and evidence is scarce from the tactile modality. Here, we examined tactile numerosity perception. Using tactile Braille displays, participants completed the following three main tasks: (1) Unisensory task with focused attention: Participants reported the number (1~12) of the tactile pins. (2) Unisensory task with divided attention: Participants compared the numbers of pins across the upper and lower area of their left index fingers, in addition to reporting the number of tactile pins on their right index fingers. (3) Cross-modal task with divided attention: Participants reported the number of tactile pins and compared the numbers of visual dots across the upper and lower part of a (illusory) rectangle that overlaid the tactile stimuli. We found that performance of subitizing rather than estimation was interfered with in dual tasks, regardless of whether distractor events were from the same modality (tactile modality) or from a different modality (visual modality). Moreover, a further test of visual/tactile working memory capacity revealed that the precision of tactile subitizing, in the presence of a visual distractor, was correlated with the capacity of visual working memory, not of tactile working memory. Overall, our study revealed that tactile numerosity perception is accounted for by amodal attentional modulation yet by differential attentional mechanisms in terms of subitizing and estimation.