Summation of visual attributes in auditory–visual crossmodal correspondences

Crossmodal correspondences are a feature of human perception in which two or more sensory dimensions are linked together; for example, high-pitched noises may be more readily linked with small than with large objects. However, no study has yet systematically examined the interaction between different visual–auditory crossmodal correspondences. We investigated how the visual dimensions of luminance, saturation, size, and vertical position can influence decisions when matching particular visual stimuli with high-pitched or low-pitched auditory stimuli. For multidimensional stimuli, we found a general pattern of summation of the individual crossmodal correspondences, with some exceptions that may be explained by Garner interference. These findings have applications for the design of sensory substitution systems, which convert information from one sensory modality to another.     

Does visual experience influence the spatial distribution of auditory attention?

Sighted individuals are less accurate and slower to localize sounds coming from the peripheral space than sounds coming from the frontal space. This specific bias in favour of the frontal auditory space seems reduced in early blind individuals, who are particularly better than sighted individuals at localizing sounds coming from the peripheral space. Currently, it is not clear to what extent this bias in the auditory space is a general phenomenon or if it applies only to spatial processing (i.e. sound localization). In our approach we compared the performance of early blind participants with that of sighted subjects during a frequency discrimination task with sounds originating either from frontal or peripheral locations. Results showed that early blind participants discriminated faster than sighted subjects both peripheral and frontal sounds. In addition, sighted subjects were faster at discriminating frontal sounds than peripheral ones, whereas early blind participants showed equal discrimination speed for frontal and peripheral sounds. We conclude that the spatial bias observed in sighted subjects reflects an unbalance in the spatial distribution of auditory attention resources that is induced by visual experience.     

Does retrieval practice depend on semantic cues? Assessing the fuzzy trace account of the testing effect

Retrieval practice enhances long-term retention more than restudying; a phenomenon called the testing effect. The fuzzy trace explanation predicts that a testing effect will already emerge after a short interval when participants are solely provided with semantic cues in the final test. In the present study, we assessed this explanation by gradually reducing the surface features overlap between cues in the learning phase and the final recognition test. In all five experiments, participants in the control/word condition received as final test cues the same words as in the learning phase. The experimental final test cues consisted of scrambled words, words in a new context, scrambled words in a new context (Experiment 1), synonyms (Experiment 2), or images (Experiments 3, 4a, 4b). A short-term testing effect was only observed for the image final test cues. These results do not provide strong support for the fuzzy trace explanation of the testing effect.     

Misleading contextual cues: How do they affect visual search?

Contextual cueing occurs when repetitions of the distractor configuration are implicitly learned. This implicit learning leads to faster search times in repeated displays. Here, we investigated how search adapts to a change of the target location in old displays from a consistent location in the learning phase to a consistent new location in the transfer phase. In agreement with the literature, contextual cueing was accompanied by fewer fixations, a more efficient scan path and, specifically, an earlier onset of a monotonic gaze approach phase towards the target location in repeated displays. When the repeated context was no longer predictive of the old target location, search times and number of fixations for old displays increased to the level of novel displays. Along with this, scan paths for old and new displays became equally efficient. After the target location change, there was a bias of exploration towards the old target location, which soon disappeared. Thus, change of implicitly learned spatial relations between target and distractor configuration eliminated the advantageous effects of contextual cueing, but did not lead to a lasting impairment of search in repeated displays relative to novel displays.     

Do multielement visual tracking and visual search draw continuously on the same visual attention resources?

Multielement visual tracking and visual search are 2 tasks that are held to require visual-spatial attention. The authors used the attentional operating characteristic (AOC) method to determine whether both tasks draw continuously on the same attentional resource (i.e., whether the 2 tasks are mutually exclusive). The authors found that observers can search and track within the same trial significantly better than would be predicted if the 2 tasks were mutually exclusive. In fact, the AOC for tracking and search is similar to that for tracking and auditory monitoring. The results of additional experiments support an attention-switching account for this high level of dual-task performance in which a single attentional resource is efficiently switched between the tracking and search. The results provide important constraints for architectures of visual selective attention and the mechanisms of multielement tracking.     

Influence of stimulus–response assignment on the joint-action correspondence effect

Sebanz et al. (Cognition 88:B11–B21, 2003) have shown that spatial correspondence effects are observed even when the two-choice reaction time task is distributed between two people, such that each person is assigned only one of two possible stimulus–response (S–R) pairings. The effect is similar to when one person is assigned and responds to both S–R pairings. These results have been taken to suggest that two people performing a complementary task co-represent each other’s response alternatives. In our experiment, we examined performance when paired participants responded to the same S–R alternative. We reasoned that co-representation would be of little advantage as the task alternatives would be the same for both participants. Correspondence effects were absent when paired participants responded to the same S–R alternative but emerged when they responded to different alternatives.     

Does quality of sleep mediate the effect of depression on hopelessness?

The objectives of the study were to evaluate the relationship between sleep quality, depression, and hopelessness in advanced cancer patients and whether sleep quality mediated the effect of depression on hopelessness. The final sample consisted of 102 advanced cancer patients under palliative treatment. Patients completed the Greek Pittsburgh Sleep Quality Index, a sleep quality instrument, the Greek Beck Depression Inventory for measuring depression, and finally the Beck Hopelessness Scale. Patients' performance status was assessed by their overall physical functioning, as defined by the Eastern Cooperative Oncology Group. Depression was highly associated with hopelessness (r = .52, p<.001). Statistically significant associations were found between sleep quality with hopelessness (r = .37, p<.001), as well as with depression (r = .36, p<.001). Mediation analyses indicated that depression influenced hopelessness directly as well as indirectly by its effect on sleep quality. About 14.58% of the variation in hopelessness was explained by depression; 4% of the variance in hopelessness explained by depression was accounted for by the mediation pathway indicating that sleep quality mediated the relationship between depression and hopelessness. Similarly, in the reverse mediation analysis, depression mediated the relationship between sleep quality and hopelessness; 43% of the variation in hopelessness was explained by sleep quality. In conclusion, some of the effect of depression on hopelessness was mediated by sleep quality, but depression had a direct effect on hopelessness as well. Additionally, some of the effect of sleep quality on hopelessness was mediated by depression. The current findings are important because improving sleep quality by treating depression may contribute to decreased hopelessness scores and vice versa: Treating depression by improving sleep quality may also contribute to lower hopelessness scores.     

Does contingency awareness mediate the influence of emotional learning on the cueing of visual attention?

Previous research has indicated that conditioning depends on contingency awareness (CA). However, we argue that these studies have examined this issue under methodological conditions that might be insensitive to associative learning without CA. In the present study we examined the effect of an experimental manipulation of CA on attentive processing of classically conditioned stimuli, which is sensitive to associative learning with and without CA. We found that aversive conditioning with additional contingency instructions modulated visual attention, in the sense that the conditioned cues captured and held attention more strongly than the non-conditioned cues. Surprisingly, conditioning under conditions of restricted CA yielded a response pattern that was different from that under full CA. These findings suggest that conditioning with full and restricted CA can lead to qualitatively different effects on attention.     

Does stimulus correspondence account for the Simon effect? Comments on Hasbroucq and Guiard (1991)

Summary In a recent paper analysing the Simon effect, Hasbroucq and Guiard (1991) concluded that stimulus congruence, a correspondence relationship between stimulus components, accounts for the Simon effect and explains its reversal in the Hedge and Marsh experiment (1975). We contend that their definition of stimulus congruence is applied inconsistently, which invalidates their conclusion. It is argued here that the effect of display-control arrangement correspondence (Simon, Sly, & Vilapakkam, 1981) is an alternative account that fits the presented data better. In a second experiment, Hasbroucq and Guiard (1991) claimed to have invalidated the suggestion that display-control arrangement correspondence could be considered to be an alternative account of the findings in their Experiment 1. However, we assert that the type of display-control arrangement employed in their second experiment was so unpredictable that no effect of display-control arrangement correspondence could occur.     

Focal lung pathology detection in radiology: Is there an effect of experience on visual search behavior?

In radiology, 60% to 80% of diagnostic errors are perceptual. The use of more efficient visual search behaviors is expected to reduce these errors. We collected eye-tracking data from participants with different levels of experience when interpreting chest X-rays during the completion of a pathology-detection task. Eye-tracking measures were assessed in the context of three existing visual search theories from the literature to understand the association between visual search behavior and underlying processes: the long-term working memory theory, the information-reduction hypothesis, and the holistic model of image perception. The most experienced participants (radiology residents) showed the highest level of performance, albeit their visual search behaviors did not differ from the intermediate group. This suggests that radiology residents better processed the represented information on the X-ray, using a visual search strategy similar to the intermediate group. Since similar visual search resulted in more information extraction in the radiology residents compared with the intermediates, we suggest that this result might support the long-term working memory theory. Furthermore, compared with novices, intermediates and radiology residents fixated longer on areas that were more important to avoid missing any pathology, which possibly confirms the information-reduction hypothesis. Finally, the larger distances between fixations observed in more experienced participants could support the holistic model of image perception. In addition, measures of generic skills were related to a lower time cost for switching between global and local information processing. Our findings suggest that the three theories may be complementary in chest X-ray interpretation. Therefore, a unified theory explaining perceptual-cognitive superiority in radiology is considered.

     

To cross or not to cross: Impact of visual and auditory cues on pedestrians’ crossing decision-making

The controlled study of pedestrians’ crossing decision-making is relevant to the search for better safety conditions for this class of vulnerable road users. Several risk factors have been identified in the literature related to the crosswalks’ surrounding environment, the socio-demographic characteristics of the pedestrians crossing the road and the place where the crosswalks are inserted, as well as situational variables, such as speed and distance of the approaching vehicle during the crossing. In this work, the roles of visual and auditory cues in crossing decisions were analysed, comparing different speeds and distances, and taking into consideration different speed patterns of the approaching vehicle, aiming to identify what can affect pedestrians’ crossing behaviour. Experiments were performed in a virtual environment. Participants were presented with 10 different stimuli featuring a vehicle approaching with different speeds and movement patterns, combined with 2 auditory conditions: one concerning a vehicle with a gasoline combustion engine and another one with no sound cues. Participants were tasked with indicating the moment they decided to cross the street when they thought it was safe to do so by pressing a response button. Percentage of crossings, response time (RT), and time-to-passage (TTP) were recorded and subsequently analysed. The results showed that lower speeds and higher distances lead to higher percentages of crossings and RTs. The auditory condition did not significantly affect participants’ responses, leading to the conclusion that participants’ crossing decision was especially based on their visual perception of the movement characteristics of the approaching vehicle, particularly its speed and distance. These results may have relevance for the development of communication strategies between the vehicles, especially the automated ones, and pedestrians.     

Do the contents of visual working memory automatically influence attentional selection during visual search?

In many theories of cognition, researchers propose that working memory and perception operate interactively. For example, in previous studies researchers have suggested that sensory inputs matching the contents of working memory will have an automatic advantage in the competition for processing resources. The authors tested this hypothesis by requiring observers to perform a visual search task while concurrently maintaining object representations in visual working memory. The hypothesis that working memory activation produces a simple but uncontrollable bias signal leads to the prediction that items matching the contents of working memory will automatically capture attention. However, no evidence for automatic attentional capture was obtained; instead, the participants avoided attending to these items. Thus, the contents of working memory can be used in a flexible manner for facilitation or inhibition of processing.     

Does the proportion of associatively related pairs modulate the associative priming effect at very brief stimulus-onset asynchronies?

A number of experiments have shown that the magnitude of the associative priming effect increases substantially when there is a high proportion of associatively related pairs in the list when the stimulus-onset asynchrony (SOA) between prime and target is long (more than 400 ms). In the present series of experiments we manipulated the proportion of associatively related pairs when the SOA was very brief (less than 200 ms). If processing of a target word is facilitated automatically by the prior presentation of a related prime, the occurrence of priming should be unaffected by the proportion of related pairs in the list. Experiment 1 showed a robust relatedness proportion effect obtained in a double lexical decision task. Experiments 2-4 used the masked priming technique at several very short SOAs (66, 116, and 166 ms) in lexical decision and naming. The results showed a reliable associative priming effect in the two tasks, which did not differ as a function of the proportion of related pairs. Finally, Experiment 5 used unmasked primes at an 83-ms SOA in which the primes remained in view after the target presentation. As in Experiments 2-4, the associative effect was not modulated by the proportion of associatively related pairs. The implications of these results are discussed.     

Does the testing effect depend on presentation modality?

We examined whether the testing effect generalizes to an auditory presentation modality. Five lists of unrelated words (Experiment 1) and related words (Experiment 2) were presented to participants, half of whom studied them visually and half studied them auditorily. Participants in the study-only condition performed a short distractor task following lists 1–4, whereas those in the testing condition completed a short distractor task and then attempted to recall each list. Both groups were subsequently tested on List 5 and on all five lists 30 min later. In both experiments, we found a testing effect for both List 5 and for the final cumulative recall test. However, the effect did not interact with study modality, despite the fact that proactive interference was greater following auditory study. These results have important implications for educational practice, suggesting that initial testing is important for materials presented in auditory as well as visual formats.     

What are the shapes of response time distributions in visual search?

Many visual search experiments measure response time (RT) as their primary dependent variable. Analyses typically focus on mean (or median) RT. However, given enough data, the RT distribution can be a rich source of information. For this paper, we collected about 500 trials per cell per observer for both target-present and target-absent displays in each of three classic search tasks: feature search, with the target defined by color; conjunction search, with the target defined by both color and orientation; and spatial configuration search for a 2 among distractor 5s. This large data set allows us to characterize the RT distributions in detail. We present the raw RT distributions and fit several psychologically motivated functions (ex-Gaussian, ex-Wald, Gamma, and Weibull) to the data. We analyze and interpret parameter trends from these four functions within the context of theories of visual search.     

Does the mortality salience effect on worldview defence depend on the cultural orientation of Chinese people?

According to the terror management theory, people tend to favour their worldview and in-group members after being reminded of death (i.e., mortality salience [MS] effect). However, inconsistent findings of the MS effect were found among Chinese people. In the present study, we examined the MS effect with Chinese samples and tested whether the effect would depend on participants' cultural orientation and relational self-esteem. In Studies 1 (N = 227) and 2 (N = 221), we examined the roles of participants' cultural orientations and relational self-esteem in their evaluations on moral transgression and/or perceived regard from people around after being primed with mortality (vs. dental pain) salience. We obtained the interaction effects of mortality salience, cultural orientations, and relational self-esteem. The implications of these results are discussed in the context of Chinese culture.     

On the process of recognizing inverted words: Does it rely only on orientation-invariant cues?

Following a demonstration by Parks (1983) of failure to notice the reflection of a letter of an inverted word, two experiments were conducted to test a hypothesis about the process of recognizing inverted words that is termed here invariant cues only (ICO)-a letter-by-letter identification process based only on orientation-invariant letter features. In Experiment 1, subjects were presented with whole strings-words and nonwords, either upright or inverted-in which either all the letters were normal or one of the letters was reflected, and they were asked to make lexical decisions. In Experiment 2, subjects made a reflection judgment about an upright or inverted letter within a string immediately after they had been presented with the other, nonreflected string letters, again either upright or inverted. The results do not support the ICO hypothesis: Lexical decisions were greatly affected by the reflection of a letter in upright and inverted stimuli alike. Reflection judgments were considerably facilitated by word context in the upright and the inverted modes alike. The results are accommodated better by the notion that recognition of disoriented words requires some correction used to restore orientation-sensitive features.     

The combined effects of risk and time on choice: Does uncertainty eliminate the immediacy effect? Does delay eliminate the certainty effect?

Researchers have noted parallels between decisions under uncertainty and over time. Three experiments evaluated the theory that uncertainty and time affect choice via a common underlying dimension, such that delaying an outcome is equivalent to making it uncertain. To test this account we asked whether adding uncertainty to outcomes would eliminate the immediacy effect bias. We also asked whether adding time delay to outcomes would eliminate the certainty effect bias. The answer to both questions was yes, provided the prospects were presented singly rather than jointly. In single evaluation uncertainly eliminated the immediacy effect and delay eliminated one form of the certainty effect, while in joint evaluation, these effects did not occur. These findings suggest that at least in some contexts decision makers may equate risk and delay. Other explanations are possible, however, demonstrating that the interaction between risk and delay is complex and not easily understood.