Disentangling boundary extension and normalization of view memory for scenes

Boundary extension (BE) is a memory error for close-up views of scenes in which participants tend to remember a picture of a scene as depicting a more wide-angle view than what was actually displayed. However, some experiments have yielded data that indicate a normalized memory of the views depicted in a set of scenes, suggesting that memory for the previously studied scenes has become drawn toward the average view in the image set. In previous studies, normalization is only found when the retention interval is very long or when the stimuli no longer appear to represent a spatial expanse. In Experiment 1, we examine whether normalization can influence results for scenes depicting a partial view of space and when the memory test occurs immediately following the study block by manipulating the degree of difference between studied close-up and wide-angle scenes. In Experiment 2, normalization is induced in a set of scenes by creating conditions expected to lead to memory interference, suggesting that this may be the cause of view normalization. Based on the multi-source model of BE, these scenes should be extended during perception (Intraub, H. (2010). Rethinking scene perception: A multisource model. Psychology of Learning and Motivation, 52, 231–265). In Experiment 3, we show that BE is indeed observable if the same scenes are tested differently, supporting the notion that BE is primarily a perceptual phenomenon while normalization is a memory effect.     

Effect of contextual knowledge on spatial layout extrapolation

Boundary extension (BE) refers to the tendency to remember a previously perceived scene with a greater spatial expanse. This phenomenon is described as resulting from different sources of information: external (i.e., visual) and internally driven (i.e., amodal, conceptual, and contextual) information. Although the literature has emphasized the role of top-down expectations to account for layout extrapolation, their effect has rarely been tested experimentally. In this research, we attempted to determine how visual context affects BE, as a function of scene exposure duration (long, short). To induce knowledge about visual context, the memorization phase of the camera distance paradigm was preceded by a preexposure phase, during which each of the to-be-memorized scenes was presented in a larger spatial framework. In an initial experiment, we examined the effect of contextual knowledge with presentation duration, allowing for in-depth processing of visual information during encoding (i.e., 15 s). The results indicated that participants exposed to the preexposure showed decreased BE, and displayed no directional memory error in some conditions. Because the effect of context is known to occur at an early stage of scene perception, in a second experiment we sought to determine whether the effect of a preview occurs during the first fixation on a visual scene. The results indicated that BE seems not to be modulated by this factor at very brief presentation durations. These results are discussed in light of current visual scene representation theories.     

Does inversion affect boundary extension for briefly-presented views?

Inverting scenes interferes with visual perception and memory on many tasks. Might scene inversion eliminate boundary extension (BE) for briefly-presented photographs? In Experiment 1, an upright or inverted photograph (133, 258, or 383?ms) was followed by a 258 ms masked interval and a test photograph showing the identical view. Test photographs were rated as “same”, “closer”, or “farther away” (5-point scale). BE was just as great for inverted as upright views at the 133 and 383 ms durations, but surprisingly was greater for inverted views at the 258 ms duration. In Experiment 2, 258-ms views yielded greater BE when the study photographs were always tested in the opposite orientation, indicating that the difference in BE was related to encoding. Results suggest that scene construction beyond the view boundaries occurs rapidly and is not impeded by scene inversion, but that changes in the relative quality of visual details available for upright and inverted views may sometimes yield increased BE for inverted scenes.     

Seeking the boundary of boundary extension

Boundary extension (BE) is a remarkably consistent visual memory error in which participants remember seeing a more wide-angle image of a scene than was actually viewed (Intraub & Richardson, Journal of Experimental Psychology: Learning, Memory, and Cognition 15:179–187, 1989). Multiple stimulus factors are thought to contribute to the occurrence of BE, including object recognition, conceptual knowledge of scenes, and amodal perception at the view boundaries (Intraub, Wiley Interdisciplinary Reviews: Cognitive Science 3:117–127, 2012). In the present study, we used abstract scenes instead of images of the real world, in order to remove expectations based on semantic associations with objects and the schematic context of the view. Close-angle and wide-angle scenes were created using irregular geometric shapes rated by independent observers as lacking any easily recognizable structure. The abstract objects were tested on either a random-dot or a blank background in order to assess the influence of implied continuation of the image beyond its boundaries. The random-dot background conditions had background occlusion cues either present or absent at the image border, in order to test their influence on BE in the absence of high-level information about the scenes. The results indicate that high-level information about objects and schematic context is unnecessary for BE to occur, and that occlusion information at the image boundary also has little influence on BE. Contrary to previous studies, we also found clear BE for all conditions, despite using scenes depicting undetailed objects on a blank white background. The results highlighted the ubiquitous nature of BE and the adaptability of scene perception processes.     

Constraints on spatial extrapolation in the mental representation of scenes: View-boundaries vs. object-boundaries

Viewers remember seeing information from outside the boundaries of a scene (boundary extension; BE). To determine if view-boundaries have a special status in scene perception, we sought to determine if object-boundaries would yield the same effect. In Experiment 1 eight “bird's-eye view” photographs containing single object clusters (a smaller object on top of a larger one) were presented. After the presentation, participants reconstructed four scenes by selecting among five different-sized cutouts of each object. BE occurred between the view-boundaries and the object cluster, but not between the smaller object and the larger object's boundaries. There was no consistent effect of the larger object's boundaries. Experiment 2 replicated these results using a drawing task. BE does not occur whenever a border surrounds an object, it occurs when the border signifies the edge of the view. We propose the BE reflects anticipatory representation of scene structure that supports scene comprehension and view integration.     

Top-down attentional modulation of spatial frequency processing in scene perception

Recent evidence suggests that spatial frequency (SF) processing of simple and complex visual patterns is flexible. The use of spatial scale in scene perception seems to be influenced by people's expectations. However as yet there is no direct evidence for top-down attentional effects on flexible scale use in scene perception. In two experiments we provide such evidence. We presented participants with low- and high-pass SF filtered scenes and cued their attention to the relevant scale. In Experiment 1 we subsequently presented them with hybrid scenes (both low- and high-pass scenes present). We observed that participants reported detecting the cued component of hybrids. To explore if this might be due to decision biases, in Experiment 2, we replaced hybrids with images containing meaningful scenes at uncued SFs and noise at the cued SFs (invalid cueing). We found that participants performed poorly on invalid cueing trials. These findings are consistent with top-down attentional modulation of early spatial frequency processing in scene perception.     

Why does vantage point affect boundary extension?

To determine if layout affects boundary extension (BE; false memory beyond view boundaries; Intraub & Richardson, 1989), 12 single-object scenes were photographed from three vantage points: central (0°), shifted rightward (45°), and shifted leftward (45°). Size and position of main objects were held constant. Pictures were presented for 15 s each and were repeated at test with their boundaries: (a) displaced inward or outward (Experiment 1: N=120), or (b) identical to the stimulus views (Experiment 2: N=72). When participants adjusted test boundaries to match memory, BE always occurred, but tended to be smaller for 45° views. We propose this reflects the fact that more of the 3-D scene is visible in the 45° views. This suggests that scene representation reflects the 3-D world conveyed by the global characteristics of layout, rather than the 2-D distance between the main object and the boundaries of a picture.     

The role of context on boundary extension

Boundary extension (BE) is a memory error in which observers remember more of a scene than they actually viewed. This error reflects one’s prediction that a scene naturally continues and is driven by scene schema and contextual knowledge. In two separate experiments we investigated the necessity of context and scene schema in BE. In Experiment 1, observers viewed scenes that either contained semantically consistent or inconsistent objects as well as objects on white backgrounds. In both types of scenes and in the no-background condition there was a BE effect; critically, semantic inconsistency in scenes reduced the magnitude of BE. In Experiment 2 when we used abstract shapes instead of meaningful objects, there was no BE effect. We suggest that although scene schema is necessary to elicit BE, contextual consistency is not required.     

How does information from low and high spatial frequencies interact during scene categorization?

Current models of visual perception suggest that, during scene categorization, low spatial frequencies (LSF) are rapidly processed and activate plausible interpretations of visual input. This coarse analysis would be used to guide subsequent processing of high spatial frequencies (HSF). The present study aimed to further examine how information from LSF and HSF interact and influence each other during scene categorization. In a first experimental session, participants had to categorize LSF and HSF filtered scenes belonging to two different semantic categories (artificial vs. natural). In a second experimental session, we used hybrid scenes as stimuli made by combining LSF and HSF from two different scenes which were semantically similar or dissimilar. Half of the participants categorized LSF scenes in hybrids, and the other half categorized HSF scenes in hybrids. Stimuli were presented for 30 or 100?ms. Session 1 results showed better performance for LSF than HSF scene categorization. Session 2 scene categorization was faster when participants attended and categorized LSF than HSF scene in hybrids. The semantic interference of a semantically dissimilar HSF scene on LSF scene categorization was greater than the semantic interference of a semantically dissimilar LSF scene on HSF scene categorization, irrespective of exposure duration. These results suggest a LSF advantage for scene categorization, and highlight the prominent role of HSF information when there is uncertainty about the visual stimulus, in order to disentangle between alternative interpretations.     

Seeing the big picture: Broadening attention relieves sadness and depressed mood

We examined whether the broadened attentional scope would affect people's sad or depressed mood with two experiments, enlightened by the meaning of “seeing the big picture” and the broaden‐and‐build model. Experiment 1 (n = 164) is a laboratory‐based experiment, in which we manipulated the attentional scope by showing participants zoomed‐out or zoomed‐in scenes. In Experiment 2 (n = 44), we studied how depressed mood and positive and negative emotions were affected when participants watched distant versus proximal scenes for eight weeks in real life. Healthy participants in Experiment 1, who were induced to feel sad, could return to the baseline mood after having the broadened attention task but not after having the narrowed attention task, which indicated that immediate attention broadening manipulation could function as antidotes for the lingering effects of induced negative emotions. Participants with depressed mood in Experiment 2 showed reduced depressed mood, increased positive affect, and decreased negative affect after receiving attention broadening training compared to those receiving attention narrowing training. Our findings suggest a robust role of broadened attentional scope in relieving negative emotions and even mildly depressed mood in the long run.     

Surface construal and the mental representation of scenes

What distinguishes scenes from nonscenes? Photographs of objects on both naturalistic and blank backgrounds yielded boundary extension (BE: memory for unseen spatial expanse outside the picture's boundaries). However, line-drawn objects on blank backgrounds did not (Experiment 1). Perhaps the blank background was construed as depicting a real-world surface in the photograph condition but was construed as depicting nothing in the line-drawn condition. To change background construal, the authors used objects cut out of photographs; these were placed on blank backgrounds while viewers watched (Experiments 2 and 3). BE was eliminated. The authors propose that amodal continuation is a fundamental aspect of scene perception. However, not all pictures are scenes--only pictures construed as depicting a truncated view of a continuous world.     

Eye movements disrupt episodic future thinking

Remembering the past and imagining the future both rely on complex mental imagery. We considered the possibility that constructing a future scene might tap a component of mental imagery that is not as critical for remembering past scenes. Whereas visual imagery plays an important role in remembering the past, we predicted that spatial imagery plays a crucial role in imagining the future. For the purpose of teasing apart the different components underpinning scene construction in the two experiences of recalling episodic memories and shaping novel future events, we used a paradigm that might selectively affect one of these components (i.e., the spatial). Participants performed concurrent eye movements while remembering the past and imagining the future. These concurrent eye movements selectively interfere with spatial imagery, while sparing visual imagery. Eye movements prevented participants from imagining complex and detailed future scenes, but had no comparable effect on the recollection of past scenes. Similarities between remembering the past and imagining the future are coupled with some differences. The present findings uncover another fundamental divergence between the two processes.     

Nonblurred regions show priority for gaze direction over spatial blur

The human eye continuously forms images of our 3D environment using a finite and dynamically changing depth of focus. Since different objects in our environment reside at different depth planes, the resulting retinal images consist of both focused and spatially blurred objects concurrently. Here, we wanted to measure what effect such a mixed visual diet may have on the pattern of eye movements. For that, we have constructed composite stimuli, each containing an intact photograph and several progressively blurred versions of it, all arranged in a 3?×?3 square array and presented simultaneously as a single image. We have measured eye movements for 7 such composite stimuli as well as for their corresponding root mean square (RMS) contrast-equated versions to control for any potential contrast variations as a result of the blurring. We have found that when observers are presented with such arrays of blurred and nonblurred images they fixate significantly more frequently on the stimulus regions that had little or no blur at all (p?<?.001). A similar pattern of fixations was found for the RMS contrast-equated versions of the stimuli indicating that the observed distributions of fixations is not simply the result of variations in image contrasts due to spatial blurring. Further analysis revealed that, during each 5 second presentation, the image regions containing little or no spatial blur were fixated first while other regions with larger amounts of blur were fixated later, if fixated at all. The results contribute to the increasing list of stimulus parameters that affect patterns of eye movements during scene perception.     

Spatial frequency filtering and the direct control of fixation durations during scene viewing

The present study employed a saccade-contingent change paradigm to investigate the effect of spatial frequency filtering on fixation durations during scene viewing. Subjects viewed grayscale scenes while encoding them for a later memory test. During randomly chosen saccades, the scene was replaced with an alternate version that remained throughout the critical fixation that followed. In Experiment 1, during the critical fixation, the scene could be changed to high-pass and low-pass spatial frequency filtered versions. Under both conditions, fixation durations increased, and the low-pass condition produced a greater effect than the high-pass condition. In subsequent experiments, we manipulated the familiarity of scene information during the critical fixation by flipping the filtered scenes upside down or horizontally. Under these conditions, we observed lengthening of fixation durations but no difference between the high-pass and low-pass conditions, suggesting that the filtering effect is related to the mismatch between information extracted within the critical fixation and the ongoing scene representation in memory. We also conducted control experiments that tested the effect of changes to scene orientation (Experiment 2a) and the addition of color to a grayscale scene (Experiment 2b). Fixation distribution analysis suggested two effects on the distribution fixation durations: a fast-acting effect that was sensitive to all transsaccadic changes tested and a later effect in the tail of the distribution that was likely tied to the processing of scene information. These findings are discussed in the context of theories of oculomotor control during scene viewing.     

Confinement has no effect on visual space perception: The results of the Mars-500 experiment

People confined to a closed space live in a visual environment that differs from a natural open-space environment in several respects. The view is restricted to no more than a few meters, and nearby objects cannot be perceived relative to the position of a horizon. Thus, one might expect to find changes in visual space perception as a consequence of the prolonged experience of confinement. The subjects in our experimental study were participants of the Mars-500 project and spent nearly a year and a half isolated from the outside world during a simulated mission to Mars. The participants were presented with a battery of computer-based psychophysical tests examining their performance on various 3-D perception tasks, and we monitored changes in their perceptual performance throughout their confinement. Contrary to our expectations, no serious effect of the confinement on the crewmembers’ 3-D perception was observed in any experiment. Several interpretations of these findings are discussed, including the possibilities that (1) the crewmembers’ 3-D perception really did not change significantly, (2) changes in 3-D perception were manifested in the precision rather than the accuracy of perceptual judgments, and/or (3) the experimental conditions and the group sample were problematic.     

Spatial affect learning restricted in major depression relative to anxiety disorders and healthy controls

Detecting and learning the location of unpleasant or pleasant scenarios, or spatial affect learning, is an essential skill that safeguards well-being (Crawford & Cacioppo, 2002). Potentially altered by psychiatric illness, this skill has yet to be measured in adults with and without major depressive disorder (MDD) and anxiety disorders (AD). This study enrolled 199 adults diagnosed with MDD and AD (n=53), MDD (n=47), AD (n=54), and no disorders (n=45). Measures included clinical interviews, self-reports, and a validated spatial affect task using affective pictures (IAPS; Lang, Bradley, & Cuthbert, 2005). Participants with MDD showed impaired spatial affect learning of negative stimuli and irrelevant learning of pleasant pictures compared with non-depressed adults. Adults with MDD may use a “GOOD is UP” heuristic reflected by their impaired learning of the opposite correlation (i.e., “BAD is UP”) and performance in the pleasant version of the task.     

Does solving distant analogies facilitate relational integration?

Relational processing underpins many forms of human thinking. This research addressed whether relational integration in the n-term task (linear syllogisms with three and four premises) can be facilitated. We hypothesised that solving distant analogies (e.g. furnace : coal :: stomach : ______) but not near analogies (e.g. furnace : coal :: woodstove :______) would facilitate n-term performance of undergraduates (N?=?120). Participants generated solutions to near analogies (near condition), to distant analogies (distant condition) while participants in the control condition completed a word rating task. Participants then completed the n-term task with items at two levels of complexity (ternary, quaternary), and a fluid intelligence test. Solving distant analogies facilitated relational integration on the more complex quaternary-relational items. It eliminated the complexity effect in the n-term task and the association between quaternary-relational reasoning and fluid intelligence.     

Representation and perception of scenic layout

This paper presents a cognitive approach to on-line spatial perception within scenes. A theoretical framework is developed, based on the idea that experience with a scene can activate a complex representation of layout that facilitates subsequent processing of spatial relations within the scene. The representations integrate significant, relevant scenic information and are substantial in amount or extent. The representations are active across short periods of time and across changes in the retinal position of the image. These claims were supported in a series of experiments in which pictures of scenes (primes) facilitated subsequent spatial relations processing within the scenes. The prime-induced representations integrated object identity and layout, were broad in scope, involved both foreground and background information, and were effective across changes in image position.     

Safety behaviors were associated with greater anxious symptoms during the first year of the COVID-19 pandemic

Research shows that people who use safety behaviors are at greater risk factor for anxiety than people who do not use safety behaviors. However, the perception of some safety behaviors changed during the COVID-19 pandemic; behaviors that were once considered unnecessary or excessive were now commonplace (e.g., monitoring bodily symptoms, avoiding crowds). The purpose of this study was to determine the degree to which the pandemic changed the status of health-related safety behaviors as a risk factor for symptoms of anxiety. To this end, we tested the effect of safety behavior use on anxious symptoms during the first year of the pandemic using a longitudinal design with 8 time points and participants (n = 233) from over 20 countries. Despite possible changes in their perception, those engaging in high levels of safety behaviors reported the greatest levels of anxious symptoms throughout the pandemic year. However, the outcomes for safety behavior users were not all negative. Safety behavior use at baseline was the only predictor of participants' willingness to receive the COVID-19 vaccine (measured one year later).     

The effect of psychological distance on perceptual level of construal

Three studies examined the effect of primed psychological distance on level of perceptual construal, using Navon's paradigm of composite letters (global letters that are made of local letters). Relative to a control group, thinking of the more distant future (Study 1), about more distant spatial locations (Study 2), and about more distant social relations (Study 3) facilitated perception of global letters relative to local letters. Proximal times, spatial locations, and social relations had the opposite effect. The results are discussed within the framework of Construal Level Theory of psychological distance ( Liberman & Trope, 2008 ; Trope & Liberman, 2003 ).