Mapping the similarity space of paintings: Image statistics and visual perception

What makes two images look similar? Here we test the hypothesis that perceived similarity of artwork is related to basic image statistics to which the early visual system is attuned. In two experiments, we employ multidimensional scaling (MDS) analysis of paired-image similarity ratings from observers for paintings. Two sets of images, classified as “landscapes” and “portraits/still-life”, are tested separately. For the landscapes, we find that one of the first two MDS scales of similarity is strongly correlated with a basic greyscale image statistic, whereas the other dimension can be accounted for by a semantic variable (representation of people). For portrait/still-life, the first two MDS scales of similarity are most highly correlated with semantic variables. Linear combinations of statistical and nonstatistical features achieve improved predictive values for the first two MDS scales for both sets. The statistics that play the largest role in shaping similarity judgements in our tests are the activity fraction measure of sparseness and the log-log slope of the spatial frequency amplitude spectrum. We discuss these results in the context of scene perception and in terms of efficient coding of statistical regularities in scenes.     

Shadworth Hodgson and William James's formulation of space perception: Phenomenology and perceptual realism

This paper has two related goals. First, it seeks to show that the theory of perception found in William James's Principles of Psychology is thoroughly consistent if it is approached through the framework of perceptual realism versus constructionism rather than the nativism versus empiricism debate. As such, this paper offers an alternative to Nicholas Pastore's claim that there are two contradictory theories of perception in the Principles. James's commitment to perceptual realism is articulated within the contexts of his (1) critique of constructionist perception theories, (2) notion of the spatial quale, and (3) formulation of the role of knowledge in adult perception. The second goal of this paper deals with the historical development of James's perceptual realism. Here it is argued that Shadworth Hodgson's method of reflection–an anticipation of Husserl's phenomenological reduction–served as the basis of James's commitment to perceptual realism.     

On the nature of perceptual information during letter perception

Letter perception has been traditionally viewed as a process in which individual features are accumulated over time. In order to test this notion, a special stimulus set was created having little or no featural redundancy. Using a masking paradigm, confusion matrices were generated at each of eight interstimulus intervals. Few, if any, of the predictions made by the feature accumulation models were upheld. Instead, it is suggested that letter perception is better thought of as a global-to-local process. When a letter is presented, an observer initially perceives a large array of perceptual data. Over time, a clearer view of the stimulus emerges as the perceptual system brings the letter into focus. Thus, global information about the letter is available quite early in processing, while the letter’s more local aspects become available only after relatively extensive perceptual processing.     

Emergent features, attention, and perceptual glue in visual form perception

We examined the grouping of line segments into unitary shapes and attempted to identify procedures to diagnose when such grouping is taking place. Previous research has indicated that attentional measures may diagnose grouping: With grouped parts, selective attention to individual parts is difficult and divided attention across parts is easy, whereas with ungrouped parts selective attention is easy and divided attention is difficult. This result suggests that grouping operates via a perceptual glue binding parts into wholes that are difficult or impossible to divide. Other studies have suggested in addition that grouped parts produce emergent features, possibly including symmetry and closure, that make possible configural superiority effects, where whole shapes are more discriminable than are their distinguishing contours shown in isolation. The 13 experiments reported here indicate that perceptual glue is not needed to explain known findings about grouping, a claim that agrees with conclusions by other investigators using other criteria. Rather, emergent features alone may suffice to explain grouping, provided that reliable and accurate diagnostic criteria can be identified. It is shown that the diagnostics now available are not fully adequate for this purpose. Surprisingly, it appears that some prime candidates for emergent features--namely, closure and line terminators--may not be of central importance to form perception.     

The perceptual root of object-based storage: an interactive model of perception and visual working memory

Mainstream theories of visual perception assume that visual working memory (VWM) is critical for integrating online perceptual information and constructing coherent visual experiences in changing environments. Given the dynamic interaction between online perception and VWM, we propose that how visual information is processed during visual perception can directly determine how the information is going to be selected, consolidated, and maintained in VWM. We demonstrate the validity of this hypothesis by investigating what kinds of perceptual information can be stored as integrated objects in VWM. Three criteria for object-based storage are introduced: (a) automatic selection of task-irrelevant features, (b) synchronous consolidation of multiple features, and (c) stable maintenance of feature conjunctions. The results show that the outputs of parallel perception meet all three criteria, as opposed to the outputs of serial attentive processing, which fail all three criteria. These results indicate that (a) perception and VWM are not two sequential processes, but are dynamically intertwined; (b) there are dissociated mechanisms in VWM for storing information identified at different stages of perception; and (c) the integrated object representations in VWM originate from the "preattentive" or "proto" objects created by parallel perception. These results suggest how visual perception, attention, and VWM can be explained by a unified framework.     

Picture perception: An analysis of visual compensation

Although geometric information is altered when a picture’s viewing point is changed, such changes often do not affect perception. Two experiments assessed pictorial perception relative to the distortions introduced by viewing point dislocation. Results provide a psychophysical demonstration of pictorial compensation and suggest that it is based on the discrepancy between the actual and an assumed-correct viewing position. An explanation of pictorial compensation is offered that could be applied to direct picture perception and to picture-in-a-picture perception.     

On the relationship between visual imagery and visual perception: Evidence from priming studies

Two priming experiments using a perceptual identification task were conducted to explore the functional and representational overlap between visual imagery and visual perception. The first experiment included a study phase in which primes were either perceived or imaged objects and a perceptual identification test task in which targets were parts of studied and non-studied objects. Imagery primed identification when subjects were instructed to count the parts of the imaged objects in the study phase but not when they were instructed to focus on the global shape of the imaged objects. This result suggests that imagery involves perceptual representations identical to those involved in perception. It also suggests that the representational overlap between imagery and perception depends on the type of images generated, as some images may consist in global shapes only, whereas others may consist in detailed, multi-part shapes. In the second experiment, we used whole objects as target stimuli which provided subjects with more information to identify masked targets and thereby reduced top-down processing. Priming from imagery fell beneath significance, suggesting that this sort of priming is elicited in a large part by a transfer of top-down processes from study to test.     

The influence of visual flow and perceptual load on locomotion speed

Visual flow is used to perceive and regulate movement speed during locomotion. We assessed the extent to which variation in flow from the ground plane, arising from static visual textures, influences locomotion speed under conditions of concurrent perceptual load. In two experiments, participants walked over a 12-m projected walkway that consisted of stripes that were oriented orthogonal to the walking direction. In the critical conditions, the frequency of the stripes increased or decreased. We observed small, but consistent effects on walking speed, so that participants were walking slower when the frequency increased compared to when the frequency decreased. This basic effect suggests that participants interpreted the change in visual flow in these conditions as at least partly due to a change in their own movement speed, and counteracted such a change by speeding up or slowing down. Critically, these effects were magnified under conditions of low perceptual load and a locus of attention near the ground plane. Our findings suggest that the contribution of vision in the control of ongoing locomotion is relatively fluid and dependent on ongoing perceptual (and perhaps more generally cognitive) task demands.     

Longitudinal study of perception of structured optic flow and random visual motion in infants using high‐density EEG

Electroencephalogram (EEG) was used in infants at 3–4 months and 11–12 months to longitudinally study brain electrical activity as the infants were exposed to structured forwards and reversed optic flow, and non‐structured random visual motion. Analyses of visual evoked potential (VEP) and temporal spectral evolution (TSE, time‐dependent amplitude changes) were performed on EEG data recorded with a 128‐channel sensor array. VEP results showed infants to significantly differentiate between the radial motion conditions, but only at 11–12 months where they showed shortest latency for forwards optic flow and longest latency for random visual motion. When the TSE results of the motion conditions were compared with those of a static non‐flow dot pattern, infants at 3–4 and 11–12 months both showed significant differences in induced activity. A decrease in amplitudes at 5–7 Hz was observed as desynchronized theta‐band activity at both 3–4 and 11–12 months, while an increase in amplitudes at 9–13 Hz was observed as synchronized alpha‐band activity only at 11–12 months. It was concluded that brain electrical activities related to visual motion perception change during the first year of life, and these changes can be observed both in the VEP and induced activities of EEG. With adequate neurobiological development and locomotor experience infants around 1 year of age rely, more so than when they were younger, on structured optic flow and show a more adult‐like specialization for motion where faster oscillating cell assemblies have fewer but more specialized neurons, resulting in improved visual motion perception.     

Spatial orientation from optic flow in the central visual field

Previous research has shown that stimulation of the central visual field with radial flow patterns (produced by forward motion) can induce perceived self-motion, but has failed to demonstrate effects on postural stability of either radial flow patterns or lamellar flow patterns (produced by horizontal translation) in the central visual field. The present study examined the effects of lamellar and radial flow on postural stability when stimulation was restricted to the central visual field. Displays simulating observer motion through a volume of randomly positioned points were observed binocularly through a window that limited the field of view to 15 degrees. The velocity of each display varied according to the sum of four sine functions of prime frequencies. Changes in posture were used to measure changes in perceived spatial orientation. A frequency analysis of postural sway indicated that increased sway occurred at the frequencies of motion simulated in the display for both lamellar and radial flow. These results suggest that both radial and lamellar optic flow are effective for determining spatial orientation when stimulation is limited to the central visual field.     

Body ownership affects visual perception of object size by rescaling the visual representation of external space

Size perception is most often explained by a combination of cues derived from the visual system. However, this traditional cue approach neglects the role of the observer’s body beyond mere visual comparison. In a previous study, we used a full-body illusion to show that objects appear larger and farther away when participants experience a small artificial body as their own and that objects appear smaller and closer when they assume ownership of a large artificial body (“Barbie-doll illusion”; van der Hoort, Guterstam, & Ehrsson, PLoS ONE, 6(5), e20195, 2011). The first aim of the present study was to test the hypothesis that this own-body-size effect is distinct from the role of the seen body as a direct familiar-size cue. To this end, we developed a novel setup that allowed for occlusion of the artificial body during the presentation of test objects. Our results demonstrate that the feeling of ownership of an artificial body can alter the perceived sizes of objects without the need for a visible body. Second, we demonstrate that fixation shifts do not contribute to the own-body-size effect. Third, we show that the effect exists in both peri-personal space and distant extra-personal space. Finally, through a meta-analysis, we demonstrate that the own-body-size effect is independent of and adds to the classical visual familiar-size cue effect. Our results suggest that, by changing body size, the entire spatial layout rescales and new objects are now perceived according to this rescaling, without the need to see the body.     

The role of direction information in the perception of geometric optic flow components

Theoretically, optic flow, an important source of information for the perception of locomotion and three-dimensional structure of the environment, is described in terms of divergence, curl, and shear components. We measured how the detection of the type of flow field depends on directional information. We manipulated the local directions by rotating them through an angle x relative to the original direction (i.e., the direction of motion at that locus in an unaltered flow field). The results of the first experiments showed that divergence, curl, and shear can be detected even if the directional range of the individual motion vectors is as broad as 180 degrees. Subsequent experiments revealed that the detection of the geometric components of the optic flow field is merely based on the integration of a few (10% of vectors) local directions correctly (within 10 degrees of original direction) specifying the type of flow field. Other directions are irrelevant to this process. This is actually what one would expect if the optic flow is analyzed by special purpose mechanisms that detect and process the geometric components on the basis of the integration of motion information. The results indicate that as far as they integrate motion information, detectors for divergence, curl, and shear operate in a similar manner. Implications of the results for modeling such mechanisms are discussed.