Measurement and modelling of perceived slant in surfaces represented by freely viewed line drawings

Simple pictures under everyday viewing conditions evoke impressions of surfaces oriented in depth. These impressions have been studied by measuring the slants of perceived surfaces, with probes (rotating arrowheads) designed to respect the distinctive character of depicted scenes. Converging arguments indicated that the perceived orientation of the probes was near theoretical values. A series of experiments showed that subjects formed well-defined impressions of depicted surface orientation. The literature suggests that perceived objects might be 'flattened', but that was not the general rule. Instead, both mean slant and uncertainty fitted models in which slant estimates are derived in a relatively straightforward way from local relations in the picture. Simplifying pictures tended to make orientation estimates less certain, particularly away from the natural anchor points (vertical and horizontal). The shape of the object affected all aspects of the observed-object/percept relationship. Individual differences were large, and suggest that different individuals used different relationships as a basis for their estimates. Overall, data suggest that everyday picture perception is strongly selective and weakly integrative. In particular, depicted slant is estimated by finding a picture feature which will be strongly related to it if the object contains a particular regularity, not by additive integration of evidence from multiple directly and indirectly relevant sources.     

Recognizing a plane-misoriented view of a familiar object is not influenced by the ease of specifying the main axis of elongation of that object

Participants saw three versions of pictures of familiar objects: the original unaltered (axis-normal) pictures, axis-extended pictures in which the main axes of the axis-normal pictures were elongated, and axis-switched pictures in which objects that were originally horizontally elongated were depicted as vertically elongated and vice versa. Relative to axis-normal pictures, axis extension aided decisions about whether the picture of the object was wide or tall, and axis switching hindered these decisions for both upright and plane-misoriented views. Nevertheless, although these axis manipulations clearly influenced decisions about the location of the object's main axis of elongation, axis-switched pictures were no harder to name than axis-extended pictures. Changing the depicted main axis of elongation by axis switching and axis extension did not influence object recognition in itself, whether for upright or for plane-misoriented views. This suggests that specifying the main axis of elongation of an object does not play an important role in the orientation-sensitive processes involved in identifying plane-misoriented views of that object.     

Episodic encoding and recognition of pictures and words: role of the human medial temporal lobes

In the present PET study, we examined brain activity related to processing of pictures and printed words in episodic memory. Our goal was to determine how the perceptual format of objects (verbal versus pictorial) is reflected in the neural organization of episodic memory for common objects. We investigated this issue in relation to encoding and recognition with a particular focus on medial temporal-lobe (MTL) structures. At encoding, participants saw pictures of objects or their written names and were asked to make semantic judgments. At recognition, participants made yes-no recognition judgments in four different conditions. In two conditions, target items were pictures of objects; these objects had originally been encoded either in picture or in word format. In two other conditions, target items were words; they also denoted objects originally encoded either as pictures or as words. Our data show that right MTL structures are differentially involved in picture processing during encoding and recognition. A posterior MTL region showed higher activation in response to the presentation of pictures than of words across all conditions. During encoding, this region may be involved in setting up a representation of the perceptual information that comprises the picture. At recognition, it may play a role in guiding retrieval processes based on the perceptual input, i.e. the retrieval cue. Another more anterior right MTL region was found to be differentially involved in recognition of objects that had been encoded as pictures, irrespective of whether the retrieval cue provided was pictorial or verbal in nature; this region may be involved in accessing stored pictorial representations. Our results suggest that left MTL structures contribute to picture processing only during encoding. Some regions in the left MTL showed an involvement in semantic encoding that was picture specific; others showed a task-specific involvement across pictures and words. Together, our results provide evidence that the involvement of some but not all MTL regions in episodic encoding and recognition is format specific.     

The effects of interference on recognition of haptic pictures in blindfolded sighted participants: the modality of representation of haptic information

Haptic picture recognition was tested in 36 undergraduate students to determine whether haptic representations are visual or multi-modal. Participants explored target haptic pictures and were asked to recognize the target from three alternatives. Each participant completed eight control and eight interference trials in visual, lexical and tactile recognition modalities. For interference, participants were assigned to either an articulatory suppression (repeat "the" at a constant rate) or a visual interference (watch a visual display) condition, to prevent recoding into a verbal or visual code. The results showed that accuracy was higher at control compared to interference trials and for tactile compared to lexical recognition. Additionally, lexical and tactile recognition decreased with articulatory suppression whereas only tactile recognition decreased with visual interference. These findings suggest that haptic pictures may be represented by coordinating visual and verbal codes.     

The origins of pictorial competence

Pictorial competence , which refers to the many factors involved in perceiving, interpreting, understanding, and using pictures, develops gradually over the first few years of life. Although experience is not required for accurate perception of pictures, it is necessary for understanding the nature of pictures. Infants initially respond to depicted objects as if they were real objects, and toddlers are remarkably insensitive to picture orientation. Only gradually do young children figure out the nature of pictures and how they are used.     

Toddlers’ referential understanding of pictures

Pictures are referential in that they can represent objects in the real world. Here we explore the emergence of understanding of the referential potential of pictures during the second year of life. In Study 1, 15-, 18-, and 24-month-olds learned a word for a picture of a novel object (e.g., “blicket”) in the context of a picture book interaction. Later they were presented with the picture of a blicket along with the real object it depicted and asked to indicate the blicket. Many of the 24-, 18-, and even 15-month-olds indicated the real object as an instance of a blicket, consistent with an understanding of the referential relation between pictures and objects. In Study 2, children were tested with an exemplar object that differed in color from the depicted object to determine whether they would extend the label they had learned for the depicted object to a slightly different category member. The 15-, 18-, and 24-month-old participants failed to make a consistent referential response. The results are discussed in terms of whether pictorial understanding at this age is associative or symbolic.     

Face recognition in pictures is affected by perspective transformation but not by the centre of projection

Recognition of unfamiliar faces is susceptible to image differences caused by angular sizes subtended from the face to the camera. Research on perception of cubes suggests that apparent distortions of a shape due to large camera angle are correctable by placing the observer at the centre of projection, especially when visibility of the picture surface is low (Yang and Kubovy, 1999 Perception & Psychophysics 61 456-467). To explore the implication of this finding for face perception, observers performed recognition and matching tasks where face images with reduced visibility of picture surface were shown with observers either at the centre of projection or at other viewpoints. The results show that, unlike perception of cubes, the effect of perspective transformation on face recognition is largely unaffected by the centre of projection. Furthermore, the use of perspective cues is not affected by textured surfaces. The limitation of perspective in restoring 3-D information of faces suggests a stronger role for image-based, rather than model-based, processes in recognition of unfamiliar faces.     

Recognition of Concrete and abstract Pictures as a Function of Poststimulus Interval

This study examined picture recognition of concrete common objects and abstract random shapes under two presentation conditions: The durations of the unfilled intervals (off-time duration) that followed the presentation of the pictures were varied either randomly or in blocks. The major findings were: (a) recognition of the concrete pictures was better than recognition of random shapes, (b) the off-time duration did not influence recognition of either type of picture under the random presentation condition, and (c) under the block presentation condition, recognition of the concrete pictures increased as a function of off-time duration, whereas the effect of off-time duration was not found for the abstract shapes. The results were interpreted as suggesting that a longer off-time duration is necessary for abstract shapes so that stimulus differentiation, verbal encoding, visual analogizing, and rehearsing may be utilized in processing.     

Grasping the Nature of Pictures

The role of experience in the development of pictorial competence has been the center of substantial debate. The four studies presented here help resolve the controversy by systematically documenting and examining manual exploration of depicted objects by infants. We report that 9-month-old infants manually investigate pictures, touching and feeling depicted objects as if they were real objects and even trying to pick them up off the page. The same behavior was observed in babies from two extremely different societies (the United States and the Ivory Coast). This investigation of pictures occurs even though infants can discriminate between real objects and their depictions. By the time infants are 19 months of age, their manual exploration is replaced by pointing at depicted objects. These results indicate that initial uncertainty about the nature of pictures leads infants to investigate them. Through experience, infants begin to acquire a concept of "picture." This concept includes the fact that a picture has a dual nature (it is both an object and a representation of something other than itself), as well as knowledge about the culturally appropriate use of pictures.     

Perceiving pictures

I aim to give a new account of picture perception: of the way our visual system functions when we see something in a picture. My argument relies on the functional distinction between the ventral and dorsal visual subsystems. I propose that it is constitutive of picture perception that our ventral subsystem attributes properties to the depicted scene, whereas our dorsal subsystem attributes properties to the picture surface. This duality elucidates Richard Wollheim’s concept of the “twofoldness” of our experience of pictures: the “visual awareness not only of what is represented but also of the surface qualities of the representation.” I argue for the following four claims: (a) the depicted scene is represented by ventral perception, (b) the depicted scene is not represented by dorsal perception, (c) the picture surface is represented by dorsal perception, and (d) the picture surface is not necessarily represented by ventral perception.     

Influencesicture context on object recognition

The effect of sorrounding context on the recognition of objects from briefly presented pictures was investigated. Forty-eight undergraduates saw 100 msec displays of either line drawings containing several objects embedded in context or drawings of object arrays without background context. Following each exposure they were required to select from among four objects the one that had been contained in the picture. Presentation of objects in context aided recognition only when incorrect response alternatives were inconsistent with the picture context. The results suggest that context contributes to the construction of a general characterization of the pictures which provides expectancies regarding the identity of specific objects.     

Recognition of concrete and abstract pictures as a function of poststimulus interval

This study examined picture recognition of concrete common objects and abstract random shapes under two presentation conditions: The durations of the unfilled intervals (off-time duration) that followed the presentation of the pictures were varied either randomly or in blocks. The major findings were: recognition of the concrete pictures was better than recognition of random shapes, the off-time duration did not influence recognition of either type of picture under the random presentation condition, and under the block presentation condition, recognition of the concrete pictures increased as a function of off-time duration, whereas the effect of off-time duration was not found for the abstract shapes. The results were interpreted as suggesting that a longer off-time duration is necessary for abstract shapes so that stimulus differentiation, verbal encoding, visual analogizing, and rehearsing may be utilized in processing.     

Perception of pictorial depth cues by pigeons

Pigeons were trained to discriminate pictures of intact objects from pictures of objects in which both depth from shading and depth from perspective cues were manipulated. Depth from shading was manipulated either by scrambling or by removing three-dimensional shading cues. Depth from perspective was manipulated either by presenting pictures of objects with a two-dimensional outline (i.e., a square) or with a three-dimensional outline (i.e., a cube). Transfer tests with novel images suggest that pigeons perceive and utilize both types of pictorial depth cues. The implications of these results for our understanding of picture perception in pigeons are discussed.     

PIGEONS ARE SENSITIVE TO THE SPATIAL ORGANIZATION OF COMPLEX VISUAL STIMULI

Abstract— Two experiments investigated the role of spatial organisation in the discrimination and generalization of complex visual stimuli by pigeons. In Experiment 1, after pigeons had been trained to discriminate line drawings of four objects, they were tested with novel pictures in which the same component parts of the objects were spatially rearranged. The spatially scrambled pictures led to a dramatic drop in recognition accuracy, hut responding remained above chance. In Experiment 2, pigeons reached a high level of discriminative performance when required to choose among four different spatial arrangements of the same object parts. These results confirm Cerella's (1980) conclusion that pigeons discriminate the component parts of complex visual stimuli, but. unless it is assumed that the scrambling deleted or created emergent features, the results disconfirm his conclusion that spatial organization plays no role in pigeons' picture perception.     

Dissociating positive and negative influences of verbal processing on the recognition of pictures of faces and objects

Four experiments investigated the role of verbal processing in the recognition of pictures of faces and objects. We used (a) a stimulus-encoding task where participants learned sequentially presented pictures in control, articulatory suppression, and describe conditions and then engaged in an old-new picture recognition test and (b) a poststimulus-encoding task where participants learned the stimuli without any secondary task and then either described or not a single item from memory before the recognition test. The main findings were as follows: First, verbalization influenced picture recognition. Second, there were contrasting influences of verbalization on the recognition of faces, compared with objects, that were driven by (a) the stage of processing during which verbalization took place (as assessed by the stimulus-encoding and poststimulus-encoding tasks), (b) whether verbalization was subvocal (whereby one goes through the motions of speaking but without making any sound) or overt, and (c) stimulus familiarity. During stimulus encoding there was a double dissociation whereby subvocal verbalization interfered with the recognition of faces but not objects, while overt verbalization benefited the recognition of objects but not faces. In addition, stimulus familiarity provided an independent and beneficial influence on performance. Post stimulus encoding, overt verbalization interfered with the recognition of both faces and objects, and this interference was apparent for unfamiliar but not familiar stimuli. Together these findings extend work on verbalization to picture recognition and place important parameters on stimulus and task constraints that contribute to contrasting beneficial and detrimental effects of verbalization on recognition memory.     

Picture and pattern perception in the sighted and the blind: the advantage of the late blind

Two experiments are reported on the contribution of visual experience to tactile perception. In the first experiment, sighted, congenitally blind, and late blind individuals made tactual matches to tangible embossed shapes. In the second experiment, the same subjects attempted tactile identification of raised-line drawings. The three groups did not differ in the accuracy of shape matching, but both groups of blind subjects were much faster than the sighted. Late blind observers were far better than the sighted or congenitally blind at tactile picture identification. Four of the twelve pictures were correctly identified by most of the late blind subjects. The sighted and congenitally blind performed at comparable levels in picture naming. There was no evidence that visual experience alone aided the sighted in the tactile task under investigation, since they performed no better than did the early blind. The superiority of the late blind suggests that visual exposure to drawings and the rules of pictorial representation may help tactile picture identification when combined with a history of tactual experience.     

Effects of semantic priming on visual encoding of pictures

We investigated the effects of semantic priming on initial encoding of briefly presented pictures of objects and scenes. Pictures in four experiments were presented for varying durations and were followed immediately by a mask. In Experiments 1 and 2, pictures of simple objects were either preceded or not preceded by the object's category name (e.g., dog). In Experiment 1 we measured immediate object identification; in Experiment 2 we measured delayed old/new recognition in which targets and distractors were from the same categories. In Experiment 3 naturalistic scenes were either preceded or not preceded by the scene's category name (e.g., supermarket). We measured delayed recognition in which targets and distractors were described by the same category names. In Experiments 1-3, performance was better for primed than for unprimed pictures. Experiment 4 was similar to Experiment 2 in that we measured delayed recognition for simple objects. As in Experiments 1-3, a prime that preceded the object improved subsequent memory performance for the object. However, a prime that followed the object did not affect subsequent performance. Together, these results imply that priming leads to more efficient information acquisition. We offer a picture-processing model that accounts for these results. The model's central assumption is that knowledge of a picture's category (gist) increases the rate at which visual information is acquired from the picture.     

Very young children are insensitive to picture- but not object-orientation

In two experiments on very young children's response to the orientation of pictures and objects, 18-, 24- and 30-month-old children showed no preference for upright pictures over inverted ones. More importantly, we found that children in all three age groups were equally accurate and equally fast at identifying depicted objects regardless of orientation. These studies further established that young children's insensitivity to picture orientation does not extend to objects. These results, in combination with the earlier ones, indicate that only gradually do young children come to share the picture orientation preference of adults and older children and that their adoption of the orientation convention is not based on changes in their ability to process upright and inverted images.     

Categorizing chairs and naming pears: Category differences in object processing as a function of task and priming

Four experiments are reported examining the locus of structural similarity effects in picture recognition and naming with normal subjects. Subjects carried out superordinate categorization and naming tasks with picture and word forms of clothing, furniture, fruit, and vegetable exemplars. The main findings were as follows: (1) Responses to pictures of fruit and vegetables (\ldstructurally similar\rd objects) were slowed relative to pictures of clothing and furniture (\ldstructurally dissimilar\rd objects). This structural similarity difference was greater for picture naming than for superordinate categorization of pictures. (2) Structural similarity effects in picture naming were reduced by repetition priming. Repetition priming effects were equivalent from picture and word naming as prime tasks. (3) However, superordinate categorization of the prime did not produce the structural similarity effects on priming found for picture naming. Furthermore, such priming effects did not arise for picture or word categorization or for reading picture names as target tasks. It is proposed that structural similarity effects on priming object processing are located in processes mapping semantic representations of pictures to name representations required to select names for objects. Visually based competition between fruit and vegetables produces competition in name selection, which is reduced by priming the mappings between semantic and name representations.     

Enhanced recognition of memorable pictures in ultra-fast RSVP

Long-term recognition memory for some pictures is consistently better than for others (Isola, Xiao, Parikh, Torralba, & Oliva, IEEE Transaction on Pattern Analysis and Machine Intelligence (PAMI), 36(7), 1469–1482, 2014). Here, we investigated whether pictures found to be memorable in a long-term memory test are also perceived more easily when presented in ultra-rapid RSVP. Participants viewed 6 pictures they had never seen before that were presented for 13 to 360 ms per picture in a rapid serial visual presentation (RSVP) sequence. In half the trials, one of the pictures was a memorable or a nonmemorable picture and perception of this picture was probed by a visual recognition test at the end of the sequence. Recognition for pictures from the memorable set was higher than for those from the nonmemorable set, and this difference increased with increasing duration. Nonmemorable picture recognition was low initially, did not increase until 120 ms, and never caught up with memorable picture recognition performance. Thus, the long-term memorability of an image is associated with initial perceptibility: A picture that is hard to grasp quickly is hard to remember later.