Metaphor in pictures

Pictures can be literal or metaphoric. Metaphoric pictures involve intended violations of standard modes of depiction that are universally recognizable. The types of metaphoric pictures correspond to major groups of verbal metaphors, with the addition of a class of pictorial runes. Often the correspondence between verbal and pictorial metaphors depends on individual features of objects and such physical parameters as change of scale. A more sophisticated analysis is required for some pictorial metaphors, involving juxtapositions of well-known objects and indirect reference.     

Syntax in A Dynamic Brain

Proponents of the language of thought (LOT) thesis are realists when it comes to syntactically structured representations, and must defend their view against instrumentalists, who would claim that syntactic structures may be useful in describing cognition, but have no more causal powers in governing cognition than do the equations of physics in guiding the planets. This paper explores what it will take to provide an argument for LOT that can defend its conclusion from instrumentalism. I illustrate a difficulty in this project by discussing arguments for LOT put forward by Horgan and Tienson. When their evidence is viewed in the light of results in connectionist research, it is hard to see how a realist conception of syntax can be formulated and defended.

     

Perceiving pictures

I aim to give a new account of picture perception: of the way our visual system functions when we see something in a picture. My argument relies on the functional distinction between the ventral and dorsal visual subsystems. I propose that it is constitutive of picture perception that our ventral subsystem attributes properties to the depicted scene, whereas our dorsal subsystem attributes properties to the picture surface. This duality elucidates Richard Wollheim’s concept of the “twofoldness” of our experience of pictures: the “visual awareness not only of what is represented but also of the surface qualities of the representation.” I argue for the following four claims: (a) the depicted scene is represented by ventral perception, (b) the depicted scene is not represented by dorsal perception, (c) the picture surface is represented by dorsal perception, and (d) the picture surface is not necessarily represented by ventral perception.     

Surface perception in pictures

Subjects adjusted a local gauge figure such as to perceptually “fit” the apparent surfaces of objects depicted in photographs. We obtained a few hundred data points per session, covering the picture according to a uniform lattice. Settings were repeated 3 times for each of 3 subjects. Almost all of the variability resided in the slant; the relative spread in the slant was about 25% (Weber fraction). The tilt was reproduced with a typical spread of about 10?. The rank correlation of the slant settings of different observers was high, thus the slant settings of different subjects were monotonically related. The variability could be predicted from the scatter in repeated settings by the individual observers. Although repeated settings by a single observer agreed within 5%, observers did not agree on the value of the slant, even on the average. Scaling factors of a doubling in the depth dimension were encountered between different subjects. The data conformed quite well to some hypothetical fiducial global surface, the orientation of which was “probed” by the subject’s local settings. The variability was completely accounted for by singleobserver scatter. These conclusions are based upon an analysis of the internal structure of the local settings. We did not address the problem of veridicality, that is, conformity to some “real object.”     

The Syntax of Features

The syntax of features is a complicated and densely researched domain, from a variety of theoretical perspectives. The present paper takes one influential syntactic framework [the minimalist program of Chomsky, 1995] as its vantage point, and discusses the major issues that arise within this framework in the domain of the syntax of features, with particular emphasis on Case and agreement.     

Surface perception in pictures.

Subjects adjusted a local gauge figure such as to perceptually "fit" the apparent surfaces of objects depicted in photographs. We obtained a few hundred data points per session, covering the picture according to a uniform lattice. Settings were repeated 3 times for each of 3 subjects. Almost all of the variability resided in the slant; the relative spread in the slant was about 25% (Weber fraction). The tilt was reproduced with a typical spread of about 10 degrees. The rank correlation of the slant settings of different observers was high, thus the slant settings of different subjects were monotonically related. The variability could be predicted from the scatter in repeated settings by the individual observers. Although repeated settings by a single observer agreed within 5%, observers did not agree on the value of the slant, even on the average. Scaling factors of a doubling in the depth dimension were encountered between different subjects. The data conformed quite well to some hypothetical fiducial global surface, the orientation of which was "probed" by the subject's local settings. The variability was completely accounted for by single-observer scatter. These conclusions are based upon an analysis of the internal structure of the local settings. We did not address the problem of veridicality, that is, conformity to some "real object."     

Learning 10000 pictures

Four experiments are reported which examined memory capacity and retrieval speed for pictures and for words. Single-trial learning tasks were employed throughout, with memory performance assessed by forced-choice recognition, recall measures or choice reaction-time tasks. The main experimental findings were: (1) memory capacity, as a function of the amount of material presented, follows a general power law with a characteristic exponent for each task; (2) pictorial material obeys this power law and shows an overall superiority to verbal material. The capacity of recognition memory for pictures is almost limitless, when measured under appropriate conditions; (3) when the recognition task is made harder by using more alternatives, memory capacity stays constant and the superiority of pictures is maintained; (4) picture memory also exceeds verbal memory in terms of verbal recall; comparable recognition/recall ratios are obtained for pictures, words and nonsense syllables; (5) verbal memory shows a higher retrieval speed than picture memory, as inferred from reaction-time measures. Both types of material obey a power law, when reaction-time is measured for various sizes of learning set, and both show very rapid rates of memory search.

From a consideration of the experimental results and other data it is concluded that the superiority of the pictorial mode in recognition and free recall learning tasks is well established and cannot be attributed to methodological artifact.     

The effect of masked pictures on the interpretation of ambiguous pictures

Two experiments investigated whether the initial organization of ambiguous pictures presented supraliminally could be influenced by the presentation of semantically related pictures that had been pattern masked to prevent conscious representation. Twenty-two pictures were presented tachistoscopically in a counterbalanced sequence, each alternating with the supraliminal presentation of its ambiguous counterpart. The results supported the hypothesis that pictures precluded from consciousness by pattern masking could nevertheless influence the interpretation of ambiguous pictures. Although the possibility of structural priming could not be completely ruled out in these experiments, there is evidence to suggest that semantic priming is a component. The research potential of semantic priming is also discussed.     

A Solid Sense Of Syntax

Every materially adequate explication of the concepts ``picture'and ``the pictorial' has to appeal to syntactical properties.From the available definitions, a conception of syntax is extractedthat is applicable to symbol systems of any sort. Against thisbackground, it is shown that a non-semantical characterization ofthe pictorial is mandatory. Finally, specific syntactical featuresare explicated that recommend themselves as necessary conditions forthe application of the concept of a picture.     

Hypermnesia for pictures: Incremental memory for pictures but not words in multiple recall trials

Two studies are reported on multiple forced recall following a single visual presentation of a sequence of pictures or words. In both experiments, a hypermnesic memory function (in which performance improved with repeated recall) was obtained for pictures, while a flat, nonincremental function was obtained for words. Interpolation of intervals of thinking between recall trials further enhanced hypermnesia for pictorial items. Retrieval, whether overt (recall trials) or covert (thinking), apparently produces increased net recovery of pictures but not words.     

Syntax model games and language in early education

Some procedures for developing language skills in young children are set forth. These procedures, syntax model games, were developed with consideration for children's language development and their developmental styles, and a consideration for transformational-generative grammar. Through the syntax model games, participants inductively acquire language patterns through functional use in a playful setting. A purpose of the activities was to support more efficient and flexible use of language. In addition to discussing induction as a way of knowing language, this article deals with the contrast of understanding and using language, the relation of metalinguistic awareness, some processes of syntactic development, relevant aspects of transformational-generative grammar, and a detailing of some syntax model games that were used with several hundred children between 5 and 9 years of age.Some of the concepts discussed in this article are expanded further by the author inEarly Childhood Education: A Perceptual Models Curriculum to be published by John Wiley and Sons in 1976.     

The perception of semantic relations in pictures

Three picture processing experiments are reported that present evidence of an “agent advantage effect,” that is, faster processing of the performer of the action depicted the agent of the action than of the element acted upon (the patient). Experiment 1 demonstrated the effect in a paradigm in which reaction time to manually indicate the location of a target (agent or patient) was faster for agent targets. Experiment 2 demonstrated that the critical time required for subjects to encode the agent was shorter than the time required for encoding patients. Experiment 3 again demonstrated the agent advantage effect in a directed attention paradigm. Together, the results of the experiments indicated that subjects were able to encode agent information faster than patient information. The results also indicated that subjects did not adopt a strategy whereby encoding of patient information was necessarily dependent upon encoding agent information.     

Pigeons can discriminate locations presented in pictures

The present experiments were designed to teach pigeons to discriminate two locations represented by color photographs. Two sets of photographs were taken at two distinctive locations on a university campus. These sets represented several standpoints at each location. For the true-discrimination group, pictures from the two locations were differentially associated with reward; for the pseudodiscrimination group, half of the views from each location were arbitrarily but consistently associated with reward. The former group acquired the discrimination much more rapidly. These birds also showed good transfer to new views from the standpoints used in training and to a new standpoint at each location not used in training. In a second experiment, another group of pigeons could terminate any training trial by pecking an “advance” key. Three of 4 subjects used this option to reduce the duration of trials in which pictures from the negative location were presented. These data suggest that pigeons can integrate views shown in pictures into a “concept” of a location. The method used here may be the experimental analogue of a common, natural process by which animals learn to identify locations.