A theory of visual attention

A unified theory of visual recognition and attentional selection is developed by integrating the biased-choice model for single-stimulus recognition (Luce, 1963; Shepard, 1957) with a choice model for selection from multielement displays (Bundesen, Pedersen, & Larsen, 1984) in a race model framework. Mathematically, the theory is tractable, and it specifies the computations necessary for selection. The theory is applied to extant findings from a broad range of experimental paradigms. The findings include effects of object integrality in selective report, number and spatial position of targets in divided-attention paradigms, selection criterion and number of distracters in focused-attention paradigms, delay of selection cue in partial report, and consistent practice in search. On the whole, the quantitative fits are encouraging.     

Logical rules of visual brain: From anatomy through neurophysiology to cognition

Humans can easily recognize objects as complex as faces even if they have not seen them in such conditions or context before. It seems that perceptually we are insensitive to the exact properties of an object’s parts but the same parts in different configurations or contexts may introduce contradictory effects. From a computational point of view, we are often insensitive to changes of some symbols, but the same symbols may lead to different classification of the same object. In present work we are looking for the anatomical and neurophysiological basis of these perceptual effects. We describe interactions between parts and their configurations in different areas of the visual brain on the basis of a single cell electrophysiological activity in the thalamus, and cortical areas V1 and V4. Our model is based on feedforward (FF) and feedback (FB) interactions between these areas. In the retina and thalamus simple light spots are classified, V1 is the first area extracting edge orientation and V4 is the first area sensitive to simple shapes. The FF pathways combine properties extracted in each area into hypothetical objects. Area V1 presents concepts of orientations, while area V4 presents concepts of a simple shape. The FB pathways are responsible for comparison of the learned concepts with extracted object’s properties – they form predictions. In each area structure related predictions are tested against hypothesis. We formulate a theory in which different visual stimuli are described through their condition attributes: responses in LGN, V1, and V4 neurons are divided into several ranges and are treated as decision attributes. Applying rough set theory [Pawlak, Z. (1991). Rough sets – theoretical aspects of reasoning about data. Boston, London, Dordrecht: Kluwer Academic Publishers] we have divided our stimuli into area dependent equivalent classes. We propose that relationships between decision rules in each area are determined by two different logical rules: “driver logical rule” of FF and “modulator logical rule” of FB pathways. These interactions are proposed to be a neurophysiological basis of the object classification.     

A Boolean map theory of visual attention

A theory is presented that attempts to answer two questions. What visual contents can an observer consciously access at one moment? Answer: only one feature value (e.g., green) per dimension, but those feature values can be associated (as a group) with multiple spatially precise locations (comprising a single labeled Boolean map). How can an observer voluntarily select what to access? Answer: in one of two ways: (a) by selecting one feature value in one dimension (e.g., selecting the color red) or (b) by iteratively combining the output of (a) with a preexisting Boolean map via the Boolean operations of intersection and union. Boolean map theory offers a unified interpretation of a wide variety of visual attention phenomena usually treated in separate literatures. In so doing, it also illuminates the neglected phenomena of attention to structure.     

Gaze cueing of attention: visual attention, social cognition, and individual differences

During social interactions, people's eyes convey a wealth of information about their direction of attention and their emotional and mental states. This review aims to provide a comprehensive overview of past and current research into the perception of gaze behavior and its effect on the observer. This encompasses the perception of gaze direction and its influence on perception of the other person, as well as gaze-following behavior such as joint attention, in infant, adult, and clinical populations. Particular focus is given to the gaze-cueing paradigm that has been used to investigate the mechanisms of joint attention. The contribution of this paradigm has been significant and will likely continue to advance knowledge across diverse fields within psychology and neuroscience.     

Exploring the neural basis of cognition: multi-modal links between human fMRI and macaque neurophysiology

Although functional magnetic resonance imaging (fMRI) with sophisticated behavioral paradigms has enabled the investigation of increasingly higher-level cognitive functions in humans, these studies seem to lose touch with neurophysiological studies in macaque monkeys. The application of fMRI and other MRI-based techniques to macaque brains allows studies in the two species to be linked. fMRI in human and macaque subjects using equivalent cognitive tasks enables direct comparisons of the functional brain architecture, even for high-level cognitive functions. Combinations of functional or structural MRI and microelectrode techniques provide ways to explore functional brain networks at multiple spatiotemporal scales. These approaches would illuminate the neurophysiological underpinnings of human cognitive functions by integrating human functional neuroimaging with macaque single-unit recordings.     

Measuring and modeling salience with the theory of visual attention

For almost three decades, the theory of visual attention (TVA) has been successful in mathematically describing and explaining a wide variety of phenomena in visual selection and recognition with high quantitative precision. Interestingly, the influence of feature contrast on attention has been included in TVA only recently, although it has been extensively studied outside the TVA framework. The present approach further develops this extension of TVA’s scope by measuring and modeling salience. An empirical measure of salience is achieved by linking different (orientation and luminance) contrasts to a TVA parameter. In the modeling part, the function relating feature contrasts to salience is described mathematically and tested against alternatives by Bayesian model comparison. This model comparison reveals that the power function is an appropriate model of salience growth in the dimensions of orientation and luminance contrast. Furthermore, if contrasts from the two dimensions are combined, salience adds up additively.     

At the root of embodied cognition: cognitive science meets neurophysiology

Recent experimental research in the field of neurophysiology has led to the discovery of two classes of visuomotor neurons: canonical neurons and mirror neurons. In light of these studies, we propose here an overview of two classical themes in the cognitive science panorama: James Gibson's theory of affordances and Eleanor Rosch's principles of categorization. We discuss how theoretical perspectives and neuroscientific evidence are converging towards the current paradigm of embodied cognition. From this perspective, we discuss the role of action and simulation in cognitive processes, which lead to the perceptual recognition of objects, and actions and to their conceptual categorization.     

Moving to higher ground: The dynamic field theory and the dynamics of visual cognition

In the present report, we describe a new dynamic field theory that captures the dynamics of visuo-spatial cognition. This theory grew out of the dynamic systems approach to motor control and development, and is grounded in neural principles. The initial application of dynamic field theory to issues in visuo-spatial cognition extended concepts of the motor approach to decision making in a sensori-motor context, and, more recently, to the dynamics of spatial cognition. Here we extend these concepts still further to address topics in visual cognition, including visual working memory for non-spatial object properties, the processes that underlie change detection, and the ‘binding problem’ in vision. In each case, we demonstrate that the general principles of the dynamic field approach can unify findings in the literature and generate novel predictions. We contend that the application of these concepts to visual cognition avoids the pitfalls of reductionist approaches in cognitive science, and points toward a formal integration of brains, bodies, and behavior.     

Top-down modulation: bridging selective attention and working memory

Selective attention, the ability to focus our cognitive resources on information relevant to our goals, influences working memory (WM) performance. Indeed, attention and working memory are increasingly viewed as overlapping constructs. Here, we review recent evidence from human neurophysiological studies demonstrating that top-down modulation serves as a common neural mechanism underlying these two cognitive operations. The core features include activity modulation in stimulus-selective sensory cortices with concurrent engagement of prefrontal and parietal control regions that function as sources of top-down signals. Notably, top-down modulation is engaged during both stimulus-present and stimulus-absent stages of WM tasks; that is, expectation of an ensuing stimulus to be remembered, selection and encoding of stimuli, maintenance of relevant information in mind and memory retrieval.     

Top-down selective visual attention: A neurodynamical approach

We propose a system of interconnected modules consisting of populations of neurons for modelling the underlying mechanisms involved in selective visual attention. We demonstrate that it is plausible to build a neural system for visual search, which works across the visual field in parallel, but, due to the intrinsic dynamics of the system, resembles apparent modes of visual attention, namely the serial focal and the parallel spread over the space mode. Thus, neither explicit serial focal search nor saliency maps need to be assumed. A focal attentional spotlight is not included in the system but rather focal attention emerges due to the convergence of the dynamic behaviour of the neural networks. The dynamics of the system can be interpreted as a mechanism for routing information from the sensory input.     

Clinical pragmatism: bridging theory and practice

This response to Lynn Jansen's critique of clinical pragmatism concentrates on two themes: (1) contrasting approaches to moral epistemology and (2) the connection between theory and practice in clinical ethics. Particular attention is paid to the status of principles and the role of consensus, with some closing speculations on how Dewey might view the current state of bioethics.     

A memory-based theory of verbal cognition

The syntagmatic paradigmatic model is a distributed, memory-based account of verbal processing. Built on a Bayesian interpretation of string edit theory, it characterizes the control of verbal cognition as the retrieval of sets of syntagmatic and paradigmatic constraints from sequential and relational long-term memory and the resolution of these constraints in working memory. Lexical information is extracted directly from text using a version of the expectation maximization algorithm. In this article, the model is described and then illustrated on a number of phenomena, including sentence processing, semantic categorization and rating, short-term serial recall, and analogical and logical inference. Subsequently, the model is used to answer questions about a corpus of tennis news articles taken from the Internet. The model's success demonstrates that it is possible to extract propositional information from naturally occurring text without employing a grammar, defining a set of heuristics, or specifying a priori a set of semantic roles.     

A feature-integration theory of attention

A new hypothesis about the role of focused attention is proposed. The feature-integration theory of attention suggests that attention must be directed serially to each stimulus in a display whenever conjunctions of more than one separable feature are needed to characterize or distinguish the possible objects presented. A number of predictions were tested in a variety of paradigms including visual search, texture segregation, identification and localization, and using both separable dimensions (shape and color) and local elements or parts of figures (lines, curves, etc. in letters) as the features to be integrated into complex wholes. The results were in general consistent with the hypothesis. They offer a new set of criteria for distinguishing separable from integral features and a new rationale for predicting which tasks will show attention limits and which will not.     

An attractor network in the hippocampus: theory and neurophysiology

A quantitative computational theory of the operation of the CA3 system as an attractor or autoassociation network is described. Based on the proposal that CA3-CA3 autoassociative networks are important for episodic or event memory in which space is a component (place in rodents and spatial view in primates), it has been shown behaviorally that the CA3 supports spatial rapid one-trial learning and learning of arbitrary associations and pattern completion where space is a component. Consistent with the theory, single neurons in the primate CA3 respond to combinations of spatial view and object, and spatial view and reward. Furthermore, single CA3 neurons reflect the recall of a place from an object in a one-trial object-place event memory task. CA3 neurons also reflect in their firing a memory of spatial view that is retained and updated by idiothetic information to implement path integration when the spatial view is obscured. Based on the computational proposal that the dentate gyrus produces sparse representations by competitive learning and via the mossy fiber pathway forces new representations on the CA3 during learning (encoding), it has been shown behaviorally that the dentate gyrus supports spatial pattern separation during learning, and that the mossy fiber system to CA3 connections are involved in learning but not in recall. The perforant path input to CA3 is quantitatively appropriate to provide the cue for recall in CA3. The concept that the CA1 recodes information from CA3 and sets up associatively learned back-projections to neocortex to allow subsequent retrieval of information to neocortex provides a quantitative account of the large number of hippocampo-neocortical back-projections.     

An integrated theory of prospective time interval estimation: the role of cognition, attention, and learning

A theory of prospective time perception is introduced and incorporated as a module in an integrated theory of cognition, thereby extending existing theories and allowing predictions about attention and learning. First, a time perception module is established by fitting existing datasets (interval estimation and bisection and impact of secondary tasks on attention). The authors subsequently used the module as a part of the adaptive control of thought--rational (ACT-R) architecture to model a new experiment that combines attention, learning, dual tasking, and time perception. Finally, the model predicts time estimation, learning, and attention in a new experiment. The model predictions and fits demonstrate that the proposed integrated theory of prospective time interval estimation explains detailed effects of attention and learning during time interval estimation.     

Spatial cognition: evidence from visual neglect

Recent work on human attention and representational systems has benefited from a growing interplay between research on normal attention and neuropsychological disorders such as visual neglect. Research over the past 30 years has convincingly shown that, far from being a unitary condition, neglect is a protean disorder whose symptoms can selectively affect different sensory modalities, cognitive processes, spatial domains and coordinate systems. These clinical findings, together with those of functional neuroimaging, have increased knowledge about the anatomical and functional architecture of normal subsystems involved in spatial cognition. We provide a selective overview of how recent investigations of visual neglect are beginning to elucidate the underlying structure of spatial processes and mental representations.