The Cognitive Architecture of Perceived Animacy: Intention,Attention, and Memory

Human vision supports social perception by efficiently detecting agents and extracting rich information about their actions, goals, and intentions. Here, we explore the cognitive architecture of perceived animacy by constructing Bayesian models that integrate domain‐specific hypotheses of social agency with domain‐general cognitive constraints on sensory, memory, and attentional processing. Our model posits that perceived animacy combines a bottom–up, feature‐based, parallel search for goal‐directed movements with a top–down selection process for intent inference. The interaction of these architecturally distinct processes makes perceived animacy fast, flexible, and yet cognitively efficient. In the context of chasing, in which a predator (the “wolf”) pursues a prey (the “sheep”), our model addresses the computational challenge of identifying target agents among varying numbers of distractor objects, despite a quadratic increase in the number of possible interactions as more objects appear in a scene. By comparing modeling results with human psychophysics in several studies, we show that the effectiveness and efficiency of human perceived animacy can be explained by a Bayesian ideal observer model with realistic cognitive constraints. These results provide an understanding of perceived animacy at the algorithmic level—how it is achieved by cognitive mechanisms such as attention and working memory, and how it can be integrated with higher‐level reasoning about social agency.     

Non-transient luminance changes do not capture attention

The processing of luminance change is a ubiquitous feature of the human visual system and provides the basis for the rapid orienting of attention to potentially important events (e.g., motion onset, object onset). However, despite its importance for attentional capture, it is not known whether a luminance change attracts attention solely because of its status as a sensory transient or can attract attention at a relatively high cognitive level. In a series of six experiments, we presented visual displays in which a single object underwent a luminance change that was either visible or obscured by a mask. A target then appeared either at the change location or elsewhere. The results showed that the luminance change attracted attention only in the visible condition. This was even observed with the largest change we could generate (> 75 cd/m(2)). These data suggest that the importance of a luminance change is only in its status as a low-level sensory transient.     

A review of processing and analysing visual metaphors in psychology

IntroductionA visual metaphor is an image depicting an incongruity in the spatial distribution of visual elements, which is not consistent with reality. In this paper, we present an overview of theoretical and empirical studies on visual metaphor processing.ObjectiveFirstly, attention is given to the spatial distribution of visual elements, which defines the type of visual metaphors as well as the meaning operations required to understand the communicative message. The paper then reviews several empirical studies that collect behavioural measures for assessing visual metaphor processing using questionnaires and exploring the role played by cognitive abilities. In line with the contemporary literature, we then present three semiotic dimensions for visual metaphor processing, namely the expression, conceptualisation, and communication. We then present a pilot study that focusses on these three dimensions. Few research studies have collected behavioural data for visual metaphors processing. This may be due to the lack of theoretical framework in the corresponding field of research. These three semiotic dimensions highlight the value of pursuing research on visual metaphors in the scope of psychology. The presented pilot study could be a starting point for the investigation of visual metaphors in the framework of psychology.ConclusionWe propose future avenues of research that consider the visual structure of metaphors and meaning operations while assessing the influence of cognitive abilities in visual metaphor processing.     

Tracking the influence of reflexive attention on sensory and cognitive processing

Previously, we demonstrated that reflexive attention facilitates early visual processing during form discrimination (Hopfinger & Mangun, 1998). In the present study, we tested whether reflexive facilitation of early visual processing will be generated when task load is low (simple luminance detection). Target stimuli that were preceded at short cue-to-target intervals by irrelevant visual events (cues) elicited an enhanced sensory (P1) event-related potential (ERP) component as well as an enhanced longer latency, cognitive ERP component (P300). At long cue-to-target intervals, facilitation in these ERP components was no longer observed, and, although inhibition of return (IOR) was observed in reaction times, the ERPs did not show an inhibition of sensory processing. These results provide converging evidence that reflexive attention transiently facilitates neural processing of visual inputs at multiple stages of analysis (i.e., sensory processing and higher order cognitive processing) but question the view that IOR is manifest at the earliest visual cortical stages of analysis.     

The influence of training on the attentional blink and psychological refractory period

A growing body of research suggests that dual-task interference in sensory consolidation (e.g., the attentional blink, AB) and response selection (e.g., the psychological refractory period, PRP) stems from a common central bottleneck of information processing. With regard to response selection, it is well known that training reduces dual-task interference. We tested whether training that is known to be effective for response selection can also reduce dual-task interference in sensory consolidation. Over two experiments, performance on a PRP paradigm (Exp. 1) and on AB paradigms (differing in their stimuli and task demands, Exps. 1 and 2) was examined after participants had completed a relevant training regimen (T1 practice for both paradigms), an irrelevant training regimen (comparable sensorimotor training, not related to T1 for both tasks), a visual-search training regimen (Exp. 2 only), or after participants had been allocated to a no-training control group. Training that had shown to be effective for reducing dual-task interference in response selection was also found to be effective for reducing interference in sensory consolidation. In addition, we found some evidence that training benefits transferred to the sensory consolidation of untrained stimuli. Collectively, these findings show that training benefits can transfer across cognitive operations that draw on the central bottleneck in information processing. These findings have implications for theories of the AB and for the design of cognitive-training regimens that aim to produce transferable training benefits.     

The traveling salesman problem: A hierarchical model

Our review of prior literature on spatial information processing in perception, attention, and memory indicates that these cognitive functions involve similar mechanisms based on a hierarchical architecture. The present study extends the application of hierarchical models to the area of problem solving. First, we report results of an experiment in which human subjects were tested on a Euclidean traveling salesman problem (TSP) with 6 to 30 cities. The subject's solutions were either optimal or near-optimal in length and were produced in a time that was, on average, a linear function of the number of cities. Next, the performance of the subjects is compared with that of five representative artificial intelligence and operations research algorithms, that produce approximate solutions for Euclidean problems. None of these algorithms was found to be an adequate psychological model. Finally, we present a new algorithm for solving the TSP, which is based on a hierarchical pyramid architecture. The performance of this new algorithm is quite similar to the performance of the subjects.     

Attention,Memory, Intrusive Thoughts,and Acceptance in PTSD: An Update on the Empirical Literature for Clinicians

Information processing theory suggests that cognitive changes following trauma are common and hypothesized to have an impact on attention, memory, and intrusive thoughts. There is an ever-expanding empirical literature where cognitive features of posttraumatic stress disorder (PTSD) are being explored. However, it can sometimes be difficult for front-line clinicians to stay abreast of this literature and how it impacts the treatment s/he provides. The goal of this paper is to provide an overview of some recent basic and applied research on information processing in PTSD and the implications of these findings for cognitive-behavioral clinicians. In particular, we explore recent findings regarding attention, memory, intrusive thoughts/thought suppression, and acceptance as they relate to clinical work in patients with PTSD.     

The object advantage can be eliminated under equiluminant conditions

A key phenomenon supporting the existence of object-based attention is the object advantage, in which responses are faster for within-object, relative to equidistant between-object, shifts of attention. The origins of this effect have been variously ascribed to low-level “bottom-up” sensory processing and to a cognitive “top-down” strategy of within-object attention prioritization. The degree to which the object advantage depends on lower-level sensory processing was examined by differentially stimulating the magnocellular (M) and parvocellular (P) retino-geniculo-cortical visual pathways by using equiluminant and nonequiluminant conditions. We found that the object advantage can be eliminated when M activity is reduced using psychophysically equiluminant stimuli. This novel result in normal observers suggests that the origin of the object advantage is found in lower-level sensory processing rather than a general cognitive process, which should not be so sensitive to differential activation of the bottom-up P and M pathways. Eliminating the object advantage while maintaining a spatial-cueing advantage with reduced M activity suggests that the notion of independent M-driven spatial attention and P-driven object attention requires revision.     

The cognitive architecture for chaining of two mental operations

A simple view, which dates back to Turing, proposes that complex cognitive operations are composed of serially arranged elementary operations, each passing intermediate results to the next. However, whether and how such serial processing is achieved with a brain composed of massively parallel processors, remains an open question. Here, we study the cognitive architecture for chained operations with an elementary arithmetic algorithm: we required participants to add (or subtract) two to a digit, and then compare the result with five. In four experiments, we probed the internal implementation of this task with chronometric analysis, the cued-response method, the priming method, and a subliminal forced-choice procedure. We found evidence for an approximately sequential processing, with an important qualification: the second operation in the algorithm appears to start before completion of the first operation. Furthermore, initially the second operation takes as input the stimulus number rather than the output of the first operation. Thus, operations that should be processed serially are in fact executed partially in parallel. Furthermore, although each elementary operation can proceed subliminally, their chaining does not occur in the absence of conscious perception. Overall, the results suggest that chaining is slow, effortful, imperfect (resulting partly in parallel rather than serial execution) and dependent on conscious control.     

Active Listening Delays Attentional Disengagement and Saccadic Eye Movements

Successful goal-directed visual behavior depends on efficient disengagement of attention. Attention must be withdrawn from its current focus before being redeployed to a new object or internal process. Previous research has demonstrated that occupying cognitive processes with a secondary cellular phone conversation impairs attentional functioning and driving behavior. For example, attentional processing is significantly impacted by concurrent cell phone use, resulting in decreased explicit memory for on-road information. Here, we examined the impact of a critical component of cell-phone use—active listening—on the effectiveness of attentional disengagement. In the gap task—a saccadic manipulation of attentional disengagement—we measured saccade latencies while participants performed a secondary active listening task. Saccadic latencies significantly increased under an active listening load only when attention needed to be disengaged, indicating that active listening delays a disengagement operation. Simple dual-task interference did not account for the observed results. Rather, active cognitive engagement is required for measurable disengagement slowing to be observed. These results have implications for investigations of attention, gaze behavior, and distracted driving. Secondary tasks such as active listening or cell-phone conversations can have wide-ranging impacts on cognitive functioning, potentially impairing relatively elementary operations of attentional function, including disengagement.     

Working memory, deafness and sign language

Working memory (WM) for sign language has an architecture similar to that for speech-based languages at both functional and neural levels. However, there are some processing differences between language modalities that are not yet fully explained, although a number of hypotheses have been mooted. This article reviews some of the literature on differences in sensory, perceptual and cognitive processing systems induced by auditory deprivation and sign language use and discusses how these differences may contribute to differences in WM architecture for signed and speech-based languages. In conclusion, it is suggested that left-hemisphere reorganization of the motion-processing system as a result of native sign-language use may interfere with the development of the order processing system in WM.     

Representation recovers information

Early agreement within cognitive science on the topic of representation has now given way to a combination of positions. Some question the significance of representation in cognition. Others continue to argue in favor, but the case has not been demonstrated in any formal way. The present paper sets out a framework in which the value of representation use can be mathematically measured, albeit in a broadly sensory context rather than a specifically cognitive one. Key to the approach is the use of Bayesian networks for modeling the distal dimension of sensory processes. More relevant to cognitive science is the theoretical result obtained, which is that a certain type of representational architecture is necessary for achievement of sensory efficiency. While exhibiting few of the characteristics of traditional, symbolic encoding, this architecture corresponds quite closely to the forms of embedded representation now being explored in some embedded/embodied approaches. It becomes meaningful to view that type of representation use as a form of information recovery. A formal basis then exists for viewing representation not so much as the substrate of reasoning and thought, but rather as a general medium for efficient, interpretive processing.     

Bayes,predictive processing,and the cognitive architecture of motor control

Despite their popularity, relatively scant attention has been paid to the upshot of Bayesian and predictive processing models of cognition for views of overall cognitive architecture. Many of these models are hierarchical; they posit generative models at multiple distinct “levels,” whose job is to predict the consequences of sensory input at lower levels. I articulate one possible position that could be implied by these models, namely, that there is a continuous hierarchy of perception, cognition, and action control comprising levels of generative models. I argue that this view is not entailed by a general Bayesian/predictive processing outlook. Bayesian approaches are compatible with distinct formats of mental representation. Focusing on Bayesian approaches to motor control, I argue that the junctures between different types of mental representation are places where the transitivity of hierarchical prediction may be broken, and I consider the upshot of this conclusion for broader discussions of cognitive architecture.     

Genetic factors and neurocognitive traits

Genetic contributions to phenotypic variation in general intelligence have been studied extensively. Less research has been conducted on genetic contributions to specific cognitive abilities, such as attention, memory, working memory, language, and motor functions. However, the existing data indicate a significant role of genetic factors in these abilities. Stages of information processing, such as sensory gating, early sensory registration, and cognitive analysis, also show evidence of genetic contributions. Recent molecular studies have begun to identify candidate genes for specific cognitive functions. Future research, identifying endophenotypes based on cognitive profiles of neuropsychiatric disorders, may also assist in the detection of genes that increase susceptibility to major psychiatric disorders.     

Cognitive contributions of the ventral parietal cortex: an integrative theoretical account

Although ventral parietal cortex (VPC) activations can be found in a variety of cognitive domains, these activations have been typically attributed to cognitive operations specific to each domain. In this article, we propose a hypothesis that can account for VPC activations across all the cognitive domains reviewed. We first review VPC activations in the domains of perceptual and motor reorienting, episodic memory retrieval, language and number processing, theory of mind, and episodic memory encoding. Then, we consider the localization of VPC activations across domains and conclude that they are largely overlapping with some differences around the edges. Finally, we assess how well four different hypotheses of VPC function can explain findings in various domains and conclude that a bottom-up attention hypothesis provides the most complete and parsimonious account.     

Visual attention and its intimate links to spatial cognition

It is almost universal to regard attention as the facility that permits an agent, human or machine, to give priority processing resources to relevant stimuli while ignoring the irrelevant. The reality of how this might manifest itself throughout all the forms of perceptual and cognitive processes possessed by humans, however, is not as clear. Here, we examine this reality with a broad perspective in order to highlight the myriad ways that attentional processes impact both perception and cognition. The paper concludes by showing two real-world problems that exhibit sufficient complexity to illustrate the ways in which attention and cognition connect. These then point to new avenues of research that might illuminate the overall cognitive architecture of spatial cognition.     

Unraveling the Aging Skein: Disentangling Sensory and Cognitive Predictors of Age‐related Differences in Decision Making

Age‐related differences in sensory functioning, processing speed, and working memory have been identified as three significant predictors of the age‐related performance decline observed in complex cognitive tasks. Yet, the assessment of their relative predictive capacity and interrelations is still an open issue in decision making and cognitive aging research. Indeed, no previous investigation has examined the relationships of all these three predictors with decision making. In an individual‐differences study, we therefore disentangled the relative contribution of sensory functioning, processing speed, and working memory to the prediction of the age‐related decline in cognitively demanding judgment and decision‐making tasks. Structural equation modeling showed that the age‐related decline in working memory plays an important predictive role, even when controlling for sensory functioning, processing speed, and education. Implications for research on decision making and cognitive aging are discussed. Copyright © 2015 John Wiley & Sons, Ltd.     

The link between brain learning, attention, and consciousness

The processes whereby our brains continue to learn about a changing world in a stable fashion throughout life are proposed to lead to conscious experiences. These processes include the learning of top-down expectations, the matching of these expectations against bottom-up data, the focusing of attention upon the expected clusters of information, and the development of resonant states between bottom-up and top-down processes as they reach an attentive consensus between what is expected and what is there in the outside world. It is suggested that all conscious states in the brain are resonant states and that these resonant states trigger learning of sensory and cognitive representations. The models which summarize these concepts are therefore called Adaptive Resonance Theory, or ART, models. Psychophysical and neurobiological data in support of ART are presented from early vision, visual object recognition, auditory streaming, variable-rate speech perception, somatosensory perception, and cognitive-emotional interactions, among others. It is noted that ART mechanisms seem to be operative at all levels of the visual system, and it is proposed how these mechanisms are realized by known laminar circuits of visual cortex. It is predicted that the same circuit realization of ART mechanisms will be found in the laminar circuits of all sensory and cognitive neocortex. Concepts and data are summarized concerning how some visual percepts may be visibly, or modally, perceived, whereas amodal percepts may be consciously recognized even though they are perceptually invisible. It is also suggested that sensory and cognitive processing in the What processing stream of the brain obey top-down matching and learning laws that are often complementary to those used for spatial and motor processing in the brain's Where processing stream. This enables our sensory and cognitive representations to maintain their stability as we learn more about the world, while allowing spatial and motor representations to forget learned maps and gains that are no longer appropriate as our bodies develop and grow from infanthood to adulthood. Procedural memories are proposed to be unconscious because the inhibitory matching process that supports these spatial and motor processes cannot lead to resonance.     

How brains beware: neural mechanisms of emotional attention

Emotional processes not only serve to record the value of sensory events, but also to elicit adaptive responses and modify perception. Recent research using functional brain imaging in human subjects has begun to reveal neural substrates by which sensory processing and attention can be modulated by the affective significance of stimuli. The amygdala plays a crucial role in providing both direct and indirect top-down signals on sensory pathways, which can influence the representation of emotional events, especially when related to threat. These modulatory effects implement specialized mechanisms of 'emotional attention' that might supplement but also compete with other sources of top-down control on perception. This work should help to elucidate the neural processes and temporal dynamics governing the integration of cognitive and affective influences in attention and behaviour.     

Dissociation of sensory facilitation and decision bias in statistical learning

ABSTRACT

The detection of regularities in the sensory environment, known as statistical learning, is an important brain function that has been observed in many experimental contexts. In these experiments, statistical learning of patterned sensory stimulation leads to improvements in the speed and/or accuracy with which subsequent stimuli are recognized. That is, statistical learning facilitates the transformation of sensory stimuli into motor responses, but the mechanism by which this occurs is unclear. Statistical learning could improve the efficiency of sensory processing, or it could bias responses toward particular outcomes. The distinction is important, as these different hypotheses imply different functions and different neural substrates for statistical learning. Here we address this problem by studying statistical learning as a decision-making process, which allows us to leverage the extensive computational literature on this topic. Specifically we describe a method for applying the Diffusion Decision Model (DDM) to isolate different sensory and cognitive processes associated with decision-making. The results indicate that statistical learning improves performance on a visual learning task in two distinct ways: by altering the efficiency of sensory processing and by introducing biases in the decision-making process. By fitting the parameters of the DDM to data from individual subjects, we find that the prominence of these two factors differed substantially across the population, and that these differences were predictive of individual performance on the psychophysical task. Overall, these results indicate that different cognitive processes can be recruited by statistical learning, and that the DDM is a powerful framework for detecting these influences.