The role of color in high-level vision

Traditional theories of object recognition have emphasized the role of shape information in high-level vision. However, the accumulating behavioral, neuroimaging and neuropsychological evidence indicates that the surface color of an object affects its recognition. In this article, we discuss the research that examines the conditions under which color influences the operations of high-level vision and the neural substrates that might mediate these operations. The relationship between object color and object recognition is summarized in the 'Shape+Surface' model of high-level vision.     

A model of serial order problems in fluent, stuttered and agrammatic speech

Many models of speech production have attempted to explain dysfluent speech. Most models assume that the disruptions that occur when speech is dysfluent arise because the speakers make errors while planning an utterance. In this contribution, a model of the serial order of speech is described that does not make this assumption. It involves the coordination or 'interlocking' of linguistic planning and execution stages at the language-speech interface. The model is examined to determine whether it can distinguish two forms of dysfluent speech (stuttered and agrammatic speech) that are characterized by iteration and omission of whole words and parts of words.     

The beholder beheld: A study of social emotionality

The study reported in this paper is concerned with social emotions. These are defined as states which are experienced either exclusively or more intensively before a real or imagined audience. It is argued that when social emotions arise as a consequence of disrupting social rules, this is because the actor in question is aware of a discrepancy between his or her self-image, which is assumed to be neutral, and the image which he or she assumes to have conveyed to those who witness the incident, in a role-playing experiment, subjects were presented with four situations depicting disruptions of routine activity, two of which involved rule disruption. These situations were described from one of two perspectives (actor or observer) and set in one of two social contexts (public or private). Results confirmed the main predictions, which were (1) that in the case of rule disruptions, the emotionality attributed to the actor would be greater in public than in private; (2) that dispositional ratings of the actor would reveal a discrepancy between self image and public image, and that this discrepancy would covary with the actor's emotionality; and (3) that dispositional ratings of the actor would reveal a discrepancy between public image and subjective public image.     

Bidirectional Spillover in the Family across the Transition to Parenthood

Although family systems theory posits reciprocal causality between subsystems of the family, such as intimate partner violence exacerbating harsh parenting and vice versa, longitudinal studies with cross‐lagged models have been used infrequently to test these principles. As guided by the spillover model, this study examined bidirectional associations between couple dysfunction, parent–child aggression risk, and child functioning across the transition to parenthood to determine whether and how disruptions in one subsystem relate to problems in other family subsystems. Participants were 201 first‐time mothers and 151 fathers from a diverse community sample, evaluated during pregnancy, and reassessed two more times through their child's first 18 months of life. Individual and dyadic path model results indicate bidirectional spillover effects between parent–child aggression risk and child functioning for both mothers and fathers, and spillover from parent–child aggression risk to couple dysfunction for mothers but not fathers. However, limited spillover effects were identified between couple functioning and child adjustment, in contrast to previous work. Findings suggest that spillover can happen reciprocally and early in the family, supporting transactional models of behavior and highlighting the need for early family level intervention.     

Effects of marital conflict on subsequent triadic family interactions and parenting

This study examined marital conflict's indirect effects on children through disruptions in family alliances and parenting. Forty married couples were observed interacting with their 6-8-year-old sons after pleasant and conflictual discussions. After conflictual discussion, fathers showed lower support/engagement toward sons, and coparenting styles were less democratic. Couple negativity was correlated with family negativity, regardless of the topic of discussion, which suggests continuity in the affective quality of the two family subsystems. Mothers' marital satisfaction moderated families' responses to the experimental manipulation. The results provide stronger evidence than previously available of a causal link between conflict and disrupted parenting. Further research is needed to identify which conflict-related disruptions in parenting influence the development of children's problems.     

The temporally-integrated causality landscape: A theoretical framework for consciousness and meaning

Theoretical approaches to understanding consciousness have begun to converge upon areas of general agreement, yet substantive differences remain. Here, I introduce a new theoretical framework for the emergence of consciousness from the functional integration of the thalamocortical system: the Temporally-Integrated Causality Landscape (TICL). TICL presents a novel perspective which addresses important phenomenological characteristics of consciousness that other frameworks, such as IIT, do not. First, the TICL is based upon the observation that conscious experiences are temporally continuous, not discrete. Secondly, the TICL establishes a thalamocortical basis for the point-of-view. According to TICL, consciousness is composed of contents that arise from neuronal subsystems that have meaning from the point-of-view of the larger, integrated system in which they are nested. Meaningful contents emerge from the subsystems because they exhibit a level of temporally-integrated causality (TIC) that is distinguishable from that of the larger system.     

Classification objects, ideal observers & generative models

A successful vision system must solve the problem of deriving geometrical information about three-dimensional objects from two-dimensional photometric input. The human visual system solves this problem with remarkable efficiency, and one challenge in vision research is to understand how neural representations of objects are formed and what visual information is used to form these representations. Ideal observer analysis has demonstrated the advantages of studying vision from the perspective of explicit generative models and a specified visual task, which divides the causes of image variations into the separate categories of signal and noise. Classification image techniques estimate the visual information used in a task from the properties of “noise” images that interact most strongly with the task. Both ideal observer analysis and classification image techniques rely on the assumption of a generative model. We show here how the ability of the classification image approach to understand how an observer uses visual information can be improved by matching the type and dimensionality of the model to that of the neural representation or internal template being studied. Because image variation in real world object tasks can arise from both geometrical shape and photometric (illumination or material) changes, a realistic image generation process should model geometry as well as intensity. A simple example is used to demonstrate what we refer to as a “classification object” approach to studying three-dimensional object representations.     

Action control: independent effects of memory and monocular viewing on reaching accuracy

Evidence suggests that perceptual networks in the ventral visual pathway are necessary for action control when targets are viewed with only one eye, or when the target must be stored in memory. We tested whether memory-linked (i.e., open-loop versus memory-guided actions) and monocular-linked effects (i.e., binocular versus monocular actions) on action arise from a common mechanism as suggested by evidence from neuropsychology and psychophysics. Participants viewed targets with either one eye or two (vision: monocular versus binocular) and then reached to touch targets in open-loop and memory-guided conditions (condition: open-loop versus 0, 500, 1000, and 1500 ms delays). Results showed that memory-linked and monocular-linked increases in radial and variable movement error were additive (i.e., main effects of vision and condition, but no interaction). This suggests that the two effects on visuomotor control arise from separate mechanisms, in contrast to evidence from psychophysics and neuropsychology suggesting a common underlying mechanism.     

Solving geometric analogy problems through two-stage analogical mapping

Evans' 1968 ANALOGY system was the first computer model of analogy. This paper demonstrates that the structure mapping model of analogy, when combined with high-level visual processing and qualitative representations, can solve the same kinds of geometric analogy problems as were solved by ANALOGY. Importantly, the bulk of the computations are not particular to the model of this task but are general purpose: We use our existing sketch understanding system, CogSketch, to compute visual structure that is used by our existing analogical matcher, Structure Mapping Engine (SME). We show how SME can be used to facilitate high-level visual matching, proposing a role for structural alignment in mental rotation. We show how second-order analogies over differences computed via analogies between pictures provide a more elegant model of the geometric analogy task. We compare our model against human data on a set of problems, showing that the model aligns well with both the answers chosen by people and the reaction times required to choose the answers.     

A comparison of two models for performance under fixed interval schedules of reinforcement

Two models are proposed for responding under fixed-interval schedules of reinforcement. The first model is a Poisson model and seems suitable for situations in which responding produces a classical “FI scallop”. A second model is then developed to describe “break and run” performance, which is also known to occur under some Fixed Interval schedules. The models do not however give any indication of the circumstances under which a particular mode of responding should arise. A comparison of the models to a small set of data collected from rats performing under an FI 60 sec schedule indicates that for the data considered, the second model (a State model) produced by far the best fit.     

Conscious contents as reflexive processes: Evidence from the habituation of high-level cognitions

Reflexes are often insuppressible, predictable, and susceptible to external control. In contrast, conscious thoughts have been regarded as whimsical, ‘offline,’ and shielded from external control. Recent advances suggest that conscious thoughts are more reflex-like and susceptible to external control than previously thought. In one paradigm, high-level conscious thoughts (subvocalizations) are triggered by external control, as a function of external stimuli and experimenter-induced action sets. It has been hypothesized that these conscious contents are activated involuntarily and in a reflex-like manner. If such is the case, then these activations should possess a well-known property of the reflex: habituation. Accordingly, we found that involuntary high-level cognitions (subvocalizations) habituated (i.e., were less likely to arise) after repeated stimulation. As in the case of the habituation of a reflex, this novel effect was stimulus-specific. We discuss the implications of this finding for theories about consciousness and about psychopathological phenomena involving undesired, involuntary cognitions.     

Psychoanalysis and the political process

The Political Process is Society's mechanism for debating value systems. The term can also be used to describe a debate in a variety of other settings — subsystems of Society — about value systems. This paper is about the contributions that psychoanalysis, both as a theory and in its various applications, can make to the understanding of the process of debate and its setting. It is also about the implications for our conduct that arise from this understanding.     

Pseudoscopic viewing: transfer and persistence of reversed depth relations from the viewing of photographs to the real scene

After viewing stereo pictures pseudoscopically (that is, with the pictures of the stereo-pair presented to the opposite eyes) part of the real scene depicted was perceived as inside out from the standpoint of depth during normal binocular vision. Experiments were designed to investigate this form of transfer but, since serious consequences can arise when an inside-out percept persists in normal binocular vision, it was intended that the experiments would be restricted to transfer of a less extreme kind. The scene chosen had not developed persistence during early trials but, surprisingly, one subject taking part in these experiments did experience some transfer from pseudoscopic direct viewing to normal binocular vision.     

On the mental representations originating during the interaction between language and vision

The interaction between vision and language processing is clearly of interest to both cognitive psychologists and psycholinguists. Recent research has begun to create understanding of the interaction between vision and language in terms of the representational issues involved. In this paper, we first review some of the theoretical and methodological issues in the current vision–language interaction debate. Later, we develop a model that attempts to account for effects of affordances and visual context on language-scene interaction as well as the role of sensorimotor simulation. The paper addresses theoretical issues related to the mental representations that arise when visual and linguistic systems interact.     

Is working memory still working?

The current state of A. D. Baddeley and G. J. Hitch's (1974) multicomponent working memory model is reviewed. The phonological and visuospatial subsystems have been extensively investigated, leading both to challenges over interpretation of individual phenomena and to more detailed attempts to model the processes underlying the subsystems. Analysis of the controlling central executive has proved more challenging, leading to a proposed clarification in which the executive is assumed to be a limited capacity attentional system, aided by a newly postulated fourth system, the episodic buffer. Current interest focuses most strongly on the link between working memory and long-term memory and on the processes allowing the integration of information from the component subsystems. The model has proved valuable in accounting for data from a wide range of participant groups under a rich array of task conditions. Working memory does still appear to be working.     

Relative brightness in natural images can be accounted for by removing blurry content

One critical question regarding visual cognition concerns how the physical properties of the visual world are represented in early vision and then relayed to high-level vision. Here, we posit a simple theory: Processes that encode object appearance reduce their response to spatial content that is coarser than the size of the attended object. We show that a filtering procedure based on this theory can account for the relative brightness levels of test patches placed in images of natural scenes and for many hard-to-explain brightness illusions. The implication is that the perception of brightness differences in most brightness illusions actually corresponds to physical differences present in the images. Portions of the visual system may encode these physical differences by means of neural processes that adaptively reduce their response to low-spatial-frequency content.     

A review of abnormalities in the perception of visual illusions in schizophrenia

Specific abnormalities of vision in schizophrenia have been observed to affect high-level and some low-level integration mechanisms, suggesting that people with schizophrenia may experience anomalies across different stages in the visual system affecting either early or late processing or both. Here, we review the research into visual illusion perception in schizophrenia and the issues which previous research has faced. One general finding that emerged from the literature is that those with schizophrenia are mostly immune to the effects of high-level illusory displays, but this effect is not consistent across all low-level illusions. The present review suggests that this resistance is due to the weakening of top–down perceptual mechanisms and may be relevant to the understanding of symptoms of visual distortion rather than hallucinations as previously thought.     

Action unit classification using active appearance models and conditional random fields

In this paper, we investigate to what extent modern computer vision and machine learning techniques can assist social psychology research by automatically recognizing facial expressions. To this end, we develop a system that automatically recognizes the action units defined in the facial action coding system (FACS). The system uses a sophisticated deformable template, which is known as the active appearance model, to model the appearance of faces. The model is used to identify the location of facial feature points, as well as to extract features from the face that are indicative of the action unit states. The detection of the presence of action units is performed by a time series classification model, the linear-chain conditional random field. We evaluate the performance of our system in experiments on a large data set of videos with posed and natural facial expressions. In the experiments, we compare the action units detected by our approach with annotations made by human FACS annotators. Our results show that the agreement between the system and human FACS annotators is higher than 90% and underlines the potential of modern computer vision and machine learning techniques to social psychology research. We conclude with some suggestions on how systems like ours can play an important role in research on social signals.     

Action unit classification using active appearance models and conditional random fields

In this paper, we investigate to what extent modern computer vision and machine learning techniques can assist social psychology research by automatically recognizing facial expressions. To this end, we develop a system that automatically recognizes the action units defined in the facial action coding system (FACS). The system uses a sophisticated deformable template, which is known as the active appearance model, to model the appearance of faces. The model is used to identify the location of facial feature points, as well as to extract features from the face that are indicative of the action unit states. The detection of the presence of action units is performed by a time series classification model, the linear-chain conditional random field. We evaluate the performance of our system in experiments on a large data set of videos with posed and natural facial expressions. In the experiments, we compare the action units detected by our approach with annotations made by human FACS annotators. Our results show that the agreement between the system and human FACS annotators is higher than 90% and underlines the potential of modern computer vision and machine learning techniques to social psychology research. We conclude with some suggestions on how systems like ours can play an important role in research on social signals.