A neural network model of implicit memory for object recognition

People name well-known objects shown in pictures more quickly if they have studied them previously. The most common interpretation of this priming effect is that processing is facilitated by an implicit memory trace in a perceptual representation system. We show that object priming can be explained instead as a bias in information processing, without recourse to an implicit memory system. Assumptions about psychological decision-making processes and bias were added to a neural network model for object identification, and the model accounted for performance both qualitatively and quantitatively in four object identification experiments.     

A neural basis for expert object recognition

Although most adults are considered to be experts in the identification of faces, fewer people specialize in the recognition of other objects, such as birds and dogs. In this research, the neurophysiological processes associated with expert bird and dog recognition were investigated using event-related potentials. An enhanced early negative component (N170, 164 ms) was found when bird and dog experts categorized objects in their domain of expertise relative to when they categorized objects outside their domain of expertise. This finding indicates that objects from well-learned categories are neurologically differentiated from objects from lesser-known categories at a relatively early stage of visual processing.     

A neural network simulator for supercomputers

Connectionist modeling is computationally intensive. Until parallel computers become more widely available, supercomputing resources can be exploited. This paper describes a neural network simulator (NNS) written in FORTRAN for supercomputers. The present simulation engine consists of code for the backpropagation method of changing weights in connectionist models. A file interface reports simulation results in a variety of formats. The file interface also contains an interpreter for an input file through which the network structure is defined, the problem is represented, and various parameters are set. The input-file syntax is described in detail. NNS has been used both as an instructional aid and as a research tool. A simulation of “recovery of unrehearsed associations” is used to illustrate the use of the input file and to demonstrate the performance of NNS. Versions of NNS have been written for the Cray X-MP/48 and for the IBM 3090.     

Large-scale neural network for sentence processing

Our model of sentence comprehension includes at least grammatical processes important for structure-building, and executive resources such as working memory that support these grammatical processes. We hypothesized that a core network of brain regions supports grammatical processes, and that additional brain regions are activated depending on the working memory demands associated with processing a particular grammatical feature. We used functional magnetic resonance imaging (fMRI) to test this hypothesis by comparing cortical activation patterns during coherence judgments of sentences with three different syntactic features. We found activation of the ventral portion of left inferior frontal cortex during judgments of violations of each grammatical feature. Increased recruitment of the dorsal portion of left inferior frontal cortex was seen during judgments of violations of specific grammatical features that appear to involve a more prominent working memory component. Left posterolateral temporal cortex and anterior cingulate were also implicated in judging some of the grammatical features. Our observations are consistent with a large-scale neural network for sentence processing that includes a core set of regions for detecting and repairing several different kinds of grammatical features, and additional regions that appear to participate depending on the working memory demands associated with processing a particular grammatical feature.     

Influence of movement activities on shape recognition and retention.

Three groups of 4-yr.-old children were asked to complete a form perception assessment instrument prior to, 1 hr. after, and 1 wk. following a treatment. Group 1 participated in a movement-based form perception program, while Group 2 was instructed using a traditional classroom method. A third group which acted as control participated in unrelated movement activities. A repeated-measures analysis of variance gave a main effect of tests and an interaction of groups X tests. Group 2 displayed significantly higher performance on the posttest than Group 1; however, after 7 wk. the performance of Group 2 had decreased to a level below that of Groups 1 and 3, which remained stable.     

Short-term memory for serial order: a recurrent neural network model

Despite a century of research, the mechanisms underlying short-term or working memory for serial order remain uncertain. Recent theoretical models have converged on a particular account, based on transient associations between independent item and context representations. In the present article, the authors present an alternative model, according to which sequence information is encoded through sustained patterns of activation within a recurrent neural network architecture. As demonstrated through a series of computer simulations, the model provides a parsimonious account for numerous benchmark characteristics of immediate serial recall, including data that have been considered to preclude the application of recurrent neural networks in this domain. Unlike most competing accounts, the model deals naturally with findings concerning the role of background knowledge in serial recall and makes contact with relevant neuroscientific data. Furthermore, the model gives rise to numerous testable predictions that differentiate it from competing theories. Taken together, the results presented indicate that recurrent neural networks may offer a useful framework for understanding short-term memory for serial order.     

Looking for a structural network: effects of changing size and style on letter recognition.

The accuracy of identifying backward-masked strings of unrelated letters was measured to test a prediction of a structural network model in which information about the absolute size of letters in a font is factored out from other types of information and is represented by a single size parameter. In this model, variation from block to block in the font size should be handled relatively easily by changing this parameter. In contrast, variation in several aspects of the font style would require changing multiple parameters and should be more difficult. In three experiments, the font was alternated in style, size, size and style, or not at all, at the end of each block of eight trials. The accuracy was lower overall when the font was varied, but contrary to the predictions of the model, variation in size reduced the accuracy of performance as much as did variation in style and variation in size and style.     

Model for a flexible motor memory based on a self-active recurrent neural network

Using recent recurrent network architecture based on the reservoir computing approach, we propose and numerically simulate a model that is focused on the aspects of a flexible motor memory for the storage of elementary movement patterns into the synaptic weights of a neural network, so that the patterns can be retrieved at any time by simple static commands. The resulting motor memory is flexible in that it is capable to continuously modulate the stored patterns. The modulation consists in an approximately linear inter- and extrapolation, generating a large space of possible movements that have not been learned before. A recurrent network of thousand neurons is trained in a manner that corresponds to a realistic exercising scenario, with experimentally measured muscular activations and with kinetic data representing proprioceptive feedback. The network is “self-active” in that it maintains recurrent flow of activation even in the absence of input, a feature that resembles the “resting-state activity” found in the human and animal brain. The model involves the concept of “neural outsourcing” which amounts to the permanent shifting of computational load from higher to lower-level neural structures, which might help to explain why humans are able to execute learned skills in a fluent and flexible manner without the need for attention to the details of the movement.     

Posterior parietal cortex as part of a neural network for directed attention in rats

A rodent model of directed attention has been developed based upon behavioral analysis of contralateral neglect, pharmacological manipulations, and anatomical analysis of neural circuitry. In each of these three domains the rodent model exhibits striking similarities to humans. We hypothesize that there is a specific thalamo-cortical-basal ganglia network that subserves spatial attentional functions. Key components of this network are medial agranular and posterior parietal cortex, dorsocentral striatum, and the lateral posterior thalamic nucleus. Several issues need to be addressed before we can hope to realistically understand or model the functions of this network. Among these are the roles of medial versus lateral posterior parietal cortex; cholinergic mechanisms in attention; interhemispheric interactions; the role of synchronous firing at the cortical, striatal, and thalamic levels; interactions between cortical and thalamic projections to the striatum; interactions between cortical and nigral inputs to the thalamus; the role of collicular inputs to the lateral posterior thalamic nucleus; the role of cerebral cortex versus superior colliculus in driving the motor output expressed as orienting behavior during directed attention; the extent to which the circuitry we describe for directed attention also plays a role in other forms of attention.     

Outline shape is a mediator of object recognition that is particularly important for living things

We assess the importance of outline shape in mediating the recognition of living and nonliving things. Natural objects were presented as shaded line drawings or silhouettes, and were living and nonliving things. For object decision (deciding whether an object may be encountered in real life) there were longer response times to nonliving than to living things. Importantly, this category difference was greater for silhouettes than for shaded line drawings. For naming, similar category and stimulus differences were evident, but were not as pronounced. We also examined effects of prior naming on subsequent object decision performance. Repetition priming was equivalent for nonliving and living things. However, prior presentation of silhouettes (but not shaded line drawings) reduced the longer RT to nonliving things relative to living things in silhouette object decision. We propose that outline contour benefits recognition of living things more than nonliving things: For nonliving things, there may be greater 2-D/3-D interpretational ambiguity, and/or they may possess fewer salient features.     

A neural network approach to identifying adolescent adjustment.

This study examined the relationship between the quality of adjustment in adolescents and a set of psychiatric diagnoses, personality traits, parental bonding, and social support variables. One hundred fifty adolescents were administered the Millon Adolescent Personality Inventory, the Parental Bonding Questionnaire, the Social Support Questionnaire, and the Diagnostic Interview for Children and Adolescents. A neural network approach was then utilized, and it was found that several of the variables (e.g., Major Depressive Disorder, Conduct Disorder, and Societal Conformity) had a significant role in classifying adolescents into three groups: maladjusted, nominally adjusted, and well-adjusted.     

Errors in proofreading: Evidence for the use of word shape in word recognition

Subjects were given a passage to read for meaning while at the same time checking off any misspellings. Critical words in the text were mutilated by either deleting or substituting letters. In half of these mutilations, an ascender in the word was removed, resulting in a large change in the overall shape of the word. In the first experiment, it was found that mutilations involving the substitution of letters were more likely to be noticed than mutilations involving deletions. For both types of mutilation, alterations to word shape were more often noticed than alterations that preserved word shape. When word shape cues were eliminated by using mixed-case stimuli in Experiment 2, the shape effect was abolished. The results are interpreted as evidence for a supraletter feature corresponding to word shape.     

How a hobby can shape cognition: visual word recognition in competitive Scrabble players

Competitive Scrabble is an activity that involves extraordinary word recognition experience. We investigated whether that experience is associated with exceptional behavior in the laboratory in a classic visual word recognition paradigm: the lexical decision task (LDT). We used a version of the LDT that involved horizontal and vertical presentation and a concreteness manipulation. In Experiment 1, we presented this task to a group of undergraduates, as these participants are the typical sample in word recognition studies. In Experiment 2, we compared the performance of a group of competitive Scrabble players with a group of age-matched nonexpert control participants. The results of a series of cognitive assessments showed that the Scrabble players and control participants differed only in Scrabble-specific skills (e.g., anagramming). Scrabble expertise was associated with two specific effects (as compared to controls): vertical fluency (relatively less difficulty judging lexicality for words presented in the vertical orientation) and semantic deemphasis (smaller concreteness effects for word responses). These results suggest that visual word recognition is shaped by experience, and that with experience there are efficiencies to be had even in the adult word recognition system.     

Effects of structural similarity on neural substrates for object recognition

Human occipitotemporal cortex (OTC) is critically involved in object recognition, but the functional organization of this brain region is controversial. In the present study, functional magnetic resonance imaging (fMRI) signal changes were recorded in humans during an animal-matching task that parametrically varied degree of structural (i.e., shape) similarity among the items. fMRI signal in the midto anterior-fusiform gyrus increased as animals overlapped more in terms of structure and as reaction time increased. In contrast, relatively more posterior aspects of the fusiform gyrus and inferior occipital cortex showed greater fMRI signal when the animals overlapped less in terms of structure. A similar organization emerged when three-dimensional geometric shapes were matched, indicating that OTC is differentially tuned to varying degrees of overlap in object structure, regardless of taxonomic category. We discuss how the present findings fit in with current functional neuroanatomical approaches to object recognition.     

Acquired equivalence and distinctiveness of cues: I. Exploring a neural network approach

Rats were placed in 4 contexts (A, B, C, D) where they received 2 auditory stimuli (X, Y); in A and B, presentations of X were paired with food and those of Y were not, and in C and D, Y was paired with food and X was not. Rats then received combinations of contexts that had provided congruent (AB, CD) or incongruent (AD, CB) information about X and Y's relationship to food. Responding was more variable during congruent than incongruent trials (Experiment 1) and was systematically increased and decreased during congruent (relative to incongruent) trials by the presentation of food or no food, respectively (Experiment 2). These results support a connectionist approach to acquired changes in stimulus distinctiveness.     

Stereo disparity facilitates view generalization during shape recognition for solid multipart objects

Current theories of object recognition in human vision make different predictions about whether the recognition of complex, multipart objects should be influenced by shape information about surface depth orientation and curvature derived from stereo disparity. We examined this issue in five experiments using a recognition memory paradigm in which observers (N = 134) memorized and then discriminated sets of 3D novel objects at trained and untrained viewpoints under either mono or stereo viewing conditions. In order to explore the conditions under which stereo-defined shape information contributes to object recognition we systematically varied the difficulty of view generalization by increasing the angular disparity between trained and untrained views. In one series of experiments, objects were presented from either previously trained views or untrained views rotated (15°, 30°, or 60°) along the same plane. In separate experiments we examined whether view generalization effects interacted with the vertical or horizontal plane of object rotation across 40° viewpoint changes. The results showed robust viewpoint-dependent performance costs: Observers were more efficient in recognizing learned objects from trained than from untrained views, and recognition was worse for extrapolated than for interpolated untrained views. We also found that performance was enhanced by stereo viewing but only at larger angular disparities between trained and untrained views. These findings show that object recognition is not based solely on 2D image information but that it can be facilitated by shape information derived from stereo disparity.     

Visual aftereffects for walking actions reveal underlying neural mechanisms for action recognition

The results of this study illustrate a new high-level visual aftereffect: Observing actors walking forward, without horizontal translation, makes subsequent actors appear to walk backward, and the opposite effect is obtained after observing backward walking. We used this aftereffect, which cannot be explained by simple low-level adaptation to motion direction, to investigate the properties of neural mechanisms underlying recognition of walking actions. Our results suggest that the perception of walking and the perception of static images of actors in walking postures rely on common brain mechanisms that are primarily object centered, rather than viewer centered, and that are blind to the identity of the actor. These results, obtained with human psychophysical adaptation techniques, support previous evidence accumulated using single-unit recording in nonhuman primates. In addition, these results provide evidence that current models of human action recognition require an object-centered processing stage.