The coding of roughness.

This review examines the way information about textures is captured, encoded, and processed by the somatosensory system to produce sensations of roughness/smoothness. Textures with spatial periods exceeding about 200 microm are encoded spatially, so roughness is nearly independent of the speed and direction of their movement across the skin. The information consists of spatial variations in activity among slowly adapting (SA1) mechanoreceptors, and appears to be extracted by specialized cortical neurons. Perception of the roughness of finer surfaces is mediated by detection, primarily by Pacinian afferents, of cutaneous vibrations generated when textures move across the skin. Movement is necessary to the perception of these textures, and vibrotactile adaptation interferes with it. The code is an intensitive one (i.e., the amount of activity in Pacinian afferents).     

Partial perceptual equivalence between vision and touch for texture information

The present study examined the extent to which vision and touch are perceptually equivalent for texture information in adults. Using Garbin's method, we selected two sets of textures having high versus low cross-modal dissimilarity values between vision and touch (Experiment 1). The two sets of textures were then used as material in a cross-modal matching task (Experiment 2). Results showed that asymmetries occurred in the performances when the stimuli had high cross-modal dissimilarity values, but not when the stimuli had low cross-modal dissimilarity values. These results extend Garbin's findings on shape information to the texture domain and support the idea that partial perceptual equivalence exists between vision and touch.     

Vibrotactile intensity and frequency information in the pacinian system: a psychophysical model

The objective of the study was to characterize the Pacinian representation of stimulus waveform. Subjects were presented with pairs of high-frequency vibrotactile stimuli that varied in intensity and/or frequency content and made same-different judgments under conditions of low-frequency adaptation designed to minimize the contribution of the RA system. We wished to infer the nature of the information conveyed by the Pacinian system about the stimuli from measured sensitivity (d') to stimulus differences. We first tested the hypothesis that the Pacinian system conveys only intensive information about vibratory stimuli and found that intensive cues could not account for much of the variance in the discrimination data. We then proposed a model characterizing the Pacinian-mediated representation of an arbitrary stimulus as a pattern of activation in a set of frequency-tuned minichannels. The model was shown to predict the discriminability of the stimulus pairs presented in the psychophysical experiments. Furthermore, the model parameters, optimized to fit the discrimination data, were compatible with analogous values obtained in other experimental contexts. One of the assumptions underlying the model is that information about individual spectral components is conveyed in parallel and quasi-independently. By simulating the response of a population of Pacinian afferents to a polyharmonic stimulus, we demonstrated that such a population can simultaneously convey information about multiple frequency components, despite having a homogeneous spectral profile.     

Individual differences in perceptual space for tactile textures: evidence from multidimensional scaling

Ratio scaling was used to obtain from 5 subjects estimates of the subjective dissimilarity between the members of all possible pairs of 17 tactile surfaces. The stimuli were a diverse array of everyday surfaces, such as corduroy, sandpaper, and synthetic fur. The results were analyzed using the multidimensional scaling (MDS) program ALSCAL. There was substantial, but not complete, agreement across subjects in the spatial arrangement of perceived textures. Scree plots and multivariate analysis suggested that, for some subjects, a two-dimensional space was the optimal MDS solution, whereas for other subjects, a three-dimensional space was indicated. Subsequent to their dissimilarity scaling, subjects rated each stimulus on each of five adjective scales. Consistent with earlier research, two of these (rough/smooth and soft/hard) were robustly related to the space for all subjects. A third scale, sticky/slippery, was more variably related to the dissimilarity data: regressed into three-dimensional MDS space, it was angled steeply into the third dimension only for subjects whose scree plots favored a nonplanar solution. We conclude that the sticky/slippery dimension is perceptually weighted less than the rough/smooth and soft/hard dimensions, materially contributing to the structure of perceptual space only in some individuals.     

Tactile roughness perception with a rigid link interposed between skin and surface.

Subjects made roughness judgments of textured surfaces made of raised elements, while holding stick-like probes or through a rigid sheath mounted on the fingertip. These rigid links, which impose vibratory coding of roughness, were compared with the finger (bare or covered with a compliant glove), using magnitude-estimation and roughness differentiation tasks. All end effectors led to an increasing function relating subjective roughness magnitude to surface interelement spacing, and all produced above-chance roughness discrimination. Although discrimination was best with the finger, rigid links produced greater perceived roughness for the smoothest stimuli. A peak in the magnitude-estimation functions for the small probe and a transition from calling more sparsely spaced surfaces rougher to calling them smoother were predictable from the size of the contact area. The results indicate the potential viability of vibratory coding of roughness through a rigid link and have implications for teleoperation and virtual-reality systems.     

Tactile roughness perception with a rigid link interposed between skin and surface

Subjects made roughness judgments of textured surfaces made of raised elements, while holding stick-like probes or through a rigid sheath mounted on the fingertip. These rigid links, which impose vibratory coding of roughness, were compared with the finger (bare or covered with a compliant glove), using magnitude-estimation and roughness differentiation tasks. All end effectors led to an increasing function relating subjective roughness magnitude to surface interelement spacing, and all produced above-chance roughness discrimination. Although discrimination was best with the finger, rigid links produced greater perceived roughness for the smoothest stimuli. A peak in the magnitude-estimation functions for the small probe and a transition from calling more sparsely spaced surfaces rougher to calling them smoother were predictable from the size of the contact area. The results indicate the potential viability of vibratory coding of roughness through a rigid link and have implications for teleoperation and virtual-reality systems.     

Discriminations among perceptual and symbolic stimuli

This research compares the time required for perceptual discriminations among pairs of physically present objects (circles) with the time required to discriminate pairs of symbols Inonsense syllables) that subjects learned to associate uniquely with each of the circles. Four experiments show very large differences between symbolic and perceptual discriminations. Discrimination times for the perceptual stimuli declined systematically as their size ratio increased, but discriminations among the associated nonsense syllables showed only a strictly ordinal effect of position in the series. Discriminations among the symbolic stimuli showed a large semantic congruity effect, but the perceptual stimuli showed none. The research does not replicate previous results showing similarities between perceptual and symbolic processing suggestive of image processing. We conclude that in the symbolic task subjects use only ordinal information rather than images or analog representations of the associated circles. We propose that perceptual discriminations show a semantic congruity effect only when they are processed as if the perceptual stimuli were symbolic.     

Statistical learning within and between modalities: pitting abstract against stimulus-specific representations

When learners encode sequential patterns and generalize their knowledge to novel instances, are they relying on abstract or stimulus-specific representations? Research on artificial grammar learning (AGL) has shown transfer of learning from one stimulus set to another, and such findings have encouraged the view that statistical learning is mediated by abstract representations that are independent of the sense modality or perceptual features of the stimuli. Using a novel modification of the standard AGL paradigm, we obtained data to the contrary. These experiments pitted abstract processing against stimulus-specific learning. The findings show that statistical learning results in knowledge that is stimulus-specific rather than abstract. They show furthermore that learning can proceed in parallel for multiple input streams along separate perceptual dimensions or sense modalities. We conclude that learning sequential structure and generalizing to novel stimuli inherently involve learning mechanisms that are closely tied to the perceptual characteristics of the input.     

A theoretical framework for testing the additive difference model for dissimilarities data: Representing gambles as multidimensional stimuli

Implicit within the acceptance of most multidimensional scaling models as accurate representations of an individual's cognitive structure for a set of complex stimuli, is the acceptance of the more general Additive Difference Model (ADM). A theoretical framework for testing the ordinal properties of the ADM for dissimilarities data is presented and is illustrated for a set of three-outcome gambles. Paired comparison dissimilarity judgments were obtained for two sets of gambles. Judgments from one set were first analyzed using the ALSCAL individual differences scaling model. Based on four highly interpretable dimensions derived from this analysis, a predicted set of dimensions were obtained for each subject for the second set of gambles. The ordinal properties of the ADM necessary for interdimensional additivity and intradimensional subtractivity were then tested for each subject's second set of data via a new computer-based algorithm, ADDIMOD. The tests indicated that the ADM was rejected. Although violations of the axioms were significantly less than what would be expected by chance, for only one subject was the model clearly supported. It is argued that while multidimensional scaling models may be useful as data reduction techniques, they do not reflect the perceptual processes used by individuals to form judgments of similarity. Implications for further study of multidimensional scaling models are offered and discussed.     

The effect of skin temperature on vibrotactile sensitivity

The effect of skin temperature on detection of vibrotactile stimuli was measured for vibrations of 30 and 250 Hz. Data for the 250-Hz stimulus supported the results of Weitz (1941), who found that thresholds for 100-, 256-, and 900-Hz vibration varied as a If-shape function of skin temperature with a minimum at about 37°C. Temperature had a negligible effect on sensitivity at 30 Hz. A second experiment examined a range of frequencies between 30 and 250 Hz. Cooling greatly lowered sensitivity only to 150- and 250-Hz stimuli. Warming reduced sensitivity less, but more uniformly across frequencies. It was concluded that cooling may affect vibrotactile thresholds by decreasing the sensitivity of Pacinian corpuscles; the reason for the decrease in sensitivity due to warming is unclear.     

Perceptual load influences auditory space perception in the ventriloquist aftereffect

A period of exposure to trains of simultaneous but spatially offset auditory and visual stimuli can induce a temporary shift in the perception of sound location. This phenomenon, known as the ‘ventriloquist aftereffect’, reflects a realignment of auditory and visual spatial representations such that they approach perceptual alignment despite their physical spatial discordance. Such dynamic changes to sensory representations are likely to underlie the brain’s ability to accommodate inter-sensory discordance produced by sensory errors (particularly in sound localization) and variability in sensory transduction. It is currently unknown, however, whether these plastic changes induced by adaptation to spatially disparate inputs occurs automatically or whether they are dependent on selectively attending to the visual or auditory stimuli. Here, we demonstrate that robust auditory spatial aftereffects can be induced even in the presence of a competing visual stimulus. Importantly, we found that when attention is directed to the competing stimuli, the pattern of aftereffects is altered. These results indicate that attention can modulate the ventriloquist aftereffect.     

Regular Minimality and Thurstonian-type modeling

A Thurstonian-type model for pairwise comparisons is any model in which the response (e.g., “they are the same” or “they are different”) to two stimuli being compared depends, deterministically or probabilistically, on the realizations of two randomly varying representations (perceptual images) of these stimuli. The two perceptual images in such a model may be stochastically interdependent but each has to be selectively dependent on its stimulus. It has been previously shown that all possible discrimination probability functions for same–different comparisons can be generated by Thurstonian-type models of the simplest variety, with independent percepts and deterministic decision rules. It has also been shown, however, that a broad class of Thurstonian-type models, called “well-behaved” (and including, e.g., models with multivariate normal perceptual representations whose parameters are smooth functions of stimuli) cannot simultaneously account for two empirically plausible properties of same–different comparisons, Regular Minimality (which essentially says that “being least discriminable from” is a symmetric relation) and nonconstancy of the minima of discrimination probabilities (the fact that different pairs of least discriminable stimuli are discriminated with different probabilities). These results have been obtained for stimulus spaces represented by regions of Euclidean spaces. In this paper, the impossibility for well-behaved Thurstonian-type models to simultaneously account for Regular Minimality and nonconstancy of minima is established for a much broader notion of well-behavedness applied to a much broader class of stimulus spaces (any Hausdorff arc-connected ones). The universality of Thurstonian-type models with independent perceptual images and deterministic decision rules is shown (by a simpler proof than before) to hold for arbitrary stimulus spaces.     

Reliability and dimensionality of judgments of visually textured materials

We extended perceptual studies of the Brodatz set of textured materials. In the experiments, texture perception for different texture sets, viewing distances, or lighting intensities was examined. Subjects compared one pair of textures at a time. The main task was to rapidly rate all of the texture pairs on a number scale for their overall dissimilarities first and then for their dissimilarities according to six specified attributes (e.g., texture contrast). The implied dimensionality of perceptual texture space was usually at least four, rather than three. All six attributes proved to be useful predictors of overall dissimilarity, especially coarseness and regularity. The novel attribute texture lightness, an assessment of mean surface reflectance, was important when viewing conditions were wide-ranging. We were impressed by the general validity of texture judgments across subject, texture set, and comfortable viewing distances or lighting intensities. The attributes are nonorthogonal directions in four-dimensional perceptual space and are probably not narrow linear axes. In a supplementary experiment, we studied a completely different task: identifying textures from a distance. The dimensionality for this more refined task is similar to that for rating judgments, so our findings may have general application.     

Recognition memory for realistic synthetic faces

A series of experiments examined short-term recognition memory for trios of briefly presented, synthetic human faces derived from three real human faces. The stimuli were a graded series of faces, which differed by varying known amounts from the face of the average female. Faces based on each of the three real faces were transformed so as to lie along orthogonal axes in a 3-D face space. Experiment 1 showed that the synthetic faces' perceptual similarity structure strongly influenced recognition memory. Results were fit by a noisy exemplar model (NEMO) of perceptual recognition memory. The fits revealed thatrecognition memory was influenced both by the similarity of the probe to the series items and by the similarities among the series items themselves. Nonmetric multidimensional scaling (MDS) showed that the faces' perceptual representations largely preserved the 3-D space in which the face stimuli were arrayed. NEMO gave a better account of the results when similarity was defined as perceptual MDS similarity, rather than as the physical proximity of one face to another. Experiment 2 confirmed the importance of within-list homogeneity directly, without mediation of a model. We discuss the affinities and differences between visual memory for synthetic faces and memory for simpler stimuli.     

Attention improves perceptual quality

Attention has been demonstrated to affect response speed, signal detection, and perceptual enhancement. We wished to determine whether exogenously cued attention had the additional effect of improving the veridicality of perceptual representations. We determined the accuracy and precision of orientation judgments for static and dynamic stimuli when they were, and when they were not, exogenously cued (luminance change). Valid exogenous cues led to more accurate responses that were also quicker. The attentional accuracy benefits were robust to stimulus degradation. Since our task displayed only one test stimulus at a time, response biases cannot account for our results. We concluded that exogenous cues can lead to percepts that are, on average, more similar to the external stimulus. Thus, exogenous cuing can improve perceptual quality.     

Perception of frequency, amplitude, and azimuth of a vibratory dipole source by the octavolateralis system of goldfish (Carassius auratus)

Goldfish (Carassius auratus) were conditioned to suppress respiration to a 40-Hz vibratory source and subsequently tested for stimulus generalization to frequency, stimulus amplitude, and position (azimuth). Animals completely failed to generalize to frequencies separated by octave intervals both lesser and greater than the CS. However, they did appear to generalize weakly to an aerial loudspeaker stimulus of the same frequency (40 Hz) after conditioning with an underwater vibratory source. Animals had a gradually decreasing amount of generalization to amplitude changes, suggesting a perceptual dimension of loudness. Animals generalized largely or completely to the same underwater source presented at a range of source azimuths. When these azimuths were presented at a transect of 3 cm, some animals did show decrements in generalization, while others did not. This suggests that although azimuth may be perceived more saliently at distances closer to a dipole source, perception of position is not immediately salient in conditioned vibratory source detection. Differential responding to test stimuli located toward the head or tail suggests the presence of perceptual differences between sources that are rostral or caudal with respect to the position of the animal or perhaps the head.     

Attentional capture by items that match episodic long-term memory representations

A remarkable ability of the human visual system is the implementation of attentional control settings (ACSs) that govern what stimuli capture or hold attention. We provide evidence that ACSs can be specified by episodic long-term memory representations. In all experiments, participants memorized 30 images of objects that they then monitored for in an attention task, inducing an episodic-based ACS. In Experiments 1a and 1b, only studied cues in a cueing task captured attention. We confirmed these cueing effects reflect capture by testing for inhibition of return in Experiment 2a, and controlled for perceptual masking by cues in Experiment 2b. In Experiment 3 we determined that ACSs are specifically supported by episodic retrieval, by dividing studied images into two sets and designating one as the targets in a rapid serial visual presentation task: Only target-set matching distractors produced a spatial blink (captured attention). These results extend our understanding of the representations specifying ACSs.     

Inhibition of acoustic startle using different mechanoreceptive channels

In this experiment, we investigated the impact of vibrotactile prepulse frequency and intensity on the acoustically elicited startle response in humans. Mechanoreceptive channels differing in their sensitivity to transient stimulation have been identified in the skin. The Pacinian channel is optimally sensitive to vibrations at approximately 300 Hz and is specialized for the detection of stimulus transients, whereas the non-Pacinian I and III channels are optimally sensitive to vibrations at approximately 30 Hz. Vibrotactile prepulses with frequencies of 30 and 300 Hz and intensities of 95 and 130 mV were presented for 50 msec to the dominant hand of college students (N = 31), followed on some trials by a 95-dB broadband acoustic startle stimulus. The 300-Hz prepulses resulted in significantly more pronounced inhibition of startle magnitude, amplitude, and probability, whereas only the 30-Hz prepulses significantly facilitated blink latency. These results support the idea that the inhibition of acoustic startle is determined more by transient than by sustained aspects of vibrotactile prepulse stimuli. This study also demonstrates that different aspects of the startle response differentially reflect stimulus characteristics of the prepulse.     

Modeling recognition memory using the similarity structure of natural input

The natural input memory (NIM) model is a new model for recognition memory that operates on natural visual input. A biologically informed perceptual preprocessing method takes local samples (eye fixations) from a natural image and translates these into a feature-vector representation. During recognition, the model compares incoming preprocessed natural input to stored representations. By complementing the recognition memory process with a perceptual front end, the NIM model is able to make predictions about memorability based directly on individual natural stimuli. We demonstrate that the NIM model is able to simulate experimentally obtained similarity ratings and recognition memory for individual stimuli (i.e., face images).