Using vision and dynamic touch to perceive the affordances of tools

The information that people use to perceive whether a tool is suitable for a certain task depends on what is available at a given time. Visually scanning a tool and wielding it each provide information about the functional attributes of the tool. In experiment 1, we investigated the relative contributions of vision and dynamic touch to perceiving the suitability of various tools for various tasks. The results show that, when both vision and dynamic touch are available, the visual information dominates. When limited to dynamic touch, ratings of suitability are constrained by the inertial properties of the tool, and the inertial properties that are exploited depend on the task. In experiment 2, we asked whether the manner in which a tool is manipulated in exploration depends on the task for which it is being evaluated. The results suggest that tools are manipulated in ways that reflect intentions to perceive particular affordances. Exploratory movements sometimes mimic performatory movements.     

Rhythm implicitly affects temporal orienting of attention across modalities

Here we present two experiments investigating the implicit orienting of attention over time by entrainment to an auditory rhythmic stimulus. In the first experiment, participants carried out a detection and discrimination tasks with auditory and visual targets while listening to an isochronous, auditory sequence, which acted as the entraining stimulus. For the second experiment, we used musical extracts as entraining stimulus, and tested the resulting strength of entrainment with a visual discrimination task. Both experiments used reaction times as a dependent variable. By manipulating the appearance of targets across four selected metrical positions of the auditory entraining stimulus we were able to observe how entraining to a rhythm modulates behavioural responses. That our results were independent of modality gives a new insight into cross-modal interactions between auditory and visual modalities in the context of dynamic attending to auditory temporal structure.     

Spatial and temporal processing in the auditory and visual modalities

Three experiments tested the idea that auditory presentation facilitates temporal recall whereas spatial recall is better if the input modality is visual. Lists of words were presented in which the temporal and spatial orders were independent, and instructions to the subjects determined whether recall would be given in a spatial or temporal order. In all three experiments, a significant interaction between the input modality and the type of recall was found, such that visual presentation resulted in superior recall over auditory presentation in the spatial conditions and auditory presentation yielded superior recall to visual in the temporal conditions. The present results contradict an earlier study by Murdock that showed that auditory presentation resulted in better performance than visual presentation in a nominally spatial task. An explanation for the discrepancies between the results of that study and the present one is presented.     

Using temporal cohesion to predict temporal coherence in narrative and expository texts

We investigated the linguistic features of temporal cohesion that distinguish variations in temporal coherence. In an analysis of 150 texts, experts rated temporal coherence on three continuous scale measures designed to capture unique representations of time. Coh-Metrix, a computational tool that assesses textual cohesion, correctly predicted the human ratings with five features of temporal cohesion. The correlations between predicted and actual scores were all statistically significant. In a complementary study, we explored the importance of temporal cohesion in characterizing genre. A discriminant function analysis, using Coh-Metrix temporal indices, successfully distinguished the genres of science, history, and narrative texts. The results suggested that history texts are more similar to narrative texts than to science texts in terms of temporal cohesion.     

Using temporal order to identify spatial reference frames

A new method for identifying spatial reference frames is described and applied to the study of spatial span. In this method, a spatial sequence is displayed in relation to two reference frames that move relative to each other, so that different temporal orders are described in each reference frame. As applied to spatial span, a sequence of dots was displayed on a rectangular template that moved relative to the computer screen and the observer. Three experiments showed that the choice of reference frame is influenced by prior conditions, the size of the template, and the presence of an alternative stationary reference frame. Recall was impaired (1) when the template moved, suggesting that movement interference occurred, and (2) with increasing template size, but only if the template was used as the reference frame.     

Shared and distinct factors driving attention and temporal processing across modalities

In addition to the classic finding that “sounds are judged longer than lights,” the timing of auditory stimuli is often more precise and accurate than is the timing of visual stimuli. In cognitive models of temporal processing, these modality differences are explained by positing that auditory stimuli more automatically capture and hold attention, more efficiently closing an attentional switch that allows the accumulation of pulses marking the passage of time (Penney, Gibbon, & Meck, 2000). However, attention is a multifaceted construct, and there has been little attempt to determine which aspects of attention may be related to modality effects. We used visual and auditory versions of the Continuous Temporal Expectancy Task (CTET; O'Connell et al., 2009) a timing task previously linked to behavioral and electrophysiological measures of mind-wandering and attention lapses, and tested participants with or without the presence of a video distractor. Performance in the auditory condition was generally superior to that in the visual condition, replicating standard results in the timing literature. The auditory modality was also less affected by declines in sustained attention indexed by declines in performance over time. In contrast, distraction had an equivalent impact on performance in the two modalities. Analysis of individual differences in performance revealed further differences between the two modalities: Poor performance in the auditory condition was primarily related to boredom whereas poor performance in the visual condition was primarily related to distractibility. These results suggest that: 1) challenges to different aspects of attention reveal both modality-specific and nonspecific effects on temporal processing, and 2) different factors drive individual differences when testing across modalities.     

The temporal course of visual pattern encoding: Effects of pattern goodness

Subjects typically display superior reproduction of good (redundant, symmetrical) visual patterns compared with poor ones. This pattern goodness effect could conceivably involve encoding processes, short-term memory processes, or response processes. The present experiments explored the time course of wholistic encoding of Garner dot patterns as a function of tachistoscopic exposure time, delay of backward masking, and post-mask shadowing. Within the specific framework of additive factors theory, Experiment I showed: (a) equal rates of encoding for all patterns since comparable slopes were obtained for the recall X processing time functions; and (b) superior absolute recall for good patterns since different intercepts were obtained. Experiment II demonstrated that when degree of encoding was initially equalized for all patterns, the rate of extraction of further information remained constant over available processing time and was unaffected by pattern goodness, slopes and intercepts for good versus poor patterns then being equal. Experiment III confirmed that, given some fixed duration of available processing time, information is abstracted at the same rate for all pattern regardless of the ratio stimulus display time to delay of mask onset. Experiment IV indicated that maintenance rehearsal normally occurs in the present experimental situation, and that very good patterns are somewhat less disrupted by shadowing over a three-second interval. While STM is thus implicated in the pattern goodness effect it does not follow that STM constitutes a complete explanation of the intercept differences reported here. Empirical evidence of response bias toward production of good patterns, however, was not found. It was shown that very good patterns are highly familiar and nameable, and proposed that they do consequently have an early encoding advantage.     

Conditions for young infants' failure to perceive trajectory continuity

When viewing an event in which an object moves behind an occluder on part of its trajectory, 4-month-old infants perceive the trajectory as continuous only when time or distance out of sight is short. Little is known, however, about the conditions under which young infants perceive trajectories to be discontinuous. In the present studies we focus first on infants' perception of trajectories that change during a period of occlusion. Four-month-olds perceive discontinuity in trajectories that change in height or orientation while behind an occluder, and this is true even when a change in direction could be due to an invisible bouncing collision with a surface. Further experiments reveal that infants do not perceive diagonal linear trajectories as continuous across an occlusion unless the occluding and revealing edges are orthogonal to the path of movement. Implications for theories of perceptual and cognitive development are discussed.     

Learning to perceive object unity: a connectionist account

To explore questions of how human infants begin to perceive partly occluded objects, we devised two connectionist models of perceptual development. The models were endowed with an existing ability to detect several kinds of visual information that have been found important in infants’ and adults’ perception of object unity (motion, co‐motion, common motion, relatability, parallelism, texture and T‐junctions). They were then presented with stimuli consisting of either one or two objects and an occluding screen. The models’ task was to determine whether the object or objects were joined when such a percept was ambiguous, after specified amounts of training with events in which a subset of possible visual information was provided. The model that was trained in an enriched environment achieved superior levels of performance and was able to generalize veridical percepts to a wide range of novel stimuli. Implications for perceptual development in humans, current theories of development and origins of knowledge are discussed.     

Vibrotactile pattern discrimination and communality at several body sites

In a series of experiments, the effects of spatial layout on vibrotactile pattern perception were explored by testing the ability to discriminate between two sequentially presented patterns that share active elements in the same spatial locations. Two-dimensional displays were used in order to examine the functional relationship between discrimination performance and patterncommunality, defined as the sharing elements, on different body sites. Accuracy of discrimination judgments was inversely proportional to communality, regardless of the number of pattern elements. For compact arrays fitted to the finger, palm, and thigh, the effects of communality appeared equivalent. The similarity between finger and thigh functions is remarkable, considering the dramatic differences between these sites in receptor components and structure. When these data were compared with those from arrays with distributed contactors, performance was substantially better with well-separated pattern elements. Such findings help to explicate how information from apposed patterns can best be delivered to the skin through tactile communication systems.     

The role of consolidation for perceptual learning in temporal discrimination within and across modalities

Training people on temporal discrimination can substantially improve performance in the trained modality but also in untrained modalities. A pretest–training–posttest design was used to investigate whether consolidation plays a crucial role for training effects within the trained modality and its transfer to another modality. In the pretest, both auditory and visual discrimination performance was assessed. In the training phase, participants performed only the auditory task. After a consolidation interval of either 5 min or 24 h, participants were again tested in both the auditory and visual tasks. Irrespective of the consolidation interval, performance improved from the pretest to the posttest in both modalities. Most importantly, the training effect for the trained auditory modality was independent of the consolidation interval whereas the transfer effect to the visual modality was larger after 24 h than after 5 min. This finding shows that transfer effects benefit from extended consolidation.     

The temporal pattern of unconstrained drinking: Rats' responses to inversion and identity constraints

Rats obtained all of their water by licking a metal tube during a series of daily 1-hour sessions. When the tube was freely available throughout, each rat showed the classic temporal pattern of unconstrained drinking: As the session progressed, drinking bouts generally grew shorter and pauses grew longer. In subsequent sessions the tube was opened and closed independently of the rat's behavior, on a schedule that gave the rat a chance to duplicate the exact inverse of its unconstrained baseline pattern. Thus, as the inversion session progressed, the opportunities to drink generally grew longer and the enforced pauses grew shorter. When the rats were forced away from their unconstrained patterns of drinking and pausing, their total time spent drinking consistently fell short of previous values, but total licks and volumetric intake remained at previous levels. The same results occurred under an identity schedule, a series of openings and closings that duplicated the unconstrained pattern of drinking and pausing. The results have implications for theories that assume that instrumental performance under schedule constraint derives from the animal's defense of a measured set-point.     

Perception of the temporal pattern of motion in infancy

Two studies explored infants' perception of the temporal pattern of motion. Study 1 used a familiarization-novelty paradigm to demonstrate that 4-month-old infants discriminate two repetitive temporal patterns (viz., || || vs. ||| |). Study 2 used a preferential-looking paradigm longitudinally at 4 and 8 months with all the possible pairs of three repetitive patterns representing three levels of complexity, namely low (|| || || ||), medium (||| | ||| |), and high (||| || | ||). Visual preference shifted from the medium-complexity pattern at 4 months to the high-complexity pattern at 8 months. Moreover, evidence was obtained at 4 months that infants discriminated between all three patterns of motion. Unexpectedly, infants with complicated deliveries (inductions, forceps, or Caesarean sections) did not, as a group, distinguish among the patterns at 4 months.     

Ovulation leads women to perceive sexy cads as good dads

Why do some women pursue relationships with men who are attractive, dominant, and charming but who do not want to be in relationships--the prototypical sexy cad? Previous research shows that women have an increased desire for such men when they are ovulating, but it is unclear why ovulating women would think it is wise to pursue men who may be unfaithful and could desert them. Using both college-age and community-based samples, in 3 studies we show that ovulating women perceive charismatic and physically attractive men, but not reliable and nice men, as more committed partners and more devoted future fathers. Ovulating women perceive that sexy cads would be good fathers to their own children but not to the children of other women. This ovulatory-induced perceptual shift is driven by women who experienced early onset of puberty. Taken together, the current research identifies a novel proximate reason why ovulating women pursue relationships with sexy cads, complementing existing research that identifies the ultimate, evolutionary reasons for this behavior.     

Musical training generalises across modalities and reveals efficient and adaptive mechanisms for reproducing temporal intervals

Expert musicians are able to time their actions accurately and consistently during a musical performance. We investigated how musical expertise influences the ability to reproduce auditory intervals and how this generalises across different techniques and sensory modalities. We first compared various reproduction strategies and interval length, to examine the effects in general and to optimise experimental conditions for testing the effect of music, and found that the effects were robust and consistent across different paradigms. Focussing on a ‘ready-set-go’ paradigm subjects reproduced time intervals drawn from distributions varying in total length (176, 352 or 704 ms) or in the number of discrete intervals within the total length (3, 5, 11 or 21 discrete intervals). Overall, Musicians performed more veridical than Non-Musicians, and all subjects reproduced auditory-defined intervals more accurately than visually-defined intervals. However, Non-Musicians, particularly with visual stimuli, consistently exhibited a substantial and systematic regression towards the mean interval. When subjects judged intervals from distributions of longer total length they tended to regress more towards the mean, while the ability to discriminate between discrete intervals within the distribution had little influence on subject error. These results are consistent with a Bayesian model that minimizes reproduction errors by incorporating a central tendency prior weighted by the subject's own temporal precision relative to the current distribution of intervals. Finally a strong correlation was observed between all durations of formal musical training and total reproduction errors in both modalities (accounting for 30% of the variance). Taken together these results demonstrate that formal musical training improves temporal reproduction, and that this improvement transfers from audition to vision. They further demonstrate the flexibility of sensorimotor mechanisms in adapting to different task conditions to minimise temporal estimation errors.