Seeing to hear better: evidence for early audio-visual interactions in speech identification

Lip reading is the ability to partially understand speech by looking at the speaker's lips. It improves the intelligibility of speech in noise when audio-visual perception is compared with audio-only perception. A recent set of experiments showed that seeing the speaker's lips also enhances sensitivity to acoustic information, decreasing the auditory detection threshold of speech embedded in noise [J. Acoust. Soc. Am. 109 (2001) 2272; J. Acoust. Soc. Am. 108 (2000) 1197]. However, detection is different from comprehension, and it remains to be seen whether improved sensitivity also results in an intelligibility gain in audio-visual speech perception. In this work, we use an original paradigm to show that seeing the speaker's lips enables the listener to hear better and hence to understand better. The audio-visual stimuli used here could not be differentiated by lip reading per se since they contained exactly the same lip gesture matched with different compatible speech sounds. Nevertheless, the noise-masked stimuli were more intelligible in the audio-visual condition than in the audio-only condition due to the contribution of visual information to the extraction of acoustic cues. Replacing the lip gesture by a non-speech visual input with exactly the same time course, providing the same temporal cues for extraction, removed the intelligibility benefit. This early contribution to audio-visual speech identification is discussed in relationships with recent neurophysiological data on audio-visual perception.     

西汉孟喜改列卦序中的哲学思想

孟喜为西汉象数易的创建人,其易学后人称之为“卦气”。卦气乃结合“学”与“术”成一结构庞大的思想体系。就学而言,乃承受先秦伏、文、孔三圣的易学精神;就术而言,乃用于当时流行的占断灾异、吉凶及祸福。然而后世易学界受儒学重经思想的影响,多轻视象数,以“术家”视孟喜。作者兹特提出孟氏卦气中对于六十四卦卦序之排列。并详作象敷之解析,以见孟氏易学实具有学术思想之价值。     

Auguste Comte on Positivism and Happiness

Auguste Comte (1798–1857) is the founder of a French school of thought that became famous for its encyclopaedic account of the sciences as well as for its exposition of what was designed as a way out of a state of intellectual and moral crisis. This essay demonstrates that there is a linkage between the diagnosis of crisis and the pursuit of happiness in Comte's foundation of positivism. It begins by distinguishing Comte's notion of positivism from that of a value-free science. In analysing Comte's peculiar usage of the term happiness, the essay shows that happiness is understood as the result of the convergence (consensus) of three components: a scientific conception of the world, the feelings of love and veneration, and a wisely ordered activity. The essay then demonstrates that the first of these components is of primary importance inasmuch as it is to frame a new horizon within which man is expected to return to a healthy state of mind, to reshape both his hopes and activities, and to discover his own participation in a supreme order acting through the laws of nature as well as through those of the civilization in which he lives. Conveying this new horizon to citizens of a lasting Republic is the sacred mission of sociology. The essay concludes by pointing out that Comte's conception of happiness can be assessed as unifying some main qualities of life as they are classified in Ruut Veenhoven's fourfold matrix.     

A dissociation between selective attention and conscious awareness in the representation of temporal order information

Previous electrophysiological studies have shown that attentional selection processes are highly sensitive to the temporal order of task-relevant visual events. When two successively presented colour-defined target stimuli are separated by a stimulus onset asynchrony (SOA) of only 10 ms, the onset latencies of N2pc components to these stimuli (which reflect their attentional selection) precisely match their objective temporal separation. We tested whether such small onset differences are accessible to conscious awareness by instructing participants to report the category (letter or digit) of the first of two target-colour items that were separated by an SOA of 10, 20, or 30 ms. Performance was at chance level for the 10 ms SOA, demonstrating that temporal order information which is available to attentional control processes cannot be utilized for conscious temporal order judgments. These results provide new evidence that selective attention and conscious awareness are functionally separable, and support the hypothesis that attention and awareness operate at different stages of cognitive processing.     

Nonparametric IRT: Testing the bi-isotonicity of isotonic probabilistic models (ISOP)

Nonparametric tests for testing the validity of polytomous ISOP-models (unidimensional ordinal probabilistic polytomous IRT-models) are presented. Since the ISOP-model is a very general nonparametric unidimensional rating scale model the test statistics apply to a great multitude of latent trait models. A test for the comonotonicity of item sets of two or more items is suggested. Procedures for testing the comonotonicity of two item sets and for item selection are developed. The tests are based on Goodman-Kruskal's gamma index of ordinal association and are generalizations thereof. It is an essential advantage of polytomous ISOP-models within probabilistic IRT-models that the tests of validity of the model can be performed before and without the model being fitted to the data. The new test statistics have the further advantage that no prior order of items or subjects needs to be known.     

Demonstrating the effect of context on order effects for an army air defense task using the patriot simulator

The results reported herein support the hypotheses that (1) situation-specific, contextual features of a task can cause people to use explanation-based reasoning (Pennington and Hastie, 1993); (2) such reasoning can cause experienced personnel, both individually and in two-person teams, to reinterpret the meaning of the same information when it is presented in two different ordered sequences; and (3) the result will be primacy or recency (or no) effects depending on whether the most recent conflicting information can be explained away or not, respectively. These results extend the belief-adjustment model proposed by Hogarth and Einhorn (1992), which does not address information reinterpretations, and always predicts recency effects for an evaluation task with a short series of conflicting information. More generally, the results demonstrate the importance of situation-specific, contextual features in understanding judgment processes. © 1997 John Wiley & Sons, Ltd.     

注意负荷对内隐序列学习的影响研究

运用次级任务研究范式,采用符号计数的次级任务和歧义序列中的次级条件序列,将内隐序列学习分为单任务组和双任务组,统一在单任务条件下测试。结果发现:(1)两组被试内隐学习成绩差异不显著;(2)双任务组被试在学习组块和测试组块的内隐学习差异也不显著。结果进一步支持了在次级任务占用注意资源的条件下内隐学习仍然可以正常地获得、内隐序列学习不受注意负荷影响的观点。     

Reward magnitude effects on temporal discrimination

Changes in reward magnitude or value have been reported to produce effects on timing behavior, which have been attributed to changes in the speed of an internal pacemaker in some instances and to attentional factors in other cases. The present experiments therefore aimed to clarify the effects of reward magnitude on timing processes. In Experiment 1, rats were trained to discriminate a short (2 s) vs. a long (8 s) signal followed by testing with intermediate durations. Then, the reward on short or long trials was increased from 1 to 4 pellets in separate groups. Experiment 2 measured the effect of different reward magnitudes associated with the short vs. long signals throughout training. Finally, Experiment 3 controlled for satiety effects during the reward magnitude manipulation phase. A general flattening of the psychophysical function was evident in all three experiments, suggesting that unequal reward magnitudes may disrupt attention to duration.     

Short-term memory for serial order supports vocabulary development: New evidence from a novel word learning paradigm

Although recent studies suggest a strong association between short-term memory (STM) for serial order and lexical development, the precise mechanisms linking the two domains remain to be determined. This study explored the nature of these mechanisms via a microanalysis of performance on serial order STM and novel word learning tasks. In the experiment, 6- and 7-year-old children were administered tasks maximizing STM for either item or serial order information as well as paired-associate learning tasks involving the learning of novel words, visual symbols, or familiar word pair associations. Learning abilities for novel words were specifically predicted by serial order STM abilities. A measure estimating the precision of serial order coding predicted the rate of correct repetitions and the rate of phoneme migration errors during the novel word learning process. In line with recent theoretical accounts, these results suggest that serial order STM supports vocabulary development via ordered and detailed reactivation of the novel phonological sequences that characterize new words.     

Item grouping and item randomization in personality measurement

This paper describes a study examining the impact of item order in personality measurement on reliability, measurement equivalence and scale-level correlations. A large sample of university students completed one of three forms of the International Personality Item Pool version of the Big Five personality inventory: items sorted at random, items sorted by factor, and items cycled through factors. Results showed that the underlying measurement model and the internal consistency of the IPIP-Big Five scale was unaffected by differences in item order. Also, most of the scale-level correlations among factors were not significantly different across forms. Implications for the administration of tests and interpretation of test scores are discussed, and future research directions are offered.