The use of configural analysis for the evaluation of test scoring methods

A method based on configural analysis has been given whereby test scoring techniques can be evaluated to see if they have optimal validity. Configural analysis has also been used to show how three well known item scoring techniques, multiple regression, total score, and multiple cut-off, imply (for optimal validity) certain conditions on the answer pattern means. The method is illustrated by a worked example.We are indebted to Professor James G. Taylor for his helpful suggestions.     

Interrater reliability of scores derived from two methods for scoring the clock drawing test

Scores on the Clock Drawing Test have long been considered a useful screening tool for neuropsychological dysfunction, and a number of scoring methods have been developed to evaluate various aspects of performance. This study compared quantitative and qualitative scoring by briefly trained students on 145 clock drawings produced by patients in a geriatric psychiatry outpatient clinic to estimate the interrater reliability of the methods, user's acceptance of the methods, and whether the methods provide differential diagnosis. Both systems showed acceptable interrater reliability. Using the quantitative method, raters scored drawings by patients with organic mental disease as more impaired than those patients diagnosed as depressed or schizophrenic. Results suggest that the Clock Drawing Test is a reliable screening tool for cognitive impairment in a geropsychiatric population, but the scoring methods examined do not yet appear psychometrically sound enough to provide a differential diagnosis.     

Effects of reading span and textual coherence on rapid-sequential reading

Subjects’ Comprehension and Memory of Conventional Presentations (Pages) And Rapid, Serial Visual Presentations (Rsvps) Of Text Were Investigated With A Statement-Recognition Test. Texts Were Presented With Sentences in An Intact Or A Scrambled Order At Rates Of 300 And 600 Words Per Minute (Wpm). Subjects’ Memory for Text Meaning And Surface Structure Was Better In 300-Than In 600-Wpm Conditions, And Subjects Retained More Textual Meaning From Coherent than Incoherent Texts Regardless of Display Rates. These Findings Are Inconsistent With the Idea That Rapid Reading Disrupts the Intersentence Integration Processes of Comprehension, but are Consistent With The Hypothesis of Consolidation Limitation: Furthermore, Subjects Were Separated Into Two Groups Based on Their Performance on the Reading Span Test of Daneman And Carpenter (1980). Low-Span Subjects Retained Significantly Less Text Meaning than High-Span Subjects with Pages, But They Did Almost As Well With RSVPs. This Interaction Suggests that the RSVP Technique Could Be Useful For Improving the Reading Abilities of Less Efficient Readers.     

Strategy use in the reading span test: an analysis of eye movements and reported encoding strategies

Strategy use in the traditional reading span test was examined by recording participants' eye movements during the task (Experiment 1) and by interviewing participants about their strategy use (Experiment 2). In Experiment 1, no differences between individuals with a low, medium, and high span were observed in how they distributed processing time between task elements. In all three groups, fixation times on words up to the to-be-remembered (TBR) word became shorter and the time spent on the TBR longer as memory load in the task increased. The results of Experiment 2, however, show that span groups differ in the use of memory encoding strategies: individuals with a low span use mainly rehearsal, whereas individuals with a high span use almost exclusively semantic elaboration. The results indicate that the use of elaborative strategies may enhance span performance but that not all individuals are necessarily able to use such strategies efficiently.     

Strategy use in the reading span test: An analysis of eye movements and reported encoding strategies

Strategy use in the traditional reading span test was examined by recording participants’ eye movements during the task (Experiment 1) and by interviewing participants about their strategy use (Experiment 2). In Experiment 1, no differences between individuals with a low, medium, and high span were observed in how they distributed processing time between task elements. In all three groups, fixation times on words up to the to-be-remembered (TBR) word became shorter and the time spent on the TBR longer as memory load in the task increased. The results of Experiment 2, however, show that span groups differ in the use of memory encoding strategies: individuals with a low span use mainly rehearsal, whereas individuals with a high span use almost exclusively semantic elaboration. The results indicate that the use of elaborative strategies may enhance span performance but that not all individuals are necessarily able to use such strategies efficiently.     

Adult age differences in the perceptual span during reading

Following up on research suggesting an age-related reduction in the rightward extent of the perceptual span during reading (Rayner, Castelhano, & Yang, 2009), we compared old and young adults in an N + 2-boundary paradigm in which a nonword preview of word N + 2 or word N + 2 itself is replaced by the target word once the eyes cross an invisible boundary located after word N. The intermediate word N + 1 was always three letters long. Gaze durations on word N + 2 were significantly shorter for identical than nonword N + 2 preview both for young and for old adults, with no significant difference in this preview benefit. Young adults, however, did modulate their gaze duration on word N more strongly than old adults in response to the difficulty of the parafoveal word N + 1. Taken together, the results suggest a dissociation of preview benefit and parafoveal-on-foveal effect. Results are discussed in terms of age-related decline in resilience towards distributed processing while simultaneously preserving the ability to integrate parafoveal information into foveal processing. As such, the present results relate to proposals of regulatory compensation strategies older adults use to secure an overall reading speed very similar to that of young adults.     

Suggestions for revised scoring of the Tower of Hanoi test

Detailed time and error analyses of the Tower of Hanoi (TOH) test was performed using four repeated assessments of eight children (ages 9-12 years), who had perceptual and problem solving deficits. The time before each move was measured. In addition to the traditionally counted time scores, new, relative time scores were computed in order to separate the planning time from the general reaction speed. New error scores were defined and sum scores of serious errors (perserative moves, illegal moves, and wrong results) and mild errors (self-corrected moves, almost performed moves, and interrupted trials) were computed. The relative planning time correlated positively with the achieved score, and negatively with the serious errors. The serious errors correlated negatively with the achieved score. The relative planning time seems to measure the quality of planning better than does the raw planning time, and it is a recommended score for TOH analysis. The value of new error scores requires additional research.     

Eye movements,the perceptual span,and reading speed

The perceptual span or region of effective vision during eye fixations in reading was examined as a function of reading speed (fast readers were compared with slow readers), font characteristics (fixed width vs. proportional width), and intraword spacing (normal or reduced). The main findings were that fast readers (reading at about 330 wpm) had a larger perceptual span than did slow readers (reading about 200 wpm) and that the span was not affected by whether or not the text was fixed width or proportional width. In addition, there were interesting font and intraword spacing effects that have important implications for the optimal use of space in a line of text.     

Sentential structure and the perceptual span in normal reading development

An eye-voice span paradigm was adopted to determine whether children use different aspects of sentence structure to facilitate decoding early in the course of reading development. Eightyfour Grade 1 and Grade 2 children, representing four levels of early reading competence, and 15 skilled adult subjects read from four textual conditions; materials varied in the extent to which the texts were semantically and/or syntactically constrained. The more precocious the young reader, the longer his reported span. The better readers' and the adults' advantage was greater the more linguistically constrained the reading material. These data support a continuous model fo reading development and are compatible with an interactive definition of early reading behavior.     

The span of the effective stimulus during a fixation in reading

A computer-based eye-movement controlled, display system was developed for the study of perceptual processes in reading. A study was conducted to identify the region from which skilled readers pick up various types of visual information during a fixation while reading. This study involved making display changes, based on eye position, in the text pattern as the subject was in the act of reading from it, and then examining the effects these changes produced on eye behavior. The results indicated that the subjects acquired word-length pattern information at least 12 to 15 character positions to the right of the fixation point, and that this information primarily influenced saccade lengths. Specific letter- and word-shape information were acquired no further than 10 character positions to the right of the fixation point.     

Vertical perceptual span and the processing of visual signals in reading

A previous study by Pollatsek et al. ( 1993 ) claims that the perceptual span in reading is restricted to the fixated line, i.e. readers typically focus their visual attention on the line of text being read. The present study investigated whether readers make use of content structure signals (paragraph indentations and topic headings) present several lines away from the currently fixated line. We reasoned that as these signals are low-resolution visual objects (as opposed to letter and word identity), readers may attend to them even if they are located some distance away from the fixated line. Participants read a hierarchically organized multi-topic expository text containing structure signals in either a normal condition or a window condition, where the text disappeared above and below a vertical 3° gaze-contingent region. After reading, participants were asked to produce a written recall of the text. The results showed that the overall reading rate was not affected by the window. Nevertheless, the headings were reread more in the normal condition than in the window one. In addition, more topics were recalled in the normal than in the window condition. We interpret the results as indicating that the readers visually attend to useful text layout features while considering bigger units than single text lines. The perception of topic headings located away from the fixated line may favour long-range regressions towards them, which in turn may favour text comprehension. This claim is consistent with previous studies that showed that look-back fixations to headings are performed with an integrative intent.     

适用于多维迫选测验的IRT计分模型

迫选(forced-choice,FC)测验由于可以控制传统李克特方法带来的反应偏差,被广泛应用于非认知测验中,而迫选测验的传统计分方式会产生自模式数据,这种数据由于不适合于个体间的比较,一直备受批评。近年来,多种迫选IRT模型的发展使研究者能够从迫选测验中获得接近常模性的数据,再次引起了研究者与实践人员对迫选IRT模型的兴趣。首先,依据所采纳的决策模型和题目反应模型对6种较为主流的迫选IRT模型进行分类和介绍。然后,从模型构建思路、参数估计方法两个角度对各模型进行比较与总结。其次,从参数不变性检验、计算机化自适应测验(computerized adaptive testing, CAT)和效度研究3个应用研究方面进行述评。最后提出未来研究可以在模型拓展、参数不变性检验、迫选CAT测验和效度研究4个方向深入。     

Eye movements and the perceptual span in silent and oral reading

Previous research has examined parafoveal processing during silent reading, but little is known about the role of these processes in oral reading. Given that masking parafoveal information slows down silent reading, we asked whether a similar effect also occurs in oral reading. To investigate the role of parafoveal processing in silent and oral reading, we manipulated the parafoveal information available to readers by changing the size of a gaze-contingent moving window. Participants read silently and orally in a one-word window and a three-word window condition as we monitored their eye movements. The lack of parafoveal information slowed reading speed in both oral and silent reading. However, the effects of parafoveal information were larger in silent reading than in oral reading, because of different effects of preview information on both when the eyes move and how often. Parafoveal information benefitted silent reading for faster readers more than for slower readers.     

A comparison of three methods for scoring figure drawings

Figure drawings obtained from 758 white male medical students were scored using three different methods. Method I involved 16 different physical size measurements; Method II involved six separate sophistication of body concept ratings; and Method III involved 42 separate aspects of the drawings weighted in direct proportion to their relative frequency of occurrence in the sample studied (conventionality scoring). Separate factor analyses of the scores derived from each method revealed that Methods I and II each reflect only a single underlying factor, and that these factors are uncorrelated in the population studied. Method III yielded eight meaningful factors, each of which may be construed as an independent area of conventionality/deviancy. An overall conventionality/deviancy score was also derived. It is believed that these three methods of scoring capture most of the variance inherent in existing figure drawing scoring systems, but that use of all three is necessary for a comprehensive analysis.     

藏语阅读知觉广度的眼动研究

不同语体阅读知觉广度的研究由来已久,研究重心多集中于拼音文字和表意文字,已有研究表明阅读知觉广度存在语言加工的特异性。藏语作为拼音文字,同时具有表意文字的特征,是阅读知觉广度研究尚未涉及的语言材料。因此,藏语阅读知觉广度的范围尚不清楚,藏语阅读知觉广度是否也表现出语言加工的特异性也有待证实。为了探测藏语阅读知觉广度的大小,使用Eye Link 1000 Plus型眼动记录仪,以35名在校藏族大学生为被试,采用经典的移动窗口范式,设计了7种窗口(5、9、13、17、21、25和整行)。结果发现,L2R2-L12R12在所有指标的观测值上均存在显著差异,L4R4-L12R12在总注视次数、总注视时间和向右眼跳幅度三个指标的观测值上存在显著差异,L6R6-L12R12在向右眼跳幅度指标的观测值上存在显著差异,L8R8-L12R12在所有指标的观测值上均不存在显著差异,达到了基准水平。结果支持藏族大学生藏语阅读知觉广度的右侧范围大约是注视点右侧4~8个字符的空间。阅读知觉广度存在语言加工的特异性。