Modeling differentiation of cognitive abilities within the higher-order factor model using moderated factor analysis

Receptive foreign language proficiency is usually measured with reading and listening comprehension tasks. A novel approach to assess such proficiencies – viewing comprehension – is based on the presentation of short instructional videos followed by one or more comprehension questions concerning the preceding video stimulus. In order to evaluate a newly developed viewing comprehension test 485 German high school students completed reading, listening, and viewing comprehension tests, all measuring the receptive proficiency in English as a foreign language. Fluid and crystallized intelligence were measured as predictors of performance. Relative to traditional comprehension tasks, the viewing comprehension task has similar psychometric qualities. The three comprehension tests are very highly but not perfectly correlated with each other. Relations with fluid and crystallized intelligence show systematic differences between the three comprehension tasks. The high overlap between foreign language comprehension measures and between crystallized intelligence and language comprehension ability can be taken as support for a uni-dimensional interpretation. Implications for the assessment of language proficiency are discussed.     

Simultaneous listening and speaking and retention of prose

In order to examine the effects of simultaneous listening and speaking on comprehension and recall, nine trainee simultaneous interpreters were asked to shadow, listen to, and simultaneously interpret into English three French prose passages. Subsequent tests of comprehension and recall showed that higher scores were obtained in the listening condition than in simultaneous interpretation, which in turn yielded significantly higher scores than shadowing.     

Listening comprehension and working memory are impaired in attention-deficit hyperactivity disorder irrespective of language impairment

This study investigated listening comprehension and working memory abilities in children with attention-deficit hyperactivity disorder (ADHD), presenting with and without language impairments (LI). A 4-group design classified a community sample (n = 77) of boys aged 9–12 into ADHD, ADHD + LI, LI, and Normal groups. Children completed tests of basic language and cognitive skills, verbal and spatial working memory, and passage-level listening comprehension. Multivariate analyses and post hoc comparisons indicated that ADHD children who did not have co-occurring LI comprehended factual information from spoken passages as well as normal children, but were poorer at comprehending inferences and monitoring comprehension of instructions. ADHD children did not differ from normal children in verbal span, but showed significantly poorer verbal working memory, spatial span, and spatial working memory. The ADHD + LI and LI groups were most impaired in listening comprehension and working memory performance, but did not differ from each other. Listening comprehension skills were significantly correlated with both verbal and spatial working memory, and parent–teacher ratings of inattention and hyperactivity/impulsivity. Findings that children with ADHD but no LI showed subtle higher-level listening comprehension deficits have implications for both current diagnostic practices and conceptualizations of ADHD.     

Adding Value to Second-Language Listening and Reading Subscores: Using a Score Augmentation Approach

This study examined whether reporting subscores for groups of items within a test section assessing a second-language modality (specifically reading or listening comprehension) added value from a measurement perspective to the information already provided by the section scores. We analyzed the responses of 116,489 test takers to reading and listening items from operational administrations of two large-scale international tests of English as a foreign language. To “strengthen” the reliability of the subscores, and thus improve their added value, we applied a score augmentation method (Haberman, 2008). In doing so, our aim was to examine whether reporting augmented subscores for specific groups of reading and listening items could improve the added value of these subscores and consequently justify providing more fine-grained information about test taker performance. Our analysis indicated that in general, there was lack of support for reporting subscores from a psychometric perspective, and that score augmentation marginally improved the added value of the subscores. We discuss several implications of our findings for test developers wishing to report more fine-grained information about test performance. We conclude by arguing that research on how to best report such refined feedback should remain the focus of future efforts related to second-language proficiency tests.     

Second language vocabulary level is related to benefits for second language listening comprehension under lower reverberation time conditions

The acoustic qualities of a room can have a deleterious effect on the quality of speech signals. The acoustic measurement of reverberation time (RT) has shown to impact second language (L2) speech comprehension positively when lower due to release from spectral and temporal masking effects as well as top-down processing factors. This auralization experiment investigated the benefits of better L2 vocabulary and executive function (updating) skills during L2 listening comprehension tests under shorter versus longer RT conditions (0.3 and 0.9?s). 57 bilingual university students undertook L2 vocabulary, number updating and L2 listening comprehension tests. After splitting groups into high/low vocabulary and updating groups, a mixed ANOVA was conducted. The high number updating group showed no significant differences or interactions in L2 listening comprehension than the lower number updating group across RT conditions. The high vocabulary group had 22% better L2 listening comprehension than the low vocabulary group in long RT, and 9% better in short RT. A significant benefit in L2 listening comprehension due to release from reverberation was only evident in the high vocabulary group. Results indicate that the benefit of good room acoustics for listening comprehension is greatest for those with better language (vocabulary) ability.     

汉语综合理解能力的测试及其初步分析

采用两个测试,多媒语言理解测试和文章的阅读理解测试,分别测量了大学生的汉语综合理解能力和阅读理解能力.多媒语言理解测试根据Gernsbacher的多媒理解量表编制而成.文章的阅读理解测试是莫雷编制的<语文阅读水平测量>中的一个分测验.测斌结果表明(1)两个测试之间有显著相关和较高的一致性,说明阅读是汉语综合理解的一个重要方面;(2)汉语综合理解能力有两个成分外部语言和内部语言理解能力;(3)书面语言的阅读理解与口头语言的听力理解显著相关,说明外部语言的理解受信息传递方式的影响较小.     

COMPONENTS IN LISTENING BEHAVIOR: THE ROLE OF SHORT-TERM MEMORY

Three measures of listening—short-term (STL), short-term listening with rehearsal (STL-R), and lecture comprehension—were compared with other scores of general mental ability and classroom performance scores. The listening measures were significantly different from each other in relation to ACT composite scores. Short-term listening related most closely to oral performance whereas lecture comprehension did so to general mental ability and written examination scores. Listening behavior seems not to be a singular skill but a very complex process.     

Programming for the Generalization of Oral Reading Fluency: Repeated Readings of Entire Text versus Multiple Exemplars

This study compared a multiple exemplar approach involving the training of key words and sentence structures to a typical repeated readings procedure for their effects on students’ generalized oral reading fluency. The two training approaches were also compared in terms of their relative learning rates (i.e., fluency gain per minute of instruction time). Participants were 111 first- and second-grade students from three public schools in a large urban school district. This study utilized an across students pre-test/post-test experimental design and one-way analyses of variance on the gain scores from pre-test to post-test to assess the effectiveness of multiple exemplar instruction, listening passage preview/repeated readings, and a time and attention control condition. Results showed significantly higher gain scores for students in both the multiple exemplar and listening passage preview/repeated readings groups versus controls on the trained and generalization passages. Multiple exemplar instruction also resulted in significantly larger learning rates than listening passage preview/repeated readings. Implications, limitations, and directions for future research are discussed.     

Recorded Readings: A Taped Parent-Tutoring Intervention

Parent tutoring has been successfully used to increase children’s oral reading fluency. However, commonly used procedures pose a challenge for parents who are not proficient in reading or who speak English as a second language. A taped reading program that included listening passage preview, repeated reading, and performance feedback was developed for parental implementation during home tutoring sessions. A multiple baseline design across participants was used to evaluate the effects of parent tutoring on the oral reading fluency of two elementary-aged English language learners. Data were collected on oral reading fluency using high- and low-word overlap passages. Results revealed an immediate increase in generalized oral reading fluency for one child upon intervention implementation and continued growth for both children 2 months following termination. Findings suggest recorded readings was an effective and acceptable parent tutoring intervention for increasing reading performance for language minority families.     

The Role of Dichotic Listening Performance and Tasks of Executive Functions in Reading Impairment: A Discriminant Function Analysis

This study focused on the role of dichotic listening performance for the identification of reading impaired subtypes. Dichotic listening (DL), using verbal stimuli, has shown to be a valid measure of language lateralization. Usually, lateralization is estimated from the proportion of right ear over left ear accuracy during a free recall test procedure. However, it has been suggested that a more accurate estimate of laterality can be obtained by using a directed attention procedure. A sample of 43 reading disabled children of whom 18 showed signs of impaired language comprehension skills and 25 without language comprehension impairments, were compared to 20 age, and gender, matched controls on dichotic listening performance in both an unbiased free recall task and in a directed attention task using consonant-vowel syllables as dichotic stimuli. A laterality index was calculated for left and right ear stimuli reported during both the free recall condition and the attended ear-scores for the two directed attention conditions. Although both DL procedures yielded significant group differences, with a lower laterality score for the reading disabled compared to the controls, there was no main effect of DL-procedure or group × procedure interaction. Taken alone, DL performance could correctly classify 42% of the reading impaired samples, but together with other measures of executive functions, discriminant function analyses yielded 90.74% accuracy in classifying reading impaired children. The result indicates that DL together with tests of executive functions are valuable tools for assessment of reading impaired subjects.     

The role of dichotic listening performance and tasks of executive functions in reading impairment: a discriminant function analysis.

This study focused on the role of dichotic listening performance for the identification of reading impaired subtypes. Dichotic listening (DL), using verbal stimuli, has shown to be a valid measure of language lateralization. Usually, lateralization is estimated from the proportion of right ear over left ear accuracy during a free recall test procedure. However, it has been suggested that a more accurate estimate of laterality can be obtained by using a directed attention procedure. A sample of 43 reading disabled children of whom 18 showed signs of impaired language comprehension skills and 25 without language comprehension impairments, were compared to 20 age, and gender, matched controls on dichotic listening performance in both an unbiased free recall task and in a directed attention task using consonant-vowel syllables as dichotic stimuli. A laterality index was calculated for left and right ear stimuli reported during both the free recall condition and the attended ear-scores for the two directed attention conditions. Although both DL procedures yielded significant group differences, with a lower laterality score for the reading disabled compared to the controls, there was no main effect of DL-procedure or group x procedure interaction. Taken alone, DL performance could correctly classify 42% of the reading impaired samples, but together with other measures of executive functions, discriminant function analyses yielded 90.74% accuracy in classifying reading impaired children. The result indicates that DL together with tests of executive functions are valuable tools for assessment of reading impaired subjects.     

High second‐language proficiency protects against the effects of reverberation on listening comprehension

The purpose of this experiment was to investigate whether classroom reverberation influences second‐language (L2) listening comprehension. Moreover, we investigated whether individual differences in baseline L2 proficiency and in working memory capacity (WMC) modulate the effect of reverberation time on L2 listening comprehension. The results showed that L2 listening comprehension decreased as reverberation time increased. Participants with higher baseline L2 proficiency were less susceptible to this effect. WMC was also related to the effect of reverberation (although just barely significant), but the effect of WMC was eliminated when baseline L2 proficiency was statistically controlled. Taken together, the results suggest that top‐down cognitive capabilities support listening in adverse conditions. Potential implications for the Swedish national tests in English are discussed.     

Child care effects in context: quality, stability, and multiplicity in non-maternal child care arrangements during the first 15 months of life

Main and interactive effects of child care quality, stability, and multiplicity on infants' attachment security, language comprehension, language production, and cognitive development at 15 months were examined using data from the National Institute of Child Health and Human Development (NICHD) Study of Early Child Care. Thirty-nine percent of the infants in this sample experienced arrangement change, and 46% experienced multiple concurrent arrangements during the first 15 months. As in previous studies, concurrent quality, average quality, and quality slope significantly predicted cognitive and language development. There was some evidence that certain forms of unstable child care--including nonfamilial change, familial to nonfamilial change, and within-home to out-of-home change--were associated with poorer language development. Multiple child care arrangements involving family members positively predicted language comprehension; multiple care involving a mix of family and non-relative caregivers negatively predicted language comprehension. Interactions among variables exhibited "effects in context." That is, under conditions of low or moderate quality in the primary care arrangement, the use of fewer multiple arrangements was associated with higher language scores; under conditions of high primary care quality, the use of more multiple arrangements was associated with higher language scores.     

Longitudinal dichotic listening patterns for aphasic patients : I. Description of recovery curves

Aphasic patients were given digit and noun dichotic listening tests at monthly intervals during the first 6 months postonset of left hemisphere ischemic infarctions. Significant changes in performance were observed that consisted of parallel increases in scores for the two ears, and thus did not support the hypothesis that language recovery is mediated by transfer of language dominance from the left to the right hemisphere. Reliable differences also were noted between performance on the two tests. RE scores accounted for most of the variance among patients in performance on dichotic tests and, as such, appeared to be the best measure for characterizing individual differences.     

Administration and Environment Considerations in Computer-Based Sports-Concussion Assessment

Computer-based testing has become a vital tool for the assessment of sport-related concussion (SRC). An increasing number of papers have been published on this topic, focusing on subjects such as the purpose and validity of baseline testing, the performance of special populations on computer-based tests, the psychometric properties of different computerized neurocognitive tools, and considerations for valid and reliable administration of these tools. The current paper describes several considerations regarding computerized test design, input and output devices, and testing environment that should be described explicitly when administering computer-based cognitive testing, regardless of whether the assessment is used for clinical or research purposes. The paper also reviews the conclusions of recent literature (2007–2013) using computer-based testing for the assessment of SRC, with special attention to the methods used in these studies. We also present an appendix checklist for clinicians and researchers that may be helpful in ensuring proper attention to factors that could influence the reliability and validity of computer-based cognitive testing. We believe that explicit attention to these technological factors may lead to the development of standards for the development and implementation of computer-based tests. Such standards have the potential to enhance the accuracy and utility of computer-based tests in SRC.     

THE RELATIONSHIP BETWEEN LISTENING AND READING COMPREHENSION OF DIFFERENT TYPES OF TEXT AT INCREASING GRADE LEVELS

This study examined the hypotheses that (a) the relationship between listening and reading comprehension becomes stronger after decoding mastery; (b) the difference between listening and reading decreases with increasing grade level; and (c) similar patterns of relationship and difference are obtained with narrative and expository texts. The sample included 612 students in Grades 2, 4, 6, and 8. Students read and listened to two narratives and two expository texts and completed corresponding comprehension tests that were in the form of sentence verification tasks. The findings confirmed the first two hypotheses but not the third one. In the case of expository text, the relationship between listening and reading comprehension was weaker than the corresponding one with narrative text, and performance levels were comparable across all elementary grades. Moreover, reading comprehension levels were higher than listening comprehension levels in Grade 8, regardless of text type. The implications of these findings with respect to the dominant unitary process model and the assessment and instruction of oral and written language comprehension are discussed.     

Bilingual Children’s Narrative Comprehension: Do Pauses during Retelling Buy Time for Understanding?

Abstract

This study extended research on bilingual children’s narrative comprehension to text processing during retelling. A cross- and monolinguistic design allowed for the investigation of the association of various aspects of narrative comprehension with two types of pause occurring during oral retelling of a story heard in one language and retold in a second or in the same language. A sample of 95 bilingual (L1 German/L2 English) fourth-graders participated in the experiment. Comprehension was predominantly accomplished during listening, as children with L1 input outperformed children with L2 input, but they did not benefit from L1 in retelling. Children’s comprehension performance and corresponding pause patterns suggested that the duration of filled pauses dedicated to gist formation indicated efficiency of comprehension: The duration decreased with increasing comprehension. The findings allowed the conclusion that longer pauses during retelling did not buy time for comprehension.     

A cognitive tool to diagnose predominantly inattentive ADHD behavior

Poor performance on tests of reading comprehension could be the result of weak word-recognition skills, inconsistent attention (ADD), or a combination of the two. Identifying the source of the reading disability (RD) reliably has been difficult because inconsistent attention interferes with reading and weak word recognition skill makes attention wander. The situation is further complicated by the fact that there are no objective diagnostic tests for ADD (Breggin, 1998; Diller, 1998). We proposed a new model of differential diagnosis of ADHD-I/RD and field-tested its utility in two studies. The new diagnostic procedure utilizes intra-individual differences seen in the performance of at-risk learners on tasks related to reading that vary in the degree of sustained attention required for successful performance. The hypothesis is that children whose attention is inconsistent would perform more poorly on tests such as listening comprehension, which require sustained attention, than on tests such as reading comprehension, which are more tolerant of inattention. Such differences will not be seen in the test scores of children who have only a reading disability because their performance on reading tests is determined more by the difficulty level of the tests than by the sensitivity of the tests to attention. The validity of this new model was evaluated by determining the relationship between differences seen in the scores of tests that differ in their attention requirement and the degree of inconsistency in sustained attention as measured by Conners' CPT. The results of the two studies indicate this to be a viable approach. The results of the second study are presented in this report.