Race and Cognitive-Ability Test Performance: The Mediating Effects of Test Preparation, Test-Taking Strategy Use and Self-Eff icacy

Test-taking strategy use, cognitive-ability test preparation, and test-taking self-efficacy were examined as possible mediators of the relationship between race and cognitiveability test performance. We hypothesized that African Americans would report using fewer test-taking strategies and less test preparation when compared to White Americans. In addition, we proposed that Afiican Americans would report lower levels of test-taking self-efficacy when faced with a cognitive-ability test. It was expected that these 3 variables would mediate the relationship between race and cognitive-ability test performance. Using a sample of 170 college students, results indicated that African Americans reported using more ineffective test-taking strategies, reported participating in more cognitiveability test preparation, and reported higher levels of test-taking self-efficacy when compared to White Americans. A portion of the difference in performance on a cognitiveability test between African Americans and White Americans could be attributed to the use of ineffective strategies and test preparation.     

A moderate financial incentive can increase effort,but not intelligence test performance in adult volunteers

A positive correlation between self-reported test-taking motivation and intelligence test performance has been reported. Additionally, some financial incentive experimental evidence suggests that intelligence test performance can be improved, based on the provision of financial incentives. However, only a small percentage of the experimental research has been conducted with adults. Furthermore, virtually none of the intelligence experimental research has measured the impact of financial incentives on test-taking motivation. Consequently, we conducted an experiment with 99 adult volunteers who completed a battery of intelligence tests under two conditions: no financial incentive and financial incentive (counterbalanced). We also measured self-reported test-taking importance and effort at time 1 and time 2. The financial incentive was observed to impact test-taking effort statistically significantly. By contrast, no statistically significant effects were observed for the intelligence test performance scores. Finally, the intelligence test scores were found to correlate positively with both test-taking importance (r_c = .28) and effort (r_c = .37), although only effort correlated uniquely with intelligence (partial r_c = .26). In conjunction with other empirical research, it is concluded that a financial incentive can increase test-taking effort. However, the potential effects on intelligence test performance in adult volunteers seem limited.     

The need for self-control in achievement tests: Changes in students’ state self-control capacity and effort investment

In the present research, we investigated the relation between changes in students’ state self-control capacity and their motivational test-taking effort over the course of an achievement test. Thereby, we considered trait self-control as a major predictor of achievement-related behavior as a covariate. N?=?1840 apprentices repeatedly rated their state self-control capacity and the test-taking effort they invested while working on a 140-min achievement test in mathematics and science. Using growth curve analyses, our results revealed correlated decreases in state self-control capacity and the test-taking effort invested over the course of the test. Furthermore, we found that trait self-control helped to keep state self-control capacity and test-taking effort at a higher level over the course of the test. Our results support the assumption of the process model of self-control that waning self-control capacity is reflected in reduced motivational effort. Furthermore, our findings provide evidence that self-control might play a crucial role in students’ test-taking behavior in large-scale assessment studies. By modeling changes in state self-control capacity and effort investment while considering trait self-control, we provide an alternative approach for investigating self-control-dependent processes and the underlying mechanisms of self-control in achievement situations.     

Test-taking behaviors in a neurocognitive assessment: associations with school-age outcomes in a Finnish longitudinal follow-up

Test-taking behaviors (i.e., task focus, maintenance of attention, and cooperation) affect children's cognitive test performance, and, thus, it is critical to take test-taking behavior into account when drawing conclusions and making recommendations. Prior studies have evaluated test-taking behaviors at the end of the assessment; the present study focused on the fluctuation of cooperation and attention during a neuropsychological assessment. We examined the attention and cooperation of 5-year-old children in a test-taking situation; the associations between these aspects of their test-taking behavior and the children's concurrent neurocognitive test performance, IQ, and parent-rated behavior; and the associations with their IQ, behavioral outcomes, and academic achievement at 8 years of age. The data (for 76 boys and 63 girls) were drawn from the Jyv?skyl? Longitudinal Study of Dyslexia (Lyytinen et al., 2001, 2004). All the children were Caucasian and spoke Finnish as their native language. As a whole, the 5-year-old children showed high cooperation and attention, but a slight decrement in test-taking behavior toward the end of the session was rather common. Three subgroups of children with different levels of cooperation and attention were identified. Children in the subgroup with nonoptimal attention and cooperation showed decreasing neurocognitive test performance toward the end of the assessment session. They also showed more inattentive behavior 3 years later. The findings imply that the examiner's observations of waning attention and cooperation during the assessment session are highly relevant, as these provide stable and clinically meaningful information about the child's behavioral tendencies.     

Examining the effects of stereotype threat on test-taking behaviors

This study examines the relationship between stereotype threat and individual test-taking behaviors. Previous research has examined the impact of stereotype threat on test scores, but little research has examined the impact of stereotype threat on the test-taking behaviors impacting those scores. Using a pre-post experimental design, stereotype threat was manipulated and test-taking behaviors (e.g., time spent per item, response changes) were measured while completing verbal ability items before and after the manipulation. The results indicated that stereotype threat minimally impacted time-related test-taking behaviors, but did impact behaviors related to response changes. Implications of the findings are discussed.     

Relating Test-Taking Attitudes and Skills and Stereotype Threat Effects to the Racial Gap in Cognitive Ability Test Performance

This research extended past studies on race effects and stereotype threat (ST) effects outside the academic domain, as well as exploring the mediating role of test-related cognition, motivation, and emotionality in the Black-White cognitive ability test performance differences. One hundred seventy-two undergraduates took a simulated personnel selection test and responded to measures of attitudinal and test-taking skills prior to and after the test. Half of the participants were told that the test provided the hypothetical employer diagnostic information about their reasoning abilities and limitations; they were also asked to report their racial status prior to taking the test. Significant race differences favoring Whites were found for mathematical and logical performance, holding ability constant. A metacognitive strategy, regulation of cognition, partially mediated race effects on mathematical and verbal performance. Contrary to previous findings, no traditional significant ST effects were found; however, a 3-way interaction revealed that proficiency in test-taking strategies mitigated the Black-White mathematical score gap to a greater extent for those in the ST condition.     

Evidence for discrete profiles of children’s physiological activity across three neurobiological system and their transitions over time

The conceptualization of stress‐responsive physiological systems as operating in an integrated manner is evident in several theoretical models of cross‐system functioning. However, limited empirical research has modeled the complexity of multisystem activity. Moreover few studies have explored developmentally regulated changes in multisystem activity during early childhood when plasticity is particularly pronounced. The current study used latent profile analysis (LPA) to evaluate multisystem activity during fall and spring of children's transition to kindergarten in three biological systems: the parasympathetic nervous system (PNS), sympathetic nervous system (SNS), and hypothalamic pituitary adrenal (HPA) axis. Latent transition analysis (LTA) was then used to examine the stability of profile classification across time. Across both timepoints, three distinct profiles of multisystem activity emerged. One profile was characterized by heightened HPA axis activity (HPA Axis Responders), a second profile was characterized by moderate, typically adaptive patterns across the PNS, SNS, and HPA axis (Active Copers/Mobilizers), and a third profile was characterized by heightened baseline activity, particularly in the PNS and SNS (Anticipatory Arousal/ANS Responders). LTA of fall‐to‐spring profile classifications indicated higher probabilities that children remained in the same profile over time compared to probabilities of profile changes, suggesting stability in certain patterns of cross‐system responsivity. Patterns of profile stability and change were associated with socioemotional outcomes at the end of the school year. Findings highlight the utility of LPA and LTA to detect meaningful patterns of complex multisystem physiological activity across three systems and their associations with early adjustment during an important developmental transition.     

The Effects of Subject-and Experimenter-Induced Defensive Response Sets on Picture-Frustration Test Reactions

Thirty male college students, half scoring high and half low on the MMPI K-scale, were administered a multiple-choice (M-C) modification of the Rosenzweig P-F Study under three instructional sets. Two of these sets were induced by E and compared with the third which represented S's normal test-taking set. The two induced sets included (1) a “should” set in which concern for the social consequences of behavior was accentuated, and (2) a “wish” set in which concern for social consequences was minimized, and freedom of self-expression was accentuated.

It was hypothesized that Ss making extremely high or low scores on the K-scale would likewise score differently on the M-C, P-F test. High K, defined by its authors as a measure of test defensiveness, and low K, as test-taking candidness, would be associated with P-F score patterns reflecting these test-taking attitudes: High K Ss showing Impunitive (M) dominant reaction patterns and low K showing Extrapunitive (E) or Intropunitive (I) dominant patterns. These hypothèses were confirmed except that intropunitive responses were extremely rare in the entire subject sample.

It was further hypothesized that the typical high K pattern would be induced in low K Ss under the “should” instructional set and the low K pattern would be elicited from high K Ss under “wish” instructions. This expectation was confirmed. It was suggested that the technique of manipulating responses via test taking instructions can generate correction factors useful in projective as well as structured personality tests.     

Test-Taker and Close-Other Selection of Personality Inventory Feedback

Results from previous studies suggest that normal persons self-enhance both when rating their own personality traits, and when evaluating personality inventory feedback. In this study, 64 male and female undergraduates attempted to distinguish their own California Psychological Inventory (Gough, 1975) profiles from those of two other individuals. Sixty-four close friends and relatives (close others) of test-takers also attempted to identify test-taker profiles. It was found that a significant proportion of test-takers, and a near-significant proportion of close others, made accurate selections, Z =: 3.76. p < .001 and Z = 1.90, p = .06, respectively. It was also found that close others who selected incorrectly were significantly likely to flatter the test-taker by choosing the most favorable profile of the three, Z = 1.97, p < .05, whereas test-takers who selected incorrectly did not show a significant tendency to choose the most favorable profile.     

Item-response theory modeling of IQ gains (the Flynn effect) on crystallized intelligence: Rodgers' hypothesis yes,Brand's hypothesis perhaps

Potential explanations for generational intelligence test score gains continue to be subject to intense debate and scrutiny in the scientific community. However, the explanatory value of some of the proposed causes remains difficult to determine, since only little empirical evidence is available. To clarify the role of two scarcely investigated theories accounting for the Flynn effect, this study set out to examine the role of changing test-taking behavior (Brand's hypothesis) and of a narrowing of the IQ ability distribution (Rodgers' hypothesis). Archival records of crystallized intelligence test performance over a time-span of 17 years of a large number of psychiatric inpatients and outpatients in Austria were investigated (N = 5445; 1978–94). This sample was particularly suitable to investigate our hypotheses since participants were under no pressure to perform which makes observed changes in test taking behavior attributable to personal style and ability rather than differential performance in pressure situations. Analytical approaches of both classical test theory and item response theory (IRT) yielded gains of 1.0 to 2.4 IQ points per decade. Test-taking behavior indicative of guessing and decreasing population IQ variability appeared to contribute both to IQ test score gains. IRT-based analyses showed that gains were largely preserved when controlling for highest educational qualification, while the test instrument showed measurement invariance between cohorts. However, IRT-based results also suggested that changes in test-taking behavior might not necessarily reflect increased guessing, but item drift instead. In all, this evidence emphasizes better performance of individuals of the lower tail of the IQ ability distribution in more recent years as one important contributing factor for generational IQ test score gains.     

Identifying Misfitting Achievement Estimates in Performance Assessments: An Illustration Using Rasch and Mokken Scale Analyses

Researchers apply individual person fit analyses as a procedure for checking model-data fit for individual test-takers. When a test-taker misfits, it means that the inferences from their test score regarding what they know and can do may not be accurate. One problem in applying individual person fit procedures in practice is the question of how much misfit it takes to make the test score an untrustworthy estimate of achievement. In this paper, we argue that if a person’s responses generally follow a monotonic pattern, the resulting test score is “good enough” to be interpreted and used. We present an approach that applies statistical procedures from the Rasch and Mokken measurement perspectives to examine individual person fit based on this good enough criterion in real data from a performance assessment. We discuss how these perspectives may facilitate thinking about applying individual person fit procedures in practice.     

Investigating Test-Taking Behaviors Using Timing and Process Data

The use of computer-based assessments makes the collection of detailed data that capture examinees’ progress in the tests and time spent on individual actions possible. This article presents a study using process and timing data to aid understanding of an international language assessment and the examinees. Issues regarding test-taking strategies, test speededness, test design, and their relationship to examinees’ demographic backgrounds and performance are also discussed.     

Optimal appropriateness measurement

The test-taking behavior of some examinees may be so idiosyncratic that their test scores may not be comparable to the scores of more typical examinees. Appropriateness measurement attempts to use answer patterns to recognize atypical examinees. In this report appropriateness measurement procedures are viewed as statistical tests for choosing between a null hypothesis of normal test-taking behavior and an alternative hypothesis of atypical test-taking behavior. Most powerful tests for inappropriateness are described together with methods for computing their power. A recursion greatly simplifying the calculation of optimal test statistics is described and illustrated.The work reported in this article was supported by United States Office of Naval Research contracts N00014-79C-0752, NR 154-445 and N00014-83K-0397, NR 150-518, Michael V. Levine, Principal Investigator.     

The Role of Students’ Attitudes and Test-Taking Motivation on the Validity of College Institutional Accountability Tests: A Path Analytic Model

Given worldwide prevalence of low-stakes testing for monitoring educational quality and students’ progress through school (e.g., Trends in International Mathematics and Science Study, Program for International Student Assessment), interpretability of resulting test scores is of global concern. The nonconsequential nature of low-stakes tests can undermine students’ test-taking motivation, artificially deflating performance and thus jeopardizing validity of test-based inferences, whether they pertain to programs, institutions, or nations (Eklöf, 2007, 2010; Stanat & Lüdtke, 2013; Wise & DeMars, 2005). Moreover, students in countries such as the United States, where academic progress over the course of K–12 (kindergarten through Grade 12) is systematically assessed, are likely to develop antagonistic attitudes toward low-stakes testing by the time they enter college. The relationship between such attitudes, test-taking motivation, and performance on a low-stakes university accountability test was modeled via path analysis. Results indicated the effects of attitudes were indirect (via test-taking motivation) and minimal, suggesting the influence of attitudes on test performance is negligible, further supporting the validity of inferences made from such low-stakes tests. Implications for international assessment are discussed.     

Leiter-3 generalizability in Scandinavia

The Leiter-3 is a nonverbal assessment that evaluates cognitive abilities and has been adapted for use in Scandinavia. Generalizability of United States-based normative scoring for use with the Scandinavian population was evaluated. Leiter-3 scores from a sample of Scandinavian students were compared with scores obtained from the Leiter-3 standardization sample, controlling for confounding variables, across ages, using mixed-methods analysis. A Scandinavian-population-based sample was created from Leiter-3 standardization data and norms were constructed and were used to generate standardized scores from the sample data. Results suggest that overall the Scandinavian test-takers score higher than American test-takers, but that differences between groups were minimized when controlling for factors that may influence cognitive performance. Creating Scandinavian based scores was not effective at reducing gaps in performance, suggesting that differences in performance between the different populations may be attributable to factors other than those typically controlled for when constructing standardized tests. Implications of these results and recommendations for Leiter-3 adaptation are reviewed.     

高一学生成就目标特征模式及学业适应:基于潜在剖面分析

本研究采用潜在剖面分析技术探究高中生成就目标的特征模式及学业适应。被试为732名来自北京、广东、福州和西安各一所高中的高一学生,本研究采用问卷法收集学生的成就目标取向、学习效能、学业自我阻碍、学习策略和考试焦虑的数据。结果发现：（1）学生中存在成功导向、学业淡漠、典型掌握导向和非典型掌握导向四种类型,其中,典型和非典型掌握导向型所占比例较高,成功导向型和学业淡漠型所占比例较低;（2）成功导向组学生在学习效能、学习策略、学业自我阻碍和考试焦虑上的得分最高,学业淡漠组在各学业适应指标上得分最低,典型和非典型掌握导向组得分处于成功导向组和学业淡漠组中间。本研究结果对预防和干预学业适应不良具有重要意义。     

全国高考英语试题的城乡项目功能差异分析

本研究主要目的是针对高考英语成绩存在的城乡差异,检验这种差异是否来源于试题在城乡上的项目功能差异。如果两个能力本来相同的考生群体在某一试题得分上表现出不同程度的差异,该试题就存在项目功能差异。研究采用试题标准化分数差法,利用STDIF软件逐一分析了2016年三套全国高考英语卷的客观题是否存在城乡上的项目功能差异,在确定客观题没有项目功能差异后,以客观题成绩为匹配变量,采用条件得分图法对书面表达题是否存在城乡上的项目功能差异进行了分析。研究结果显示,高考英语全国I、II、III卷均未发现城乡上的项目功能差异试题,即可以认为高考英语全国卷对城乡不同户籍考生都非常公平、公正,城乡考生在英语成绩上的差异并非题目的公平性所致。     

幼儿教师教学策略的结构、类型及特点

以432名幼儿教师为样本,探讨了幼儿教师教学策略的结构及类型,并进一步分析了不同类型幼儿教师的教学策略特点。结果表明:(1)幼儿教师教学策略的结构主要包括引导监控策略、分析总结策略、交流互动策略及计划应变策略4部分;(2)幼儿教师教学策略的类型主要分为综合发展型、整合提升型和交流缺失型3种;(3)综合发展型幼儿教师的教学策略水平较高,交流缺失型幼儿教师的交流互动策略最差,而整合提升型幼儿教师的教学策略正处在整合发展期。     

Assessing changes in performance and monitoring processes in individual and collaborative tests according to students' metacognitive skills

This study assessed students' test performances and metacognitive processes in real classroom settings. Psychology undergraduates were categorised according to their metacognitive skills (high vs. low) and had their test performances and monitoring processes in two different types of tests (multiple-choice and short-answer tests) compared in individual and collaborative test conditions. Students' test preparation practices, attributions, and regulatory processes during test-taking were also compared by using open-ended questions. In the collaborative tests, three types of metacognitive pairings were made (high/high vs. high/low vs. low/low). Results showed that: (1) in individual tests, high-metacognitive students presented better performance and higher confidence levels due to their more effective test preparation practices and regulatory skills; (2) Differences in performance and confidence levels due to metacognitive skills disappear when students take tests collaboratively; (3) Over time, collaborative testing had particular positive effects on the low/low metacognitive pairings. Results are discussed focusing on their educational implications.