Examining the testing effect with open‐ and closed‐book tests

Two experiments examined the testing effect with open‐book tests, in which students view notes and textbooks while taking the test, and closed‐book tests, in which students take the test without viewing notes or textbooks. Subjects studied prose passages and then restudied or took an open‐ or closed‐book test. Taking either kind of test, with feedback, enhanced long‐term retention relative to conditions in which subjects restudied material or took a test without feedback. Open‐book testing led to better initial performance than closed‐book testing, but this benefit did not persist and both types of testing produced equivalent retention on a delayed test. Subjects predicted they would recall more after repeated studying, even though testing enhanced long‐term retention more than restudying. These experiments demonstrate that the testing effect occurs with both open‐ and closed‐book tests, and that subjects fail to predict the effectiveness of testing relative to studying in enhancing later recall. Copyright © 2007 John Wiley & Sons, Ltd.     

Developing a Computer-Based TTCT: Promises and Problems*

The purposes of the present study were to examine the equivalence of paper-pencil and computer-based versions of the Torrance Tests of Creative Thinking (TTCT), Figural Forms A and B, and to investigate the patterns of responses involved in the computer-based TTCT. The participants were 34 fifth- and sixth-grade students currently enrolled in two public schools in southern Texas. The computer-based TTCT was developed to present all the features of the paper-pencil TTCT with the additional benefits offered by computer-based testing. Means, variances, test-retest reliability, and attitudinal differences were analyzed to investigate equivalence between the paper-pencil and computer-based TTCT. Response patterns involved in the figural tasks were explored based on data collected from the computer-based test (e.g., latency, tool using patterns, correction activities). The findings of the study indicated that the results obtained from the computer-based TTCT were not equivalent with the paper-pencil version. However, additional information regarding response patterns obtained from the computer-based TTCT showed clear indication of different response tendencies among different groups of students and between the two alternate test forms (A and B).     

Three brief assessments of math achievement

Because of wide disparities in college students?? math knowledge??that is, their math achievement??studies of cognitive processing in math tasks also need to assess their individual level of math achievement. For many research settings, however, using existing math achievement tests is either too costly or too time consuming. To solve this dilemma, we present three brief tests of math achievement here, two drawn from the Wide Range Achievement Test and one composed of noncopyrighted items. All three correlated substantially with the full achievement test and with math anxiety, our original focus, and all show acceptable to excellent reliability. When lengthy testing is not feasible, one of these brief tests can be substituted.     

A mixture hierarchical model for response times and response accuracy

In real testing, examinees may manifest different types of test‐taking behaviours. In this paper we focus on two types that appear to be among the more frequently occurring behaviours – solution behaviour and rapid guessing behaviour. Rapid guessing usually happens in high‐stakes tests when there is insufficient time, and in low‐stakes tests when there is lack of effort. These two qualitatively different test‐taking behaviours, if ignored, will lead to violation of the local independence assumption and, as a result, yield biased item/person parameter estimation. We propose a mixture hierarchical model to account for differences among item responses and response time patterns arising from these two behaviours. The model is also able to identify the specific behaviour an examinee engages in when answering an item. A Monte Carlo expectation maximization algorithm is proposed for model calibration. A simulation study shows that the new model yields more accurate item and person parameter estimates than a non‐mixture model when the data indeed come from two types of behaviour. The model also fits real, high‐stakes test data better than a non‐mixture model, and therefore the new model can better identify the underlying test‐taking behaviour an examinee engages in on a certain item.     

Type A behaviour pattern and attentional bias in relation to anger/hostility, achievement, and failure

Type A subjects are characterised by dysfunctional cognitions related to themes of competitiveness, achievement, and hostility. The present experiment investigated attentional biases for words relevant to the content of these dysfunctional schemata in Type A individuals. After completing the MMPI-2 Type A Scale, subjects completed two alternative versions of a visual probe detection task (administered 4–12 days apart) which contained achievement, failure, and anger/hostility/aggression related words. Prior to testing at time 1, subjects were told that the purpose of the procedure was to collect normative data only. Prior to testing at time 2, subjects were told that performance on the test was known to be closely related to IQ and that they could compare their performance with that of other subjects following completion of the task. Type A subjects directed attention towards anger/hostility/aggression words under low performance motivation conditions but away from such words under high performance motivation conditions. Type A subjects also showed less selective attention to failure words than Type B subjects, and no group differences were detected for achievement related words. The results are discussed with reference to models of dysfunctional cognitive processing, and the role of anger/hostility, in particular, in Type A personality.     

Control motivation and attributions for performance

Two experiments examined the relationship between the desire for effective control over performance outcomes and attributions of causality for those outcomes. In Experiment 1, subjects were led to believe that they had either succeeded at or failed a test that was either unimportant or important. As predicted, failure of the important test was attributed more to lack of effort (a controllable cause) and less to lack of ability (an uncontrollable cause) than was failure of the unimportant test. In Experiment 2, all subjects were led to believe that they had failed a test. Once again, subjects were informed that the test was either important or unimportant. In addition, half the subjects were told that they would be undergoing more tests in a later testing session, while half were not informed of any future testing. As in Experiment 1, subjects failing the important test attributed their failure less to lack of ability than did subjects failing the unimportant test. The anticipation of future testing interacted with test importance in its effects on attributions to ability. Subjects performing the unimportant task attributed their failure more to lack of ability when anticipating future performance than when not. Attributions of subjects performing an important task were not affected by the anticipation of future performance. Results were discussed in terms of the need for control over performance outcomes.     

Adolescent school performance following parental divorce: are there family factors that can enhance success?

Most research on the effects of divorce on children has focused on delineation of specific areas of child maladjustment. A more optimistic approach seeks to identify variables that may mediate negative effects of a stressor, such as parental divorce. The goal of this study was to examine the relationship between one area of child adjustment, school achievement, and family factors which may mediate the negative influence of divorce. The subjects were 71 early adolescents and their recently divorced mothers. The adolescents were divided into low, medium, and high grade achievement groups. Analyses of variance and subsequent Newman-Keuls tests revealed that adolescents with high grade point averages had mothers with a lower level of depression, a higher educational level, less conflict with their ex-spouse, and less intense levels of conflict between mother and adolescent than those in the low grade point average group. A discriminant analysis resulted in a two-variable equation which accounted for 33% of the variance between low and high grade achievers. The two variables were mother's report of conflict between her and her ex-spouse in front of the adolescent and the adolescent's report of the intensity of arguments between him/herself and mother. These results indicated that school performance following divorce is not uniform for all adolescents and that family factors may mediate scholastic achievement problems.     

Curriculum-Based Measurement Oral Reading as an indicator of reading achievement: A meta-analysis of the correlational evidence

This meta-analysis summarized the correlational evidence of the association between the CBM Oral Reading measure (R-CBM) and other standardized measures of reading achievement for students in grades 1–6. Potential moderating variables were also examined (source of criterion test, administration format, grade level, length of time, and type of reading subtest score). Results indicated a significant, strong overall correlation among R-CBM and other standardized tests of reading achievement and differences in correlations as a function of source of test, administration format, and reading subtest type. No differences in the magnitude of correlations were found across grade levels. In addition, there was minimal evidence of publication bias. Results are discussed in terms of existing literature and directions for future research.     

Learning potential and anxious tendency: Test anxiety as a bias factor in educational testing

Abstract

Contrary to conventional educational testing, in so-called dynamic assessment subjects are allowed to consult help during testing or are offered prior training. The differential results of both testing procedures are sometimes ascribed to the idea that dynamic tests reflect the breadth of the zone of proximal development on top of independent achievement. Alternative explanations claim that conventional tests are more strongly biased towards various characteristics of persons, which have a negative influence on performance, when compared to dynamic tests. In this study, it was hypothesised that static as well as dynamic assessment is biased towards anxious tendencies of subjects, but the former more strongly than the latter. In order to investigate this supposition, the performance of subjects on dynamic and static tests was systematically compared and related to measures of test anxiety in a longitudinal experiment. In the experiment, repeated measures of independent mathematics achievement as well as mathematics learning potential were gathered among students of secondary education in the Netherlands. Prior to every mathematics test, subjects filled out a test anxiety questionnaire. After every mathematics test, subjects filled out a general state anxiety questionnaire. The participating subjects were students from secondary education, either preparing for higher vocational training or university, aged approximately 15 years on average.

The results of the experiment showed that lack of self-confidence is an important constituent factor of test anxiety, apart from worry and emotionality. The data supported the assumption that such testing procedures are less biased towards anxiety than conventional tests, but it was not established that dynamic testing procedures render results that are not biased by test anxious tendencies.     

风险条件下的跨期选择

跨期选择是指对发生在未来不同时间点上的结果做出权衡的决策过程。由于大部分跨期选择的情景都处于某种风险之中, 把风险变量纳入跨期选择的研究中则至为关键。针对以往研究在研究范围、理论构建、现实意义等诸方面的不足, 本研究拟采用实验室实验与纸笔测验相结合的方法, 深入揭示高、中、低三种概率水平下风险对跨期选择的影响特征, 探索其发生的机制、各类经典效应的大小。在此基础上, 根据全国不同地区的大样本调查结果, 了解各地区风险条件下跨期选择的差异及其与本地宏观经济指标(如, 消费者物价指数)的关联, 进而探讨研究的现实意义。本研究期望对风险条件下的跨期选择做出系统、全面的科学探索, 并为国家相关部门制定政策提供有价值的参考。     

Is expanding retrieval a superior method for learning text materials?

Expanding retrieval practice refers to the idea that gradually increasing the spacing interval between repeated tests ought to promote optimal long-term retention. Belief in the superiority of this technique is widespread, but empirical support is scarce. In addition, virtually all research on expanding retrieval has examined the learning of word pairs in paired-associate tasks. We report two experiments in which we examined the learning of text materials with expanding and equally spaced retrieval practice schedules. Subjects studied brief texts and recalled them in an initial learning phase. We manipulated the spacing of the repeated recall tests and examined final recall 1 week later. Overall we found that (1) repeated testing enhanced retention more than did taking a single test, (2) testing with feedback (restudying the passages) produced better retention than testing without feedback, but most importantly (3) there were no differences between expanding and equally spaced schedules of retrieval practice. Repeated retrieval enhanced long-term retention, but how the repeated tests were spaced did not matter.     

Occupational Achievement Motivation as a Function of Biological Sex, Sex-Linked Personality, and Occupation Stereotype

Predicted sex differences in occupational achievement motivation based on the work of Horner (1968) and Stein, Pohly and Mueller (1971) were examined by administering questionnaires to 87 female and 91 male undergraduate psychology students. Subjects made six achievement related responses to twelve occupations which had been stereotyped by a separate group of subjects as being either high prestige masculine, middle prestige masculine, middle prestige feminine or middle prestige androgynous (appropriate for both sexes). Analyses of variance were performed on all achievement responses with subjects'sex, sex-linked personality (Spence, Helmreich & Stapp, 1974), and occupational stereotype as independent variables. Significant sex by occupation stereotype interactions were found on all six dependent measures supporting the Stein et al. prediction of highest achievement motivation toward sex appropriate occupations. The fact that females did not show significantly lower motivation than males toward high prestige masculine occupations is inconsistent with earlier findings. Sex-linked personality was related to some of the achievement measures but did not interact with either occupation stereotype or biological sex.     

Academic achievement in Blacks and Whites: Are the developmental processes similar?

Genetic and environmental influences on academic achievement were investigated in four groups of siblings: (1) White full siblings, (2) White half-siblings, (3) Black full siblings, and (4) Black half-siblings. Our expectation was that the variances and covariances among three achievement tests would have the same structure across the four groups. This expectation was confirmed by a quantitative genetic model that imposed equal factor loadings across groups. This best fitting model had two factors: a Genetic factor representing genetic variation and a Shared Environment factor representing environmental differences among families. Reading recognition, reading comprehension, and mathematics tests all loaded on the Genetic factor, but primarily mathematics loaded on the Shared Environment factor. The quantitative genetic model was next fit to the achievement test means. Its successful fit suggested that the genetic and environmental influences involved in producing individual variation were the same as those producing the group-mean differences. In this sample, genes accounted for 66% to 74% of the observed group difference in verbal achievement and 36% of the difference in mathematics achievement. Shared environment accounted for the remainder, 34% to 26% of the difference in verbal achievement and 64% of that in mathematics achievement.     

Sex differences in self-confidence: The influence of comparison to others' ability level

Previous investigators have suggested that women display lower self-confidence than men in almost all achievement settings. The validity of this suggestion is assessed in an experiment testing the impact of comparison to others upon sex differences. Male and female undergraduates, who expected to cooperate in the future with a same-sex partner of high, average, or low ability, selected a difficulty level for an achievement test, completed the test, evaluated their own performance, and estimated their future partner's probable performance. As predicted, only when subjects' future partner was highly competent did women select an easier test than men, perform less well, and compare themselves less favorably to their partner. Also, women's, but not men's, self-evaluations depended upon their partner's ability level. It is concluded that sex differences are moderated by social comparison variables. Cognitive processes that may underlie such differences are discussed.The authors wish to express their appreciation to Phoebe Ellsworth for her critical comments on this research, and to Pamela Joy, Tama Jacobson, and Thomas Hallet for serving as experimenters. Portions of this study were reported at the Eastern Psychological Association Convention, 1978.     

The predictive role of achievement goals adoption on sensation-seeking and risk taking in driving

Risk taking in driving is a major road safety issue. Understanding the individual psychological differences that may influence risk taking may contribute to better overcome its negative consequences. Recently, four achievement goals were highlighted in the driving domain: striving to drive well or to improve as much as possible (mastery-approach goals), to avoid driving badly or to avoid being a worse driver than before (mastery-avoidance goals), to outperform other drivers (performance-approach goals), and to avoid being a worse driver than other drivers (performance-avoidance goals). The first purpose of the present study was to examine the predictive role of these achievement goals in driving on self-reported drivers’ risk taking (ordinary and aggressive violations) and sensation-seeking. The second purpose of the study was to test the mediating role of sensation seeking between achievement goals adoption in driving and violations. A total of 341 French drivers voluntarily filled out the questionnaires assessing the variables of interest. The main results showed that performance-approach goals adoption was found to positively predict sensation seeking, ordinary and aggressive violations, whereas mastery-avoidance goals adoption was found to negatively predict these variables. The results also highlighted that sensation seeking was a significant mediator of the relationships between the two previous achievement goals (performance-approach and mastery-avoidance goals) and ordinary and aggressive violations. In conclusion, the achievement goal model may now be considered a relevant theoretical framework in the driving literature focusing on risk taking, sensation seeking, and road safety.     

Paradoxical effects of testing: Repeated retrieval attempts enhance the likelihood of later accurate and false recall

The testing effect is the finding that taking an initial test enhances the likelihood of later recall. The present report examines the extent to which this benefit of testing comes with a cost: an enhanced likelihood of erroneously recalling incorrect information. Subjects were given short lists of semantic associates (e.g., hill, valley, climb); each list converged upon a related nonpresented word (e.g., mountain). After presentation of some lists, the subjects received no initial test; after others, one initial free recall test; and after others, three successive free recall tests. The probabilities of final free recall (and the probability of reporting vivid recollection of the moment of encoding) of both studied and related, nonstudied words (e.g., mountain) were highest when three initial tests had been taken, intermediate following one initial test, and lowest when no initial test had occurred. The beneficial effects of testing carry the cost of increases in erroneous memory for related information.     

The testing effect in free recall is associated with enhanced organizational processes

In two experiments with categorized lists, we asked whether the testing effect in free recall is related to enhancements in organizational processing. During a first phase in Experiment 1, subjects studied one list over eight consecutive trials, they studied another list six times while taking two interspersed recall tests, and they learned a third list in four alternating study and test trials. On a test 2 days later, recall was directly related to the number of tests and inversely related to the number of study trials. In addition, increased testing enhanced both the number of categories accessed and the number of items recalled from within those categories. One measure of organization also increased with the number of tests. In a second experiment, different groups of subjects studied a list either once or twice before a final criterial test, or they studied the list once and took an initial recall test before the final test. Prior testing again enhanced recall, relative to studying on the final test a day later, and also improved category clustering. The results suggest that the benefit of testing in free recall learning arises because testing creates retrieval schemas that guide recall.     

Role of the Disease in the Psychological Impact of Pre-Symptomatic Testing for SCA2 and FAP ATTRV30M: Experience with the Disease, Kinship and Gender of the Transmitting Parent

To identify possible factors affecting the psychological impact of pre-symptomatic testing for spinocerebellar ataxia type 2 (SCA2) and familial amyloid polyneuropathy (FAP ATTRV30M), we studied (1) the effect of previous experience with the disease in the family, (2) kinship with the closest affected relative and (3) gender of affected parent, when adapting to test results; as well as (4) differences in the course of psychological wellbeing in 63 subjects ( 28 at-risk for FAP ATTRV30M, and 35 at risk for SCA2), who pursued predictive testing for these diseases, in Cuba and in Portugal. Our research shows that individuals with little or no experience with the disease in their family exhibited more anxiety; at-risk subjects for SCA2 or FAP ATTRV30M who had a first degree relative with the disease showed lower levels of anxiety and depression during pre-symptomatic testing. Also those with an affected mother had lower levels of depression, either immediately, or one year after receipt of test results. Adaptation to pre-symptomatic testing results differed for subjects at-risk for the two different conditions. Unlike the FAP ATTRV30M families, carriers for SCA2 reported pathological levels of depression immediately after-testing (3 weeks), although those levels had returned to normal levels at 6 months. Subjects at-risk for FAP ATTRV30M tended to have less anxiety than those tested for SCA2, at the one-year follow-up. Overall, depression levels improved over time, while anxiety remained more constant. A longer awareness of the disease in the family, closer kinship, and a transmitting mother all lessened the impact of pre-symptomatic testing, as expressed by the post-test levels of anxiety and depression.     

Meta‐Analyses of the Relationship of Creative Achievement to Both IQ and Divergent Thinking Test Scores

There is disagreement among researchers about whether IQ tests or divergent thinking (DT) tests are better predictors of creative achievement. Resolving this dispute is complicated by the fact that some research has shown a relationship between IQ and DT test scores (e.g., Runco & Albert, 1986; Wallach, 1970). The present study conducted meta‐analyses of the relationships between creative achievement and both IQ and DT test scores. The analyses included 17 studies (with 5,544 participants) that established the correlation coefficients between IQ and creative achievement and 27 studies (with 47,197 participants) that established the correlation coefficients between DT test scores and creative achievement. Marginal, but statistically significant, Fisher's Z‐transformed correlation coefficients were revealed. The analysis found a significantly higher relationship between DT test scores and creative achievement (r = .216) than between IQ test scores and creative achievement (r = .167). The differences in the correlation coefficients were explained by differences in DT tests, creative achievement types, predicted time periods, and creativity subscales. The significant independent moderator effect for different DT tests indicates that the Torrance Tests of Creative Thinking (TTCT) predict creative achievement better than any other DT test included in this study. Among the creative achievement types, music is predicted the best by IQ and all others are predicted best by DT tests. Among the time periods evaluated, the relationship between DT test scores and creative achievement had the highest correlation at the period of 11–15 years.