Estimating the mean effect size in meta-analysis: Bias,precision, and mean squared error of different weighting methods

Although use of the standardized mean difference in meta-analysis is appealing for several reasons, there are some drawbacks. In this article, we focus on the following problem: that a precision-weighted mean of the observed effect sizes results in a biased estimate of the mean standardized mean difference. This bias is due to the fact that the weight given to an observed effect size depends on this observed effect size. In order to eliminate the bias, Hedges and Olkin (1985) proposed using the mean effect size estimate to calculate the weights. In the article, we propose a third alternative for calculating the weights: using empirical Bayes estimates of the effect sizes. In a simulation study, these three approaches are compared. The mean squared error (MSE) is used as the criterion by which to evaluate the resulting estimates of the mean effect size. For a meta-analytic dataset with a small number of studies, theMSE is usually smallest when the ordinary procedure is used, whereas for a moderate or large number of studies, the procedures yielding the best results are the empirical Bayes procedure and the procedure of Hedges and Olkin, respectively.     

Contents Volume

Volume Contents

Contents Volume     

Reinventing the University Through the Teaching of Diversity

University reform encompasses an increased emphasis on the social and emotional development of students. In particular, the development of caring, empathy, and community are emphasized. This team of psychology professors approaches the task of university reform by presenting both its philosophy of diversity inclusion and specific inclusion strategies as means of promoting enhanced development of our students. Although the discipline of psychology is used as an example, the philosophical argument and the strategic approaches may be applied to other disciplines.     

Large-scale databases of proper names

Few tools for research in proper names have been available—specifically, there is no large-scale corpus of proper names. Two corpora of proper names were constructed, one based on U.S. phone book listings, the other derived from a database of Usenet text. Name frequencies from both corpora were compared with human subjects’ reaction times (RTs) to the proper names in a naming task. Regression analysis showed that the Usenet frequencies contributed to predictions of human RT, whereas phone book frequencies did not. In addition, semantic neighborhood density measures derived from the HAL corpus were compared with the subjects’ RTs and found to be a better predictor of RT than was frequency in either corpus. These new corpora are freely available on line for download. Potentials for these corpora range from using the names as stimuli in experiments to using the corpus data in software applications.     

Effects of response type on coordinated responses during arm movement

This paper reports some experimental results on the coordination of finger and vocal responses with passing through a target position in multjjoint arm movement. In Experiment 1, we found that the difference in the timing of finger and vocal responses cannot be attributed entirely to efferent or representational effects. Instead, it appears to reflect the extent to which information about the internal stimuli generated by the arm movement are available to the centers controlling these different responses. That is, it is a compatibility effect. In Experiment 2, the case in which a finger response is made on the same side of the body as the moving arm was compared with the case in which it is made with the contralateral hand, which remains static. The interaction effect observed suggests that the path-ways subserving coordinated responses are informationally encapsulated, so that information about arm movement is not shared between the neural centers controlling different coordinated responses.     

What affects strategy selection in arithmetic? The example of parity and five effects on product verification

The parity effect in arithmetic problem verification tasks refers to faster and more accurate judgments for false equations when the odd/even status of the proposed answer mismatches that of the correct answer. In two experiments, we examined whether the proportion of incorrect answers that violated parity or the number of even operands in the problem affected the magnitude of these effects. Experiment 1 showed larger parity effects for problems with two even operands and larger parity effects during the second half of the experiment. Experiment 2 replicated the results of Experiment 1 and varied the proportion of problems violating parity. Larger parity effects were obtained when more of the false problems violated parity. Moreover, all three effects combined to show the greatest parity effects in conditions with a high proportion of parity violations in problems containing two even operands that were solved during the second half of the experiment. Experiment 3 generalized the findings to the case of five rule (i.e., checking whether a false product ends in 5 or 0), another procedure for solving and verifying multiplication problems quickly. These results (1) delineate further constraints for inclusion in models of arithmetic processing when thinking about how people select among verification strategies, (2) show combined effects of variables that traditionally have been shown to have separate effects on people's strategy selection, and (3) are consistent with a view of strategy selection that suggests a bias either in the allocation of cognitive resources in the execution of strategies or in the order of execution of these strategies; they argue against a simple, unbiased competition among strategies.     

COMPETITION BETWEEN POSITIVE AND NEGATIVE REINFORCEMENT IN THE TREATMENT OF ESCAPE BEHAVIOR

We compared the effects of reinforcing compliance with either positive reinforcement (edible items) or negative reinforcement (a break) on 5 participants' escape-maintained problem behavior. Both procedures were assessed with or without extinction. Results showed that compliance was higher and problem behavior was lower for all participants when compliance produced an edible item rather than a break. Treatment gains were achieved without the use of extinction. Results are discussed regarding the use of positive reinforcement to treat escape behavior.     

THE EFFECT OF TOKEN REWARDS ON “INTRINSIC” MOTIVATION FOR DOING MATH

This study used a multielement baseline design to analyze the effects of token rewards delivered contingent upon completion of math problems by 2 middle-school boys. Time spent on math and number of work pages completed increased (with high accuracy) during reward conditions and were maintained during fading and withdrawal. At follow-up, time spent and work pages completed remained well above baseline for 1 boy and fell below for the other, while accuracy remained high and ratings of liking math were the highest possible for both boys. Overall, the results are inconsistent with warnings about use of token rewards to motivate children.