F-test bias for experimental designs in educational research

Reference is made to Neyman's study ofF-test bias for the randomized blocks and Latin square designs employed in agriculture, and some account is given of later statistical developments which sprang from his work—in particular, the classification of model-types and the technique of variance component analysis. It is claimed that there is a need to carry out an examination ofF-test bias for experimental designs in education and psychology which will utilize the method and, where appropriate, the known' results of this new branch of variance analysis. In the present paper, such an investigation is carried out for designs which may be regarded as derivatives of the agricultural randomized blocks design. In a paper to follow, a similar investigation will be carried out for experimental designs of the Latin square type.     

Improper solutions in the analysis of covariance structures: Their interpretability and a comparison of alternate respecifications

A Monte Carlo approach was employed to investigate the interpretability of improper solutions caused by sampling error in maximum likelihood confirmatory factor analysis. Four models were studied with two sample sizes. Of the overall goodness-of-fit indices provided by the LISREL VI program significant differences between improper and proper solutions were found only for the root mean square residual. As expected, indicators of the factor on which the negative uniqueness estimate occurred had biased loadings, and the correlations of its factor with other factors were also biased. In contrast, the loadings of indicators on other factors and those factor intercorrelations did not have any bias of practical significance. For initial solutions with one negative uniqueness estimate, three respecifications were studied: Fix the uniqueness at .00, fix it at .20, or constrain the domain of the solution to be proper. For alternate, respecified solutions that were converged and proper, the constrained solutions and uniqueness fixed at .00 solutions were equivalent. The mean goodness-of-fit and pattern coefficient values for the original improper solutions were not meaningfully different from those obtained under the constrained and uniqueness fixed at .00 respecifications.This investigation was supported in part by a grant from the Baylor University Research Committee (#018-F83-URC). The authors gratefully acknowledge the comments and suggestions of Claes Fornell and Roger E. Kirk, and the assistance of Timothy J. Vance with the analysis.     

A randomized study of the impact of a sensitizing intervention on the child‐rearing attitudes of parents of low birth weight preterm infants

Nordhov, S. M., Kaaresen, P. I., Rønning, J. A., Ulvund, S. E. & Dahl, L. B. (2010). A randomized study of the impact of a sensitizing intervention on the child‐rearing attitudes of parents of low birth weight preterm infants. Scandinavian Journal of Psychology, 51, 385–391. The background for this study was that nurturant child‐rearing attitudes are associated with positive development in low birth weight (LBW) infants. The objective was to study child‐rearing attitudes and early intervention (EI) in parents of LBW infants from 12–36 months corrected age. LBW infants (BW < 2000 g) were randomized to an intervention (IG) or a control group (CG). The EI consisted of seven in‐hospital sessions prior to discharge, then four home visits. A Child Rearing Practices Report was administered at 12 (mothers only), 24 and 36 months. A total of 146 infants were randomized. The mean BW in IG was 1396 (SD 429) g and 1381 (436) g in CG. The mean GA was 30.2 (3.1) weeks in IG and 29.9 (3.5) weeks in CG. Mothers in IG reported significantly more nurturant child‐rearing attitudes at 12 and 24 months. There was a significant change in restrictive and nurturant attitudes over time. It was concluded that EI may lead to more nurturant child‐rearing attitudes in mothers of preterms.     

Effects of A Dual-Task Intervention in Postural Control and Cognitive Performance in Adolescents

Abstract

The aim was to assess dual- versus single-task training for motor performance and cognitive performance in adolescents. Two experiments were performed. In the first, 30 adolescents were randomized to three groups to determine the effect of dual-task difficulty on postural control: α-scaling and root mean square (RMS). In the second, 20 adolescents were randomized to two groups to determine the effect of dual-task practice to improve working memory. RMS in the post-test was lower than the pre-test in both dual-task groups, while α-scaling was lower in post-test than pre-test only in the high-difficulty dual-task group. A practice effect was observed on the percentage of correct answers only in the dual-task group (p?=?0.035). Thus, dual-task training could enhance motor and cognitive performance more than single-task training.     

A special latin square for the use of each subject “as his own control”

When the purpose of the experiment is to compare treatments, the Sequences × Positions Latin Square has been employed to control unwanted effects attributable to individuals, position, and sequence. This particular Latin Square has been subjected to criticism on the grounds there is confounding due to structure, random variables, and subject interactions. Special Latin Square, a subclass of the Sequences × Positions Latin Square, is basically ap ×p factorial design in blocks of sizep. The two factors are treatments (T) and positions (P). Sequence is one component of theTP interaction, and square uniqueness is the sum of the remaining components. This completely replicated factorial design has no structural or random variable confounding; if subject interactions are present, square uniqueness may be used as the error term and the bias in the test of treatments will be conservative.     

F-test bias for experimental designs of the Latin square type

In an earlier paper, a method of analysis, due to Neyman and now known generally as variance component analysis, was used to examineF-test bias for experimental designs in education of the randomized block type. The same method is now applied to studyF-test bias for designs of the Latin square type. The results, in general, disprove the view that, for a valid application of Latin square techniques, it is necessary that all interactions are zero.     

三类多层中介效应分析方法比较

比较了贝叶斯法、Monte Carlo法和参数Bootstrap法在2-1-1多层中介分析中的表现。结果发现：1)有先验信息的贝叶斯法的中介效应点估计和区间估计都最准确;2)无先验信息的贝叶斯法、Monte Carlo法、偏差校正和未校正的参数Bootstrap法的中介效应点估计和区间估计表现相当,但Monte Carlo法在第Ⅰ类错误率和区间宽度指标上表现略优于其他三种方法,偏差校正的Bootstrap法在统计检验力上表现略优于其他三种方法,但在第Ⅰ类错误率上表现最差;结果表明,当有先验信息时,推荐使用贝叶斯法;当先验信息不可得时,推荐使用Monte Carlo法。     

The Place of Mania Among the Depressions from a Biological Standpoint

One hundred college women completed a situational story that dealt with a traditional feminine occupation, while another 100 women completed a story that dealt with a more nontraditional, masculine occupation. The stories were used to measure fear of success. All women furnished information on their college major, career aspirations, and year in school, and completed the Masculinity and Ascendency scales from the Guilford-Zimmerman Temperament Survey. Both two- and three-dimensional chi square tests of association were performed to determine the relationship between fear of success and other variables.

Results (p < .05) indicated that fear of success is greater toward a nontraditional occupation, especially for women of low ascendency, and fear of success is greater the closer women get to graduation.     

Necessary Conditions for Mean Square Convergence of the Best Linear Factor Predictor

Several sufficient conditions are available for mean square convergence of factor predictors. A necessary and sufficient condition is given in the Heywood case with respect to (confirmatory) factor analysis. This condition generalizes that of Krijnen (2006) and performs better than a signal-to-noise type of condition (Schneeweiss & Mathes, 1995). The author is obliged to the reviewers for their stimulating remarks. Requests for reprints should be sent to Department of Psychology, Psychological Methods, University of Amsterdam, Roetersstraat 15, 1018 WB Amsterdam, The Netherlands.     

The role of feedback and dot presentation format in younger and older adults’ number estimation

Numerosity estimation, the rapid assessment of the number of items in a visual scene, is historically inaccurate. We assessed whether providing feedback regarding the correct numerosity on either 0%, 50%, or 100% of the trials would affect younger and older adults’ estimation accuracy for randomized, clustered (i.e., groups of 3 or 7 dots), and stacked (i.e., column) dot formats. Participants provided estimates and confidence ratings in six blocks, each containing 48 trials (16 numerosities shown in each format). Feedback frequency was manipulated between participants during blocks 1–4; no feedback was provided during blocks 5 and 6, which contained old and new numerosities and previously estimated presentations rotated 90°. Estimation accuracy was age equivalent across blocks despite younger adults initially being more accurate than older adults. Feedback improved both age groups’ accuracy. Stacked presentations were most accurately estimated but were more likely to be over-estimated than clustered and randomized presentations. Older adults gave lower confidence ratings than younger adults despite both age groups showing increased confidence across blocks, for more structured presentation formats, and as feedback frequency increased. These results expand our understanding of the role of presentation format and feedback in producing age equivalence or age-related differences in numerosity estimation.     

Optimization of Blocked Designs in fMRI Studies

Blocked designs in functional magnetic resonance imaging (fMRI) are useful to localize functional brain areas. A blocked design consists of different blocks of trials of the same stimulus type and is characterized by three factors: the length of blocks, i.e., number of trials per blocks, the ordering of task and rest blocks, and the time between trials within one block. Optimal design theory was applied to find the optimal combination of these three design factors. Furthermore, different error structures were used within a general linear model for the analysis of fMRI data, and the maximin criterion was applied to find designs which are robust against misspecification of model parameters.     

Sensitivity of Fit Indices to Misspecification in Growth Curve Models

This study investigated the sensitivity of fit indices to model misspecification in within-individual covariance structure, between-individual covariance structure, and marginal mean structure in growth curve models. Five commonly used fit indices were examined, including the likelihood ratio test statistic, root mean square error of approximation, standardized root mean square residual, comparative fit index, and Tucker-Lewis Index. The fit indices were found to have differential sensitivity to different types of misspecification in either the mean or covariance structures with severity of misspecification controlled. No fit index was always more (or less) sensitive to misspecification in the marginal mean structure relative to those in the covariance structure. Specifying the covariance structure to be saturated can substantially improve the sensitivity of fit indices to misspecification in the marginal mean structure; this result might help identify the sources of specification error in a growth curve model. An empirical example of children's growth in math achievement (Wu, West, &; Hughes, 2008 Wu, W., West, S. G. and Hughes, J. N. 2008. Effect of retention in first grade on children's achievement trajectories over four years: A piecewise growth analysis using propensity score matching.. Journal of Educational Psychology, 100: 727–740. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) was used to illustrate the results.     

Multivariate multiple regression analyses: a permutation method for linear models

A multivariate extension of a univariate procedure for the analysis of experimental designs is presented. A Euclidean-distance permutation procedure is used to evaluate multivariate residuals obtained from a regression algorithm, also based on Euclidean distances. Applications include various completely randomized and randomized block experimental designs such as one-way, Latin square, factorial, nested, and split-plot designs, with and without covariates. Unlike parametric procedures, the only required assumption is the randomization of subjects to treatments.     

The wrecking effects of race and social class on self and success

The literature on success neurosis has expanded in recent years to include a consideration of preoedipal as well as oedipal factors. Typically, success neurosis is considered to be a symptomatic result of complex intrapsychic phenomena, whether they be at the oedipal and/or preoedipal level. Having previously considered that success neurosis can also be determined by internalized representations of "real" factors, such as racism and poverty (Holmes, in press, b) the author here considers how these factors become primary intrapsychic building blocks of success neurosis through their negative impact on the components of success in the self and the ego.     

Beta‐binomial ANOVA for multivariate randomized response data

There is much empirical evidence that randomized response methods improve the cooperation of the respondents when asking sensitive questions. The traditional methods for analysing randomized response data are restricted to univariate data and only allow inferences at the group level due to the randomized response sampling design. Here, a novel beta‐binomial model is proposed for analysing multivariate individual count data observed via a randomized response sampling design. This new model allows for the estimation of individual response probabilities (response rates) for multivariate randomized response data utilizing an empirical Bayes approach. A common beta prior specifies that individuals in a group are tied together and the beta prior parameters are allowed to be cluster‐dependent. A Bayes factor is proposed to test for group differences in response rates. An analysis of a cheating study, where 10 items measure cheating or academic dishonesty, is used to illustrate application of the proposed model.     

The integrative action of the cerebral hemispheres

In four experiments, right-handed subjects were asked to identify uppercase letters presented tachistoscopically in the right (R) or left (L) visual field or in both visual fields simultaneously (RL). When R, L, and RL trials were randomized together and RL trials consisted of the same letter in each visual field (Experiments 1 and 2), 11 of 21 male subjects (Experiment 1) and 9 of 18 female subjects (Experiment 2) showed a strong left-visual-field advantage, and the remainder in each experiment showed an equivalently strong right-visual-field advantage. When the RL trials consisted of a different letter in the two visual fields (Experiment 3), a consistent right-visual-field advantage was observed. It is argued that these results reflect predominantly analytical (left-hemisphere) processing of “different” pairs and relatively holistic processing of “same” pairs, which induces a shift toward a right-hemisphere advantage in some subjects. The main purpose of three of the four experiments was to test five probability models of hemispheric integration: (1) statistical summation, which assumes that the hemispheres operate independently; (2) redundancy, which assumes that RL decisions reflect only processing by the more specialized hemisphere; (3) complete dependency, according to which RL decisions are the mean of Rand L decisions; (4) integration, which assumes that R and L decisions can be represented as vectors in a joint RL space; (5) correlation, according to which the Rand L decisions are assumed to be statistically dependent. Whether R, L, and RL trials were randomized together or RL trials were presented in separate blocks, models 1 and 4 could be clearly rejected. In general, the best predictor of RL performance was model 5. It is argued that the hemispheres function as an integrated system in letter identification.     

Rumination-focused cognitive behaviour therapy for residual depression: a case series

The treatment of chronic and recurrent depression is a priority for the development of new interventions. The maintenance of residual symptoms following acute treatment for depression is a risk factor for both chronic depression and further relapse/recurrence. This open case series provides the first data on a cognitive-behavioural treatment for residual depression that explicitly targets depressive rumination. Rumination has been identified as a key factor in the onset and maintenance of depression, which is found to remain elevated following remission from depression. Fourteen consecutively recruited participants meeting criteria for medication--refractory residual depression [Paykel, E.S., Scott, J., Teasdale, J.D., Johnson, A.L., Garland, A., Moore, R. et al., 1999. Prevention of relapse in residual depression by cognitive therapy--a controlled trial. Archives of General Psychiatry 56, 829-835] were treated individually for up to 12 weekly 60-min sessions. Treatment specifically focused on switching patients from less helpful to more helpful styles of thinking through the use of functional analysis, experiential/imagery exercises and behavioural experiments. Treatment produced significant improvements in depressive symptoms, rumination and co-morbid disorders: 71% responded (50% reduction on Hamilton Depression Rating Scale) and 50% achieved full remission. Treating depressive rumination appears to yield generalised improvement in depression and co-morbidity. This study provides preliminary evidence that rumination-focused CBT may be an efficacious treatment for medication--refractory residual depression.     

Deciding about decision models of remember and know judgments: a reply to Murdock (2006)

B. B. Murdock (2006) has interpreted remember-know data within a decision space defined by item and associative information, the fundamental variables in his general recognition memory model TODAM (B. B. Murdock, 1982). He has related parameters of this extended model to stimulus characteristics for several classic remember-know data sets. The authors show that this accomplishment is shared by both one- and two-dimensional signal-detection-based remember-know models (J. C. Dunn, 2004; C. M. Rotello, N. A. Macmillan, & J. A. Reeder, 2004; J. T. Wixted & V. Stretch, 2004), which can be represented in this same decision space and can be related to stimulus characteristics with similar success. Murdock claims that his model, unlike its competitors, is a process model; however, the process aspects of TODAM are not used in his application, and the decision aspects are identical to a previously proposed model. Murdock's claim that one competing model (STREAK; C. M. Rotello et al., 2004) is not fully specified is shown to be false. The new model is not superior to existing ones, but comparisons among the models to date are not definitive. The authors describe several strategies that might be applied to distinguish among them.     

Communicative Behaviors of Outperformers and Their Perception by the Outperformed People

Four studies explored the communicative behaviors of people who outperform others in a relevant or irrelevant field and the impression formed of these outperformers by the outperformed people. In line with the premises of the self‐evaluation maintenance model ( A. Tesser, 1988 ) and the STTUC framework ( J. J. Exline & M. Lobel, 1999 ), Studies 1 and 2 predicted and found that people tend to conceal their achievements in conversation with a person whom they have outperformed, especially when the field of performance is relevant to this individual and irrelevant to them. Studies 3 and 4 found that the perception of outperformers is dependent not only on their communicative behaviors following the success but also on the relevance of the field for them and for the perceivers.     

Sex differences in attribution for occupational success

A study was conducted to both test and extend Deaux's (Sex: A perspective on the attribution process. In J. H. Harvey, W. J. Ickes, & R. F. Kidd, (Eds.), New directions in attribution research, Volume 1. Hillsdale, N.J.: Erlbaum, 1976) expectancy model of sex-linked differences in attribution for success. Specifically, it was hypothesized that female occupational subjects would attribute success more to the unstable causes of effort and luck, as well as the stable internal cause of interpersonal skill, while male occupational subjects would make higher attributions to the stable causes of ability and task ease. This hypothesis was supported for the causes of effort, luck, and task ease. Additionally, a comparison between sex differences in attribution occurring within a nonpersonal vs. personal frame of reference showed three of the expected sex differences in attribution to be stronger in the latter condition. Moreover, it was shown that this difference was largely accounted for by changes in females' rather than males' attributions. A final hypothesis, namely, that males would perceive themselves as more successful in their occupations than females, was not confirmed.