A tutorial on a practical Bayesian alternative to null-hypothesis significance testing

Null-hypothesis significance testing remains the standard inferential tool in cognitive science despite its serious disadvantages. Primary among these is the fact that the resulting probability value does not tell the researcher what he or she usually wants to know: How probable is a hypothesis, given the obtained data? Inspired by developments presented by Wagenmakers (Psychonomic Bulletin &; Review, 14, 779–804, 2007), I provide a tutorial on a Bayesian model selection approach that requires only a simple transformation of sum-of-squares values generated by the standard analysis of variance. This approach generates a graded level of evidence regarding which model (e.g., effect absent [null hypothesis] vs. effect present [alternative hypothesis]) is more strongly supported by the data. This method also obviates admonitions never to speak of accepting the null hypothesis. An Excel worksheet for computing the Bayesian analysis is provided as supplemental material.     

An improved Hochberg procedure for multiple tests of significance

We propose a simple modification of Hochberg's step‐up Bonferroni procedure for multiple tests of significance. The proposed procedure is always more powerful than Hochberg's procedure for more than two tests, and is more powerful than Hommel's procedure for three and four tests. A numerical analysis of the new procedure indicates that its Type I error is controlled under independence of the test statistics, at a level equal to or just below the nominal Type I error. Examination of various non‐null configurations of hypotheses shows that the modified procedure has a power advantage over Hochberg's procedure which increases in relationship to the number of false hypotheses.     

A program for constructing SVT tests: An alternative way of assessing text comprehension

The sentence verification technique (SVT), developed by Royer, Hastings, and Hook (1979), provides developmental and educational researchers with an alternative way of assessing text comprehension based on all of the information contained in a passage. Students must decide if test sentences have the same meaning as sentences that appeared in an original passage. The program described here automates the more laborious aspects of constructing SVT tests. The user must create a passage using a word processor. The program will prompt the user for information as needed. Finally, printable text files (SVT test and answer key) are generated. The program is written in BASIC for IBM and IBM-compatible computers.     

An intrusive and restrictive alternative to contingent shock

A 31-year-old man, a New Zealander with severe developmental disability, engaged in life-threatening operant vomiting. His therapists and two consultant behavior analysts recommended applying for a Court order to evaluate treatment that included the short-term use of contingent shock. In Court, others gave expert testimony that positive procedures alone would be sufficient and effective. Following the Court's decision against contingent shock, professionals who were responsible for ensuring compliance with the decision did not identify a nonaversive intervention. Consequently, the client was subjected to an intrusive medical procedure (chronic nasogastric intubation) and a severely restricted environment. This intervention was continued for 1 year. Problems that resulted from conflicting expert testimony on treatment alternatives are discussed.     

An alternative to the methodology for analysis of covariance

A general statistical model for simultaneous analysis of data from several groups is described. The model is primarily designed to be used for the analysis of covariance. The model can handle any number of covariates and criterion variables, and any number of treatment groups. Treatment effects may be assessed when the treatment groups are not randomized. In addition, the model allows for measurement errors in the criterion variables as well as in the covariates. A wide variety of hypotheses concerning the parameters of the model can be tested by means of a large sample likelihood ratio test. In particular, the usual assumptions of ANCOVA may be tested.Research reported in this paper has been partly supported by the Swedish Council for Social Science Research under project Statistical methods for analysis of longitudinal data, project director Karl G. Jöreskog, and partly by the Bank of Sweden Tercentenary Foundation under project Structural Equation Models in the Social Sciences, project director Karl G. Jöreskog.     

An alternative approach to the method of correct matching

The correct matching method is treated in a new way which increases its power and enables the results to be expressed by a correlation coefficient. Tables for 3n7 are included.I wish to express my thanks and indebtedness to Professor Louis Guttman for his assistance and guidance. Also I am grateful for helpful discussions with Dr. D. Kahneman, O. E. Schild, and J. Norman.     

Statistical significance tests for binormal ROC curves

Statistical significance tests are derived and evaluated for measuring apparent differences between an obtained and an expected binormal ROC curve, between two independent binormal ROC curves, and among groups of independent binormal ROC curves. A binormal ROC curve is described by two parameters which represent the spread of the means and the ratio of the standard deviations of the two underlying Gaussian decision variable distributions. To test the significance of apparent differences between or among ROC curves, approximate χ² statistics for each of the three tests were constructed from maximum likelihood estimates of the two parameters defining the binormal ROC curve. The performance of each test statistic was evaluated by simulating five-category rating scale data with equal numbers of noise and signal-plus-noise trials (set at 50, 250, and 500) for each of three typical ROC curves. For the significance test involving only one ROC curve, rating scale data were generated from the chance diagonal of the ROC space also. Although test performance was found to be somewhat dependent on the number of trials and on the location of the ROC curve in the ROC space, comparisons of the obtained and expected fractions of (falsely) significant results at various α levels showed the proposed statistical significance tests to be reliable under practical experimental conditions.     

The future case: An alternative to single case study

Traditional single case studies have tended to focus on the individual's past and/or present with minimal reference to one's future. This allows for an incomplete assessment of the reality in which humans participate as organisms-in-process. The future case is advanced as a complement to traditional single case designs. Emphasis is upon imaginative and creative involvement with one's future in the clinical setting. The rationale and concrete outline for this future invention process reflect how individuals can move beyond restricting conditions to higher levels of emotional growth and satisfaction.     

Homograph norms: An alternative approach to determining meaning dominance

In the present study, we provide a new technique for the collection of homograph norms that reduces subjectivity in the determination of meaning dominance by allowing participants rather than experimenters to indicate to which meaning or meanings the associates were related. To evaluate the effectiveness of this new technique, a subset of homograph norms were used in three separate experiments, demonstrating that (1) when presented with additional meaning categories, participants classified the associates consistently into the primary and secondary meaning categories; (2) overall, the participants were most familiar with primary meanings, followed by secondary, tertiary, and quaternary meanings; and (3) the meaning categories provided to the participants during norms collection were appropriate, since the two meanings provided for each homograph by the participants were consistent with the original data. Finally, in a fourth experiment, we compared the results of this new technique with a parallel set collected in Australia. The high degree of similarity in the results provides validity for this procedure. The homograph norms discussed in this article may be downloaded from http://brm.psychonomic-journals.org/content/supplemental.     

Estimation and tests of significance in factor analysis

A distinction is drawn between the method of principal components developed by Hotelling and the common factor analysis discussed in psychological literature both from the point of view of stochastic models involved and problems of statistical inference. The appropriate statistical techniques are briefly reviewed in the first case and detailed in the second. A new method of analysis called the canonical factor analysis, explaining the correlations between rather than the variances of the measurements, is developed. This analysis furnishes one out of a number of possible solutions to the maximum likelihood equations of Lawley. It admits an iterative procedure for estimating the factor loadings and also for constructing the likelihood criterion useful in testing a specified hypothesis on the number of factors and in determining a lower confidence limit to the number of factors.     

An alternative for counselor education

What is it that makes the counselor a professional? Is it possible to separate the personal and political responsibilities of the professional counselor in today's world? In this article, David Island tries to answer these questions and provides an alternative model for approaching counseling and counselor education in a period of rapid cultural change.     

The smoked plastic screen: An alternative to the one-way mirror

A double thickness, smoked plastic screen is presented as an alternative to the one-way mirror. Relative to the glass mirror, the use of the plastic screen provides a safe, nondistracting, durable, light weight, and inexpensive method for unobserved viewing without an appreciable loss in light transmission.