A nonparametric approach for assessing latent trait unidimensionality

Assuming a nonparametric family of item response theory models, a theory-based procedure for testing the hypothesis of unidimensionality of the latent space is proposed. The asymptotic distribution of the test statistic is derived assuming unidimensionality, thereby establishing an asymptotically valid statistical test of the unidimensionality of the latent trait. Based upon a new notion of dimensionality, the test is shown to have asymptotic power 1. A 6300 trial Monte Carlo study using published item parameter estimates of widely used standardized tests indicates conservative adherence to the nominal level of significance and statistical power averaging 81 out of 100 rejections for examinee sample sizes and psychological test lengths often incurred in practice.The referees' comments were remarkably detailed and greatly enhanced the writeup and sensitized the author to certain pertinent issues. Discussions with Fritz Drasgow, Lloyd Humphreys, Dennis Jennings, Brian Junker, Robert Linn, Ratna Nandakumar, and Robin Shealy were also very useful.This research was supported by the Office of Naval Research under grant N00014-84-K-0186; NR 150-533, and by the National Science Foundation under grant DMS 85-03321.     

DOES EFFORT PLAY A ROLE IN THE EFFECT OF RESPONSE REQUIREMENTS ON DELAYED MATCHING TO SAMPLE?

The possible role of "effort" in the accuracy of pigeons' performance on a delayed matching-to-sample procedure was investigated by examining the effects of response requirements that accompanied a trial-initiating stimulus and that accompanied a sample stimulus. In the first experiment, the effect of varying the size of a fixed-ratio requirement for responses during an initiating stimulus was compared to that of varying a similar requirement for responses during the sample stimulus. Accuracy increased reliably with increases in the ratio scheduled during the sample stimulus, but was not significantly affected by increases in the ratio scheduled on the key during the initiating stimulus. In another phase of Experiment 1, sample duration was held constant while the ratio requirement was varied during the initiating stimulus. Again, accuracy of matching to sample was not significantly affected by the size of the ratio scheduled during the initiating stimulus. Experiment 2 provided a systematic replication of these results in another group of pigeons and included a more detailed analysis of responding. These results support the view that increases in sample-response requirement facilitate accuracy of delayed matching by increasing the durations of exposure to the sample stimuli, and do not support a role of effort in the sample-response effect. In Experiment 3, the facilitative effect of responses on the sample but not of those on the initiating stimulus was replicated using a simultaneous matching-to-sample procedure. This finding provides further evidence against an interpretation of response-requirement effects that appeals to effort; the finding also suggests that sample exposure might affect initial discrimination of the sample rather than remembering the sample.     

Transfer of matching-to-figure samples in the pigeon

Three pigeons were trained on a modified six-key matching-to-sample procedure. The third peck on the figure-sample key (which presented a bird, hand, face, beetle, rabbit, fish, flower, or red hue, as the sample) lighted only one comparison key. Every three additional pecks on the sample lighted another comparison key, up to a maximum of five keys. Pecks on keys of matching figures produced grain. Pecks on nonmatching keys (mismatches) turned off all lights on the comparison keys and repeated the trial. Three figures were used during acquisition. The birds learned to peck each sample until the matching comparison stimulus appeared on one of three comparison stimulus keys, and then to peck that key. Later, five novel stimuli, employed as both sample and comparison stimuli, and two additional matching keys were added. Each bird showed matching transfer to the novel samples. The data suggest that the birds may have learned the concept of figure matching rather than a series of two-component chains or discrete five-key discriminations.     

Premature conclusions about the signal-to-noise ratio in structural equation modeling research: A commentary on Yuan and Fang (2023)

In a recent article published in this journal, Yuan and Fang (British Journal of Mathematical and Statistical Psychology, 2023) suggest comparing structural equation modeling (SEM), also known as covariance-based SEM (CB-SEM), estimated by normal-distribution-based maximum likelihood (NML), to regression analysis with (weighted) composites estimated by least squares (LS) in terms of their signal-to-noise ratio (SNR). They summarize their findings in the statement that “[c]ontrary to the common belief that CB-SEM is the preferred method for the analysis of observational data, this article shows that regression analysis via weighted composites yields parameter estimates with much smaller standard errors, and thus corresponds to greater values of the [SNR].” In our commentary, we show that Yuan and Fang have made several incorrect assumptions and claims. Consequently, we recommend that empirical researchers not base their methodological choice regarding CB-SEM and regression analysis with composites on the findings of Yuan and Fang as these findings are premature and require further research.     

Toward a theory of verbal behavior

This paper is a reply to an accompanying set of six commentaries by Sidman; Hayes and Barnes; Schusterman, Kastak, and Reichmuth; Tonneau and Sokolowski; Lowenkron; and Moerk. Those commentaries were prompted by our article “On the Origins of Naming and Other Symbolic Behavior” (1996), which was, in turn, followed by 26 commentaries and a reply. In the course of the present reply, we further develop the naming account to embrace more complex verbal relations such as same, different, more, and less. We also examine what we see as the lack of conceptual coherence in equivalence theories, including relational frame theory, and the disparities between these accounts and the findings from empirical research.     

传统统计方法面临的挑战:元分析方法

利用计算机构造实验组和控制组总体,进行传统统计方法与元分析比较实验研究。在实验组总体高出控制组总体０．５０个标准差的提下,传统ｔ检验的统计检验能力（Ｐ）仅为为４１％;而利用元分析的方法进行统计分析,其结果与计算机构造模型有很高的一致性从而提出元分析方法在进入心理学实验研究和证实理论方面的有效性和可靠性,以及传统统计方法面临挑战的事实。     

A NOTE ON TRANSFER OF STIMULUS CONTROL IN THE DELAYED-CUE PROCEDURE: FACILITATION BY AN OVERT DIFFERENTIAL RESPONSE

This case study describes initially unsuccessful attempts to use the delayed-cue procedure to teach conditional discriminations to an individual with moderate mental retardation. The task was matching printed-word comparison stimuli to dictated-name sample stimuli. In three experiments, the subject typically waited for the delayed cue unless differential responses to the dictated samples (repeating the sample names) were required. Hence, the study provides an example of a way to make the delayed-cue method more effective. The stimulus control bases for the results are discussed.     

A general linear model for estimating effect size in the presence of publication bias

When the process of publication favors studies with smallp-values, and hence large effect estimates, combined estimates from many studies may be biased. This paper describes a model for estimation of effect size when there is selection based on one-tailedp-values. The model employs the method of maximum likelihood in the context of a mixed (fixed and random) effects general linear model for effect sizes. It offers a test for the presence of publication bias, and corrected estimates of the parameters of the linear model for effect magnitude. The model is illustrated using a well-known data set on the benefits of psychotherapy.Authors' note: The contributions of the authors are considered equal, and the order of authorship was chosen to be reverse-alphabetical.     

Formation of transitivity in conditional matching to sample by pigeons

Four homing pigeons were trained over 5 months in a zero-delay, “arbitrary” matching-to-sample procedure with sample and comparison stimuli presented on any of three response keys. Birds were also required to complete a fixed-ratio 10 requirement on both sample and comparison stimuli to terminate their presentation. The procedure resulted in the establishment of relations that were not specifically trained and that can be characterized by the property of transitivity in a stimulus equivalence context. This result was in contrast with the findings obtained from most previous research with nonhuman subjects.