Heterogeneous heterogeneity by default: Testing categorical moderators in mixed-effects meta-analysis

Categorical moderators are often included in mixed-effects meta-analysis to explain heterogeneity in effect sizes. An assumption in tests of categorical moderator effects is that of a constant between-study variance across all levels of the moderator. Although it rarely receives serious thought, there can be statistical ramifications to upholding this assumption. We propose that researchers should instead default to assuming unequal between-study variances when analysing categorical moderators. To achieve this, we suggest using a mixed-effects location-scale model (MELSM) to allow group-specific estimates for the between-study variance. In two extensive simulation studies, we show that in terms of Type I error and statistical power, little is lost by using the MELSM for moderator tests, but there can be serious costs when an equal variance mixed-effects model (MEM) is used. Most notably, in scenarios with balanced sample sizes or equal between-study variance, the Type I error and power rates are nearly identical between the MEM and the MELSM. On the other hand, with imbalanced sample sizes and unequal variances, the Type I error rate under the MEM can be grossly inflated or overly conservative, whereas the MELSM does comparatively well in controlling the Type I error across the majority of cases. A notable exception where the MELSM did not clearly outperform the MEM was in the case of few studies (e.g., 5). With respect to power, the MELSM had similar or higher power than the MEM in conditions where the latter produced non-inflated Type 1 error rates. Together, our results support the idea that assuming unequal between-study variances is preferred as a default strategy when testing categorical moderators.     

“‘WE' AND ‘THEY'”: WHY MUST WE ENGAGE IN CROSS-CULTURAL CONVERSATION?

This article contains the principal ideas that I presented in four different sessions at the IRAS 2022 conference, on the theme “‘We' and ‘They’: Cross-Cultural Conversation on Identity.” Focusing on the central topic, the article begins with (i) the contents of my opening lecture; followed by (ii) a broad outline of the concerns discussed in my book, Cross-Cultural Conversation: A New Way of Learning, intertwined with glimpses of the intellectual journey that led me to CCC, delivered in the Book-discussion session; (iii) a summary of the main ideas about the importance of meeting of religions today, which formed the background for the CCC Panel discussion on religion, where I was in conversation with spokespersons of five world religions; and (iv) my comments on how science–religion dialogue can help promote a sense for human solidarity by combining knowledge with wisdom, in the concluding session.     

Order effects in belief updating with consistent and inconsistent evidence

The current study tests for the presence of differential order effects in evaluation tasks with consistent and inconsistent evidence as predicted by the Hogarth and Einhorn (1992) belief-adjustment model. The results, based on both between-subjects and within-subjects experiments, demonstrate that there were significant recency effects with inconsistent evidence as predicted, larger recency effects when the inconsistent evidence was farther apart in subjective value as predicted, and significant recency effects even when subjects were given training designed to both help them understand the task as completely as possible and to be better able to assess the pieces of evidence. By including a within-subjects design, we were able to demonstrate that the difference in subjective value between two pieces of evidence is the primary factor influencing the magnitude of the recency effect, regardless of whether the evidence is consistent or inconsistent. This latter finding is unique and contrary to previous research and theory.     

EXPERIMENTAL ANALYSIS AND TREATMENT OF MULTIPLY CONTROLLED SELF-INJURY

A functional analysis of the self-injurious behavior (SIB) of 3 adults with profound developmental disabilities showed that each engaged in SIB in more than one assessment condition. Such outcomes may result from a failure to isolate the variable maintaining SIB, or they may reflect multiple sources of control over SIB. In order to identify more clearly the determinants of SIB, each subject was exposed to a series of treatments appropriate to one or both of the apparent functions of SIB. These treatments, applied sequentially on baselines appropriate to each behavioral function, identified the maintaining variables for SIB through differential outcomes across baselines. Results indicated that the SIB of 2 subjects was multiply controlled, confirming the outcomes of the functional analysis. However, the SIB of the 3rd subject was eliminated using a treatment designed for a single function, suggesting spurious results of the original assessment. Alternative interpretations of undifferentiated assessment data are discussed, as are analysis and treatment issues related to multiply determined behavior disorders.     

Momentary maximizing in concurrent schedules with a minimum interchangeover interval

Eight pigeons were trained on concurrent variable-interval variable-interval schedules with a minimum interchangeover time programmed as a consequence of changeovers. In Experiment 1 the reinforcement schedules remained constant while the minimum interchangeover time varied from 0 to 200 s. Relative response rates and relative time deviated from relative reinforcement rates toward indifference with long minimum interchangeover times. In Experiment 2 different reinforcement ratios were scheduled in successive experimental conditions with the minimum interchangeover time constant at 0, 2, 10, or 120 s. The exponent of the generalized matching equation was close to 1.0 when the minimum interchangeover time was 0 s (the typical procedure for concurrent schedules without a changeover delay) and decreased as that duration was increased. The data support the momentary maximizing theory and contradict molar maximizing theories and the melioration theory.     

Delayed and current stimulus control in successive discriminations

In a successive discrimination in which successively alternating red and green hues signaled component variable-interval schedules, sensitivity of the ratio of responses in the two components to variation in the component reinforcer ratio decreased systematically during the course of the component. This decrease in stimulus control or discrimination over the course of the component was shown to be the result of delayed control of responding during the component by the stimulus transition between components. When the red–green stimulus transition was altered by interpolating a white stimulus at the end of each 60-s component, discrimination at the beginning of the component (measured by the power-function exponent for sensitivity to reinforcement) was reduced. Conditions with the white stimulus inserted in other quarters of the component indicated that the current discriminative stimulus exerts control over responding throughout the component, whereas during about the first half of the component, response differentials are influenced by the transition between discriminative stimuli.     

New lower and upper bounds for communality in factor analysis

We derive several relationships between communalities and the eigenvalues for ap ×p correlation matrix under the usual factor analysis model. For suitable choices ofj, _j (), where _j () is thej-th largest eigenvalue of , provides either a lower or an upper bound to the communalities for some of the variables. We show that for at least one variable, 1 - _p () improves on the use of squared mulitiple correlation coefficient as a lower bound.This research was done while the second author was at Tokyo Institute of Technology.     

时序信息的加工:自动还是控制

从长时记忆的角度出发,以故事的形式为实验材料,对时序信息的加工方式和通道效应进行了研究。结果表明,时序信息的加工存在视听通道效应,通道效应的机制源于记忆,且与加工方式有关。时序信息三个属性的加工方式不同：顺序属性倾向于自动加工;位置属性,就视觉信息来说倾问于自动加工,听觉在有顺序标码情况下倾向于自动加工、而在无顺序标码情况下则是一控制加工过程;间隔特性是一个控制加工过程。