The Geometry of Enhancement in Multiple Regression

In linear multiple regression, “enhancement” is said to occur when R ²=b′r>r′r, where b is a p×1 vector of standardized regression coefficients and r is a p×1 vector of correlations between a criterion y and a set of standardized regressors, x. When p=1 then b≡r and enhancement cannot occur. When p=2, for all full-rank R _xx≠I, R _xx=Exx′]=V Λ V′ (where V Λ V′ denotes the eigen decomposition of R _xx; λ ₁>λ ₂), the set B₁:={b_i:R²=b_i￠r_i=r_i￠r_i;0 < R² ￡ 1}\boldsymbol{B}_{1}:=\{\boldsymbol{b}_{i}:R^{2}=\boldsymbol{b}_{i}'\boldsymbol{r}_{i}=\boldsymbol{r}_{i}'\boldsymbol{r}_{i};0R² ￡ 1;R²l_p ￡ r_i￠r_i < R²}0p≥3 (and λ ₁>λ ₂>⋯>λ _p ), both sets contain an uncountably infinite number of vectors. Geometrical arguments demonstrate that B ₁ occurs at the intersection of two hyper-ellipsoids in ℝ ^p . Equations are provided for populating the sets B ₁ and B ₂ and for demonstrating that maximum enhancement occurs when b is collinear with the eigenvector that is associated with λ _p (the smallest eigenvalue of the predictor correlation matrix). These equations are used to illustrate the logic and the underlying geometry of enhancement in population, multiple-regression models. R code for simulating population regression models that exhibit enhancement of any degree and any number of predictors is included in Appendices A and B.