Question

In: Statistics and Probability

If I ran a multivariate regression analysis for the effect of independent variables X and Y...

If I ran a multivariate regression analysis for the effect of independent variables X and Y on dependent variable A, that produced an adjusted R^2 of .0553, then added the independent variable Z to the analysis and got an adjusted R^2 of .0550, would that decrease in the adjusted R^2 translate to the independent variable Z not being a strong predictor of the dependent variable A? If it were a strong predictor of A would the adjusted R^2 increase?

Solutions

Expert Solution

Adjusted R squared value often decreases when a new predictor variable is added. When you add a new independent variable to the model, the adjusted R squared value will dip if the new variable is not able to improve the existing model by more than expected by chance.

It is possible that a you add a totally unrelated variable but it still happens to improve the exsiting model as matter of pure luck. So in regression analysis, in order to rule out this chance happening, the addition of the new variable must overcome this 'chance improvement'. If it does not, then the adjusted R squared value shows a dip.

If the new variable is actually a very strong predictor of A in terms of linear regression, then the adjusted R squared value is bound to increase.

It can also sometimes happen that a variable is a good predictor individually, but when taken in combination it causes a decrease in adjusted R squared value, because it set the bar low since the other variables were far better predictors than the one you added.


Related Solutions

Regression and Correlation Analysis Use the dependent variable (labeled Y) and one of the independent variables...
Regression and Correlation Analysis Use the dependent variable (labeled Y) and one of the independent variables (labeled X1, X2, and X3) in the data file. Select and use one independent variable throughout this analysis. Use Excel to perform the regression and correlation analysis to answer the following. Generate a scatterplot for the specified dependent variable (Y) and the selected independent variable (X), including the graph of the "best fit" line. Interpret. Determine the equation of the "best fit" line, which...
Let X and Y be two independent random variables such that X + Y has the...
Let X and Y be two independent random variables such that X + Y has the same density as X. What is Y?
Given The following results from LINEAR REGRESSION Analysis for the variables X and Y Slope= 12.7...
Given The following results from LINEAR REGRESSION Analysis for the variables X and Y Slope= 12.7 y-intercept =3.2 n=10 SE=4.3 The equation of the regression line is …… and 95% confidence interval for the slope is…. (A)Y=3.2+12.7X, and (3.675,12.768) (B)Y=12.7+3.2X, and (2.784,12.745) (C)Y=3.2+12.7X, and (2.784,22.616)
How can I explain multivariate regression?
How can I explain multivariate regression?
Let X and Y be two independent random variables. X is a binomial (25,0.4) and Y...
Let X and Y be two independent random variables. X is a binomial (25,0.4) and Y is a uniform (0,6). Let W=2X-Y and Z= 2X+Y. a) Find the expected value of X, the expected value of Y, the variance of X and the variance of Y. b) Find the expected value of W. c) Find the variance of W. d) Find the covariance of Z and W. d) Find the covariance of Z and W.
In a single variable regression analysis the respective values for the variables are as follows: Independent...
In a single variable regression analysis the respective values for the variables are as follows: Independent variable: 2.00, 7.00, 11.00, 16.00, 13.00, 14.00, 1.00, 12.00, 19.00, 9.00. Dependent variable: 58.78, 44.64, 33.27, 16.04, 26.72, 24.89, 63.11, 28.41, 7.66, 39.20. What is the predicted value of the dependent variable when the independent variable is equal to 15.00?
Let X, Y be independent exponential random variables with mean one. Show that X/(X + Y...
Let X, Y be independent exponential random variables with mean one. Show that X/(X + Y ) is uniformly distributed on [0, 1]. (Please solve it with clear explanations so that I can learn it. I will give thumbs up.)
Suppose X and Y are independent random variables with X = 2:8 and Y = 3:7....
Suppose X and Y are independent random variables with X = 2:8 and Y = 3:7. Find X+Y , the standard deviation of X + Y .
According to Pollock and Edwards, a multiple regression analysis contains at least __ independent variables a....
According to Pollock and Edwards, a multiple regression analysis contains at least __ independent variables a. 0 b. 1 c. 2 d. none of the above According to Pollock and Edwards, the .05 threshold suggests that researchers wish to commit _____ less than five times out of 100 tests. a. individual fallacy b. Type I error c. Type II error d. ecological fallacy According to Pollock and Edwards, a p-value determines the exact probability of obtaining the observed sample difference...
Suppose X and Y are independent variables and X~ Bernoulli(1/2) and Y~ Bernoulli(1/3) and Z=X+Y A-...
Suppose X and Y are independent variables and X~ Bernoulli(1/2) and Y~ Bernoulli(1/3) and Z=X+Y A- find the joint probability table B- find the probility distribution table of Z C- find E(X+Y) D- find E(XY) E- find Cov(X, Y)
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT