In: Statistics and Probability
Objective of this Assignment: To conduct a regression and correlation analysis
Instructions:
(Note: the source of the data must be given. Data which is not properly documented as to source is unacceptable and paper will be graded F. Textbook examples are unacceptable).
1. Graph the data (scatter diagram)
2. Use the method of least squares to derive a trend equation and trend values
3. Use check column to verify computations ∑ (Y-Yc)=0
4. Superimpose trend equation on scatter diagram.
5. Use your model to predict the movement of the variable for the next year.
6. Compare your predictions with the actual behavior of the variable during the 21styear .
Solution:
Suppose you have N pairs of data points (X_1, Y_1), (X_2, Y_2), ... (X_N, Y_N) and you would like to know the relationship of the Y's to the X's and, if possible, predict one from the other. The X's and Y's could be whatever you like, but let's say for now that they are heights and weights. You would expect there to be a clear relationship between the two; on average, you would expect taller people to be heavier than shorter people.
A good way to start might be to model the relationship with a linear equation, Y = mX + b, where m is the slope of the line and b is the Y-intercept, as you learned in high school algebra. The question now is to determine the best way to estimate m and be given your pairs of X's and Y's.
It turns out that the best way to do this is to use least squares regression. We call it least squares regression because the line that we choose will be the one for which the sum of the squares of the differences between predicted and observed values is as small as possible.
1. Scatter Plot of Y and X1
Scatter plot of sales and calls shows that there can be a linear trend between the both. The trendline indicates that it looks like higher the number of calls, higher will be sales
2. Best fit line
Using the Regression option in Excel Data analysis menu, we obtaain the following output
From this, bestfit line equation is Sales=Intercept+Coefficient of Calls *Calls
i.e., Sales = 22.52 + 0.1237 * Calls
3. Coefficient of Correlation
It denotes the strength of association between two variables. The sign denotes the direction of association.
In Exel, we calculate Correlation coefficient as Correl(X1array,Yarray)
We get the value as 0.318
This means that calls and sales are slightly positively associated. With increase in one quantiity, the other is also showing an increasing trend. Please note that this does not imply causation, i.e.,we CANNOT say that the rise or fall in one is causing the change in other.
4. Coefficient of Determination
It is more commonly known as R squared value. It gives the measure of how close the data points are to the best fit line. In other words, it gives the proportion of variability in dependent variable that can be explained by the independent variable. Higher the Rsquared value, better the model is.
From Excel regression output, we get R squared value or Coefficient of Determination as 0.101
~10% of variability in sales is explained by calls.
5. Utility of Regression model
F test can be used to test the utility of the model.
Null Hypothesis: Beta coefficient of call = 0; i.e., Calls is NOT linearly associated with sales
Alternate Hypothesis: Beta coefficient of call 0; Calls is linearly associated with sales
Let us choose significance level, = 0.05.
From the regression ANOVA output, we get p value (or significance value) of F test as 0.0012 (<0.05) for the given degrees of freedom (highlighted)
Since p value < , we can reject Null hypothesis, thereby concluding that with the given data it can be said that calls is linearly associated with sales.
6. Based on the above findings, it can be said that calls is a good and important variable in predicting sales volume. It has been proved that calls and sales have a positive linear association between them. From the best fit line (Sales = 22.52 + 0.1237 * Calls), we can say that with every call, sales increases by 0.1237units (interpretation of coefficient of calls).