In: Statistics and Probability
3. The model
yt = β0 + β1x1t + β2x2t + β3x3t + ut
was estimated by ordinary least squares from 26 observations. The results were
yˆt = 2 + 3.5x1t − 0.7x2t + 2.0x3t
(1.9) (2.2) (1.5)
t-ratios are in parentheses and R2 = 0.982. The same model was estimated with the restriction β1 = β2. Estimates are
yˆt = 1.5 + 3(x1t + x2t) − 0.6x3t R2 = 0.876
(2.7) (2.4)
(a) Test the significance of the restriction β1= β2. State the assumptions under which the test is valid.
(b) Suppose that x2t were dropped from the equation: would the R2 rise or fall?
(c) Would the R2 rise or fall if x2t were dropped?
(a)
H0: β1= β2
H1: β1 β2
We will use F test to test for linear restrictions in linear model.
F Statistic is given as,
F = [(R2U - R2R )/q ] / [(1 - R2U) / (n-k-1)]
where
R2U , R2R are R2 value of the unrestricted model (model 1 with β1 β2 ) and the restricted model (model 2 with β1 = β2 )
q is number of restrictions in the null hypothesis. Here q = 1
n is number of observations. n = 26
k is number of explanatory variables in unrestricted model. Here k = 3
F = [(0.982- 0.876)/1 ] / [(1 - 0.982) / (26 -3 -1)] = 129.56
Degree of freedom = q, n-k-1 = 1, 26-3-1 = 1, 22
Critical value of F at 5% significance level and df = 1, 24 is 4.30
Since the observed F (129.56) is greater than the critical value, we reject the null hypothesis H0 and conclude that there is strong evidence that β1 β2.
Assumptions - For the F test all of the assumptions of the Gaussian-noise simple linear regression model hold: the true model must be linear, the errors around it must be Gaussian, the error variance must be constant, the error must be independent of explanatory variables and independent across measurements.
(b)
If any variable is dropped from the model, R2 of the model will always decrease/fall.
(c)
R2 will fall if variable x2t were dropped from the model.