Should the independent (or dependent) variables in a linear regression model be normal or just the residual?

Question

barene55d · Accepted Answer

Linear regression expresses a relationship between a response and covariates that is linear in terms of coefficients. In the simple case it associates one-dimensional response   Y with one-dimensional   X as follows.  Y  =      β    0    +      β    1    X  +  ϵwhere   Y  ,  X and ϵ are considered as random variables and       β    0    ,      β    1   are coefficients (model parameters) to be estimated.Being a regression to the mean, the model specifies:  E  [  Y      |    X  ]  =      β    0    +      β    1    X with an implied assumption that  E  [  ϵ      |    X  ]  =  0 and also   V  a  r  (  ϵ  )  = constant.Thus, model restrictions are placed only on the conditional distribution of   ϵ given   X, or equivalently on   Y given   X.A convenient distribution used for residuals (  ϵ) is Normal/Gaussian, but the regression model, in general, works with other distributions as well. Not to confuse things further here, but it should still be noted that the regression analysis doesn&#039;t have to make any distributional assumptions. In estimation of the coefficients, for example, we use least squares method with no mention of any distributions. However, for more complex analysis, statisticians use various probability distributions to specify models, make assumptions explicit and use probability theory to justify results.

Should the independent (or dependent) variables in a linear regression model be normal or just the residual?

Answered question

Answer & Explanation

New Questions in Inferential Statistics