Sample Standard Deviation and Degrees of Freedom
The sample mean, S(xi - )2/n and multiply by a "correction factor" of (n-1)/n?
, is the sum of all of the values of x, divided by n. So why isn't the sample variance the sum of all of the squared deviations of x from divided by n? Why do we divide by n-1 instead? Alternatively, why do we takeThe answer is that you lose a degree of freedom when you use the sample to estimate the mean. One way to think of this is that if you tell me the sample mean and then tell me the deviation of every observation but one, I can tell you the value of the last observation without looking at it. That is because I know that the sum of the deviations from the mean must equal zero.
You would not lose a degree of freedom if you had a completely independent estimate of the mean. If you were given the true mean and calculated the deviations of your sample values of x from the true mean, then you could divide by n. If you were given an estimate of the mean from an independent sample, say
, and calculated the deviations of your sample values of x from , then you could divide by n.To see why you cannot divide by n, expand the first term of the sum of squared deviations. That is, expand (x1 -
)2. You getx12 - 2x1S(xi/n) + [S(xi/n)]2
+ 2 = x12 - 2x1Each of the x's in your sample is uncorrelated with one another, but x1 is certainly correlated with itself. As a result, when we take the expected value, the middle term will be -2x12/n and the last term will be + x12/n, so that netting out, we have
(1/n)[x12 - x12/n] = (1/n)[(n-1)/n]x12]We see the factor [(n-1)/n] emerging. This is the bias in the uncorrected sample variance. What it means is that the uncorrected sample variance, x12/n, has to be multiplied by [n/(n-1)] in order to produce an unbiased estimate of the true population variance, s2.