Statistics: Alternate variance formulas

I think now is as good a time as any to play around a little bit with the formula for variance and see where it goes. And I think just by doing this we'll also get a little bit better intuition of just manipulating sigma notation, or even what it means. So we learned several times that the formula for variance-- and let's just do variance of a population. It's almost the same thing as variance of a sample. You just divide by n instead of n minus 1. Variance of a population is equal to-- well, you take each of the data points x sub i. You subtract from that the mean. You square it. And then you take the average of all of these. So you add the squared distance for each of these points from i equals 1 to i is equal to n. And you divide it by n. So let's see what happens if we can-- maybe we want to multiply out the squared term and see where it takes us. So let's see. And I think it'll take us someplace interesting. So this is the same thing as the sum from i is equal to 1 to n. This, we just multiply it out. This is the same thing as x sub i squared minus-- this is your little algebra going on here. So when you square it-- I mean, we could multiply it out. We could write it. x sub i minus mu times x sub i minus mu. So we have x sub i times x sub i, that's x sub i squared. Then you have x sub i times minus mu. And then you have minus mu times x sub i. So when you add those two together, you get minus 2x sub i mu, because you have it twice. x sub i times mu, that's 1 minus x sub i mu. And then you have another one, minus mu x sub i. When you add them together, you get minus 2x sub i mu. I know it's confusing with me saying sub i and all of that. But it's really no different than when you did a minus b squared. Just the variables look a little bit more complicated. And then the last term is minus mu times minus mu, which is plus mu squared. Fair enough. Let me switch colors just to keep it interesting. Let me cordon that off. The sum of this is the same thing as the sum of-- because if you think about it, we're going to take each x sub i. For each of the numbers in our population, we're going to perform this thing. And we're going to sum it up. But if you think about it, this is the same thing as-- if you're not familiar with sigma notation this is a good thing to know in general, just a little bit of intuition. That this is the same thing as-- I'll do it here to have space. The sum from i is equal to 1 to n of the first term, x sub i squared minus-- and actually, we can bring out the constant terms. When you're summing, the only thing that matters is the thing that has the i-th term. So in this case, it's x sub i. So x sub 1, x sub 2. So that's the thing that you have to leave on the right hand side of the sigma notation. And if you've done the calculus playlists already, sigma notation is really like a discrete integral on some level. Because in an integral, you're summing up a bunch of things and you're multiplying them times dx, which is a really small interval. But here you're just taking a sum. And we showed in the calculus playlist that an integral actually is this infinite sum of infinitely small things, but I don't want to digress too much. But this was just a long way of saying that the sum from i equals 1 to n of the second term is the same thing as minus 2 times mu of the sum from i is equal to 1 to n of x sub i. And then finally, you have plus-- well, this is just a constant term. This is just a constant term. So you can take it out. Times mu squared times the sum from i equals 1 to n. And what's going to be here? It's going to be a 1. We just divided a 1. We just divided this by 1. And took it out of the sigma sign, out of the sum. And you're just left with a 1 there. And actually, we could have just left the mu squared there. But either way, let's just keep simplifying it. So this we can't really do-- well, actually we could. Well, no, we don't know what the x sub i's are. So we just have to leave that the same. So that's the sum. Oh sorry, and this is just the numerator. This whole simplification, we're just simplifying the numerator. And later, we're just going to divide by n. So that is equal to that divided by n, which is equal to this thing divided by n. I'll divide by n at the end. Because it's the numerator that's the confusing part. We just want to simplify this term up here. So let's keep doing this. So this equals the sum from i equals 1 to n of x sub i squared. And let's see, minus 2 times mu-- sorry, that mu doesn't look good. Edit, Undo, minus 2 times mu times the sum from i is equal to 1 to n of xi. And then, what is this? What is another way to write this? Essentially, we're going to add 1 to itself n times. This is saying, just look, whatever you have here, just iterate through it n times. If you had an x sub i here, you would use the first x term, then the second x term. When you have a 1 here, this is just essentially saying, add one to itself n times, which is the same thing as n. So this is going to be plus mu squared times n. And then see if there's anything else we can do here. Remember, this was just the numerator. So this looks fine. We add up each of those terms. So we just have minus 2 mu from i equals 1 to-- oh well, think about this. What is this? What is this thing right here? Well actually, let's bring back that n. So this simplified to that divided by n, which simplifies to that whole thing, which is simplified to this whole thing, divided by n, which simplifies to this whole thing divided by n, which is the same thing as each of the terms divided by n, which is the same thing as that, which is the same thing as that, which is the same thing as that. And now, well, how does this simplify? This is the interesting part. Well, this, nothing much I can do here. So that just becomes the sum from i is equal to 1 to n x sub i squared divided by big N. Now this is interesting. If I take each of the terms in my population and I add them up and then I divide it by n, what is that? This thing right here? If I sum up all of the terms in my population and divide by the number of terms there are? That's the mean, right? That's the mean of my population. So this thing right here is also mu. So this thing simplifies to what? Minus 2 times what? Mu times this whole thing is mu too. So times mu squared. mu times mu, this is the mean of the population. So that was a nice simplification. And then plus-- what do you have here? Well let's see, you have n over n. Those cancel out. So we just have plus mu squared. So that was a very nice simplification. And then this simplifies to-- can't do much on this side. So the sum from i is equal to 1 to n of x sub i squared over n. And then you see, we have minus 2 mu squared plus mu squared. Well, that's the same thing as minus mu squared. Minus the mean squared. So this already we've come up with a neat way of writing the variance. You can essentially take the average of the squares of all of the numbers in this case, a population, and then subtract from that the mean squared of your population. So this could be, depending on you're calculating things, maybe a slightly faster way of calculating the variance. So just playing with a little algebra, we got from this thing where you have to each time take each of your data points, subtract the mean from it, and then squared. And of course, before you have to do anything you have to calculate the mean. And you take the square. And then you sum them all up. Then you take the average, essentially, when you sum and divided by n. We've simplified it just using a little bit of algebra to this formula. We're getting to something called the raw score method. And what we want to do is write this right here just in terms of xi's. And then we really are what you call the raw score method, which is oftentimes a faster way of calculating the variance. So let's see what is mu equal to? What is the mean? The mean is just equal to the sum from i is equal to 1 to n of each of the terms-- you just take the sum of each of the terms-- and you divide by the number of terms there are. So if we look at this thing, this thing can be written as-- let me draw a line here. This thing can be written as the sum from i is equal to 1 to n of x sub 1 squared all of that over n minus mu squared. Well, mu is this. So this thing squared is what? This is x sub i take the sum up to n. i is equal to 1. You're going to square this thing. And then you're going to divide it by-- we squared, right? You divide it by n squared. And this might seem like a more-- out of all of them, this actually seems like the simplest formula for me. Where you essentially just take-- if you know the mean of your population-- you just say, OK, my mean is whatever and I can just square that. And just put that aside for a second. But first, I can just take each of the numbers, square them, and then sum them up, and divide by the number of numbers I have. I don't know if I wrote-- no, I've erased the last set of numbers. But we could show you that you'll get to the same variance. So to me, this is almost the simplest formula. But this one's even faster in a lot of ways because you don't really have to even calculate the mean ahead of time. You can just say, OK, for each xi I just perform this operation. And then I divide by n squared or n accordingly. And I'll also get to the variance. So you don't have to do this calculation before you figure out the whole variance. But anyway, I thought it would be instructive and hopefully give you a little bit more intuition behind the algebra dealing with sigma if we worked out these other ways to write variances. And frankly, some books will just say, oh yeah, you know what? The variance could be written like this. We're talking about the variance of a population. Or it could be written like this, or maybe they'll even write it like this. And it's good to know that you can just do a little simple algebraic manipulation and get from one to the other. Anyway, I've run out of time. See you in the next video.