I was going to write a whole blog post on this one (I mean a big one, but I've had alcohol, I'm a bit squiffy and I really need to go outside to cool down). I think a hell of a lot of people confuse physical inequality (and by that I mean physical 'differences') for moral inequality. The former does not excuse the latter. We are all human, we are all equal, whatever our differences. And where we aren't we should be doing our damnedest to make sure we are.
Thinking otherwise puts you in unmitigated fuckwit territory.