I hold my own opinion of myself higher than anyone else's. That's not ego; that's individuality.
Sometimes that can be selfishness. There are times we need to think of others before ourselves.