I think the best thing to do is to be the change you wish to see in the world. You'll have to deal with the accompanying adversity, but you can't expect anything to change unless you are willing to live it yourself. Plus, no matter what anybody does or says against you, you will always have an unmatched dignity that nobody can touch, and you just might influence and inspire souls along the way, whether your impact is minimal or monumental. If you submit to a lesser way of being then you will end up no better than the people you are criticizing. Don't end up with regret, stand tall and do what you know is right. Don't worry about tripping over some speed-bumps, it'll happen, that's life.
