You need to pick your destinations carefully. First you need to remember there are some places a women never goes. Don't go there. There are other places women go to, but never alone. Don't go there alone. Bring friends.
Maybe there shouldn't be places where a woman can't be safe, especially while wearing something that attracts attention. But our society is just not there yet, and maybe won't be for a long time yet. So be prepared to take precautions.
