It depends upon the amount of effort you are willing to devote to minimizing risk. The more contingency planning you do beforehand, the more you reduce the risk factor in the actual event.

You could go to a location far from your regular routine.
You could enter and exit your home at night.
You could have a change of clothes in back seat for emergency changing.
Etc. Etc.

You will never find a scenario that guarantees nothing negative will happen, because nobody can see into the future. Except for Bernie Maddox...oh yeah...scratch that comment...:D

"There are many ways of going forward, but there is only one way of standing still."
--some famous person I can't remember...