I would like to comment that GG's typically dress for the "venue". They do not typically consider a grocery store, movies, or a mall, a dressy venue. That is why I do like to attend concerts, plays, clubs, and dances where I get a chance to wear cute dresses and heels. (I do work at a concert venue and the GG's are dressed beautifully!)
As to passing, wear what you like. However, remember, if you aren't dressing for the venue that typically warrants GG's to wear the type of clothes that some CDers are attracted to, you may stand out and be scrutinized more closely. If you truly "care if you pass", keep in mind the "place" that you are trying to pass. The idea of "blending" in with the crowd usually helps people who "care" about "passing".
Wear what you like, it's all ok. Just remember that GG's will probably be dressed more casually when they are doing a casual activity. Don't get the impression at the mall that GG's don't want to dress like what a CDer would consider feminine, because we don't usually care what anyone else thinks while shopping. Feminine is a state of mind no matter what the clothes are.