Male or female, people look or glance at one other because it's human nature.
When I first started going out, I used to be concious of people looking at me, but then I realized it's normal. If some is avoiding eye contact on purpose, you can tell and the same thing goes when someone is staring because your mind just knows it.

Women will look at other women because they want to see what they're wearing and so with you they're probably checking out your fashion sense.
Now depending on what you were wearing, if you stood out like sore a thumb, then they would staring with their eyes wide open. If they were glancing, then it's no big deal.