Would you tell Sharon Stone or Tina Turner or Cher they aren't dressing "age appropriately?" No? Well if you look as good as they do at their age, you can wear that short skirt.
For the rest of us, wear what looks good on you, not what you think will. Wear what's appropriate for the occasion. And if you are going to dress out there, don't complain if people don't react well...