We all start somewhere. The first tentative steps are usually the most nerve racking.
To make life easier, have you considered getting lower heels? Something less noticeable and more comfortable and build up once your experience and confidence has increased. There's no rule that says you must go from zero to hero in one big mighty bound. Making yourself less noticeable will help in growing your ability to be out when others are about.
Baby steps.