Your primary care doctor only needs to know if your crossdressing contributes to a medical issue. Same for most health care providers, except for mental health providers. It may be helpful for your therapist to know.
But before you unnecessarily confide in your crossdressing behavior to your eye doctor, surgeon or neurologist, accept the fact that your admission may become part of your medical records.