Totally agree with you.
Although there is a bit of a difference eg you have always been black and you can't be black in the closet, it's not something you could keep secret! Also your family won't turn against you because they share your experience. There are pros and cons that differ from the pros and cons of being trans.
Unlike you the average white CD has little experience with being marginalised or extreme prejudice, some will be blissfully unaware just how much privilege they take for granted and losing it, especially if they have really benefited could really break them.
Trying to relate your example as best I can to this forum:
Imagine someone becoming black midway through life after enjoying the privilege of being white, would you tell them it's all going to be rosey or would you want to prepare them for the harsh reality in the hope they can appreciate the benefits rather than dwell on the negatives?
What if then some white guy has the cheek to tell you what it's like being an ethnic minority?
I will never get involved in a discussion of living as an ethnic minority because I simply have so limited experience, I could liken it to how I'm treated in some parts of Europe just because I'm English but as you know that's just not even close to comparable.
We can sympathise but unless you live it day in day out and there is no escape, how can you truly get it?
Despite my struggles my transition has been pretty easy that's because I'm fortunate to live where I live, I'm pretty privileged and I also have passing privilege I'm well aware of that. But it would be wrong of me to pretend that's the norm because some other poor sod might go through hell.
When I say struggles the majority has been internal rather than external, you can never be 100% sure you made the right decision until you live it, I now know it was right but there was always doubt.