I feel pretty much the same. Certainly, I'd hate to be outted at work, but I'd also feel bad for some lout ridiculing an old person, who was just minding their own business.
It would be appropriate to interject a comment like , "is she a problem for you?" Of course, hindsight is 20:20.