That's not really something to ask in a working environment, even as a joke it seems like borderline harassment. Personally I would have avoided answering the question and moved on to my work.