Good point!
Using one form of bigotry to defend another form of bigotry is probably not a good idea. And, if women don't like men saying stuff like that to them, they probably shouldn't say such things to men. Men have feelings about being single too!