@overly defensive bystanders:
You're making things worse by objecting to references to a particular demographic. Especially so since you're not part of it yourself, because you're deciding for other people wether they feel offended.
The rule of thumb is, make it funny. When it's not funny, it comes off as hostile.
This guy was just bsing and it seemed amusing to me.