If it's just a joke for humours sake, go for it. I might not like it, I might choose to stop watching, but more importantly I'd like humour to be free to break any limits.
As for my own taste, it depends on the purpose of the humour. I'm very likely to let jokes of poor taste fly if they are...