Actually...strange as it sounds, I know for a fact I would be. There was an incident a couple of weeks ago where a mod's joke was misinterpreted and some people on the usergroups I frequent started to panic. Caught me by surprise when I woke up and noticed the 21 messages in my inbox, including a "hey, in case you get banned, we can hang out here" link.
I'm still not sure what to think of all that.
Of course, this assumes I was permabanned out of nowhere. More likely case would be me turning everyone against me and being banned for asshattery. Not going to happen any time soon, but still.