Seeing as how all my avatars on this very site have been of adorable anime women--more specifically, their heads and faces (aside from my current one, I suppose)--it would be hypocritical of me to say anything besides: No. It doesn't make you a pervert.
Though I do agree with the first reply in that your answer to their simple message was a bit harsh. I personally would've waited for a reply. If they don't reply, they're just childish assholes and deserve no further attention. If they just ragged on you, then I'd block them, and report them.
Anyway, back to the topic at hand:
I don't see any problems with playing a female avatar in any game, particularly action games (and then preferably ones where they aren't super-sexed-up), since I think the action genre is just a bit too much of a sausage fest, if you catch my meaning. I'm one of the 20% of gamers that almost always plays a female Shepard (mostly for the relaxing tones of Jennifer Hale, but I digress). The person that single-worded you (if this IS actually the complaint) seems to have a personal problem with this, and if THIS is what upset them, they shouldn't be playing online games.
It also works from a gameplay standpoint, like a previous poster said. Female avatars in games (for example, Zoey and Rochelle from either L4D game) are a bit shorter and make somewhat smaller targets, so they don't have to aim downward as much. And if it was an FPS game, there really isn't anything you can stare at besides her barely-visible hands. Even if it was TPS, you're usually just a bit more focused on the things shooting at you to stare at her.
Besides, games are an escapist medium. We shouldn't have to be limited to playing a single gender just because that's what we are in real life. Games were designed to be played several times, anyway. Why can't we do it with a different voice actor every once in a while?