Are you sure you get branded as a "hipster"? To my awareness, hipsters just wear old-fashion clothing (Or, as I describe it, "Something you find in your mom's closet that even she hasn't worn for 30 years"), but maybe there is more to it than that?
Sure, you can still be called a "Nerd", but the "Nerd"-term has somehow lost its meaning. Before, it meant social outcast (more or less), now it is just "Something that social outcasts used to like, but now has become cult and is thus socially acceptable".
I don't know the literal, dictionary translation, but I think it says something about "overly interested in certain things", like "Computer-nerd" or "Gaming-nerd". But if such is the case, then there would be fotball-nerds or wrestling-nerds.
It just bugs me out a bit that people now, when it is socially acceptable, seem to almost jump on the wagon and proudly say "Hey, I'm a Nerd, I play video-games and have gaming-references on my clothing".
Once again, not aimed at you per se, just a general observation.