It's not "gay" in that you don't need to be gay to do it (I know lots of straight guys who are fond of hugs, whether with males or females), but if some people are uncomfortable with it then don't hug them.
There is a similar thing here in France about kissing. Females greet each other by kissing, same thing when it's a male and a female. But when it's two males they shake hands. Except in some contexts.
For instance a pub I used to go to. There everyone kissed, male or female, and pretty much none of them were gay. Some companies also kiss rather than shake hands. In the end it's more of a "tradition" for them so people do it, but in other contexts if a guy held his hand and you (another guy) kissed him instead people would find it weird.
Similarly some people think that outside of family and childhood friends hugging is weird. Well just keep that in mind and don't hug them, I guess. But don't let them make you ashamed of the fact you like hugging, though.