Personally, I love a man with a good ponytail.
What it really comes down to is most people can look fine with long hair, if it's kept well. However, women are taught that they must take care of their hair because they are expected to have long hair, while many men never learn this lesson. The result? Most women look great with long hair and most men look horrible with it.
Take care of your hair and it'll probably look at least fine. Depending on your hair, face, and body, you might even look awesome.
(Oh, and keep in mind that if you are more comfortable, confident, and satisfied with your appearance with long hair, you will look better overall. People who have long hair out of laziness and/or as a curtain to hide behind will always look pretty terrible.)