I have no problem with people bugging me about my hair (I have a slightly-below-the-shoulders mane), but that may be due to the fact that I live in the Pacific NW (lots of hippies here) or the fact that I'm 6'4" and built like a linebacker.
As to why I have long hair, well, there was a period where I used to buzz my head (clippers, no guard, but didn't take a razor to it), and I hit two major problems-- one: I would go places (I was living in the South at the time) and people would say "WOW! STONE-COLD STEVE AUSTIN!" and I find it somewhat disturbing to be confused with a pro wrestler, and two: after three years, my wife looked at me and said "I like you better with long hair."
So... yeah. Long hair is going to be here for a while... and everyone says that it 'just looks right' on me. And since I don't have to invest all that much extra care on it (all I do is shampoo and brush every day-- maybe 5 extra minutes over caring for short hair), it's not all that big of a deal.
Thing is: I don't think it's just the hair. I think the problem with people like the Chavs described by the OP is that they are looking for a target that has some sort of distinguishing feature or characteristic that they can use to attempt to belittle the person and make him or her feel like an outcast.
Now you could say to yourself "I'll do what I can to avoid attention from them", but I would say that in the long run it's more important to be who you want to be... even if you have to take some shit for it.