Waiting is a good thing IMO, but you have to be sure to keep yourself flexible. Alot of folks take their year off, buy a car, move out, rack up 10k in credit card debt, then go knock up their high school sweetheart. From there its basically game over dude, you're spending the next 10 years working menial jobs just to make due. Then once you finally get your hands on all those other responsibilities, you'll just feel too old. This happens alot.
If you're really gonna take time off set yourself a time to go back. Say two years and you're enrolling. Break up with any girl that gets in the way, don't hold any debt, don't do anything that jeopardizes your ability to go later. Understand the difference between a job and a career. Alot of friends I knew got jobs working construction, pays well here. Making 25 an hour is nice when your young but the work is very hard and there is about zero upward mobility.
College isn't the only choice too, there's nothing wrong with just learning a trade. The demand for mechanics is never gonna go away, nor for plumbers or electricians. The point is to learn something.
And all that crap about being miserable because you picked the wrong degree is crap honestly. You have a decent idea of things your good at and things you hate. A job is a job. It's not your entire being. Pick a degree that has a decent career outlook so you have a bit of choice in employer. Being able to work for a good company will make much more of a difference in how happy you are at work than the actual work itself. One of the best part time jobs I had growing up was working at a landfill. It was nasty as hell, but my coworkers and bosses were terrific. The right group mentality makes all the difference.
If you feel like you've got the discipline to go out and take your year off and stick to your plan and go back, do it. But be honest with yourself. If you're weak willed, do yourself a favor and quit bein a ***** and just go get it overwith =p. The people pushing you to just go are probably doing it because they made choices they regret. If they scoff at the idea of taking a year off, its probably because they know you won't be able to go back. Sometimes its just better to listen and trust so you can avoid making mistakes you can't ever fix, and very often the people close to us have a better idea of what we're really like than we do.