Working out is always a great way to get rid of frustration. If I feel like going to a gym when I'm frustrated, then I'll go lift some weights. If I don't have a gym near me or if I don't feel like going to the gym, then I usually mix jogging with calisthenics.
Sometimes, fresh air is all you need to relieve frustration. Go out when it's dark. Cold, windy fresh air is amazing for the head.
For those with a sedentary lifestyle, though, someone mentioned the sauna. Most amazing place ever. You cannot go to a sauna and come out in a bad mood. It just defies the laws of life.