Ideally I'd quite like an L85A2 because that's the gun the military use over here, meaning that ammo and spare magazines would be everywhere in a zombie appocalypse. I like to think I have the self control to stay on single-fire mode and avoid switching to rock-'n'-roll when things get heavy.
Unfortunatly, by the nessecity of the military using it, it's also a military grade assault rifle and the chances of me owning one over here in Britain are slim-to-illegal. So restricing myself to relativly low power firearms, I'd go for a nice .22 rifle, preferably bolt action with an external magazine because they're a little more reliable and very easy to unblock if the rifle does jam, as well as being easy to reload (though they do carry the slight risk of a round going off prematurely as you slide the bolt home, thus shattering all the bones in your hand. Fun!).
Since .22 rifles do tend to use .22 ammunition, I can use the same ammo in a .22 pistol as well for close quarters such as clearing out a building for the night.
Right, rifle on my back and a pistol on one hip, that leaves my other hip free for a melee weapon. A machete would be useful for cutting up wood for a fire, but to be honest a pocket knife with a saw would do the job, and I live in the city so I won't be hacking through undergrowth anytime soon... in which case I choose the crowbar! A little on the heavy side but it does have decent range, it's solid iron, has a big sharp point on the end AND can actuallly be used as, you know, a crowbar when I need to force my way into a building.
(Why yes, I have put a lot of thought into this. I'll see you on the other side of the apocalypse, when the rest of the human race has died due to their lack of forsight!)