An AK47, M9 Beretta and a crowbar.
The Kalashnikov is easy to maintain, durable, reliable and ammo is easy to come by. Saw off the rear stock (or better yet, get a foldout one) and strap a torch on the front and it can also cover small dark areas should you ever need to go through such a place.
The M9 (or any 9mm pistol really) is also a solid choice due to the fact that it's strong enough to whiz through Uncle Zeddy's head but weak enough to not break my wrists with every shot. Suppressing it would be nice but without sub-sonic rounds it'd still be loud enough to give away your position and I imagine sub-sonic rounds aren't that easy to find.
The crowbar because it can crack open doors, boxes and skulls. What's not to love?
Might be pretty boring but I see to many flaws with most other weapons. .22 pistols aren't strong enough to consistently pierce a skull requiring you to aim for the eyes if your target is thick headed which is something you clearly don't have time for if you have your pistol drawn. Revolvers would be far to awkward to reload in the heat of the moment and make a lot of noise. Shotguns seem like overkill to me. If a 9mm to the head can take him out (and in most zombie scenarios is the only way to put him back in the ground for good) then spraying buckshot all over the place and making a ruckus is unnecessary. Assault rifles are a good bet (even better if you can nab a carbine like the M4A1) and so are a lot of machine pistols and SMGs, my only worry would be grabbing one that's high maintenance, hence the AK47 (so easy to use even kids can use them!). Sniper rifles and marksman rifles could be useful, but they're noisy, a lot of them are pretty high-maintenance and to heavy to be lugging about with food, water, a side arm and some form of automatic weapon. LMGs and Heavy Assault Rifles are to heavy and their strengths (spraying and suppressive fire) are not only useless against zombies but could prove to be dangerous, you're making loads of noise, chewing through ammo and making half of them into crawlers by damaging their legs or spines. The Crossbow sounds nice but you've one shot before a reload and ammo and maintenance weigh it down further. Melee weapons should be last resort and multi purpose. Charging head first towards a creature that with a single bite or drop of blood, bile or spit into an open wound can turn you into another walking bag of infection sounds crazy. What's even crazier is the fact that you intend to start slashing, stabbing or smashing up the bag of infection in what must be one of the messiest ways of getting rid of it.
I'm sure there's some flaws in my own logic (like getting hold of an AK47 in Scotland) but those are just my reasons.