I would recommend a FN Browning High Power in 9mm. Standard issue in most Commonwealth nations since the end of WW2, an excellent firearm. A Russian TT-33 (7.62x25 Tokarev) is also a good choice as it is cheap, historical and there is quite a bit of cheap surplus ammunition available (here in Canada there is quite a bit anyways).
For rifles that might be particularily interesting to an Australian, I'd go for a Lithgow made Lee-Enfield No.1 Mk.3 (.303 British). The ANZACs used this rifle throughout WW1, WW2, Korea and into Vietnam, they are of top quality. A company called Australian International Arms also makes a modernized Lee Enfield chambered in 7.62x51 or 7.62x39. Never handled one but they are popular here in Canada.
I own a Longbranch Lee-Enfield No.4 Mk.1, a Russian SVT-40 w/ reproduction sniper scope, a Mosin Nagant M44 Carbine and a Belgian FN-49. All are WW2 dated except the FN. I take them to the range a bit, but I hope to keep them in great condition and eventually pass them on to a future generation (hopefully not to be tossed into a smelter...).
OT:
Speaking as an ardent socialist, I am so tired of liberals, left-wingers and pacifists spouting off such misinformed, prejudiced nonsense against firearms. Please actually look into the realities of the shooting sports as well as legal firearm ownership in general before condemning an entire way of life found in many communities. These remarks by George Orwell capture my position on firearms ownership:
?That rifle on the wall of the labourer's cottage or working class flat is the symbol of democracy. It is our job to see that it stays there.?
"Thus, for example, tanks, battleships and bombing planes are inherently tyrannical weapons, while rifles, muskets, long-bows, and hand-grenades are inherently democratic weapons. A complex weapon makes the strong stronger, while a simple weapon ? so long as there is no answer to it ? gives claws to the weak."