I'm from Australia too friend. I really have never had this problem - except after midnight and with Garden Ops. Haven't tried some of the game modes though, and I primarily play Turf Takedown and Garden ops. Sure Garden ops (at times) can be a bit sparse - which I must say I am surprised about because it a great game mode. That used to happen to me all the time though recently in GW 1. I haven't tried any other servers. I think there are enough people playing to popular the servers (like Australia), there will certainly be more when the game price drops a bit.
The other problem though just might be if you have any restrictions on your internet connectivity or if your on - your xbox connection setting (like open Nat). This was generally a problem though on 360 I havent really heard it being a problem on xbone.
