No players in the game

The map loads and there's just the three of us running about without any opponents, teammates of flags.  When I play a game by myself I don't have this problem, I'm also in a game full of players.

We resort to Server Browser but then we end up in games where you have to score 2000 points - this takes an age and is dull as ditch-water when you're winning 1000-500 or so.  My latency is also about 300 in these games whereas it's 15-20 when we play without having to use the Server Browser.  This makes the games a bit * as what I see isn't what's happening, you have to shoot in front of where people are running so bullets will hit.