So now I have tried playing on Amsterdam Datacenter and the 4th game was a packet loss game again. The Datacenter shows a ping of 23 and 0 packet loss in the menu.
And now that @Amra_gasp is describing his issues in more detail, I realize that I haven't described all the issues that I am facing. When I try to leave such a match or we get killed, I am stuck in "connecting to lobby" as well. Sometimes I reach lobby after maybe 5 minutes or so but mostly I Alt+F4 and get a "Unable to reconnect - reservation timed out" error as well. I confirm it and then I can get back to the lobby. Also the frame by frame feel of the match is identical to what @Amra_gasp described.