Matchmaking breaks every other match when on same network

Same issue, both on PC through steam. It doesnt matter if it is just us in a lobby or with more people it still will have one of us not join the game. We already had static IPs and even tried using different wifi networks.