Getting kick before game starts

I am trying to play with my friends, we join a lobby but as soon as we find a match they load in I get booted out to the lobby screen, this has been happening for over a month now, tried to restart my game, hard reset console, uninstall and reinstall. Nothing keeps happening. We have an open nat type (all of us). This might just make me stop playing.