Matchmaking breaks every other match when on same network

I am having consistant issues with loading into matches with my party. For some reason when I start run the client and join a party, our first match goes off without a hitch. Everytime we go to start the next match, my party goes into the game and I'm stuck in the loading screen. I can still hear them, but I don't load into the game. I literally have to close out and requeue. Need assist in figuring out if this is a me thing or a known issue.