Game closes when playing with console friends.

I can play perfectly fine solo or even with fellow pc players in a party, but when i go to load into a game with my mate how plays on xbox it closes itself no error message or anything it just shuts the game down as if i exited it. Has anyone else experienced this or found a fix, this is really frustrating.