Pc Player Gets Kicked From Xbox Party at Start/End of Matches

So I'm in an Xbox party (we have two people on Xbox and one on PC that's using Xbox game bar to be in the Xbox party with us), and every time the match ends, the PC player gets kicked from the Xbox party, sometimes at the start of the match too in the menus while we're waiting for people to join, and also at random points in matches. He confirmed that it's only happening with BF6 and not other games. Also, when he gets kicked, he still visually sees he's in the Xbox party but we know he's not because it says he left and he's not in the party on our end. We are playing Closed Weapon All Out Warfare (we mostly got Conquest), not sure if this is happening with other modes too. I was thinking maybe the game is trying to connect him with the voice chat in game and that's why he's getting kicked? Probably not right but just thinking out loud.

Edit: Now it's happening on other games too just randomly the party will kick him, but it specifically was happening when any of our matches ended in battlefield, and it happened every time, so there has to be some sort of issue between Xbox game bar and battlefield.