Disconnected due to inactivity (XBox Series X).

I continuously get disconnected due to inactivity when I'm actually playing. 9/10 games get disconnected. How do I fix this? Battlefield 6 (for me) is totally unplayable at this point. I have attached a video of what it looks like when I'm about to be kicked.