Matchmaking Penalty - unable to reconnect

When I load into the plane and right before the match starts, I get disconnected from the server for "inactivity."  When I reboot my app on Xbox Series X, it gives me an option to reconnect. I pre...