Game Freezes after controller disconnect - Xbox Series X

Everytime the controller disconnects, for example if the controller dies mid game, the menus disappear, leaving the player stuck unable to control the game, and thus having to restart the game.