EA SPORT FC 26 Xbox controller disconnects

On several occasions my controller disconnects and regard of it being plugged in or not it will not work. This only happens on ea sport. Nothing fixes it not even unplugging the cable or taking out the battery it's like the game complete unpairs the controller.