Controller works but cant use controller

My controller works fine on my xbox series x but when I login sometimes doesn't recognize my controller and when it dies. It doesn't recognize that controller but it works fine on the console. I have Uninstalled, I've cleared cache. It has become to the point where the game is unplayable.