All Inputs Stop Working - PC

I am having this strange issue where I have yet to see anyone else complain about it. I use a Bluetooth Xbox controller, I have issues where all my inputs freeze and I cannot do anything. I will be running in the middle of a game and my player will just keep running, and none of my controller inputs work, and I cannot use any inputs on my keyboard. I have to ALT + Tab or CTRL + ALT + DELETE to get the game to automatically go to the pause menu.

After waiting 2-3 minutes my curser comes back and now my controller and keyboard work again. Game does not freeze I just lose all my inputs randomly for 2-3 minutes. Sometimes restarting my computer will help and I can play with no issues. 90% of the time this constantly happens and I have no clue what is going on. I figure if it was a controller issue, I can quick grab my mouse and use those as my inputs, but for whatever reason my mouse disappears and my controller stops working all together.