Sims 4: Contols won't work

Product: The Sims 4
Platform:Xbox Series S
Which language are you playing the game in? English
How often does the bug occur? Often (50% - 99%)
What is your current game version number? 2.4.3.2300
What expansions, game packs, and stuff packs do you have installed? Cats and dogs, city living, Discover University, Eco Lifestyle, For rent, Get famous, Get to work, Get together, Growing together, High school years, Home chef hustle, laudry day, lovestruck, luxury party stuff, Moschino stuff, movie hangout, my first pet, parenthood, seasons, snowy escape, spa day, toddler stuff, and some kits.
Steps: How can we find the bug ourselves? Just playing the game, it randomly occurs
What happens when the bug occurs? I play using my xbox controller, and randomly the controls within the game will stop working and you will only see a green cursor circle hovering over an icon. And this only happens within the game. I can press the xbox icon on my controller to exit the game and the controller works just fine. Occasionally, I will disconnect and reconnect my controller and the game will reset its controls and it will work for one second then go back to not working. I doubt it is a pack problem because I've played this game for a while, back when I had no packs, and it would still happen. It would just correct itself after a few seconds. Now, I often have to close the game and reload it entirely but the bug still happens even after that.
What do you expect to see? I expect for the controls to run seamlessly within the game and not lag or "disconnect"
Have you installed any customization with the game, e.g. Custom Content or Mods? On console - never used.
Did this issue appear after a specific patch or change you made to your system? No

‌