Controller stops responding mid game on FC26-PC

I have the issue that my controller stops responding mid online games on FC26 on PC. Anyone knows how to fix this issue? I have tried two controllers, wired and wireless. Same issue every time I play the game. The controller stops working for at leas 5-10 seconds 2-5 times on each online game on ultimate team, kick offs or any mode. It is getting way too annoying