Sticky gameplay and controller issues

Could anybody PLEASE help me with this issue, or clarify if this is something that can't be solved at least.

I have been Elite division player in 21, 22, 23 and 24 and skipped 25. I know I have the skills to play the game, this is not a skill issue - at least not a 100% skill issue (I know there's a bigger gap this year though). 

I play on PC. The game just feels like there's at least a 0.3 second delay in everything I do at all times. At kick offs, corner kicks, free kicks, penalties etc. The game is completely unplayable for the first 3-5 seconds as the FPS drops close to 5. When it's my kick off, I can wait for a moment so the FPS gets back together but other instances even waiting won't help as the lag starts as soon as the ball is played.

'Sometimes the lag gets even more remarkable randomly causing a solid 2+ second  delay in every input I make, this lasts usually around 10-15 seconds and then vanishes back to the "usual" 0.3 second input lag. 

I have went through every single option there is for display settings, currently using Full Screen - 60Hz - 60 FPS - VSync ON. Any other settings will cause more lag and makes the controller completely unresponsive randomly, usually in the later minutes in game the lag gets more unbearable.

I have also tried uninstalling the game, setting up Nvidia App optimizations (and removing them - now I can't even modify the game anymore from there lol), Steam controller input settings and every single thing that can be found in YouTube/Reddit tutorials on how to make things by. 

Also I want to mention that my PC is very high end (RTX 5080, 64Gb RAM, Ryzen 7 9800X3D so I refuse to believe this can be an issue here. I have not tried the game on PS5 but I've heard that these issues I'm experiencing sound very strange to them and the game feels super smooth on console.