EA FC 24 freezing/speed up lag ingame

Hi, I have EA FC 24 on PC, got ultimate edition so I've played it for a week now, and at first, I had stuttering, lag and speed up lag, but I changed some settings and other things and that got fixed for a couple of days. I am not lagging or stuttering now (for the most part) but I still get speed up lag (my game freezing ingame for like a whole IRL minute) like every other game I play. I got a new router a couple days before the launch, and even got an upgrade to 300 download, 300 upload on the router. I use ethernet cable straight to my PC, and on tests I get like 295/295, so my internet connection shouldn't be a problem. My PC should definitely be able to run this game, dont know much about computers but I have:

RTX 3060 12GB

Ryzen 5 3600 3,6 GHz 35MB

16 GB RAM

which should be way over the minimum requirements.

Usually happens towards the later part of the game, after 60 minutes. I even get the popup that comes up after you have been inactive for a while, and when I press anything on the controller, it goes away, so it really doesn't feel like it's my connection to the game.

Does anyone know what to do? any helps is appreciated