As much as I hate EA.. I'd say that this is on you mate, I play using Starlink (constant 60-70ms to the servers), the latency icon rarely appears for me and I don't have such issues.
You might want to make a "MTR" test, what is happening is most likely something "in between" the connection from your home up to their servers as "the internet" is not a straight point from you to the datacenter, but your traffic goes through several other internet providers until it reaches it's destination.
https://winmtr.net/ That's the program you can download and for the test, you can find the IP when you enter a game by checking the "Resource Monitor" from Windows, e.g: https://prnt.sc/R0lKsCnQm5dA
