Problems with lag variance

I am hard wired directly to my router/ modem on a fiber network yet my game constantly has issues with latency variance and I am frequently getting the error sign in the top left. PLEASE either fix this issue or allow your players to have this icon removed. It is completely ruining my experience on what is other a great game as it constantly goes in and out while playing and I have no clue how to fix it as I have 500 mbps and 20 ping consistently