Server ping/latency displays in white occasionally

Not everyone will find this annoying, but within my peripheral version I will occasionally see numbers in white around 20 to 30 pop up - I can only assume these numbers are of the ping to the server or latency, and only started seeing them maybe around season 3 or 4. While informative - I do not need to see these numbers if my ping isn't an issue (it distracts me from the game), does anyone else get this and is there a way to either remove it or get the devs to do something about this?