Latency issue in game but resolves when I pause/die

Having a constant yellow/red latency symbol come up on screen when in game on PC. This latency affects game sound and party sound when I’m using Xbox. 
as soon as I pause the game or die, the latency rectifies. Any ideas?