Slowdown/rollback issues caused by time nudge (TN)

In conquest 64, specially in more chokepoint focused maps, TN increases to 300-700ms causing severe slowdown and teleporting players in the game. It happens more occasionally when in combat (a lot on close-quarters).
In the screenshots below (attachments in HD), you can see in the upper corner as the TN (Time Nudge) indicator increases at a very high value when in intense combat.

My PC specs:
Ryzen 5   4500
RX 6600
16GB RAM 3200Mhz