As someone else above mentioned, not changing settings or alt tabbing seems to delay the fps drop issue for me also.
Running my extra monitor disconnected seems to delay the fps drop also(not really tested this enough to say its placebo or not).
I seemed to get stable fps for a while today with one screen, but if i accidently hit alt tab it messes the game up and and my fps take a hit and also the frame time latency doubles from 6-10ms to 20 - 30ms.
Apart from that it seemed a lot better and i had quite a few games without the worst drops(outside of situations with the worst clutter driving down frames as one might expect).
It did seem to drop once at the end of my last game ( without alt tabbing or changing game settings) and i ended a round on the main menu character with 50 - 60 fps when it usually sits around 115 fps.
Ive checked my temps and they seem to be in reasonable state(cpu 70-85c under game load, gpu about 75c).
amd 5900x, 32 gb o6 3200 dual rank ram, 1tb nvme drive for game and os, 3070ti(516.79 drivers), win11(latest updates),
All setting utlra apart from ssao set to hbao full, nvidia gsync on, vsync on, reflex on full