Bad 1% Fps

The game runs not very smooth. i get clean 200fps but my 1%low fps are low and stuttery.
The most i got was 120 1% but its always dropping and not consistent. Sometimes it drops down to 30 what causes bad stutters and its just not smooth. especialy when there are some people in the same area. 

Ive tried alot of fixes already like playing with RAM settings
Reinstalling GPU drivers with DDU
Playing around with different settings in Nvidia Control panel and BIOS, but nothing helped

Specs:

GPU Nvidia 5080
CPU Ryzen 7 7800X3D
CL30 6000Mhz DRAM
Win 11 Home Edition

I hope someone can help, or this gets fixed in the future.