Performance issue on PC after 2-3 matches

Hello, I noticed that after playing 2-3 matches and waiting for the next map, when I enter the respective match, the performance drops significantly from 130-140 fps average depending on the map I'm playing, to almost 70-80 fps, if I restart the game the problem disappears, has anyone encountered this problem?

I'm playing on high preset with DLSS on quality 

PC Specs:

RTX 5060 8GB, Ryzen 5 7600 , 32 GB RAM at 5200 MHz