Game performance loss after few games

Hi, I am running a latest gen computer with RTX570ti and having a strange issue. The game runs normal and after few games it drops performance about 20-40%. This is immediatly fixed by restarting the...