Getting disconnected mid game

Hi guys
As the title suggests I keep getting thrown out of my games. This will happen at any given moment or time.
It appears as I lose connection and lag out. Which seems weird to me because usually if I experience lag, I also lag in discord. But this isn’t the case. After lagging out the game wont let me reconnect due to a connection error.
If I want to reconnect I need to quit my game via steam and reboot it. Which obviously is quite annoying. All drivers are up to date & steam files are verified. When I have task manager running nothing shows up as problematic.
Hopefully someone can help! Thanks.
PC SPECS:
AMD ryzen 7 5800x
GPU geforce rtx 4070 RAM
DDR 4 - 3600 32 GB
SSD 1 TB samsung 980 pro