Frame Drops on Xbox Series X

Whenever I get shot in a normal br game my fps will drop from 60 to 20-30, which mostly leads to me dying, making the game barely playable.

I don’t think it happens on smaller maps and my game runs fine when I’m not being shot.

Is there any way to fix this problem? I don’t get how the XBSX should be able to run 120fps but can’t handle me being shot.

There are no issues with my connection.