Controller aim snap

I have a bug where at random the aim snaps a few degrees upwards. Usually by the dimension of a player size at around 50 meters. It occurs randomly when the right stick is used to aim. Sometimes it happens several times in a row, completely throwing the aim off. It happens from one frame to the next and is like the aim suddenly porting a few inches upwards. The "snapping" setting that let's you quickly flick 180 degrees is disabled. The bug still happens when aim assist is turned off and seems to be unaffected by any settings regarding dead zones, aim curves or other metrics. Movement also doesn't appear to play a role. I feel like it happens more frequently with some optics/sights compared to others, I am not entirely sure tho. It is incredibly annoying because of its unpredictability and there seemingly being no fix I could find. When it happens around 3-5 times in a matter of seconds it is absolutely game breaking as it doesn't allow you to properly fight back.