PC - Input Lag on controller

I noticed that no matter the graphic settings, there is this input lag while using a controller that affects the overall experience. VSync off and no frame gen or smooth motion/upscaling technique, and it still feels really bad. Is this something everyone is experiencing and they need to patch it, or is there anything you would recommend setting up as far as graphics or nvda control panel settings?