Controller works in menus but not on track

I'm playing F1 25 on PC-Steam, sometimes I have this issue where my Microsoft Xbox 360 wired controller works fine on the menus but when I go on track some buttons don't work, I can't shift gears or drive the car properly. I've never had this issue with any other game.

I go back to the main menu, check my settings, all buttons work fine when I test them in the settings screen, restarted the game, unplugged the controller and plugged back on, tried different USB ports, but still have the same issue. I played the game a few hours ago and everything worked fine but now the controller doesn't work properly when on track and I can't drive the car.

Anyone had this issue? Any idea on how to fix it?

BTW I really wish CM included the option from the older games to completely disable all the built-in controller filters/dampers that can't be turned of and cause input lag. Those filters/dampers make the controls less responsive.