PC Horrid random controller input lag/disconnect

For some reason I have this extremely weird lag that randomly hits the controller. I'll be driving then suddenly can't turn, or I'm turning and locked into a turn. I can't pause the game when this happens or anything I have to wait for the lag to stop and suffer the consequences in a game that has limited retries. I'm as much gambling with the controller as my own skill. 

I do not have this problem in Heat which I was playing just before playing this. I've never had this problem in any other game. 

There are not latency issues detectable in any other program nor with steam input.

If not for the fact the random lag only occurs every maybe couple minutes the game would be absolutely unplayable. The problem even shows in the menus, where suddenly i might get stuck scrolling a menu.

I've tried wired and wireless using the xbox wireless controller adapter. I've tried different USB ports, i've tried connecting other devices. 

This is the game, it is not my PC by any measure.