Games keeps switching to mouse and keyboard

I'm playing with a controller, and the game keeps switching to keyboard and mouse controls, making me unable to perform actions on my controller that require two buttons at the same time.

I always have to use shift+tab to go into the steam overlay, leave it, and then it switches to controller again on my next controller input. It's really REALLY annoying.