Xbox 360 controller keeps losing connection while playing

Everytime I press shoot (RT) my joystick disconnects from the console (Xbox 360). I have to wait a few seconds for it to reconnect (while I'm being beaten up), but as soon as I shoot again, it loses connection one more time. It's annoying and I can barely play PvZ Garden Warfare!!

The controller battery's fine and the problem doesn't happen with any other games. Please help me!