Controller issues in match

I have the FC26 on my pc, on steam. The controller seems to not work randomly in some instances. It begins working again if i restart the game. What happens is that i start the game as normal, and the controller works. I can use it to navigate ultimate team and everything. I go and select rivals(ultimate team) and when i join the game, i cannot use the controller, and my player indicator (triangle above player) is not red(as it is usually) but orange. My controller works in the game, but not in the match(rivals or rush). When i press esc on my keyboard to take a timeout, i can use my controller to go to settings or team management or anything else, but once i resume the match, i still cant use it. Even if i restart the controller mid game. So to sum it up, the controller works in game, but not when i start a rivals match or a rush match. And then when i have to leave the rush match(or get kicked), i get a leaver warning.