FC24 controller unresponsive on rivals XBOX

Hello

This issue is happening on Xbox Series X

Been having this problem on and off for a while now, I’ll be on ultimate team and go into a rivals/champions game (also happens in seasons) and get to the kit selection screen and my controller just doesn’t work, can’t select a kit, can’t ready up or even quit the lobby have to wait to time out or until other person leaves. I can then go on squad battles (offline mode) and controller works fine. 

any ideas how to fix this??