What version XBOX are you playing on?
Did you confirm/reset your controller settings in game?
I am on PC
You mention XBOX Game Pass and a controller. You're launching via Steam on PC, then? If so, play with either keyboard/mouse or controller, not both.
If that doesn't resolve it, attach a DXDIAG report, as someone may spot something causing your issue.
Does the EA App allow you to use an Xbox controller on PC?
EA app is just a game launcher. It's whether a particular game allows a controller and Jedi Survivor definitely does. However, I've noticed that some games don't work well on PC if you have a controller plugged in while keyboard/mouse are plugged in.
