"Take control" doesn't work

I got disconnected from a race in two player carreer. After joining back to the session and navigating to "take control" while spectating my own car nothing happens when I press x (on ps). It should give me back the control of my car but nothing happens and after few laps of only being able to spectate the car automatically pits and retires. I have disconnected from a race two times and both times this has happened when I tried to rejoin.