Restart impacts frame rate

I play in VR, managed after infinite tweaking to run smoothly. However if I restart a race, the smoothness disappears. Instead, I have to quit and reload the stage, so it runs smooth again.