Party Challenges

I have been experiencing issues when playing in a party where I will go to start a challenge and after the countdown ends the challenge will not start and my player will be stuck in limbo. I can still skate around and the HUD is visible but the pause menu is unavailable, trick scores are non existent, trying to spawn an item just brings out your phone and nothing happens ETC... The only resolution I have found for this is to restart the game and hope that I don't get stuck in a loading screen. Its really frustrating when you're the party leader and all your friends are waiting for you to start the challenge and you have to tell them to wait a minute so you can load back up. Someone please chime in. I need answers.