Cannot quit challenges

Some challenges don’t allow you to quit after pressing the start button (Xbox One S).  The challenge continues but sometimes the challenge list disappears but the trick guide is still there.  Had to reboot the game numerous times.  Known challenges were the XGames dumpster challenge and the OTS in Hedgemont by the small wavy sculpture.  You are sometimes able to just shut it down to get out of it and sometimes not.