Sims 4 crashing while in build mode (Xbox One)

When building in build mode the game stops working. The game will not let me place anything down while building. No notice or any type of errors letting me know why I cannot place anything down. This has happened twice and each time that I tried to save my game it would take forever to load, leading to me having to quit the game completely and reload everything all over again.