Sims 4 Library Loading

Everytime I go into my library on the game, it has to load every sim I’ve added to the library. This is something new for me as it started after the        lovestruck patch. I’ve found a partial fix for this by letting all the sims load and then leaving the local cache file in the game and when I load it a second time, everything is loaded like it used to. But when I do this, the game lags very badly and the cache file goes up to 50,000. I also reset my internet connection and still had this issue. Is this something normal or just me? My library is a huge part of my playstyle and I desperately want it fixed 😭.