Is there a drawback to switching active households frequently?

I just clean things out of the inventories as I prepare to switch active families with the items getting moved into fridges,bookcases or storage boxes from ATS3.I always clean things out like that at the end of sessions though I forgot to a few times in the past.