Anyone else having issues with Sims not wearing the clothes you assign in CAS?

No issue in the households I am playing except when there is a festival downtown and sometimes my Sims from my other households show up and change on their own to something different than what I left them in last time I played their houses - also depending on the festival too. Generally as far as i can see though they pick from the outfits I have assigned to them and not something freaky.

I play a vanilla game - no CC and no mods - if that matters.