weird imitation "infection" glitch

I'm not sure if this is in any other gamemode, but whenever I play survival endless, leave and come back, a bunch of random plant that weren't imitated before are? keep in mind I always use imitation sunflower to start and also imitation pumpkin for the whole run and never imitate anything else. I'm sure other people have probably talked about this on here but please fix this, thank you.