I have my sims house fenced with secure gating.
And everyday hear continual protesting and see the mail lady stamping her feet with the pool blocked thought bubble.
The paparazzi do the same thing, I often have them and some passing sim out the front stamping their feet until a mod resets them for being a so called unroutable sim.
Sims will always flock to whatever they think is fun, they don't seem to understand it's a private residence, no such thing seems to exist for them.
If you hate sims treating your house like their playground all you can do is securely fence your property to keep tresspassers out.
