Fireplace being used to exit and enter area

I put a fireplace in my lot at sapphire shores and vendors are using it to enter and leave the area. They're just walking into my house uninvited and vanishing in front of it or appearing inside the ...