Is there a way to delete the objects around Deadgrass Isle?

Unless there's a mod to configure public neighborhood areas that I don't know about, unfortunately, no. You can't do anything with those things. The reason you're seeing so many ghost pets is because there is a Pet Cemetery on the Island. You'll hear an eerie howl from the ghost dogs at night too.