You can bulldoze and rebuild as many special buildings as you like but remember that some have a build path.
For example you can't build the waterpark without the carousel so if i build both then the carousel i have one building that i can't build again without the other.
You don't get anything back from bulldozing these buildings so the only time I've found it necessary is when you are doing an epic project and you have a lot of buildings giving you 1 point, i would delete them to build more 3 point buildings.
