Wall sizes on exisiting structures changing when building

When building a new structure on my existing lot, I cannot change the wall size from "Tall" to "Short" without all walls being affected. I was building a greenhouse and went to change the wall height, and in turn, it also changed the wall height of my house. Help! I can't seem to get around this, even after exiting and restarting the game.