Removing Roof Walls

Hey there guys I'm just curious on how to remove/delete the slanted walls the roofs make when I place them? I tried the sledgehammer and manually deleting by Ctrl+ mouse drag, but all I get is a small...