Builders, help! Can't seem to delete exterior trim

I think faffing around with the mouse works - ie the trim does not always highlight based on where you want to place the mouse in 3D space. I seem to remember having to move the mouse pointer around to get a connection. I seem to remember looking more down from above and moving the mouse into a position, rather than from a side-on view.