Uh...does upgrading my ships affect my immediate ship arena team?

Because I'd hate to think when I upgrade four ships in my arena team it instantly replaces them with four of my weakest 2* ones. Do I have to instantly start a battle and confirm my old lineup again?