@imparatorsto
There are only two ways to remove it. The first is going to swtor.com, click Login and then enter your Display Name, Password but leave Security Key blank. Then click Login and on the next screen when it asks for your security key, click "Forgot your Security Key?" to then receive an email to remove it. See this article here for screen shots.
If your not able to manually remove it the yes you would need to call Customer Service to have them manually remove it. Their contact info and hours of operation are here. If you have Skype, WhatsApp or another VoIP program, you can call for free or at a discounted rate if needed.