Random SWTOR Performance Issues - FPS drops from avg 150 to 30

I run SWTOR on Ultra and when loading into the game I typically get between 130 and 200 FPS depending on the amount of things on screen. When running around Makeb I'll sometimes drop to 100 or so when draw distance shoots out, but it quickly hops back up to a 150 average. 

Then my fps will drop into the 20-50 range seemingly out of nowhere. I'll be outside, in an instance, out of combat, in heavy/flashy combat - anything. The FPS drops and does not recover until I restarting my PC. I've tried changing from Fullscreen (Windowed) to other options. I've tried quitting and rebooting the game. I've even set graphics to Very Low only to find I cant even climb above 60 FPS. I've checked the CPU and RAM load to find them perfectly fine. 

The game is running worse on this computer even at lowest settings than it did on my 2011 rig. I'm at a loss as to what could be causing this and how to fix it. I was fearing something was going wrong with my PC, but this is the only game that has this issue. Since encountering the problem I've ran Outer Worlds, Sea of Thieves, No Man's Sky, Classic WoW, and several other games at max settings with absolutely no problems keeping FPS above 60. I hope someone here can help me out as I was very excited to give this another go.