Menu low fps

After the latest patch (Patch 3) while out exploring im regularly at 120 fps in most places in the world but whenever I go into menus my fps drops substantially to like 20-30 fps and its quite jarring. Im not sure what can cause this. I have noticed this tends to happen mostly whenever you make some kind of change be it party members or even just switching the appearance of things in the menu via the appearance on/off toggles. My best guess is this happens because of some kind of delayed asset loading thing cause if you switch it in the menu and you back out it shows up as you having an invisible weapon for example if you changed appearance of the weapon. then when you sheath weapons and wait for a few seconds after your new weapon appears then after another 30 seconds or so you go back into the menu frames go back up to where they should. That is just one instance that I noticed this happening in. Usually the main one that I can remember.