Refund Points Not Working

I don't think my points refund is working. I was using the Reaper Specialization on Warrior but decided to go into Champion instead. When I did so, I'm able to use all my new abilities but the passive traits like the one to make all my area abilities deal fire damage don't seem to trigger. Moreover, I am able to still charge my shield throw to the second level even though I no longer possess that skill. Not sure if i'm missing something but I'm unsure how to fix this issue. I've tried refunding my points again as well as taking all my equipment off and back on.