Can't find Royal Advisor in O Fortuna Quest

So, I'm doing the O Fortuna Quest. Going pretty well so far. Only thing is, I just got the goal to ask about Privileges. I know I'm supposed to ask the Royal Advisor, but he's not in the castle, and f...