Husband never comes home

I've been trying to complete the quest for the royal heir. I married the Royal Advisor thinking he'd stick close by.

Nope!

He's at the docks. At the market. Flitting off to the forest. You'd think he needs to sleep!

Nope. It's been about 4 in game days and that's all he does. If I try to invite him to the throne room, he says he's busy and to try again later. If I go to him, "there are no beds nearby to woo hoo" so I can't complete the quest at all.