Husband never comes home

I've been trying to complete the quest for the royal heir. I married the Royal Advisor thinking he'd stick close by. Nope! He's at the docks. At the market. Flitting off to the forest. You'd think ...