Bug: Specialization trainer plot triggers don't disappear

So I went into the mage specialization class knowing that I wanted the Knight Enchanter. Talked to the right elf, got it, and everything went smoothly and I have my  specialization. Except the map is still trying to tell me to talk to the two other trainers even though they no longer show up in the courtyard. Two exclamation marks are on the map for the places the other trainers used to be. Seems that the game wanted me to talk to all of them before deciding, but I didn't since I knew right away what I wanted.

Version: Xbox One