Wicked Eyes and Wicked Hearts: Find a missing key bug?

I've been long finished with Wicked Eyes and Wicked Hearts quest but the "Find a Missing Key" part of the quest still stays through all of my gameplay.  I tried before going back to saves before I started the entire quest and that did not change it, and there's nothing in my inventory to suggest I still have the item either.  

Is there any way to fix it or is just playing the game through with that quest technically active the only option?