Removed Scare Seeker lot challenge, Sims get Never Scared bored moodlet still

I have this too. My sim is currently on vacation in Granite Falls and is still frequently getting the "Never Scared" moodlet. One of the times it was after someone tried to scare him as a prank, which was unusual. I think I did turn off the lot challenge from his house, but he's not in his house.

I do have mods installed, but the problem persists without mods.