You're both correct. The challenge scoreboard is funky/temperamental, but the SA end scoreboard does not align with the personal score page either. Usually, the version on the overall scoreboard (where you see everyone's elimination count, not just your own) seems heavily inflated.
