Decreasing Stars

My star/point keeps decreasing in division rivals, and my question is why? Everything is fine theres no problem with my gameplay, but when I win, it's 27 stars, when I check 20 minutes after, it's 26.