Lag switching?

Has anyone else experienced issues with unstable connections? I play on a good connection averaging 9 ping for 99% of my games and all of sudden my ping is 100-120 against someone on xbox (I play PS).  I don't want to accuse anyone but it seems suspicious. He was also not that good of a player (Div 1) and had ibarbo, which adds to the suspicions. Idk if I'm going crazy or just being salty.