Nothing you can do about it really. Sometimes it is to your benefit to defeat the troublesome player's fleet/squad and then spend the crystals to immediately refresh your wait timer and jump into battle again to try to put some distance between the two of you. Otherwise you spend all your battles just trading places back-and-forth and nobody gets anywhere. You could also try attacking somebody else instead as a peace offering, but that doesn't sound like an option for you.