always lose to people who have lower score than me in manager mode

try changing from attack to control or change to something specific like a custom before starting a match 

remember to change from control to counter and attack again if necessary