Arena refresh button

Biggest frustration in the game: Arena refresh... Why do you have to click 50x refresh when you want to attack number 15 from position 21 i.e. It's frustrating and makes me want to throw my phone o...