Should the challenge timers be removed?

Having to wait 10 minutes between challenges seems absolutely pointless and means you spend about an hour grinding each challenge. I understand time limits on arena battles but challenges are illo...