If a character doesn't have debuffs, why would you care what their potency is?
Some characters need to crit more than they need damage (Resistance under Jedi Rey who don't expose normally, Snowtrooper, Lando, Jawa Scavenger under Cody lead for HAAT, etc) so you want that extra 12%.
Lots of tanks don't need speed. Assist-based teams (Echo, BB-8 and R2 with Jedi Rey) will also get more punch with Offense arrows than speed since their TM is going to fill rapidly through abilities and other effects.
In most cases, sure, speed arrow, crit damage triangle, potency cross. But don't be so dogmatic or else you're going to be a baddie.