Enemy Slave 1 always goes before mine?

This is really frustrating but I swear I've noticed this happens 90% of the time, no exaggeration. Every time I face an enemy slave 1 in ships they always seem to build up their special, their one wit...