Offence down don't apply over offence up?

I play Tarkin for some tests and with his low life pool his only advantage are his special and his main attack which deals okay damage. But how frustrating when using a turn to try to apply offence...