One thing that could make speed mods a little more of a choice and a little harder to achieve would be to change the speed mod set to require 6 (instead of 4). There is already a differentiation of different sets requiring different amounts (2 vs 4) so it wouldn't be an odd change; and considering speed is so overwhelmingly powerful, requiring you to fill all spots for the speed bonus seems fair. So you would basically have to decide to go all in on speed (which most are doing anyways) but it would require you to specifically have speed mods with high speed secondaries versus throwing in other random high speed secondary mods.