Unable to front/backflip from extreme heights while grabbing

As the title states, when attempting to do flips from the M-Corp tower as an example, I'm unable to initiate a front/backflip until i'm about 3/4 of the way down before I can flip at all let alone the normal rate lower to the ground.

I thought I was doing them incorrectly but doing  the exact same controller inputs from a small ledge works instantly but not when going from tri-towers, m-corp tower etc.