Picking up the Ladder on certain objects sends the player on the ladder flying

Basically on some small to medium sized objects, if you place the ladder down, someone gets on it, you pick it up at just the right time, and the player will go flying in a random direction. You can also launch yourself if you hold the ladder pick up button and get on the ladder.

Here's a video and I can consistently reproduce the issue. https://www.youtube.com/watch?v=uN8cn9uwI8U

Made me laugh really hard when it happened.