Return to marker delay

I'm finding that when you return to marker, sometimes it's relatively instant, but other times the screen goes black and it takes up to 10-20 seconds even if you are close to the marker, I would understand if you're far away from your marker but sometimes I could be only a few pushes away and it still takes ages to return. I'm playing on ps4 so whether that has any bearing on it in not sure.