Fishing issue

I have an issue fishing in the desert. My lure won't move at all when I prompt it with the right control stick. It just stays in place, preventing from fishing any essences in the desert.