Farm Merge Valley - Badge Progress Screen

This happened to me again tonight, as I was moving a cow into a blank spot next to the other 3 had (going for a match of 5), the screen changed to the badge progress screen, and it dropped the cow onto the ones had making a match 4.  I would like it where does not change at all or change after a change in the current challenge which for me is Harvest 150 cows.   This is not the first time where things get dropped where not wanted and won't be the last.