Secondary Keybind to Open Map will not also Close Map

I set my side mouse button (Mouse3) to open the map. This works fine. 

However pressing it agan to close the map doesnt work. 

Forcing me to either press M or ESC To close. 

ESC closes the map but then opens the pause menu which is even more annoying. 

I like having map on M3 so i can quickly open/close for situational awareness however I cant have it as this as I still have to press M or ESC to close it.