It doesn't happen when I move things around. I tested that. It just happens when I use the inventory. And I haven't tried buying or selling anything yet so I'll test that next.
The moment you buy, sell, move things, or use the inventory he stops his task, hence it's not fixed.
It looks like you're new here. If you want to get involved, click one of these buttons!