I can't stop my spellcaster using broom?

I am playing a rotation of 2 spellcasters. When I left one to go to the other then back again, they had got themselves a broom, problem is I can't now STOP him using the broom. He ddidn't have one in ...