Cows stuck in build/household inventory

I placed the animal shed with a cow in the household inventory when I moved into a different house. I have been unable to get the cows out of my inventory. I click on the animal shed and assign the cow but it never actually leaves the inventory. However, the animal shed says occupied and gets dirty.