Can't change lot type of empty, unowned residential rental

So, I built a rental property and after I was done, I uploaded it to the gallery before bulldozing it. I then wanted to build a residential house on the property; however, it is saying your Sim is currently in this unit and the property type cannot be changed. I've tried moving Sims in and then evicting them or having them move out and nothing has fixed it. I've also tried having other Sims buy the property as a retail property but it says property that is owned cannot be purchased. But the property is empty there's nothing there no building, no Sims. I even bulldozed the lot again and the landscape, just in case. But still, nothing has changed. It's essentially just an empty rental lot now. How can I fix this?