Is it possible to have only toddlers in your household?

Yes, they will be taken because they cannot stay in the house alone. Afterwards, you'll get a popup asking if you want to exit to the menu without saving. Something like that.

I don't know if it's possible to change the outcome once the last adult has already died, so give it a try and see what happens.