Do you build the exterior or interior first?

Usually exterior first, so I can see where doors and windows and stairs need to go before I start adding to the interior. But sometimes if I have a specific idea, I might build the kitchen or living room first then design the rest of the house around them.