For me it's definitely Social. I want my sims to focus on their skills, careers and aspirations, and that one always gets in the way. I never play with outgoing sims for this reason.
Unless you are using a computer or watching tv... or woohoo...fun just takes a long time to refill and sometimes it feels like it is decaying so fast, like when my sims are at work or at school.