How long do you wait before you unfriend someone?

Depends on where you are in the game and how much you depend on your friends to help you along. I think two weeks is reasonable. I keep some people who haven't played in years because of sentimental reasons. They were once someone I interacted with a lot or I like their town. Some of these people have event returned to the game and started interacting again.