Getting kicked out of game during friend visits.

I get this problem with most major events, makes it pretty impractical to visit neighbours. I presume the game is just too demanding for my device... but it only gets worse over time, so I don't really expect a "fix" as such!