Friends points

Hey all, Can someone tell me why if I have lots of friends and I visit their towns, it shows up there diary action 3 and when I’m visiting I cannot pick up any points .. from most of them Did any...