Error unable to join a session. check your network connection & try again

Have had this issue for the past 3 days on both mine and my husbands xbox live accounts.  Weird thing is that it is intermittent - sometimes one of us can get in when the other can't.  Or you can get...