Can’t join game when invited to play by friend on Xbox One S

Keep getting the message saying to wait a full minute and try again.  Error code is (0x80040900)?

I can’t figure out what is going on.  I bought my son his own version of the game so we can play different modes besides arcade together and if we can’t, this was pretty much a pointless purchase