[PC] "Unable to join session" error when joining friend's match or accepting friend's invite

I have no problems joining random Garden Op games via custom search or creating a match myself. I do not have problems with multiplayer mode either. However, if I try to invite my friend to my mat...