I can't join my friends lobby

So I'm on PC and my friend is on PS5, I've enabled cross-play and so has my friend but I cannot join his lobbies or he cannot join mine. Whenever I try to join his lobbies is states that "The Lobby i...