Cant see anybody when I join my friends party.

Whenever I try to join my friend whos on PS5 on my PC, him and everyone else in the lobby disappears. Weirdly enough I can see everyone when I'm spectating in the socials menu, but the moment I close it everyone disappears shortly after.