All game modes locked when in a party (ps5)

When in a party with my friends all the game modes are locked and we cant play together. All of us have cross play off! So frustrating, none of us are playing because we don't enjoy playing alone.

Anyone else having this issue?