Unable to Send/join invites

My friend & I trying to get into a game together. We can both send invites but there is nowhere to be able to actually accept the invite?

Nothing in notifications, can't hold down the Xbox button when on screen as it'll turn Xbox off. No options on menu to send outside of the game/direct via Xbox menu.

Playing (or rather trying to) on Xbox one.