Waiting for Players...

So, I keep getting frozen on challenge starts, me and my friend, and it needs to be addressed, immediately. I understand it's early access, but the frequency of this happening is stupid.