Input delay during online matches

I always experience 3-5 seconds of input delay when playing in any online match. This only occurs when cross play is turned on. Please please please fix it or tell me how to fix it. It is incredibly frustrating and for the price point I expected better.