Wildcard Games Freeze While Playing

At least 50% of the time, my match freezes while playing Wildcard games. Doesn't happen in other modes. I turned off cross play, still happens.  It happens in both online and offline games. The freeze is so bad I can't get back to the Xbox home screen and have to physically unplug the machine to force a restart. Anyone else have this?