Keep losing connection to opponents in Hut Champs games

Generally happens within the first 3 minutes and I get an L. 

Isp says no issues.  No other games/devices do this.

Infuriating