NHL Online Team Play Xbox One

Hey, I've been having problems with joining OTP games ever since I got the game a couple months ago, I can always get into the position screen, choose my position, change teams if I'm captain and all the jazz, but once both teams "ready up", one of two things happens 90% of the time.

1)The game (as it looks on my screen) kicks a bunch of people, the gameplay loads, it does the intro and everything. Right before opening puckdrop I notice I'm the only player in the game, and I get "disconnected from opponents".

2) Right when both captains ready up, NHL 15 closes the game and I get kicked to the Xbox One dashboard

I tweeted Ea sports and they said something about adjusting firewall on my connectio, and then doing a cold restart, neither of those worked. Any ideas? I have a refurbished Xbox One if that explains anything, although when I join OTP games with my friends, it happens to them aswell, but when they play without me it works fine, so maybe my connection just ruins the lobby? lol 

Help me out if you can!